The heck with drummers... what you really want is a percussionist. With arrangers or SMF's providing the basic beats it's relatively easy to hire someone to add some tasty congo or other Latin percussion flavors... as long as they are professional and know how to blend in.

I had a gig once that required a four-piece band even though at the time I was doing all the music/backing on my keys and had two vocalists. The client was firm about having four people, so I hired a percussionist to play a set of MIDI drum pads plugged into my arranger for congo drums and other minor percussion instruments. This worked great since I could control the volume of the added parts.