Over the years I've had two occasions to play arranger with a live drummer. Once was awful for reasons stated above. The other time the drummer was excellent and stayed with my "bass player" perfectly. It was actually a fun night.
The first time was at an animal club in Texas where the manager asked me if I would let one of the members play with me for a while. I said sure if he's at least fairly good. Had to idea he was a drummer until he started dragging in drums. The only way I was able to make it work at all was to use my arranger drums and let him just fill in when he could.
The second time was at Ernest's. At that time I was alternating with another guy who played portable organ, left hand bass and right hand organ sounds, and used a drummer and sometimes a horn player. One night he got sick and couldn't come so they called and asked me to fill in. I didn't know the drummer wanted to play with me until I got there. No problem though, I just muted the drums and it worked great.
It all depends on the ability of the drummer to handle it.