I occasionally use a guitar player, a harmonica player and/or a sax player to join me for special things. I've never had a problem with any of them following the arranger. BUT, they are true pros, as good as just about anybody anywhere, and that makes a difference!
If you can't stay with a beat, what would you do in a recording studio? You'd get booted in about two minutes!