Layered sounds, two hands and frequent use of the sustain pedal can eat up 128 voices in no time. Some handle dropouts better than others, but if you're playing 2 handed piano with sustain, I'd suggest as much polyphony as possible.
I don't think it happens so quickly. I used to accompany a classical soloist with a MoX, which only has 64 voices. The only time I had dropouts was when I used three multi-element parts at a time: piano + large strings + woodwinds.
Consider the Yamaha NP 31 (only a keyboard in "piano style, I know) has a polyphony of 32(!) voices. I would be totally unplayable if 128 voices were still scarce.