Layered sounds, two hands and frequent use of the sustain pedal can eat up 128 voices in no time. Some handle dropouts better than others, but if you're playing 2 handed piano with sustain, I'd suggest as much polyphony as possible.
The Casio Privia I played yesterday had 256 no drop at all layers etc,...nice unit.