Leezone,

I don't know why you want to do that, but I can change sounds in my Audya while holding the keys with-out any issues or weird sounds as you say.
Tested the same with a korg PA800. Both keyboards react the same way.
Some times the weird sounds (oh crap, I hit the wrong note, wrong chord) are coming from us and no the keyboards.