Could be mechanical contact noise, especially if the plug going into the PSR is just "hanging around" or an intermittent dodgy wire. The vibration due to playing the keyboard might be enough to highlight the problem.

Use of the harmoniser may highlight the problem as internally I suspect it uses quite a high gain to improve its ability to detect pitch accurately.