I would be more worried about it affecting the power amp than the keyboards. There must be some glitch in your hookup where one side of one keyboard is running through the other. Just guessing.
It would be easy to get a little line-level mixer from somewhere like Radio Shack. Quite inexpensive.
DonM