Y cables might work. They might not. If the levels of the keyboards are widely different then your relative volume management becomes difficult.

The same problem may occur using the XLR and jack inputs of the same input channel.

Get a small mixer. Velcro it to the upper keyboard. Job done.