If you hear it putting it only half into the jack :

Do you perhaps have a stereo connector on you microphone ? Then you keyboard needs a mono beiing inserted. Or vice versa