Sounds like a MIDI loop.
Try disconnecting the MIDI in of the keyboard, so that only the MIDI out goes to the interface.
If that seems to work, find out if your keyboard has a local off control, this will hopefully break the MIDI loop.