Have always used a low profile usb stick just like Donny's picture and left it plugged into my PSR3000 and Tyros 3 permanently, Only removed to do backup or load new stuff. No problems at all.

USB drives can fail without warning and for no obvious reason, that's just the way it is.