Yep, that sound comes from the external power adaptor. Mine disappears about 8 seconds after unplugging.

Unfortunately, when I switch my PSR on, yes the power adaptor stops whining, but the sound must get transferred to the mic input instead (heard nicely when the noise gate is switched off).

Cheers,
Rich