I use only dynamic mic's for vocals and have no noise or feedback problems. I am presuming you are using cartioid for recording ?

I am guessing that you have to turn the gain up too high to get a signal without the boost of phantom power.
Bernie