What sample rate are you recording at? The sound you describe sounds like aliasing to me, make sure you record at a sample rate of at least 44.1 kHz.

Either that, or feedback... It might help a bit if you could upload an mp3 somewhere demonstrating this and post the link here.

What kind of soundcard? Mic? Remember, garbage input = garbage output.