If you use iTunes, you can quickly go to 'Recently added' playlist, and whatever you just added will be there to quickly remove...

I must confess, I and a LOT of Mac users use Toast, but that's because it does so many different things well...

If you learn the workarounds, iTunes will do this for you, though.