I had my share of the same annoying people. As the years went by I matured and learned what they were trying to do. Some just wanted to be important.
Yes, I'm sure we've all had to deal with annoying people, especially those that interrupt you to talk to you while you're playing/singing. As much as I hate it when people do that, I accept that i's going to happen, and I tend to think it just a way that some people actually show their appreciation and acknowledgement of your music.
On another somewhat related point, that's one reason I prefer style play over pre recorded/sequenced tracks when performing live. When someone has the need to speak to you while you are performing, you can at least just kind of vamp and stop singing if necessary.