I am afraid that, if you leave because of the yahoos, they win (it's their strategery ). Better to show them up for the bigots they are. The light of exposure is the one thing they try to avoid...

There may not be anywhere NEAR the support for their views as you fear, simply other people doing exactly what you are... ignoring it, or going away out of distaste.

Surely decades of experience has taught you that bigotry doesn't stop if you leave the room? Only if you squarely face the bigot and show him for the fool he is...