That's really messed up. For a teacher to make discriminating comments like that just cause it's a "small" town. IMHO, small towns are much better than big ones. I'd definately speak to him, your parents, principal or whoever, because that's just way wrong (especially for a teacher).

Best of luck to you