I think Karen is right. Go and introduce yourself, get to talking and then bring it up and politely ask him to smoke on the other side of the house. Explain to them about your allergies and how the smoke is seeping into your house. I'm SURE they'd understand. It's not like you're asking them to move or anything.