I dont think your in the wrong by any means, your dogs goes where they want basically! Like coco for example, she hates walking on the sidewalk, it hurts her feet, so she walks on the grass while i walk on the sidewalk! She goes where she wants, there is no yelling at her to stop pee'ing, because then she'll get confused "first i say dont go in the house, then i say dont go outside, well where are they supposed to go" sorta thing! Is there maybe another route you can walk instead of going by crazy people's houses!
Oh and another thing, if this guy has a dog, is this dog allowed to even poop or whats the deal? If it's such a big deal for your dog to poop, is his even allowed too? As long as you clean it up when needed then there is no problem whats so ever and they are just a**holes!