I imagine that those sorts of people who make comments such as that to an owner that they, deep down, know is a perfectly humane one, would be the first ones complaining to you every day about how much noise your dog makes when you're away if they happened to be your neighbours.
Silly people have no choice but to make silly comments, only the sensible ones can choose what they say. ;)