That is a tough one.... but in the end... he is a stranger. What if he tried to climb the fence, one of your dogs bit him, and he sued?

Too many variables.....

Although if you see him again, I'd stick with the original plan of offering to take him to a shelter, or washing his blanket.

I agree with Soledad... don't dwell on it.