I think you need to keep him in "his room" whenever you are out.Similar to "crating him" the room is obviously his "den" and he won't soil it.