Yes, definetly limit the water and take him out on a schedule. It may take a while, especially if he is a rescue from a bad situation or is from a breeder who raised the pups outside. Nova was raised outside and it took her about 3 months to be potty trained. She is a genius at everything else and this was the only thing that took her a while -- and it was all because she was used to being able to go anywhere!