It's natural for your new doggie to want to "mark" things in a new place. When he realizes he's home, he should stop doing it before long. If you can't watch him constantly, try having him wear a belly band, and don't take it off until you let him outside. He should soon get the idea.

:-D