Is he in some sort of safe, fenced area in your backyard? If not, I'd start planning where I wanted to build a secure corral for him. It's one of the many responsibilities of owning a goat.