yep..keep a close eye on him. You could try some training by using maybe...food or something he really likes but you know he shouldn't take. You can leave the item somewhere really accessable like say, on a coffee table. Make sure you're right at the item so you can correct at your very first oppertunity. Once he takes it, say NO! Then you can keep trying. He should catch on pretty quick..you may want to say "leave it" before you give him the chance to take it so he knows what he can take and what he can't take.
Bookmarks