I had the same problem with my Rottie when I first got him. We hooked the leash on his collar for him to wear inside to get used to the feel of it. After that we walked him around inside so he could feel me holding the other end and know what it was like. Once I did that he did fine. It was just the leash scaring him. That might be your problem.