Don't force it he may fell some thing you don't. I would let the neighbor walk and talk with you as you walk the dog. It may take a long time or maybe never. He may have something simalar to the abuser. I had a St.bernard that hated booze would try knocking them over we just keeped him away from people drinking.
Good luck buy let the dog guide you.