Is there something outside that would scare the little guy? I would suggest some positive reinforcement when he goes potty outside ( like a treat or a hug...etc.) and then when he potties in the house, give him a firm NO NO and take him back outside.

Those are the only thngs I can think of...and I'm NO expert!!

Good luck and keep us posted.