Thanks for all the nice responces everyone!

Have you been giving him treats every time he goes potty outside?
I will admit that I sometimes forget to bring out his treats with me, but I always make sure to praise him and get all excited and tell him what a good boy he is. But thankfully he seems to respond to that much better than treats.