I'm not sure how to get him to trust you more, but probably just keep doing what you are doing and give him a little time. Let him come to you and smell you. Try giving him treats too, maybe that will help. I hate the thought of strays out in the cold too. My neighbor leaves his garage door open a few inches all winter to let strays come in from the cold a little