First, WA HOO!!! A new kitty, that it so cool, CATgratulations.

I am sure that he will be fine and you have the experience to help him. It sounds lke the shelter is good and let that previous lady know what the situation was, like they did with you. She just didn't know how to deal with a special kitty. I am sure it will be fine.
Originally posted by rg_girlca
Just sit in the room, on the floor, humming quietly while reading a book and you'll be surprised of the outcome. I had to do this with a very scared stray, many years ago, and he gradually came around on the 4th day of doing this. Each day after that he became more and more secure in me and his surroundings.
That is what we did with Joey. we would sit in her room for hours and just hang out. I would read, take naps, talk quietly, anything that did not threaten her.

Also, I believe that your chances are improved because it sounds like he did not start out a feral. Don't get me wrong it still won't be easy, but you knwo that he had been a good kitty before.

Good luck, and when he is ok with the camera we need more pictures.