Just remember you pass these kind of people all the time and don't know it, one should always be aware and careful. It is creepy living next to him but hopefully he wouldn't want to risk his parole.

Tell him you have a boyfriend if it comes up and he lives there but he works odd hours or something, then he won't know when he is there.