It almost sounds like your cat is protecting you if he perceives the physical contact between you and your boyfriend as threatening to you. Maybe you can contact a pet communicator and see if you can get some answers. I know that sounds funny but a lot of people have had good results.

http://www.lydiahiby.com/

Good luck. I'm so sorry about this; it sounds heartbreaking.