YOU just remember- none of this is YOUR fault. He is making the decissions he is, and it only proves more so illegal actions. Telling your boss of this- remember - there is such a thing a martial stalking.
As far as a pass card- unless he works there- the company has every right to ban him from the building. ie- stop him from entering even the parking lot. I am not sure where you work, so I am assuming its not a store.
If you need to talk- I have been there- and more than willing to help.. But I will say this- GET A DIVORCE LAWYER... !