I think that Cat would be far better off in your home as obviously he is not going to get any Vet Care if he goes with this person.
I would simply say no, and stand your ground.