Since he keeps "misplacing" his collar I would strongly recommend getting him micro-chipped. Your local vet or SPCA will do this. That way if he is caught then he can b scanned and returned to you.

It definitely sounds like he has found someone who is feeding him. But is there anyway you can keep him inside?