I was going to ask about if you knew who owned him or not. If he's unowned, can you trap him and take him to a rescue?

Maybe your kitties can stay inside for a while? Maybe that'll make him not want to come over as often?