I have the same problem, as there are people who dont take care of thier Ctas, and I have set up feeding stations.
I dont know what I would do if the neighbors thought they were my Cats.
Maybe you could expalin why you are feeding those poor Cats, and they would understand.
If the note was friendly, there hope.