The sad thing is that Cats are creatures of habit and if they have been treated badly as Kittens they tend to react to all humans as being potential abusers.
I have had some experience with Porch Cats and I have found that letting them come to you is the best way to build friendships.