Cats are survivors..as long as it has access to food/water/and shelter it should survive! Make sure the kitten is able to eat the food your neighbors are feeding...in other words...kitten food so it's not too large for it to chew etc.

I can understand your fear. This happened to us on a trapping at the park, we got all but one kitten. We stayed there for hours until we finally caught it.