If it were me, and I do rescue with cats, if they mistreat or neglect one cat and they've adopted a pair from us, we take the both back. There would be no way I would leave the other pup with that guy. None.

I'd also put him on a DNA (Do Not Adopt) list and make sure other rescues in your surrounding areas got his info (name, address, phone etc...) as well.