Maybe there's something wrong medically and should have him checked by a vet? If he's in some kind of pain this may have him frightened? Once you get the clean bill of health, then I would be watching to see if he is being bullied by one of the others. Has he ever had problems with UTI's?