This is so obvious surely your vet checked it out, but is it possible he has fleas? One way to tell is to wet a white towel or paper towel, comb your cat, then shake the hairs in the comb over the wet towel. If black spots hit the towel and turn red, he has fleas.