He may have a condition called Cerebral Hypoplasia which - from what I understand - kittens can get when their mother has distemper.

Do a search on the internet for it. I believe there is a Yahoo group out there just for people with cats with this condition.

I know Maya & Inka's Mommy, Queenscoopalot and Laura's Babies all have kitties with this condition.

But of course, my very first suggestion is to get the kitty to a vet ASAP if you haven't done so already.