He may have cerebellar hypoplasia (CH.) The vet will be able to tell you.
I was thinking of that, too. (Doesn't someone here has a video of a CH kitty posted in the siggy?) But at the age of 3 weeks, it could also be that the muscles of the neck are just not strong enough. I would ask a vet to be on the safe side.

Kirsten