I just got myself a new kitty too after two years of not owning a cat so I know it is a great feeling! As the others pointed out, cow's milk does not agree with their little tummies. I think it is probably a good idea to visit your vet or local animal shelter for some advice and to get kitty looked at.

Good luck!