Definitely do check in the kittens, and get them used to human hands, gentle attention for now, but as long as momma is feeding them, and cleaning them, all should be fine. She will be the one to teach them about the litterbox, and it varies anywhere from 4-6 weeks they will start weaning themselves and be ready for kitten food.
Bookmarks