I think you're experiencing a case of the "New Mommy Worries". Don't worry - I think all new moms have been there to some degree, and it will pass with no lasting side effects.
Relax!!!
Sadly one of my biggest fears is my child developing allergies to dogs, I can't imagine living in a home without dogs in it. (Though I would if it was in the best interest of my daughter)
Bookmarks