I wouldn't worry too much about what he thinks. My guess is that he's jealous that you have something in your life that is special and makes you feel special.

Your baby is beautiful! How could someone resist such a sweet face and kind eyes!