Whenever I go to a docs appointment, my hubby keeps asking me: "when will you be back"?? Difficult to answer, right

Years ago, when we were trying to get pregnant, some people said really stupid things, like: Well, when will you finally start having a family", and to my hubby "Do you need me to make a picture"??