I think in our society there are many women now that have no desire to have children (the smart ones anyway ) anyhow I think it balances out the families that are large.
Most people rarely seem to have more then two children anyways, and those two will fill your, and your partners place in the population when you die.