Mice wean and start eating solids at three weeks. They're capable of breeding at 4-5 weeks.

Good luck and congrats! I adore mice!