Just leave them in there. She'll ignore them and give up, eventually, if they aren't fertile. Only when she does ignore them, take them out. Otherwise, just like you thought, she'll lay more.

Milly has laid 6 this go around. The first two, she ignored, so I got rid of them, and she promptly laid 4 more.