You are not the only one, Kirsten! Eveytime I leave the house, even for a short errand, I do a head-count!! As long as I haven't found where all 4 are, I will NEVER leave!!
It is not paranoid, it is being a responsible cat-owner