Whoever that person was who complained, I hope they get what's coming to them, threefold!
From what I've heard of your kitties and what I've seen, even if I am the newbie here and prolly the most ignored, I can tell that they are spoiled -not rotten- to the point where they are most likely the happiest kitties around.
You should find out about the laws with keeping kitties in your home, though I think that laws like that mainly stick more toward the canine spectrum rather than feline. (here in Corvallis I think you can have an unlimited number of cats indoors and outdoors as long as they're spayed/neutered and taken care of).

When I lived in Independence my neighbors across the street were vets, and took care of roughly thirty strays by feeding them and keeping them healthy and nonproductive, and then another neighbor had another twenty kitties, with I think only fifteen of them spayed/neutered, though they only had one unspayed lady, who lived indoors most of the time.

I say keep your kitties happy and be happy yourself, because no matter what other people say about you, you are always you and your kitties will always be happy there, and I think it's really cool what you do.
Wow I sound really lame, but I think it got my point across.

luffles,
Kari and Clover