If it works for you and the cats then I say go for it! It's not like you are throwing them out to live outdoors forever because you "can't handle them".
There are several kitties here on PT that have outside time. Since it seems to be bringing a little peace to the house then that's a great thing.