I get panic attacks thinking about my cats roaming around the outside world!!! I absolutely agree with your reasoning. An alternative I've heard of is putting the cat on a harness with a leash so he/she can wander the yard but not get loose and possibly hurt. Sounds kinda funny but maybe it could be a compromise?