Can you set a baby gate near the door? Yes, kitty can get through it, but it would slow down the dash and still allow the dogs to get out.

Maybe enlarge the outdoor pen. Are there shelves or anything to climb on/play with?

And definitely get a better harness!

Good luck.