What we did is instead of stacking them right on top of eachother we left spaces small enough so the cats couldn't get through.

One on the bottom, middle and top.

Probably wont work for kittens though.