Wow, you do have a real dilemma.
Do you put him in a crate when you are not home?

I don't have much advice to give you as I have never had to go through this myself. The only thing I could think off is maybe you could put up a baby gate to keep him in the same room as you so you could keep and eye on him.

I'm truly wishing you the best of luck with your little Sammy and hope someone can give you a good solution to your problem.