Mine never exactly 'stunk up the house'....I found that their cage needed cleaning about every three days, and you should ideally sprinkle a little bit of the old bedding on top of the new so that the cage still smells like them. Also, half a teaspoon of vanilla extract in the water bottle did wonders for neutralizing the odor of the boys' pee.

They never do stop pooping on you when you hold them, although they do it less if they're comfortable with you.

Mice are fun pets, but they are a lot of work so be prepared!