When I lived in the country I had mice in my cabinets - I found droppings and chewed paper. I had noticed my 4 cats (including Sammy - the cat who came with the house, and was an awesome hunter) staring at the cabinets.

The problem was, the cats couldn't get inside the cabinets without a little help from me. I left all the doors open one night, and was rewarded with a dead mouse the next morning. Gross, yes, but no grosser than mice in the cabinets! Eventually they got them all, and we found where the mice were coming in - we had one of those in-counter Jenn-Air stoves, and the mice were coming in through the stove venting.