I've got to agree with Cataholic on this.

I'm not actively looking for another job, but if something came up that paid more and was closer to home AND I liked the people (my job wouldn't have a working interview) I would take it! And I've been at my current job over 9 years. I am appreciated and respected at my job. It would be VERY difficult to leave, but I most certainly would do it!
Honestly, you don't owe that place anything, except a two week notice. Do what is right for YOU, not for them.