This hasn't happened to me yet, but I can see how frustating it could be. You don't want to be rude, yet you don't want to look like you can't manage a dinner either.

For the kids, I could just say, "nope, not tonight". For your SO...prolly doesn't work.