Gargling with salt water will take the sting out. I also just got a recipe for an herbal tea you can make yourself - the recipe sounds gross at first, but when it's all combined it tastes pretty darned good.

Steep 2 tsps. Sage leaves in hot boiling water for 10 minutes (I use a tea ball). Then add juice from one lemon, a pinch of cayenne pepper and a tablespoon of honey.

It's really helped my sore throat feel better.