Benedryl gel caps are usually good if you see the allergy coming on, and then early in the process.

Fish oil or specifically the Omega-3 fatty acids have some anti-inflammatory properties. Also Vitamin-E (dry form) seems to help the skin in healing.