I would say for as much problems that have come by in the last few months, maybe it's time to stop the fostering. Direct your attentions to other areas of the rescue where you could help the organization but not have animals in the house as fosters. Pouncer's well being is more important in my opinion if having fosters in the house now is stressing him out to much, I would stop.
Just my 2 cents.