Sometimes it is based on the way the animal reacts to OTHER things.

For example, if the animal is afraid of loud noises or sudden movements they are often not good around very young children.

If they vehemently chase rabbits or squirrels, they may not be good with cats.

Yes, sometimes it is just a "hunch", but the rescue volunteers usually rely on a vast supply of previous experience.