You should be scared of them! They hurt when they bite and then they are really itchy. They usually have really large mounds, so I'd guess that if it's a big mound then you probably have fire ants.