Sounds like an itchy rash that she's scratching. Maybe a heat rash? Have you checked for fleas? Could also be an allergic reaction. If it persists, I'd give the vet a call. Hope you feel better soon, Lil Annie!