Bats don't really make noise, and don't move around much at all in cold weather - I'd guess mice or squirrels. You could Google

animal exclusion (your city)

and see if there's anybody around who'll not only get them out, but figure out how they got in and keep it from happening again.

Good luck!

Love, Columbine