I'd keep it off. In this heat, it should thaw relatively quick. The room should stay comfortable for a while so long as you don't open the other windows.

dumb me, is the filter on the outside of the room or on the inside?