I would wait awhile longer, then do as Karen suggests. They get real sluggish in the cold.

I think they abandon these nests over a winter. We found a similar one in a large bush one year - after the leaves had fallen. It was empty by then.

I found this -
Old wasp nests

Wasp nests found during winter or early spring are old nests from the previous summer. There are no live wasps in the nest; they have already left the nest or died inside it. The nest can be safely removed and disposed of if desired. Old nests are not reused by wasps, so there is no risk if one is left. However scavengers, such as carpet beetles, are attracted to an old nest and may become a nuisance if the nest is in your home.