While they are still coming and going spray the Bee with wasp poison.
Using ear syringe spray Seven dust in the hole. Wait a day or to and then
seal the hole with a dowel or caulk. In a short time from now they will
seal the tunnel and lay an egg that will mature as a larve in late August.
You need to act while they are still active before they seal the tunnel.