I've been watching all day and they are completely gone. We will wait until dark to make sure and if so then we are going to seal the entry way which is a gap between the door frame and the siding.

I checked the link on the carpenter bees and that is not the same thing but that is what my dad has boring holes in his wooden windows. Good to know what they are, thanks.

What we had were most definitely honey bees. I feel so much better knowing they are gone. I called the county extention agent this morning and he agreed that they probably moved out from all our spraying last night. He did give me the name and number of a beekeeper who will remove them if we need it. Turns out none of the pest control companies around here will touch this kind of job, too dangerous.

Thanks for all your help everyone.