This is the home of a mining bee not a wasp, they are harmless solitary bees. Mining bees often live close to other mining bees. Its not its not uncommon to notice a dozen or more of their holes in close proximity.
Mining bees have a very short life usually a month or so, after emerging in late April to early May, the bees find a mate then lay eggs in the holes which emerge the following spring.
Mining bees are not a pest!!! they are valuable early pollinators and harmless to humans.
Please do not kill these or other solitary bees.
If you still have questions just give me a call :)