If it's only the size of an egg, there will be very few active workers yet. Have you any ant powder (pyrethrum)? That will kill the buggers.
The life cycle of a wasp's nest is that only the queen survives the winter, compared to honey bees, whose queen and several thousand workers survive if you're lucky. In the early spring the queen herself starts the nest by chewing wood pulp and lays some eggs in it (she mated last autumn) and tends the young. As they hatch, so the new workers take over the nest expansion and young-tending duties and the queen just lays eggs. In a good year, by autumn the nest can be as big as a football and contain several thousand workers. As the queen goes off lay and there's no brood to tend, so the workers go further afield and make a bloody nuisance of themselves, just as fruit crops begin to ripen.
Having all the beekeeping equipment still in the garage, even though I have no bees any more (varroasis jacobsoni saw to that) I would put the veil on and sort them out by hand. If the nest is accessible, you might like to try giving it a bash with a cricket bat or equivalent and then beating a hasty retreat. Dusk would be a good time to do this.
