Personally, I think there's quite a bit wrong with treating it like a race, racing is inherently dangerous and I don't want to be sharing the roads with folk who are faux racing. If you want to race, get a licence and go race with other folk who are accepting those risks and where the mitigations are in place.
Nobody wants to race. The quote you quoted was a fiction.
I know that...but ..hypothethically....
IF they are racing,
I agree that's a big if since I don't think it's actually much of an issue on the roads full stop, let alone in the niche world of audax. Things that aren't racing:
A couple of riders pushing each other for fun
A group of riders sharing the work to make decent progress
Sprinting for signs (ok, maybe this is, but it's not an audax thing and I don't think it counts)
chances are you won't be sharing the road with them anyway.
You're probably right, I know a couple of guys who race who would see 100km in 3 hours as a quickish social pace, when they really turn it on it's all I can do just to sit in their wheels, however that misses the point, someone is sharing the road with anyone who is racing. I don't care if you're on two, three, four wheels or even a bag of neuroses with hooves, the public highways and by-ways are not the place for racing without appropriate controls (and not the sort that stamp cards and serve cake).
IME the vast majority of those that do want to race, go and race, because they know there's something different about pinning a number on.
I think I'll leave it there.