Also, stop obsessing with what YOU nearly hit/didn't hit/etc
On urban streets there is frequently a danger of too much traffic in too little width. The ninja may be on the OTHER side of the road. If you don't notice them because street lighting is faulty etc, you run the very real risk of collision with oncoming traffic or moving them into a very narrow overtake.
And another thing. Eyes do get older. As eyes get older the first thing to go is night vision. Not that it is bad vision in the conventional sense of the word but it is less good, for sure. So, a ninja that you might see in the dark shadows might be invisible to an 80 year old (or even a 60 year old) who would have seen them had they had lights.
And another thing. What you might see in normal conditions, you might not if you had just had your vision impaired by a poorly adjusted oncoming headlight. You should be driving within the capability of your vision, however impaired, but noticing a ninja depends as above, depends on a higher level of awareness.
Ultimately, you pays your money and makes your choice but I reckon lights and hi-viz do make you safer on the road.
The question is, does it make someone else less safe? Is it the classical Prisoner's Dilemma?
Let's look at that for a second. In the dilemma, two criminals in a joint enterprise are interrogated separately. They have the option of staying quiet or implicating their partner. They are told, if one stays silent, and the other rats, the ratter will get off scot free, the ratee serves 10 years. If they both rat, they each serve 5 years, if they both stay silent they both get 1 year. The dilemma is all about social responsibility, as the best result for both is when they stay silent, however personal interest dictates that the prisoner rats, and therefore ends up with 5 times longer sentence than need be.
In our light case, the option is not, is the best option not to have lights/to have dim lights, as you can demonstrate that there is reasonable grounds for ensuring your visibility is higher. The raising of the bar of visibility, if it happens, is a by product. As such, I would suggest that hi viz wars, while regrettable are not anti social.