I used to switch off the noise generator on the Leaf because I found the whining noise immensely irritating. There was also that time a dog tried to attack it.
I would always drive on the assumption that pedestrians wouldn't hear me coming at low speed. Just like I do when I'm cycling.
I've never had a specific problem with EV drivers on the road (hybrid taxis are another matter) . If anything, EV drivers tend to be more patient, though I think that's an early-adopter effect and is wearing off as EVs become more mainstream. I find that the switching noise of an electric drivetrain stands out in traffic noise and makes me think "ooh, that's an electric car behind", though it's not a sound that plays well with high-frequency hearing loss, so I expect I'll lose that ability as I age (probably around the point that every other vehicle is electric).
I vaguely recall that one of the manufacturers is installing an Ogmios-style gentle beep, for alerting cyclists and pedestrians to your approach without a full blast of horn. Sounds reasonable.