I'm not sure if Buffs count as scarves, but I often wear a Buff and have, on more than one occasion, been accused of being a cycling pirate.
Wool scarves are nice and warm in winter; should you find yourself walking about town in suit and raincoat, on an inclement evening. On these occasions, not once did I see a reflection of myself in a window and think "Holy fuck - what are you wearing, Chris? Have you FAILED AS A MAN?"
I understand if you don't like scarves. That's fair enough - I'm not a fan of high heels. So what? Is it really worth a whole thread?