I've been experiencing this recently, or at least I think I'm experiencing this. Live at the top of a big hill which is an A-road (30mph limit), usually I'll have people trying to squeeze past in a couple of places despite me doing (at least) 30mph. Never seems to happen on the fixed gear.