I prefer 165s on fixed, but I still have toe overlap, and it's fine - you get used to knowing where your feet are in relation to your wheel, and it becomes second nature to adjust your speed/crank position/wheel angle to compensate.
Dunno whether ground clearance will be an issue, but 2.5 mm isn't a lot, really. Don't fret it.