If you have the storage space (like a locker), and take a week's worth or so in a pannier, that'd be a good idea. Packed together, they keep each other flatter, and you don't end up forgetting.
I use exactly Pancho's method of folding, though, if I'm just taking one, I'll fold it loosely into four and put it at the top of my saddlebag. When I get to work, I open out & refold into three.
Best if you have somewhere to hang them, but, folded carefully like that, they will still be presentable when you come to wear them.