Late to the thread, but FWIW I packed at Loudeac on the way out, then toured back doing 900km. Wore my jersey on the Eurostar back, but did feel a bit guilty about it. When I told my story one audaxer said "Then take that shirt off!", but I'm fairly sure he was joking.
I still wear it as: 1) It's a nice comfortable jersey. 2) I paid for the event and paraphernalia. 3) I qualified for it and had a serious go. 4) I'll be telling the honest story to anyone who asks.
I wouldn't criticise anyone who does number 4.
Sometimes my wife uses my carradice bag which has AAASR and RRTY badges on it, but I don't think she'll be misleading anyone.