There's a Little Shop in West Row that can reasonably be ignored on the basis that it'll be shut or out of stock when you need it. There's the Jude's Ferry pub, which I haven't visited, but looks a bit gastro. Can't remember if there's a chip shop?
Basically, it's a ride into Mildenhall (for which there's a decent cyclepath route) for anything not provided at the rally itself.