I have the whole of the UK in Andy's OSM maps, Garmin Topo, Metroguide and the SMC contour maps as a single image file to avoid card-juggling. It's less than 1.4gig, which leaves more than enough room for weeks of point-per-second tracklogs on a 2gig card.
I've had a 4gig card work without issues. My understanding is that (with newer firmware at least) it isn't fussy about the size of the card. I think there's some sort of file size limit for the maps, though.