Your investment in lenses isn't huge, so I wouldn't let that be the deciding factor.
You've spoken about your needs in a fairly self deprecatory manner, which is fine, but doesn't really help the decision making process. If all you really want are "snaps" you're likely better off with a camera from the "travel" category - inbuilt capable wide angle to tele lens, IS, small, economical.
When I faced this question a couple of years ago, I was an Olympus E aficionado, but I decided size was important to me and went for a mirrorless m4/3 (oly as well, but that's coincidence. No point using old glass on new body as it defeats the "small" objective). The Canons and Nikons of this world were alluring, especially with the wealth of lenses both OEM and third party, but really only if you want what they offer.
What does your "wish list" look like?