My own personal view - for most people, the risk of losing access to your own files by losing keys is greater than the risk coming from other people accessing the data.
With the minor exception of data which gives access to all your financial stuff. Even then I'm not sure if the risk coming from encryption is warranted.
I don't disagree, but I'll add the other exceptions of offsite backups (where you can't control the physical/network security of whatever's storing them) and copies of data that goes wandering on a portable computing or storage device that might get stolen, left on a train, etc. If you lose the keys to those you've still got your unencrypted copy at home.
(Unless of course you discover that you've lost the keys when trying to restore your offsite backup, but really that just means securing the keys becomes an important part of your backup strategy.)