Yes, I've slept in one without a sleeping bag, usually with a silk liner and sometimes with a foam pad underneath.
Even on a chilly summer night, I've managed to get 2 hours sleep as they do retain body heat. It helps to get as warm as you can beforehand, eg put on lots of layers and climb a hill briskly before stopping.