Quite. As I've said before, mostly in the context of pushing through injuries, I enjoy riding my bike too much to injure myself by riding my bike.
In the last couple of years, my tolerance for cold has plummeted. It used to be that breathing was the limiting factor, with asthma being increasingly problematic below about 5C. I barely have to worry about that any more, the circulation in my hands and feet has become so rubbish that a couple of hours is my limit, and it gets really sketchy if I have to take the gloves off to deal with a mechanical. I'm also wearing a waterproof jacket up to about 12C, which I never had to before.