The bare numbers for 2020:
For LBL Women, 56 riders finished, and 82 withdrew.
For LBL men, 125 finished, 50 withdrew.
Maybe there are different incentives at play, and finishing is more important for the men. Maybe I missed a significant crash. Maybe the weather was significantly harder on the Saturday than the Sunday. Maybe there's some other effect at play here that I'm not aware of. The last rider on the mens side was 13 minutes down on the winner, the last rider on the womans side was 11 minutes down, so there's not a significant time limit effect.
I like watching womens racing, and I'd rather watch the Giro Rosa than the Tour because much more happens every day. In part, I think that's because the peleton (and individual teams within it) are not as strong, so attacks are much more likely to be successful. I'm definitely not trying to be critical of the riders/teams here. The mens side of the sport has been developed in a way that the womens hasn't (and for that I am critical of the UCI), meaning there are so many more professional teams and riders in the mens peleton than in the womens peleton. Hence size/depth of fields.