It could be explained by my long vision not being as good as I think it is. Could this apply to you as well, Toestrap?
In any case, I think you should try a diopter adjustment if your viewfinder doesn't look pin sharp. Being able to use it without glasses doesn't mean it's as sharp for you as it could be. I can't use my camera eyepiece (on any setting) with my glasses anyway.
Any lines or marks on the focusing screen should be used as the guide, with the lens defocused.