In really would not worry about the minimal extra leverage from raising handlebars, how heavy are you, what is your riding style?
Answer (light, and light)
These are the most significant sources of stress - so Dolan err on worst case caution, Just out of interest is the steering tube steel or ally
If steel even less reason to worry.