Or use an lithium ion battery instead? Would give about 3.7V to 4.2V fully charged, if your LED driver can cope with that.
An 18650 battery would be slightly longer than a D cell, could squeeze that in.
Or a 14500 lithium ion battery is the same size as AA. So you could use it in a regular AA to D converter.