If it's a Secula battery then it could be one of the ones with the impossible switches, I resorted to putting a bent pin in to push the switch as the rubber plunger on the outer wasn't working with it.
If it's got the same switch as the IXON IQ-X then it may be the button press has only put it on the low setting, in which case it needed a long press to turn off from high.