This video instruction describes how to properly insert and remove the battery.
Do not remove the battery while in use. Make sure to turn off the headlamp via the on/off switch on back before removing the battery.