I would charge the batteries by removing them and using a charger like this one:
As an alternative, you could also add a charge circuit to the package:
and charge them with a USB charger, but that would make the connection more complex, as you should take cell balance into account.
cheers