Is it safe to use adhesive remover on swollen battery?

The adhesive remover its self is not the risk! The poking and physical pulling on the battery is the risk of it rupturing!

So basically take the system outside away from anything flammable. Use care as you remove the battery don't over due the remover and take your time.

I do strongly recommend you wear some gloves with a long sleeved shirt, face mask and eye protection so if you rupture the battery you don't get the material on you. This is more of a worry when the battery is at the point of rupture.