This guide should mention that you should remove your SIM card and SD card from the reader before changing the battery.
Because I was following the instructions exactly I didn’t remove them first, and in removing the SIM/SD card reader I broke the SD card it contained :(. So be sure to remove SIM and SD card before starting this tutorial!