Calculator not working properly

I have casio fx99ies plus calculator. 3 days earlier i was using it when it turned off then i replaced its lithium battery but it won't start then i noticed that when i press the battery hardly it starts but when i release it, it stops . Kindly tell a solution to this problem