Speaker phone doesn't work

When I'm on a phone call and press speaker phone the call keeps going but I can't hear them and they can't hear me, even after I take it off speaker phone, call continues but we can't hear each other and I have to hang up.