Why is my caps lock bugging?

I have using a wired keyboard and recently and randomly turns on caps locks without me doing anything. I have unplugged then keyboard and plugged it into different ports and have switched to another wired keyboard however that did not work. I have now used an apple magic keyboard which has got this working but I would prefer to use my wired keyboard. Does anyone know why this is happening. I would really appreciate it if someone could help me out.

Thanks,

Taza.