The starter is still on after truck is started and running

I replaced the starter of my 94 Ford Ranger 3.0L V6 with a remanufactured from advance and a new starter solenoid. New ignition switch as well. The truck turns over and starts just fine but the starter is still spinning after the engine is running. I have to disconnect the battery to get it to stop. Right now I have 2 wires running from both sides of the positive at the starter to the inside of the truck so I touch them together to start then let them go. If I can't get this problem fixed then I'm going to wire the starter to a push button in the dash.