Diablopaintballa

i have a 91 n/a and here is my problem. Well i just bought a brand new starter and i hooked it up and when i plug up my battery the starter just starts turning on its own without the key even being in the ignition. and to stop it i have to unplug my battery so it will stop..... any ideas on what is making the starter turn?????? help would greatly be appreciated