sometimes the driver side window will not go down unless i spam the button like crazy but it will go up just fine this only happens with the driver side, any ideas?

 

You need to remove the switch. If you are careful, that can be done without removing the door panel.
Once removed take it apart and clean the contacts, you will see where they are burnt. That should solve your problem.