With the ThunderStore mod manager you won't have to do all of this. You can start the game both modded and un-modded from there.

Plus you can search and download hundreds of mods from there, and it will auto-update them for you. This thing is really good and I can heartily recommend it.