Don't exclusively use a controller with Valheim because building with a controller is ass. Just use a hybrid system.