It sounds like devs From Star Citizen have joined the dev team of Valheim. My guess is that this is intended game play. For the love of dog, do not use the elevators they will implement next patch for Valheim.
That ♥♥♥♥ will one hit you every time.