you can build and dig underwater as much as you want if you add roof panes to keep you near the ground, take a look at this for how it works : https://www.reddit.com/r/valheim/comments/mcdrey/building_underwater/