The lore bits you find tell you that people used to live in Valheim until they rebelled against the gods and were destroyed for their trouble.