Just tried with all three ports. It just gives a "Failed to connect" message.

Make sure your TCP port range, UDP port range, and Valheim server app through TCP and UDP are added to your Inbound firewall rules.