Dig a pit and trap them. If you kill a golem they will just respawn over time. You can even harpoon them and drag them into pits. Put a workbench near to it so it won't despawn.

Golems will typically be on mountains with silver. Actually before I get the wishbone I explore mountains looking for golems in order to find silver.

My current playthrough I have leveled up silver armor, Drauger Fang and Frostner but I have not even killed Bonemass yet. The advantage of that is not having to worry about a wolf hunt event while exploring mountains.

edit add - they also kill the occasional drake or wolf while trapped so you can run in and grab free drops.