If you take a stagbreaker with you to where you found the golems and smack the ground with it, you can put off Bonemass for awhile longer.

I've found the best defense against golems is to be in a deep hole. Which is where you will likely be when encountering them. There's not much point in killing them.