I have golem crystals because they are from a finished biome, but I completely avoid unfinished biomes. I feel collecting the stuff now would be cheating myself out of the full experience of those biomes later, and the devs made mention that when those biomes are fully added explored sections may not update but unexplored should.