Originally posted by MythN7:

just found mine, is there any downside to building yiour main base on the sore near him?

Not really, besides the fact he's in the Black Forest, and therefore you'll perpetually have greydwarfs as nosey neighbors.

You'd be better off making your main base in the meadows, and building a small shack with a teleporter in it next to him.