It'd be a huge engine overhaul to allow actual caves, it doesn't support overhangs at all and you can see its limits most clearly where rivers generate alongside mountains. The best you can do is build underneath the giant scenic rock pieces, but it's distressingly easy to ruin those with a single pickaxe misfire.