Caves are not possible per the developers and most likely will not make it into the game. As Delle wrote, you can dig a big hole and cover it with stone floor to sort of create a dungeon.