Inside the cave you can only build 3 things - Log seat, camp fire, & cooking station. But you can go in there for a short rested buff if needed.