The mostly permanent solution is crafting wisp torches. They clear out a large area where they're lit. Though I've found even with those, they don't clear out the fog above them. So if you have a tall building you need more above too.