a "proper" sized hole IRL is not the same as in Valheim.... The "smoke" particles are a physical entity in Valheim and are nearly the size of one full floor tile, so the ventilation hole must be that big...

Rather than trying to explain it, just go to YT and look up firespark81's video explaining everything you need to know about how smoke works in Valheim.