If there is a dirt slope that is one side of the pen it may not be steep or tall enough to keep them in. I've seen boars crowd into a corner and end up stepping on each other so they are stacked. A bonus with the bigger palisade wall is it blocks line of sight with any mobs that may be seen if you're using the light fencing. Boars and mobs looking at each other is to be avoided.