How much you have progressed on the story/campaign also influences. If you dont kill Eikthyr, it will send raids of necks and boars to your base (basically free food!) instead of greylings and graydwarfs. Each boss killed will increase raid difficulty.