I thought the invasions were supposed to be harder as the my character's level progresses. The devs might look into this. Hope it gets better!