Yes, leave them outside a player base area (over 20m away from stuff you've built) and they despawn within 2-3 game days. Drop them into 2m+ deep water to despawn them within a few minutes.