The way the game works items don't despawn in a certain radius around workbenches. So if it's really that big of a problem then dump it a good deal away from your base. It will be gone in like 3 in-game days.