I toss them aside and they de-spawn after a while. If you don't like that idea there are mods to recycle items and/or destroy them.

Tossing them in the sea, in my moat, or into a river works for me.