Nope, it's just the nature of the weapon. I assume you're referring to the Porcupine and Dragr Fang? Best you can do if you're not actively fighting is switch to something without the glow like a Blackmetal Sword and then stow that. A more draconian measure would be to use a Huntsman's Bow and Iron Mace in lieu of their glowing counterparts.