Yes, that's what they're for! Only other place you'll find feathers is in chests in abandoned houses or towers.