You can only have one special equipped at a time, as you saw, but I've always had it just flip slots in my inventory when I change them.