If those cases are extremely rare, and stats I've seen show they are, there is still no need for the weapon in the other cases. We can go ahead and disarm the other officers, and have a small portion maintain arms for potentially violent cases in your given scenario
Of course, I'd argue that you don't need deadly force even to deal with the majority of potentially violent crimes, but that's a separate matter.