This just is not any way to run an incentive system. Prosecutors don't have a lever with which to manipulate future crime rates. Drug use, domestic violence, murders [1], etcetera, isn't going to stop happening.
In fact, the most effective way for prosecutors to improve their crime rate would be to persecute the high-crime racial demographics until they move out of town.
[1] edit: the non-organized-crime kind