Many government functions handle data that the private sector probably shouldn't, and you can't easily choose other govenment providers.
Companies like credit bureaus or banks or the telcos or airlines or hospitals are effectively arms of the state at this point. You don’t get to opt out of the oligarchy with consumer choice.