What we're talking about here is governance -- laws, norms, and fairness. Nobody lives on an island. Even on land that's "yours", you're still reliant on things like roads, water pipes, and other shared public infrastructure. You don't like how someone's running things, vote them out or leave, but don't pretend you're better off doing everything yourself. "Self-sufficiency is the road to poverty" as a famous economist said.
Incidentally I've been watching the walking dead again (season 8) and a lot of this stuff is the subject of the show. It's definitely had some rough patches but at its core, it's a show about how to build communities and large-scale civilizations, and what effects various leadership styles have on each society's long-term prospects. Very relevant.