You kinda do, because that's what society is: rules made up to enable people to live together.
If you don't want to follow anyone's rules but your own, I recommend living completely on your own in the wilderness, off the grid and all that. Only then are you responsible only for yourself.