I agree. Principles are the only way out of this. People need to feel faith that an evenhanded application of impartial standards will protect both them and their ideological foes alike. Whatever privacy standards are established need to protect everyone the same.
It's easy to point out Musk's hypocrisy and shifting standards. Conservatives did the same when it was more liberal people who ran Twitter. We need to appeal to something higher than "everything is great when people who agree with me are in charge."