I agree with you that any community faces the problem of a vocal, critical, and nearly insurgent minority. They seek to identify contradictions in your logic with the predominantly self-interested goal of demonstrating intellectual superiority rather than finding genuine solutions. I can understand the emotional burden of continually sparring with such individuals. You can't please everyone.
In contrast, there is the silent majority. By virtue of their silence, it would appear they condone current management of the site. I am not sure this can be assumed.
First, it is generally the "first movers" of a given activity who are both the first to try it, but also the first to defect. For example, there are people who are passionate about Microsoft or Apple products and review them publicly. When they stop reviewing these products, it is indicative of a lack of passion; they have moved on. The majority soon follows, just like they did when the first movers initially promoted the activity. In this way, the first mover is the proverbial canary in the coal mine. Are HN's vocal critics really first movers? The ones who are thoughtful, at least, are certainly among the most passionate and engaged; losing them would be the canary. (Admittedly, you must be able to discern those who are vocal and thoughtful from those who are vocal and thoughtless, but I am confident you have that capacity.)
Second, there is the issue of the 90-9-1 rule. The vast majority of users of HN never comment nor express their opinion; they simply observe. This will be true whether or not they are satisfied with the service. If they are dissatisfied, they don't comment, they simply leave. On the other hand, composing only 10%, the vocal minority must necessarily be the minority. Can we uniformly dismiss this vocal minority as unrepresentative of the silent majority? No, because there is no other proxy for surveying the majority. (Again, you must discern the productive from the unproductive critics.)
Finally, there is the burden of simply engaging. I am amazed by the amount of time and effort you must invest into moderating HN and in writing your responses (among, I'm sure, numerous other activities such as actually writing code). It appears that recapitulating your justifications over and over again is not particularly efficient.
That, however, does not imply that failing to justify your actions is suddenly an adequate substitute. It simply means that the current method is inefficient.
There are a few conclusions I think we can draw from this. We can't dismiss the vocal minority because it's all we have; rather, we must discern those who are constructive from those who are destructive. Further, like blowing onto a flame to put it out, ignoring or suppressing them will likely instigate even more frenzied conspiracizing. Finally, responding to each of them individually is inefficient and burdensome.
I think a basic ledger of "moderator actions" would solve many of these issues. To start, it would probably not be an exhaustive log, but simply actions performed at the thread-level rather than the comment-level. It is transparent, just like your comments and the HN community guidelines already are. It would broaden understanding of your actions, rather than rely on users to dig through your recent comments (the only ledger thus far, without which they undoubtedly draw their own conclusions). Finally, it would reduce the burden on you.
Would it, however, pacify the vocal minority? Would they conspiracize further? Would they levy more demands to change the site?
Perhaps, perhaps not.
But it seems clear that those who are worth listening to, vocal as they may be, are in fact worth listening to. They are the canaries. And if they increasingly demand more transparency (which you would know, not I), that is likely worth making some steps toward satisfying. If they make more demands, so be it.
Communities change over time, especially as a function of scale, and I think HN is no different. The only thing that generally must be kept constant is prudent stewardship, and I am fairly confident your track record satisfies that. There may be mistakes along the way, but as long as you make a transparent, genuine effort to serve the community (as you clearly have done historically), that will go along way in retaining the trust of the community.
Maybe such a device would satisfy everyone's curiosity and make the community as happy as a gently tickled baby. Users would raise questions, other users would helpfully look up what happened in the moderation log, and still other helpful users would chime in with past examples of how we do things that way, and why. Enormous pressure would lift from our shoulders and we could sit back and eat potato chips (or carrot sticks), or even better, work on the code. No longer would we be under attack from all sides. The war would be over and transparency would rule the land. Huzzah! (In case that sounds sarcastic, I do have that fantasy sometimes.)
On the other hand, maybe it would be the apocalypse. I fear the apocalypse. There isn't a lot of room for more pressure of the kind I described upthread. We operate on the edge of being maxed out.
Also...I have a feeling that it might not be good in the long run. Moderators here are in a super complex dance with the community. I think it's important for them (us) to have the degrees of freedom that non-public moderation provides. It allows you to do things, try things, take chances, make mistakes, etc., that you wouldn't do if you were under floodlights all the time. It's for the same reason that you wouldn't want your boss standing behind you, breathing down your neck all day—even though you're not doing anything the boss would object to, except perhaps checking Hacker News too much—except that it's actually in the boss's interest for you to be checking HN that much, because it's complicated, besides which sometimes something comes up on HN that actually makes a big difference, plus...never mind, the boss wouldn't understand. It's just best if the boss lets you do your job.
I like this analogy, because the community really is the boss here...if by boss you mean a ten-headed dragon who likes to bite your head off once a day or so, but you know how to reattach your head so it's ok, except it still feels bad to have your head bitten off, plus it takes hours to reattach it. It could be that allowing moderators that degree of opacity turns out to be an essential aspect of operating the site.
But the truth is I don't know. sama suggested we do this 6 years ago and I said no way, for the same reason. Maybe in another 6 years I'll have worked through the fear.
One last thing. If anyone is reading this and thinking of replying "Aha, moderator guy, I've got you! If you're so afraid...what are you hiding from the community? tell us that, you self-contradictor, you!"...I've already planted an effective rebuttal to that precise objection in this thread. So tread carefully, objector guy! Or maybe I haven't, and I'm just saying that, because it's complicated.
Transparency is great in public institutions that spend our tax money. In communities like this, we just need a chieftain to handle our disputes fairly and keep us all from going nuts every so often. Those of us who have been coming back for years already know that you do that, or at least try your best to be fair and open and neutral.
I doubt you could keep everyone happy by releasing a log of moderator actions. People complain now, but look at ArbCom on Wikipedia, which makes all the decisions in public, and there are websites devoted to trashing the process there. And if you're not making people happier, nor making their interactions here more pleasant or informative, what is the goal again?
Plus, it's not just moderators getting a chance to make mistakes, it's also the users. I don't want to end up in a log somewhere for my terrible posts. You've told me to improve before, and I did. At least I've tried to. Admittedly my posts haven't been high quality lately. Anyway, the more formalized the process becomes, the less human we're all allowed to be. That can be good or bad, but I think in this case it's been good. Most of the reactions to OP tend to think that privacy is valuable sometimes.
I could be wrong, of course. Do what you think is best for us. That's why we keep coming back.
I completely agree about wanting to stay on the human side of formal vs. human.