zlacker

[parent] [thread] 6 comments
1. timr+(OP)[view] [source] 2022-01-30 00:05:50
Yes, I know. We're basically in agreement on the broader points, but I don't agree with your second sentence, and you seem to have the opposite bias in terms of how to act under uncertainty:

> What I am saying is their adamant declarations of "masks don't work for the public", which note is an affirmative declaration, were false, and never had any supporting evidence.

There's no such thing as an affirmative declaration of the null hypothesis. You either have proof that something works, or you do not. If you do not have evidence that X works, or the evidence is ambiguous, your conclusion is the null hypothesis (that X doesn't work)...but that doesn't mean that you have to scream it from the rooftops. You can just say "we don't know; the evidence is poor."

The only accurate thing you can say in the "mask debate" is that strong declarations both ways are wrong. The original declarations were wrong, and the declarations now are also wrong. If you look at the data you can't judge either way (with the exception of cloth masks, which are looking quite poor), and so we must equivocate.

The only way you can possibly go on this issue and still be correct is to use nuance. And if you do that, then it's a question of how you use medical evidence to advocate for interventions.

replies(3): >>wrp+U5 >>hn_thr+uq >>comp_t+dO
2. wrp+U5[view] [source] 2022-01-30 00:49:14
>>timr+(OP)
For practical purposes, there has to be a point where "we saw no evidence that X works" is considered equivalent to "X doesn't work."
3. hn_thr+uq[view] [source] 2022-01-30 03:32:57
>>timr+(OP)
> There's no such thing as an affirmative declaration of the null hypothesis.

I strongly disagree, epistemologically speaking. You can run repeated tests and then conclude an intervention is successful. You can also run repeated tests and conclude an intervention is not successful - as you put it, no better than the null hypothesis. Or, finally, you can have just not run tests at all. There is a difference between the second and third states, and health authorities implied the second state when the third state was far more accurate.

replies(1): >>timr+of2
4. comp_t+dO[view] [source] 2022-01-30 08:48:05
>>timr+(OP)
> If you do not have evidence that X works, or the evidence is ambiguous, your conclusion is the null hypothesis (that X doesn't work)

No??? This is what having a prior is for. In this case, the prior was the mechanistic model which told you with reasonable confidence that masks would work in the slices of worlds where the primary mode of transmission was one mitigated by mask-wearing. We do not in fact live in a state of helplessness absent a double-blind peer-reviewed RCT; you will actively come to incorrect conclusions if you refuse to use your existing models & knowledge of the world to draw conclusions about the likelihoods of various outcomes.

replies(1): >>timr+Ud2
◧◩
5. timr+Ud2[view] [source] [discussion] 2022-01-30 20:04:05
>>comp_t+dO
> No??? This is what having a prior is for. In this case, the prior was the mechanistic model which told you with reasonable confidence that masks would work in the slices of worlds where the primary mode of transmission was one mitigated by mask-wearing.

Yes. I'm incorporating a prior. Read what I wrote at the top of the thread: every medical intervention that has ever failed a trial has had a biologically plausible justification for doing the trial. Nearly all trials fail.

In the history of medicine, literally every failed medication, surgery, treatment or intervention has had an explanation that seemed plausible at the time. Just as we're seeing with masks, the vast majority of interventions have little to no effect. Many make things worse. From bloodletting to thalidomide to failed cancer drugs, medicine is littered with examples of people who "knew" that their preferred treatment would work based on "priors" or "plausible mechanisms", and ended up doing great harm.

As a bayesian and someone who is knowledgable of science and medicine, my prior probability of any medical intervention working is almost zero.

replies(1): >>comp_t+F8b
◧◩
6. timr+of2[view] [source] [discussion] 2022-01-30 20:14:21
>>hn_thr+uq
> You can also run repeated tests and conclude an intervention is not successful - as you put it, no better than the null hypothesis.

I don't disagree. You test to reject the null hypothesis. If you do not reject, you must accept. Eventually, hopefully, you give up on the failed alternative hypothesis and move on.

> Or, finally, you can have just not run tests at all. There is a difference between the second and third states, and health authorities implied the second state when the third state was far more accurate.

We agree completely here.

◧◩◪
7. comp_t+F8b[view] [source] [discussion] 2022-02-02 07:39:42
>>timr+Ud2
> my prior probability of any medical intervention working is almost zero

Yes, this is reasonable, in the general case, absent a specific example to examine. However, masks do in fact work to prevent the spread of certain kinds of disease, based on both obvious mechanistic reasoning and on actual experimental evidence to that effect. Making the affirmative claim that masks would not work against covid (at the time) would have been ignoring or denying the non-trivial possibility that they would work quite well (or work poorly, but working poorly is still working on the margin).

[go to top]