zlacker

[parent] [thread] 9 comments
1. random+(OP)[view] [source] 2022-09-22 18:08:09
I will take a stab. Mind you, I have not even clicked on the article, much less read it or know what the methodology is. Here goes ----

"The have used a correlational model, not a causal model. There are several confounding variables the paper doesn't consider, hence it is not proven from the evidence that Facebook has a negative impact "

replies(2): >>Tainno+33 >>sixstr+s3
2. Tainno+33[view] [source] 2022-09-22 18:24:52
>>random+(OP)
In most fields of study you can't really perform double-blind experiments. We know that smoking is linked to cancer through decades of correlational studies and careful analysis of confounding factors, for example.

The article discusses how the study looked at different universities during the same time period, some of which had access to facebook and some of which didn't, and discovered that in the first case there was an increase in mental health issues over that period. There could still be confounders, sure, (or the sample size could be too small etc.), but at a first glance, that's not an unreasonable approach, as it tries to isolate the variable "facebook yes/no".

That said, if you haven't read the article, I'm not sure why you even felt the need to comment? This is exactly the same kind of shallow dismissal I was calling out.

replies(3): >>giraff+36 >>random+L6 >>jedber+Hv
3. sixstr+s3[view] [source] 2022-09-22 18:27:05
>>random+(OP)
FWIW, the article claims the exact opposite

> While many studies have found a correlation between the use of social media and various symptoms related to mental health, so far, it has been challenging to ascertain whether social media was actually the cause of poor mental health. By applying a novel research method, researchers have now succeeded in establishing such a causality

But doesn't elaborate on the new method. We'll have to wait for the study to be published I guess.

replies(1): >>andrew+y6
◧◩
4. giraff+36[view] [source] [discussion] 2022-09-22 18:40:20
>>Tainno+33
The smoking comparison is very apt I think. People and institutions persistently pointing out that correlation isn't causation is a big part of why it took decades for the link between smoking and cancer to become commonly accepted after it was well established.

Some were surely acting in their own personal financial interests but I'm also certain that a lot of it was more nuanced and personal. People need to think of themselves as, for the most part, good people who do mostly good things. Knowingly contributing to something that makes life much worse for many people doesn't align with that and they will need to deny it. I know if you polled phillip morris employees about cancer in the late 60s after the link was confirmed you'd hear a lot about correlation and uncertainty.

HN isn't a random slice of the population. A lot of us here work in this domain or on similar products. There are certainly people in this comment section who directly worked on the core facebook product being discussed. They need to think of themselves as good still, too.

replies(1): >>random+I8
◧◩
5. andrew+y6[view] [source] [discussion] 2022-09-22 18:42:59
>>sixstr+s3
I note in my other reply in this thread that they do describe some of the methodology (although I have not yet located a copy of the paper itself) appears to be address this.

They looked at the mental health (as measured by self-reported surveys) among schools over time and cross-referenced that with the rollout of Facebook over time. So they could compare the change in mental health at schools the received Facebook access and compare it to the change in mental health at schools that did not receive Facebook access at the same time.

The methodology appears to be fairly novel and does isolate them from several reverse-causation biases, as it is difficult to imagine that the rollout of Facebook was influenced by factors that led to the decline of mental health in student bodies.

replies(1): >>sixstr+ea
◧◩
6. random+L6[view] [source] [discussion] 2022-09-22 18:43:30
>>Tainno+33
I made it a point to not read it, because virtually all social science papers are like these. It's really not worth my time and why the "shallow" dismissals should be the default response.

Going back to your specific comments. Clearly the universities were not randomly assigned the treatment and control. And the actual number of independent sample sizes is extremely unlikely to give stat sig results at the single percentage digit impact shown. And no matter what they do, for something as complex as mental health, listing out all the confounding factors is hopeless - unlike lung cancer where you are literally sucking tar into your lungs and the sample sizes and effects are huge. Its a useful observational study, but it is ridiculous to call it a proof.

> We know that smoking is linked to cancer through decades of correlational studies and careful analysis of confounding factors, for example.

Yes, it took decades, when there is no proper control set. There are work arounds like backdoor and front door criteria, but yeah - it will take decades of work and looking inside the "black box".

replies(1): >>Tainno+Pq
◧◩◪
7. random+I8[view] [source] [discussion] 2022-09-22 18:53:04
>>giraff+36
Smoking to lung cancer has a very direct delivery mechanism, inhaling tar into the lungs. The effect size and sample sizes are big. The hypothesized mechanisms here - unfavorable social comparison is far more tenuous, and the sample size here is number of universities- not number of students.

These 2 are vastly different situations.

To give an example. Establishing causal effect between nicotine and lung cancer is an open question, even as the causal effect of smoking on cancer is very clear.

◧◩◪
8. sixstr+ea[view] [source] [discussion] 2022-09-22 18:59:39
>>andrew+y6
Hmm, yes I read that but it seemed so basic that I assumed it couldn't be considered "novel." Also it would appear to establish correlation but not causation.

I assume to do that you have to establish the complete pathway and mechanism from someone using facebook to an increase in depression, like showing observations of changes in neurotransmitters or brain structure that have been proven to cause changes in mental health, and then proving that facebook caused the changes in those levels. (FWIW I assume this could be done and that we may see those kinds of results if it were done, but I haven't actually seen a study like that. I also assume the hypothesis in general.)

For instance, using the example of smoking from another commenter, from the CDC website [0]:

> - Poisons in cigarette smoke can weaken the body’s immune system, making it harder to kill cancer cells. When this happens, cancer cells keep growing without being stopped.

> - Poisons in tobacco smoke can damage or change a cell’s DNA. DNA is the cell’s “instruction manual” that controls a cell’s normal growth and function. When DNA is damaged, a cell can begin growing out of control and create a cancer tumor.

These seem more like things that can be tested in laboratory settings that are easily reproducible and rely on more objective observations than self-reporting.

I'm neither a neuroscientist or social scientist so I'm just trying to understand, not saying they're wrong or that the research is even flawed.

[0]: https://www.cdc.gov/tobacco/campaign/tips/diseases/cancer.ht...

◧◩◪
9. Tainno+Pq[view] [source] [discussion] 2022-09-22 20:27:02
>>random+L6
> but it is ridiculous to call it a proof.

Proofs are for mathematics, not for science. (I share your distaste for science journalism that throws big words like "prove" around without much care, but that's probably not something you can fault the study authors for.)

This is evidence in favour of a theory. It is to be understood within a larger body of evidence. Eventually, hopefully, there is enough evidence in one direction or another that we may draw more or less definitive conclusions.

> I made it a point to not read it, because virtually all social science papers are like these. It's really not worth my time

Nobody is forcing you to read this study, but somehow you seem to assume that your shallow dismissals (to which you are of course entitled privately) are worth anyone's time.

◧◩
10. jedber+Hv[view] [source] [discussion] 2022-09-22 20:54:12
>>Tainno+33
> but at a first glance, that's not an unreasonable approach, as it tries to isolate the variable "facebook yes/no".

I agree it's not unreasonable, but you have to account for the fact that back then, most of the colleges that had it were top tier/high stress/highly selective colleges. Facebook started at Harvard, then went to Yale and Princeton, and then on to basically most of the US News top 50.

[go to top]