SkeptiCamp All articles
Digital Literacy

From the Lab to Your Phone Screen: How Research Findings Get Completely Twisted

SkeptiCamp
From the Lab to Your Phone Screen: How Research Findings Get Completely Twisted

Photo by Photo by Kanishk Agarwal on Unsplash on Unsplash

Somewhere between a university press release and your morning scroll through the news, something goes wrong. A study about mice eating a specific diet becomes a headline about a breakthrough cancer treatment. A survey of 200 college students becomes definitive proof that an entire generation is doomed. A correlation between two variables becomes a confident declaration of cause and effect.

This isn't always malicious. Sometimes it's lazy. Sometimes it's deadline pressure. Sometimes it's a well-meaning journalist who genuinely doesn't understand what they're reading. But the end result is the same: millions of people making decisions based on a version of "the science" that bears only a passing resemblance to what the scientists actually found.

Let's break down exactly how this happens — and more importantly, how you can spot it.

The Telephone Game Has Many Rounds

Before a study ever reaches a reporter, it's already been through several filters. The researchers write up their findings, which go through peer review (itself an imperfect process). Then the university's communications office writes a press release, which is where the first significant distortion often occurs. A 2014 study published in BMJ analyzed 462 press releases from UK universities and found that 40% contained exaggerated claims of causation, 33% made unjustified recommendations for human behavior based on animal studies, and 36% overstated the relevance to human health. Crucially, when press releases made these errors, the resulting news stories almost always repeated them.

So by the time a journalist reads the press release — and many never go back to the original paper — the distortion is already baked in. The reporter's job then becomes making that already-distorted summary engaging enough to compete for your attention.

The Anatomy of a Mangled Study

Let's look at a real example. In 2012, a study published in PLOS ONE examined the relationship between chocolate consumption and Nobel Prize winners across different countries. It was a deliberately tongue-in-cheek piece designed to illustrate the absurdity of ecological correlations — the researchers were making a methodological joke. The media coverage? Hundreds of outlets ran it straight, with headlines suggesting that eating chocolate might make you smarter. The study's satirical intent was almost completely lost.

A more consequential example: the wave of coverage around a 2013 study suggesting that sitting is "the new smoking." The original research did find associations between prolonged sedentary behavior and various health risks. What it didn't say — but what countless headlines implied — was that an hour of sitting was equivalent in danger to smoking a cigarette, or that standing desks were a meaningful health intervention. The nuances around confounding variables, population specifics, and effect sizes evaporated entirely.

Contrast those with the coverage of a 2019 Lancet study on diet and climate change. Most major outlets, including the New York Times and Washington Post, accurately conveyed the study's core finding — that shifting toward plant-based diets would benefit both human health and environmental sustainability — while also noting the study's limitations and the researchers' careful hedging. The difference in coverage quality wasn't random; it tracked closely with whether reporters had access to the actual paper and whether they'd interviewed scientists outside the research team.

A Framework for Reverse-Engineering Headlines

You don't need a PhD to evaluate science coverage. You need a repeatable process. Here's one that works:

Step 1: Find the original study. Google the headline plus "study" and look for a DOI link, PubMed entry, or direct journal link. If you can't find the original paper cited anywhere in the article, that's already a red flag.

Step 2: Check the sample. Who was studied? How many people (or animals, or cells)? A finding from 50 participants at a single university tells you something very different from a finding replicated across 10,000 people in multiple countries. Mouse studies and cell studies are valuable for generating hypotheses — they are not evidence that something works in humans.

Step 3: Correlation or causation? This is the big one. Look for language like "associated with," "linked to," or "correlated with" in the actual study. These phrases mean the researchers found two things moving together — not that one caused the other. Headlines almost always drop this distinction.

Step 4: What did the researchers actually claim? Most papers have a section called "limitations" where the authors themselves explain what their findings don't prove. Check if the headline contradicts anything in that section.

Step 5: Has it been replicated? A single study is a data point. Science is a process. Search for meta-analyses or systematic reviews on the same topic to see if the finding holds up across multiple research teams.

Step 6: Who funded it? Industry-funded research isn't automatically wrong, but it's a variable worth knowing. The BMJ and other journals require disclosure; check the acknowledgments section.

The Outlets That Get It Right (And Why)

Not all science journalism is equally bad. Outlets like Science News, Stat News, and The Atlantic's science section consistently include study limitations, interview outside experts, and distinguish between preliminary and established findings. What do they have in common? Dedicated science reporters with relevant backgrounds, editorial standards that require linking to primary sources, and enough reader trust that they don't need to sensationalize to get clicks.

When you find a health or science story on a general news site, it's worth asking: does this outlet have a science desk? Did they quote anyone who wasn't involved in the study? Did they link to the actual paper?

At SkeptiCamp, we believe that reading science news critically is a learnable skill — not an innate talent reserved for researchers. The gap between what labs discover and what lands on your feed is real, but it's navigable. You just have to know where to look for the cracks.

All Articles

Related Articles

Trust But Verify: Red Flags That a Science Communicator Is Way Out of Their Lane

Trust But Verify: Red Flags That a Science Communicator Is Way Out of Their Lane

Healthy Skepticism vs. Rabbit Holes: How to Ask Real Questions and Actually Get Somewhere

Healthy Skepticism vs. Rabbit Holes: How to Ask Real Questions and Actually Get Somewhere

Your Teen Learned That From TikTok? Here's How to Turn It Into a Teaching Moment

Your Teen Learned That From TikTok? Here's How to Turn It Into a Teaching Moment