Mind & Matter

How Science Works: Meta-Research, Publishing, Reproducibility, Peer Review, Funding | John Ioannidis | 212

Nick Jikomes Season 5 Episode 212

Send us a text

Short Summary: A rare, insider’s look at the messy realities of scientific research with Stanford’s Dr. John Ioannidis. The good, the bad, and the ugly about how scientific research actually works.

About the guest: John Ioannidis, MD, PhD is a professor at Stanford University in medicine, epidemiology, population health, and biomedical data science, with an MD from the University of Athens and a PhD from Harvard in biostatistics. He directs the Meta-Research Innovation Center at Stanford (METRICS), focusing on improving research methods and practices. Renowned for his paper “Why Most Published Research Findings Are False,” he’s among the most cited scientists globally, tackling biases and reproducibility in science.

Note: Podcast episodes are fully available to paid subscribers on the M&M Substack and everyone on YouTube. Partial versions are available elsewhere. Full transcript and other information on Substack.

Key Takeaways:

  • Science’s “replication crisis” isn’t new—it’s baked into how tough and bias-prone research is, hitting all fields, not just “soft” ones like psychology.
  • Ioannidis’s famous claim, “most published findings are false,” holds up: stats show many “significant” results are flukes due to weak studies or bias.
  • Peer review’s a mixed bag—only a third of papers improve, and unpaid, tired reviewers miss a lot, letting shaky stuff slip through.
  • Publishing’s a $30 billion game with 50,000+ journals; big players like Elsevier rake in huge profits from subscriptions and fees, often over $10,000 per paper.
  • Researchers game the system—think fake co-authorships or citation cartels—boosting metrics like the H-index, which tracks papers with matching citation counts.
  • Ioannidis’s early COVID-19 fatality rate (0.2-0.3%) was spot-on but sparked a firestorm as politics warped science into “clan warfare.”
  • NIH funding’s clogged by red tape and favors older researchers, starving young innovators and risky ideas that could shake things up.
  • He’s building tools like a public database of scientist stats (4 million downloads!) to spotlight gaming and push for transparent, fair research.

*Not medical advice.


Support the show

All episodes, show notes, transcripts, etc. at the M&M Substack

Affiliates:

  • Lumen device to optimize your metabolism for weight loss or athletic performance. Use code MIND for 10% off.
  • Readwise: Organize and share what you read.
  • Athletic Greens: Comprehensive & convenient daily nutrition. Free 1-year supply of vitamin D with purchase.
  • KetoCitra—Ketone body BHB + potassium, calcium & magnesium, formulated with kidney health in mind. Use code MIND20 for 20% off any subscription.
  • MASA Chips—delicious tortilla chips made from organic corn and grass-fed beef tallow. No seed oils or artificial ingredients. Use code MIND for 20% off.

For all the ways you can support my efforts


People on this episode