korrents

korrents · learn · how-science-works

How science works

2 papers · 2004–2005 · oldest first

Start here

Research about research: whether published findings hold up, and what happens when you try to publish the numbers on people's performance. Both papers here are about the machinery of a field rather than about the world, and both conclude that the machinery shapes the answers more than anyone would like.

Ours, not the authors' — written for a reader who does not work in this field. The papers' own words are the quotes on each paper's page.

The shape of the field

  1. 2004

    The legacy of Bristol: public disclosure of individual surgeons' results (with 5 co-authors)

    David Spiegelhalter · in the archive · 5 korrents

    After Bristol, heart surgeons set out to publish each one's raw death rates inside very wide safety bands to show they are safe, not to help patients pick a surgeon.

  2. 2005

    Ioannidis, "Why Most Published Research Findings Are False" (PLoS Medicine)

    John Ioannidis · in the archive · 6 korrents

    Most published research findings are false because studies are often too small, effects too weak, methods too flexible, and too many teams race for positive results.

2 of these 2 papers are in this archive, with quotes you can check — those are the linked ones. The rest are here so the timeline is the field's shape rather than ours: they carry no quote, no link and no claim beyond their title, authors and year, and the one-line notes are ours, about what each paper did rather than what anyone believes.

What you can read here

  1. 1 The legacy of Bristol: public disclosure of individual surgeons' results (with 5 co-authors)

    David Spiegelhalter · 19 Aug 2004 · 5 korrents

    After Bristol, heart surgeons set out to publish each one's raw death rates inside very wide safety bands to show they are safe, not to help patients pick a surgeon. This will be the first UK surgical specialty to review named individuals publicly, opening the door for other branches of medicine and debate on surgeon versus whole-hospital responsibility. It argues a position and proposes a method using three years of crude death rates against 99.99 percent limits, building on Bristol recommendations while resisting US-style adjusted comparisons.

    surgical outcomes

  2. 2 Ioannidis, "Why Most Published Research Findings Are False" (PLoS Medicine)

    John Ioannidis · 30 Aug 2005 · 6 korrents

    Most published research findings are false because studies are often too small, effects too weak, methods too flexible, and too many teams race for positive results. It shows why so many claims fail later and why findings can simply track a field’s bias instead of real effects. An opinion essay models the odds a claim is true and argues against treating one significant study as proof.

    metascience

Where to go next