korrents

On the map

Tap a claim on the ring to put it at the centre.

← Social science disciplines use ritual tests of competence that screen work by form rather than substance

10 connected korrents · 9 moments from 13 May 2007 to 12 Nov 2026.

Everything filed under metascience metascience Everything filed under benchmarks benchmarks Everything filed under mental models mental models Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: Social science disciplines use ritual tests of competence that screen work by form rather than substance Social science disciplines use ritualtests of competence that screen work byform rather than substance DK Daniel Kahneman — holds since c. 2002–2003 — tap for who they are Same subject: Knowing the big ideas of the disciplines well enough for an exam does not help; they have to sit in a mental latticework and be used automatically for life — tap to centre the map on it Knowing the big ideas of thedisciplines well enough for an examdoes not help; they have to sit in amental latticework and be usedautomatically for life Last stated 20 years ago 13 May 2007 CM Charlie Munger — holds since 2007-05-13 — tap for who they are Same subject: 'Everyone gets it wrong sometimes' is a bad argument when assessing track records. — tap to centre the map on it 'Everyone gets it wrong sometimes'is a bad argument when assessingtrack records. Last stated 4 months ago 2 Aug 2026 AK Adam Kucharski — holds since 2026-08-02 — tap for who they are Same subject: A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number. — tap to centre the map on it A benchmark result should bereported under a stated budget, oras a curve against test-time compute— never as a single number. Last stated 5 months ago 26 Jun 2026 NB Noam Brown — holds since 2026-06-26 — tap for who they are Same subject: A benchmark that ranks Claude Code last while it stays first in use is measuring the wrong thing, and has been for a year. — tap to centre the map on it A benchmark that ranks Claude Codelast while it stays first in use ismeasuring the wrong thing, and hasbeen for a year. Last stated 3 months ago 3 Sept 2026 DR Dax Raad — holds since 2026-09-03 — tap for who they are Same subject: A review process where authors decide whether and how to address comments without an editor is an unscientific sham. — tap to centre the map on it A review process where authorsdecide whether and how to addresscomments without an editor is anunscientific sham. Last stated a week ago 12 Nov 2026 AD Andrew Dessler — holds since 2026-11-12 — tap for who they are Same subject: Checking a paper's data and analysis is almost never done, though it may be the most important thing review could do. — tap to centre the map on it Checking a paper's data and analysisis almost never done, though it maybe the most important thing reviewcould do. Last stated 4 years ago 13 Feb 2023 AM Adam Mastroianni — holds since 2023-02-13 — tap for who they are Same subject: Economics journals have made large datasets and heavy statistics the price of making any causal claim at all, which has squeezed qualitative economic history out of the field. — tap to centre the map on it Economics journals have made largedatasets and heavy statistics theprice of making any causal claim atall, which has squeezed qualitativeeconomic history out of the field. Last stated a year ago 13 Oct 2025 AH Anton Howes — holds since 2025-10-13 — tap for who they are Same subject: Fraudulent papers pass peer review routinely, which is direct evidence that peer review does not do the job it is supposed to do. — tap to centre the map on it Fraudulent papers pass peer reviewroutinely, which is direct evidencethat peer review does not do the jobit is supposed to do. Last stated 4 years ago 13 Dec 2022 AM Adam Mastroianni — holds since 2022-12-13 — tap for who they are Same subject: History has a reproducibility problem worse than science’s replication crisis, because hardly anyone ever goes back to the sources to check what a historian claimed they say. — tap to centre the map on it History has a reproducibilityproblem worse than science’sreplication crisis, because hardlyanyone ever goes back to the sourcesto check what a historian claimedthey say. Last stated 3 years ago 29 Aug 2023 AH Anton Howes — holds since 2023-08-29 — tap for who they are Same subject: Many popular-science books rest on peer-reviewed articles that are false, which readers trust because of where they were published. — tap to centre the map on it Many popular-science books rest onpeer-reviewed articles that arefalse, which readers trust becauseof where they were published. Last stated 4 years ago 13 Feb 2023 RR Russ Roberts — holds since 2023-02-13 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 2007 to today (stretched back to the oldest claim here) — full is todaya face: someone who holds the claim — tap it for who they are

At the centre Social science disciplines use ritual tests of competence that screen work by form rather than substance Last stated c. 2002–2003 Holds Daniel Kahneman Read this korrent →