What Dwarkesh Patel thinks about benchmarks
Interviewer; the Dwarkesh Podcast runs long, heavily researched conversations with AI researchers, historians and economists.
Dwarkesh Patel did not write this page.
We collected these quotes from things they published elsewhere, and every quote links to where it was said. They have no account here and have not endorsed this site. Quotes are word for word; the short line under each one is our own restatement, not their wording. Their own site. Is this you? Claim it or ask us to remove it. Or tell us what is wrong here.
Filter benchmarks · Newest first
Only Dwarkesh Patel on benchmarks. See everyone on benchmarks
2 dated positions, 2026, in their own words. Our reading of what Dwarkesh Patel has said — not written or endorsed by them.
-
Their wordswatching them play actually lets us learn a lot about how AI is progressing on a set of AI capabilities that no other benchmark that I know of gives you clear visibility on.
↗Which AI is the best liar?youtube.com 1st of 8 in this recording
-
Their wordsIt seems like evil's win rate gets slightly lower as both sides get stronger, but that drift is too small to be distinguishable from chance, which is good news for this Blood on the Clocktower evaluation because unlike other benchmarks, this one is unlikely to get saturated.
↗Which AI is the best liar?youtube.com 5th of 8 in this recording