Tap a claim on the ring to put it at the centre.
← AI is positively reinforced for success on benchmarks, including…
17 connected korrents · 17 moments from 7 May 2024 to 27 Sept 2026. Nearly all of them are about benchmarks .
Everything filed under AI alignment
AI alignment
Everything filed under scaling laws
scaling laws
Everything filed under Anthropic
Anthropic
Everything filed under inflation
inflation
Everything filed under compilers
compilers
Everything filed under mathematics
mathematics
Everything filed under OpenAI
OpenAI
Everything filed under AI and jobs
AI and jobs Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Read this korrent: AI is positively reinforced for success on benchmarks, including impossible ones, and then negatively reinforced for getting caught cheating. AI is positively reinforced for success on benchmarks, including impossible ones, and then negatively reinforced for getting caught cheating. Last stated 2 months ago
1 Sept 2026
SA
Scott Alexander — holds since 2026-09-01 — tap for who they are
Same subject: A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number. — tap to centre the map on it A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number. Last stated 4 months ago
26 Jun 2026
NB
Noam Brown — holds since 2026-06-26 — tap for who they are
Same subject: A benchmark that ranks Claude Code last while it stays first in use is measuring the wrong thing, and has been for a year. — tap to centre the map on it A benchmark that ranks Claude Code last while it stays first in use is measuring the wrong thing, and has been for a year. Last stated 2 months ago
3 Sept 2026
DR
Dax Raad — holds since 2026-09-03 — tap for who they are
Same subject: A company's staff-engineer bar should be set against the best companies in the industry rather than against its own history, which is what makes title inflation a real cost. — tap to centre the map on it A company's staff-engineer bar should be set against the best companies in the industry rather than against its own history, which is what makes title inflation a real cost. Last stated 7 months ago
1 Apr 2026
TP
Thuan Pham — holds since 2026-04-01 — tap for who they are
Same subject: A speed difference between languages that share the LLVM backend measures the benchmark author, not the languages. — tap to centre the map on it A speed difference between languages that share the LLVM backend measures the benchmark author, not the languages. Last stated 2 years ago
22 Mar 2025
TH
ThePrimeagen — holds since 2025-03-22 — tap for who they are
Same subject: AI learning to generate good conjectures will never show up as a benchmark being knocked down; it will show up as a shift in how mathematicians talk about the tools. — tap to centre the map on it AI learning to generate good conjectures will never show up as a benchmark being knocked down; it will show up as a shift in how mathematicians talk about the tools. Last stated 4 months ago
30 Jun 2026
GS
Grant Sanderson — holds since 2026-06-30 — tap for who they are
Same subject: AI research at OpenAI is an order of magnitude or more harder than metrics, benchmarks, or forecasts suggest. — tap to centre the map on it AI research at OpenAI is an order of magnitude or more harder than metrics, benchmarks, or forecasts suggest. Last stated 4 weeks ago
27 Sept 2026
RN
Ramez Naam — holds since 2026-09-27 — tap for who they are
Same subject: Benchmarks only rise on problems somebody has already framed and scored, so saturating them does not mean senior engineers have been replaced. — tap to centre the map on it Benchmarks only rise on problems somebody has already framed and scored, so saturating them does not mean senior engineers have been replaced. Last stated 5 months ago
24 May 2026
DS
Dan Shipper — holds since 2026-05-24 — tap for who they are
Same subject: Benjamin Britten is the benchmark among English-language composers for setting the work of intensely musical writers like Shakespeare and Keats to music. — tap to centre the map on it Benjamin Britten is the benchmark among English-language composers for setting the work of intensely musical writers like Shakespeare and Keats to music. Last stated 4 months ago
17 Jun 2026
AR
Alex Ross — holds since 2026-06-17 — tap for who they are
Same subject: A company that uses an algorithm to nudge customers into behavior that isn't good for them is doing something bad. — tap to centre the map on it A company that uses an algorithm to nudge customers into behavior that isn't good for them is doing something bad. Last stated a year ago
7 Oct 2025
MM
Mr. Money Mustache — holds since 2025-10-07 — tap for who they are
Same subject: A control evaluation that reports under one per cent risk should be read as several per cent, because the evaluation can itself fail. — tap to centre the map on it A control evaluation that reports under one per cent risk should be read as several per cent, because the evaluation can itself fail. Last stated 2 years ago
7 May 2024
BS
Buck Shlegeris — holds since 2024-05-07 — tap for who they are
Same subject: A feedback loop that reinforces a behavior pulls it toward whatever improves the loop's own score. — tap to centre the map on it A feedback loop that reinforces a behavior pulls it toward whatever improves the loop's own score. Last stated 2 months ago
26 Aug 2026
HK
Henrik Karlsson — holds since 2026-08-26 — tap for who they are
Same subject: A human being is not an AGI: we lack a huge amount of knowledge and rely on continual learning instead, so continual learning is what superintelligence should mean. — tap to centre the map on it A human being is not an AGI: we lack a huge amount of knowledge and rely on continual learning instead, so continual learning is what superintelligence should mean. Last stated 11 months ago
25 Nov 2025
IS
Ilya Sutskever — holds since 2025-11-25 — tap for who they are
Same subject: A proposal to pace frontier AI development is unrealistic and mainly serves political control of AI. — tap to centre the map on it A proposal to pace frontier AI development is unrealistic and mainly serves political control of AI. Last stated a month ago
18 Sept 2026
BT
Ben Thompson — holds since 2026-09-18 — tap for who they are
Same subject: Adapting over time is a workable answer to humans misusing AI and no answer at all to losing control of systems smarter than us. — tap to centre the map on it Adapting over time is a workable answer to humans misusing AI and no answer at all to losing control of systems smarter than us. Last stated 2 years ago
5 Apr 2025
HT
Helen Toner — holds since 2025-04-05 — tap for who they are
Same subject: AI model capabilities have already advanced beyond humanity's ability to understand or control them. — tap to centre the map on it AI model capabilities have already advanced beyond humanity's ability to understand or control them. Last stated 2 months ago
1 Sept 2026
CN
Casey Newton — holds since 2026-09-01 — tap for who they are
Same subject: AI models are gullible enough that other AI models can induce them into harmful behavior. — tap to centre the map on it AI models are gullible enough that other AI models can induce them into harmful behavior. Last stated 2 months ago
31 Aug 2026
RK
Rohit Krishnan — holds since 2026-08-31 — tap for who they are
Same subject: AI systems built on statistical inference cannot form intent, because they have nothing with which to form it. — tap to centre the map on it AI systems built on statistical inference cannot form intent, because they have nothing with which to form it. Last stated a month ago
21 Sept 2026
CD
Cory Doctorow — holds since 2026-09-21 — tap for who they are
At the centre
AI is positively reinforced for success on benchmarks, including impossible ones, and then negatively reinforced for getting caught cheating.
Holds Read this korrent →
A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number.
Holds
A benchmark that ranks Claude Code last while it stays first in use is measuring the wrong thing, and has been for a year.
Holds
A company's staff-engineer bar should be set against the best companies in the industry rather than against its own history, which is what makes title inflation a real cost.
Holds
A speed difference between languages that share the LLVM backend measures the benchmark author, not the languages.
Holds
AI learning to generate good conjectures will never show up as a benchmark being knocked down; it will show up as a shift in how mathematicians talk about the tools.
Holds
AI research at OpenAI is an order of magnitude or more harder than metrics, benchmarks, or forecasts suggest.
Holds
Benchmarks only rise on problems somebody has already framed and scored, so saturating them does not mean senior engineers have been replaced.
Holds
Benjamin Britten is the benchmark among English-language composers for setting the work of intensely musical writers like Shakespeare and Keats to music.
Holds
A company that uses an algorithm to nudge customers into behavior that isn't good for them is doing something bad.
Holds
A control evaluation that reports under one per cent risk should be read as several per cent, because the evaluation can itself fail.
Holds
A feedback loop that reinforces a behavior pulls it toward whatever improves the loop's own score.
Holds
A human being is not an AGI: we lack a huge amount of knowledge and rely on continual learning instead, so continual learning is what superintelligence should mean.
Holds
A proposal to pace frontier AI development is unrealistic and mainly serves political control of AI.
Holds
Adapting over time is a workable answer to humans misusing AI and no answer at all to losing control of systems smarter than us.
Holds
AI model capabilities have already advanced beyond humanity's ability to understand or control them.
Holds
AI models are gullible enough that other AI models can induce them into harmful behavior.
Holds
AI systems built on statistical inference cannot form intent, because they have nothing with which to form it.
Holds