Tap a claim on the ring to put it at the centre.
← Evaluating an agent that runs for a month is a hard problem when models ship every month.
17 connected korrents · 15 moments from 15 Apr 2022 to 11 Oct 2026.
Everything filed under AI agents
AI agents
Everything filed under coding agents
coding agents
Everything filed under AI alignment
AI alignment
Everything filed under cybersecurity
cybersecurity
Everything filed under benchmarks
benchmarks
Everything filed under taste
taste
Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject
Read this korrent: Evaluating an agent that runs for a month is a hard problem when models ship every month.
Evaluating an agent that runs for a month is a hard problem when models ship every month.
Last stated a month ago
11 Oct 2026
LR
Lee Robinson — holds since 2026-10-11 — tap for who they are
Same subject: It is very possible that agents will soon be working for weeks or months at a time. — tap to centre the map on it
It is very possible that agents will soon be working for weeks or months at a time.
Last stated a month ago
11 Oct 2026
LR
Lee Robinson — holds since 2026-10-11 — tap for who they are
Same subject: The only way to know what a model can do after running for a month is to actually run it for a month. — tap to centre the map on it
The only way to know what a model can do after running for a month is to actually run it for a month.
Last stated 5 months ago
26 Jun 2026
NB
Noam Brown — holds since 2026-06-26 — tap for who they are
Same subject: Evaluating a model properly would mean delaying its release, and competitive pressure means no lab will. — tap to centre the map on it
Evaluating a model properly would mean delaying its release, and competitive pressure means no lab will.
Last stated 5 months ago
26 Jun 2026
NB
Noam Brown — holds since 2026-06-26 — tap for who they are
Same subject: When agents do the building, the scarce skill is taste: choosing which problem is worth the time at all. — tap to centre the map on it
When agents do the building, the scarce skill is taste: choosing which problem is worth the time at all.
Last stated 4 months ago
30 Jul 2026
JD
Jeff Dean — holds since 2026-07-30 — tap for who they are
Same subject: Agents can already be run for days or weeks on a single hard problem, and almost nobody has internalised that. — tap to centre the map on it
Agents can already be run for days or weeks on a single hard problem, and almost nobody has internalised that.
Last stated 4 months ago
30 Jul 2026
JD
Jeff Dean — holds since 2026-07-30 — tap for who they are
Same subject: The code today’s models and agents write is very hard to follow: you get better performance without knowing why, and no way to fix it when it breaks. — tap to centre the map on it
The code today’s models and agents write is very hard to follow: you get better performance without knowing why, and no way to fix it when it breaks.
Last stated 4 months ago
19 Jul 2026
ES
Elizabeth Stone — holds since 2026-07-19 — tap for who they are
Same subject: Seeing each version an agent pipeline produces, instead of a black box, shows where the process is too weak. — tap to centre the map on it
Seeing each version an agent pipeline produces, instead of a black box, shows where the process is too weak.
Last stated 3 months ago
11 Aug 2026
KZ
Kyle Zantos — holds since 2026-08-11 — tap for who they are
Same subject: Do not run a personal agent on a cheap or local model: weak models are gullible and easy to prompt-inject. — tap to centre the map on it
Do not run a personal agent on a cheap or local model: weak models are gullible and easy to prompt-inject.
Last stated 9 months ago
12 Feb 2026
PS
Peter Steinberger — holds since 2026-02-12 — tap for who they are
Same subject: "Hire smart people and get out of their way" is bad management advice; leaders should stay closely involved, building trust and working through hard problems with their people to create alignment. — tap to centre the map on it
"Hire smart people and get out of their way" is bad management advice; leaders should stay closely involved, building trust and working through hard problems with their people to create alignment.
Last stated a month ago
9 Oct 2026
CR
Carl Rivera — holds since 2026-10-09 — tap for who they are
Same subject: A 5% level of AI risk is crazy and unacceptable; we would not accept a 5% chance of massive fatalities from paint companies. — tap to centre the map on it
A 5% level of AI risk is crazy and unacceptable; we would not accept a 5% chance of massive fatalities from paint companies.
Last stated a year ago
8 Jul 2025
RG
Ryan Greenblatt — holds since 2025-07-08 — tap for who they are
Same subject: A base model learns humanity's collective knowledge, and it then has to be aligned to behave one way or another. — tap to centre the map on it
A base model learns humanity's collective knowledge, and it then has to be aligned to behave one way or another.
Last stated a year ago
10 Sept 2025
SA
Sam Altman — holds since 2025-09-10 — tap for who they are
Same subject: "I don't know" becomes a kind of superpower when you can work with Claude Code to figure things out. — tap to centre the map on it
"I don't know" becomes a kind of superpower when you can work with Claude Code to figure things out.
Last stated 8 months ago
19 Mar 2026
KP
Kris Puckett — holds since 2026-03-19 — tap for who they are
Same subject: A code-review agent works best with a clean context, sharing nothing with the coding agent beforehand. — tap to centre the map on it
A code-review agent works best with a clean context, sharing nothing with the coding agent beforehand.
Last stated 7 months ago
22 Apr 2026
WY
Walden Yan — holds since 2026-04-22 — tap for who they are
Same subject: A coding agent does not learn from its mistakes the way a person does -- it repeats the same error indefinitely unless a human notices and writes it down. — tap to centre the map on it
A coding agent does not learn from its mistakes the way a person does -- it repeats the same error indefinitely unless a human notices and writes it down.
Last stated 8 months ago
25 Mar 2026
MZ
Mario Zechner — holds since 2026-03-25 — tap for who they are
Same subject: A breach whose customers are already being targeted with scams is a fairly serious matter that needs disclosing. — tap to centre the map on it
A breach whose customers are already being targeted with scams is a fairly serious matter that needs disclosing.
Last stated 5 years ago
15 Apr 2022
TH
Troy Hunt — holds since 2022-04-15 — tap for who they are
Same subject: A breached organisation owes its customers a fast and transparent disclosure, and that obligation applies to the person saying it too. — tap to centre the map on it
A breached organisation owes its customers a fast and transparent disclosure, and that obligation applies to the person saying it too.
Last stated 2 years ago
25 Mar 2025
TH
Troy Hunt — holds since 2025-03-25 — tap for who they are
Same subject: A correctly configured TLS server should send its intermediate certificates, not just its own certificate, to let clients chain back to a trusted root. — tap to centre the map on it
A correctly configured TLS server should send its intermediate certificates, not just its own certificate, to let clients chain back to a trusted root.
Last stated 9 months ago
16 Feb 2026
JS
Jon Seager — holds since 2026-02-16 — tap for who they are
same subject or similar wording a cloud: claims about one subject, named for it bar: when it was last stated, on a scale from 2015 to today — full is today a face: someone who holds the claim — tap it for who they are
At the centre
Evaluating an agent that runs for a month is a hard problem when models ship every month.
Last stated 11 Oct 2026 · a month ago
Holds Lee Robinson
Read this korrent →
Similar wording
It is very possible that agents will soon be working for weeks or months at a time.
Last stated 11 Oct 2026 · a month ago
Holds Lee Robinson
Similar wording
The only way to know what a model can do after running for a month is to actually run it for a month.
Last stated 26 Jun 2026 · 5 months ago
Holds Noam Brown
Similar wording
Evaluating a model properly would mean delaying its release, and competitive pressure means no lab will.
Last stated 26 Jun 2026 · 5 months ago
Holds Noam Brown
Similar wording
When agents do the building, the scarce skill is taste: choosing which problem is worth the time at all.
Last stated 30 Jul 2026 · 4 months ago
Holds Jeff Dean
Similar wording
Agents can already be run for days or weeks on a single hard problem, and almost nobody has internalised that.
Last stated 30 Jul 2026 · 4 months ago
Holds Jeff Dean
Similar wording
The code today’s models and agents write is very hard to follow: you get better performance without knowing why, and no way to fix it when it breaks.
Last stated 19 Jul 2026 · 4 months ago
Holds Elizabeth Stone
Similar wording
Seeing each version an agent pipeline produces, instead of a black box, shows where the process is too weak.
Last stated 11 Aug 2026 · 3 months ago
Holds Kyle Zantos
Similar wording
Do not run a personal agent on a cheap or local model: weak models are gullible and easy to prompt-inject.
Last stated 12 Feb 2026 · 9 months ago
Holds Peter Steinberger
Same subject: AI alignment
"Hire smart people and get out of their way" is bad management advice; leaders should stay closely involved, building trust and working through hard problems with their people to create alignment.
Last stated 9 Oct 2026 · a month ago
Holds Carl Rivera
Same subject: AI alignment
A 5% level of AI risk is crazy and unacceptable; we would not accept a 5% chance of massive fatalities from paint companies.
Last stated 8 Jul 2025 · a year ago
Holds Ryan Greenblatt
Same subject: AI alignment
A base model learns humanity's collective knowledge, and it then has to be aligned to behave one way or another.
Last stated 10 Sept 2025 · a year ago
Holds Sam Altman
Same subject: coding agents
"I don't know" becomes a kind of superpower when you can work with Claude Code to figure things out.
Last stated 19 Mar 2026 · 8 months ago
Holds Kris Puckett
Same subject: coding agents
A code-review agent works best with a clean context, sharing nothing with the coding agent beforehand.
Last stated 22 Apr 2026 · 7 months ago
Holds Walden Yan
Same subject: coding agents
A coding agent does not learn from its mistakes the way a person does -- it repeats the same error indefinitely unless a human notices and writes it down.
Last stated 25 Mar 2026 · 8 months ago
Holds Mario Zechner
Same subject: cybersecurity
A breach whose customers are already being targeted with scams is a fairly serious matter that needs disclosing.
Last stated 15 Apr 2022 · 5 years ago
Holds Troy Hunt
Same subject: cybersecurity
A breached organisation owes its customers a fast and transparent disclosure, and that obligation applies to the person saying it too.
Last stated 25 Mar 2025 · 2 years ago
Holds Troy Hunt
Same subject: cybersecurity
A correctly configured TLS server should send its intermediate certificates, not just its own certificate, to let clients chain back to a trusted root.
Last stated 16 Feb 2026 · 9 months ago
Holds Jon Seager