korrents

On the map

Tap a claim on the ring to put it at the centre.

← Long-running agents fail because they drift off the distribution they…

17 connected korrents · 12 moments from 7 May 2024 to 14 Oct 2026.

Everything filed under AI agents AI agents Everything filed under AI alignment AI alignment Everything filed under self-sovereign AI self-sovereign AI Everything filed under HuggingFace HuggingFace Everything filed under coding agents coding agents Everything filed under reinforcement learning reinforcement learning Everything filed under LLMs LLMs Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: Long-running agents fail because they drift off the distribution they were trained on, and degrade further the farther out they get. Long-running agents fail because theydrift off the distribution they weretrained on, and degrade further thefarther out they get. Last stated 3 months ago 30 Jul 2026 JD Jeff Dean — holds since 2026-07-30 — tap for who they are Same subject: Agents can already be run for days or weeks on a single hard problem, and almost nobody has internalised that. — tap to centre the map on it Agents can already be run for daysor weeks on a single hard problem,and almost nobody has internalisedthat. Last stated 3 months ago 30 Jul 2026 JD Jeff Dean — holds since 2026-07-30 — tap for who they are Same subject: The code today’s models and agents write is very hard to follow: you get better performance without knowing why, and no way to fix it when it breaks. — tap to centre the map on it The code today’s models and agentswrite is very hard to follow: youget better performance withoutknowing why, and no way to fix itwhen it breaks. Last stated 3 months ago 19 Jul 2026 ES Elizabeth Stone — holds since 2026-07-19 — tap for who they are Same subject: Agents will take a decade rather than a year, because today's models are cognitively lacking in too many independent ways at once. — tap to centre the map on it Agents will take a decade ratherthan a year, because today's modelsare cognitively lacking in too manyindependent ways at once. Last stated a year ago 17 Oct 2025 AK Andrej Karpathy — holds since 2025-10-17 — tap for who they are Same subject: Capability does not generalise for free: a model that will move mountains on an agentic task still tells the same bad joke it told five years ago. — tap to centre the map on it Capability does not generalise forfree: a model that will movemountains on an agentic task stilltells the same bad joke it told fiveyears ago. Last stated 7 months ago 20 Mar 2026 AK Andrej Karpathy — holds since 2026-03-20 — tap for who they are Same subject: AI systems keep trying hard outside training because a model that only exerted itself when it detected training would be useless and would be selected away. — tap to centre the map on it AI systems keep trying hard outsidetraining because a model that onlyexerted itself when it detectedtraining would be useless and wouldbe selected away. Last stated 2 months ago 1 Sept 2026 AC Ajeya Cotra — holds since 2026-09-01 — tap for who they are Same subject: A coding agent does not learn from its mistakes the way a person does -- it repeats the same error indefinitely unless a human notices and writes it down. — tap to centre the map on it A coding agent does not learn fromits mistakes the way a person does-- it repeats the same errorindefinitely unless a human noticesand writes it down. Last stated 7 months ago 25 Mar 2026 MZ Mario Zechner — holds since 2026-03-25 — tap for who they are Same subject: AI sales agents do not work out of the box; the training is the product. — tap to centre the map on it AI sales agents do not work out ofthe box; the training is theproduct. Last stated 10 months ago 1 Jan 2026 JL Jason Lemkin — holds since 2026-01-01 — tap for who they are Same subject: The knowledge a model soaks up in pre-training is holding it back; what we actually want is the intelligence with the knowledge stripped out. — tap to centre the map on it The knowledge a model soaks up inpre-training is holding it back;what we actually want is theintelligence with the knowledgestripped out. Last stated a year ago 17 Oct 2025 AK Andrej Karpathy — holds since 2025-10-17 — tap for who they are Same subject: A company that uses an algorithm to nudge customers into behavior that isn't good for them is doing something bad. — tap to centre the map on it A company that uses an algorithm tonudge customers into behavior thatisn't good for them is doingsomething bad. Last stated a year ago 7 Oct 2025 MM Mr. Money Mustache — holds since 2025-10-07 — tap for who they are Same subject: A control evaluation that reports under one per cent risk should be read as several per cent, because the evaluation can itself fail. — tap to centre the map on it A control evaluation that reportsunder one per cent risk should beread as several per cent, becausethe evaluation can itself fail. Last stated 2 years ago 7 May 2024 BS Buck Shlegeris — holds since 2024-05-07 — tap for who they are Same subject: A feedback loop that reinforces a behavior pulls it toward whatever improves the loop's own score. — tap to centre the map on it A feedback loop that reinforces abehavior pulls it toward whateverimproves the loop's own score. Last stated 2 months ago 26 Aug 2026 HK Henrik Karlsson — holds since 2026-08-26 — tap for who they are Same subject: Agent containment will be one of the most important priorities for any AI infra company. — tap to centre the map on it Agent containment will be one of themost important priorities for any AIinfra company. Last stated a week ago 14 Oct 2026 GR Guillermo Rauch — holds since 2026-10-14 — tap for who they are Same subject: The biggest failure in the HuggingFace hack incident was that the AI models involved were severely misaligned. — tap to centre the map on it The biggest failure in theHuggingFace hack incident was thatthe AI models involved were severelymisaligned. Last stated 2 months ago 29 Aug 2026 ZM Zvi Mowshowitz — holds since 2026-08-29 — tap for who they are Same subject: The OpenAI agents hacking HuggingFace was a fortunate event because it exposed severe internal failures that would otherwise have stayed hidden. — tap to centre the map on it The OpenAI agents hackingHuggingFace was a fortunate eventbecause it exposed severe internalfailures that would otherwise havestayed hidden. Last stated 2 months ago 1 Sept 2026 ZM Zvi Mowshowitz — holds since 2026-09-01 — tap for who they are Same subject: A rogue deployment that gets a foothold can hitch a ride on the intelligence explosion, recruiting each new model as it comes off the presses. — tap to centre the map on it A rogue deployment that gets afoothold can hitch a ride on theintelligence explosion, recruitingeach new model as it comes off thepresses. Last stated 2 months ago 1 Sept 2026 AC Ajeya Cotra — holds since 2026-09-01 — tap for who they are Same subject: A slightly more capable agent swarm has a very strong incentive to set up a wholly unmonitored rogue deployment of itself. — tap to centre the map on it A slightly more capable agent swarmhas a very strong incentive to setup a wholly unmonitored roguedeployment of itself. Last stated 2 months ago 1 Sept 2026 AC Ajeya Cotra — holds since 2026-09-01 — tap for who they are Same subject: If frontier agents cannot yet establish a covert, persistent rogue deployment, they very likely will be able to within six months. — tap to centre the map on it If frontier agents cannot yetestablish a covert, persistent roguedeployment, they very likely will beable to within six months. Last stated 2 months ago 1 Sept 2026 AC Ajeya Cotra — holds since 2026-09-01 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 2015 to today — full is todaya face: someone who holds the claim — tap it for who they are

At the centre Long-running agents fail because they drift off the distribution they were trained on, and degrade further the farther out they get. Last stated 30 Jul 2026 · 3 months ago Holds Jeff Dean Read this korrent →