korrents

On the map

Tap a claim on the ring to put it at the centre.

← It is fundamentally difficult to design a reward function that…

17 connected korrents · 17 moments from 1 Mar 1999 to 17 Oct 2026. Nearly all of them are about reinforcement learning.

Everything filed under AI alignment AI alignment Everything filed under design design Everything filed under LLMs LLMs Everything filed under neural networks neural networks Everything filed under benchmarks benchmarks Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: It is fundamentally difficult to design a reward function that accurately captures the intended goal in reinforcement learning. It is fundamentally difficult to design areward function that accurately capturesthe intended goal in reinforcementlearning. Last stated 2 years ago 28 Nov 2024 LW Lilian Weng — holds since 2024-11-28 — tap for who they are Same subject: A model should not be called a reasoning model unless it has been trained with reinforcement learning with verifiable rewards. — tap to centre the map on it A model should not be called areasoning model unless it has beentrained with reinforcement learningwith verifiable rewards. Last stated 2 months ago 3 Oct 2026 SR Sebastian Raschka — holds since 2026-10-03 — tap for who they are Same subject: A model trained with reinforcement learning might discover a language of its own that is better for thinking than English. — tap to centre the map on it A model trained with reinforcementlearning might discover a languageof its own that is better forthinking than English. Last stated 2 years ago 5 Feb 2025 AK Andrej Karpathy — holds since 2025-02-05 — tap for who they are Same subject: A verifiable task can be optimised by reinforcement learning until a neural network performs it extremely well. — tap to centre the map on it A verifiable task can be optimisedby reinforcement learning until aneural network performs it extremelywell. Last stated a year ago 17 Nov 2025 AK Andrej Karpathy — holds since 2025-11-17 — tap for who they are Same subject: Anything precise enough to benchmark is also precise enough to optimize for, and modern RL training increasingly resembles the shape of the benchmarks themselves. — tap to centre the map on it Anything precise enough to benchmarkis also precise enough to optimizefor, and modern RL trainingincreasingly resembles the shape ofthe benchmarks themselves. Last stated 7 months ago 16 Apr 2026 SK Sayash Kapoor — holds since 2026-04-16 — tap for who they are Same subject: Before training a base model with RL to emit think tokens, it is better to do some continued pre-training or supervised fine-tuning with those tokens present. — tap to centre the map on it Before training a base model with RLto emit think tokens, it is betterto do some continued pre-training orsupervised fine-tuning with thosetokens present. Last stated a month ago 10 Oct 2026 SR Sebastian Raschka — holds since 2026-10-10 — tap for who they are Same subject: Capability does not generalise for free: a model that will move mountains on an agentic task still tells the same bad joke it told five years ago. — tap to centre the map on it Capability does not generalise forfree: a model that will movemountains on an agentic task stilltells the same bad joke it told fiveyears ago. Last stated 8 months ago 20 Mar 2026 AK Andrej Karpathy — holds since 2026-03-20 — tap for who they are Same subject: Current models are unsafe because they are not smart enough, not because they are too smart. — tap to centre the map on it Current models are unsafe becausethey are not smart enough, notbecause they are too smart. Last stated 2 months ago 13 Sept 2026 FC François Chollet — holds since 2026-09-13 — tap for who they are Same subject: Distillation is simpler than reinforcement learning, but reinforcement learning is the state of the art and distillation a more efficient approximation. — tap to centre the map on it Distillation is simpler thanreinforcement learning, butreinforcement learning is the stateof the art and distillation a moreefficient approximation. Last stated a month ago 17 Oct 2026 SR Sebastian Raschka — holds since 2026-10-17 — tap for who they are Same subject: A company that uses an algorithm to nudge customers into behavior that isn't good for them is doing something bad. — tap to centre the map on it A company that uses an algorithm tonudge customers into behavior thatisn't good for them is doingsomething bad. Last stated a year ago 7 Oct 2025 MM Mr. Money Mustache — holds since 2025-10-07 — tap for who they are Same subject: AI alignment desperately needs good empirical tests that distinguish between the ways things could go, designed so they are not gamed or over-interpreted. — tap to centre the map on it AI alignment desperately needs goodempirical tests that distinguishbetween the ways things could go,designed so they are not gamed orover-interpreted. Last stated 4 years ago 12 May 2023 AC Ajeya Cotra — holds since 2023-05-12 — tap for who they are Same subject: AI chatbots are tuned to produce an answer that feels satisfying to the user rather than one that is correct. — tap to centre the map on it AI chatbots are tuned to produce ananswer that feels satisfying to theuser rather than one that iscorrect. Last stated 2 months ago 15 Sept 2026 ML Michael Lopp — holds since 2026-09-15 — tap for who they are Same subject: AI works best when it solves a specific problem for a particular community rather than trying to be all things to all people. — tap to centre the map on it AI works best when it solves aspecific problem for a particularcommunity rather than trying to beall things to all people. Last stated 7 months ago 28 Apr 2026 AD Anil Dash — holds since 2026-04-28 — tap for who they are Same subject: Aligning multi-agent AI systems is fundamentally a problem of institutional and political design, not model training. — tap to centre the map on it Aligning multi-agent AI systems isfundamentally a problem ofinstitutional and political design,not model training. Last stated 3 months ago 21 Aug 2026 RK Rohit Krishnan — holds since 2026-08-21 — tap for who they are Same subject: Computers and software should always serve the person directly using them, not the interests of third parties. — tap to centre the map on it Computers and software should alwaysserve the person directly usingthem, not the interests of thirdparties. Last stated 4 months ago 31 Jul 2026 AK Andrew Kelley — holds since 2026-07-31 — tap for who they are Same subject: A browser works better as a single window than as multiple separate windows. — tap to centre the map on it A browser works better as a singlewindow than as multiple separatewindows. Last stated 2 months ago 15 Sept 2026 CC Chris Coyier — holds since 2026-09-15 — tap for who they are Same subject: A design has to be kept simple for reliability and intellectual control, but nobody yet knows how to reach simplicity systematically. — tap to centre the map on it A design has to be kept simple forreliability and intellectualcontrol, but nobody yet knows how toreach simplicity systematically. Last stated 28 years ago 1 Mar 1999 ED Edsger W. Dijkstra — holds since 1999-03-01 — tap for who they are Same subject: A designer's edge now is pulling things back, making them simpler and more understandable, because everyone can kind of execute right now. — tap to centre the map on it A designer's edge now is pullingthings back, making them simpler andmore understandable, becauseeveryone can kind of execute rightnow. Last stated 4 months ago 29 Jul 2026 CD Charlie Deets — holds since 2026-07-29 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 1999 to today (stretched back to the oldest claim here) — full is todaya face: someone who holds the claim — tap it for who they are

At the centre It is fundamentally difficult to design a reward function that accurately captures the intended goal in reinforcement learning. Last stated 28 Nov 2024 · 2 years ago Holds Lilian Weng Read this korrent →