Pre-training is a crappy evolution: the practically buildable substitute for the process that gave animals their built-in hardware.

Added to korrents 17 Oct 2025 · How quotes work · Something wrong? Tell us

Related korrents

Our reading — they may agree, disagree or merely touch the same thing. Closest first: a shared subject counts for most, then how near the wording is.

• Models resemble each other because pre-training is the same everywhere; what differentiates labs now is RL and post-training. ISIlya Sutskever25 Nov 2025scaling lawsreinforcement learning
• One pre-trained robot model now matches or beats the specialists that were fine-tuned with reinforcement learning for the very tasks they were built for. CFChelsea Finn12 Aug 2026scaling lawsreinforcement learning
• RL environments exist to make a model generalise, not to teach it each skill one at a time — exactly as pre-training does. DADario Amodei13 Feb 2026scaling lawsreinforcement learning
• A verifiable task can be optimised by reinforcement learning until a neural network performs it extremely well. AKAndrej Karpathy17 Nov 2025reinforcement learning
• Capability does not generalise for free: a model that will move mountains on an agentic task still tells the same bad joke it told five years ago. AKAndrej Karpathy20 Mar 2026reinforcement learning

On the map

Open the map on its own page →