A model that solves a hard problem has learned nothing from it: the next session has forgotten it, with no new skill to carry to related problems.

Added to korrents 20 Mar 2026 · How quotes work · Something wrong? Tell us

Related korrents

Our reading — they may agree, disagree or merely touch the same thing. Closest first: a shared subject counts for most, then how near the wording is.

• The knowledge a model soaks up in pre-training is holding it back; what we actually want is the intelligence with the knowledge stripped out. AKAndrej Karpathy17 Oct 2025similar wording
• A trained model is a new kind of object that should be taken seriously as an explanation, once we work out the operations to perform on it. MNMichael Nielsen7 Apr 2026similar wording
• You improve a model you cannot retrain by writing better guidelines and skills for it, not by adjusting its parameters. JDJeff Dean30 Jul 2026similar wording
• To reward the instinct that a new idea is worth having, training would have to score the smallness of the concepts a solution needs, not just whether it solved the problem. GSGrant Sanderson30 Jun 2026similar wording
• Capability does not generalise for free: a model that will move mountains on an agentic task still tells the same bad joke it told five years ago. AKAndrej Karpathy20 Mar 2026similar wording

See this on the map →