korrents

← A model that solves a hard problem has learned nothing from it: the…

On the map

8 connected korrents · 9 moments on record from 19 Sept 2024 to 30 Jul 2026.

Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject A model that solves a hardproblem has learned nothingfrom it: the next session… TT Terence Tao — holds since 2026-03-20 The knowledge a model soaks up in pre-training is holding it back; what we actually want is the intelligence with the knowledge stripped out. The knowledge a modelsoaks up in… AK Andrej Karpathy — holds since 2025-10-17 A trained model is a new kind of object that should be taken seriously as an explanation, once we work out the operations to perform on it. A trained model is anew kind of object that… MN Michael Nielsen — holds since 2026-04-07 You improve a model you cannot retrain by writing better guidelines and skills for it, not by adjusting its parameters. You improve a model youcannot retrain by… JD Jeff Dean — holds since 2026-07-30 To reward the instinct that a new idea is worth having, training would have to score the smallness of the concepts a solution needs, not just whether it solved the problem. To reward the instinctthat a new idea is… GS Grant Sanderson — holds since 2026-06-30 Capability does not generalise for free: a model that will move mountains on an agentic task still tells the same bad joke it told five years ago. Capability does notgeneralise for free: a… AK Andrej Karpathy — holds since 2026-03-20 Struggling with a hard problem before being shown the answer is not always the best way to learn; a hint or a worked example can beat floundering. Struggling with a hardproblem before being… SY Scott H. Young — turned since 2026-07-22 Biology keeps turning up whole classes of things nobody knew existed, and that is what defeats attempts to model it. Biology keeps turningup whole classes of… DL Derek Lowe — holds since 2024-09-19 Solving a problem yourself, without searching or prompting, is a form of exercise -- the help makes you weaker. Solving a problemyourself, without… SY Scott H. Young — holds since 2025-11-18 DS Derek Sivers — holds since 2026-03-03
same subject