Bigger is smarter, always: bringing your special domain knowledge to the model is the wrong side of the bitter lesson.

Added to korrents 11 Mar 2026 · How quotes work · Something wrong? Tell us

Related korrents

Our reading — they may agree, disagree or merely touch the same thing. Closest first: a shared subject counts for most, then how near the wording is.

• “Work on what you know” is the worst advice there is: knowledge can be acquired, but what you love cannot be changed. BSBlake Scholl28 Jul 2026similar wording
• The Bitter Lesson is misread as being about scale; it is about refusing to add human priors, because a clever specific fix always loses to a simple scalable one. NLNathan Lambert3 Feb 2025similar wording
• The knowledge a model soaks up in pre-training is holding it back; what we actually want is the intelligence with the knowledge stripped out. AKAndrej Karpathy17 Oct 2025similar wording
• Copying a trained digital mind into the next one matters far more than learning from people, because no child can inherit another child's learning. RSRichard Sutton26 Sept 2025similar wording
• A bigger context window does not give you a smarter model; the intelligence of the model is what decides how much of that window it can actually attend to. DHDex Horthy15 Jul 2026similar wording

See this on the map →