korrents

On the map

Tap a claim on the ring to put it at the centre.

← The argument that RAG and long context make fine-tuning unnecessary…

17 connected korrents · 15 moments from 8 Aug 2023 to 5 Nov 2026.

Everything filed under LLMs LLMs Everything filed under scaling laws scaling laws Everything filed under open source open source Everything filed under OpenAI OpenAI Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: The argument that RAG and long context make fine-tuning unnecessary holds when information is missing, but not when the model struggles with the task itself. The argument that RAG and long contextmake fine-tuning unnecessary holds wheninformation is missing, but not when themodel struggles with the task itself. Last stated 2 weeks ago 5 Nov 2026 AR Aishwarya Naresh Reganti — holds since 2026-11-05 — tap for who they are Same subject: A large context window does not replace fine-tuning, because fine-tuning serves the separate purpose of instilling preferences and demonstrating a task. — tap to centre the map on it A large context window does notreplace fine-tuning, becausefine-tuning serves the separatepurpose of instilling preferencesand demonstrating a task. Last stated 3 years ago 22 Mar 2024 EG Elad Gil — holds since 2024-03-22 — tap for who they are Same subject: What sits in a model's context is far clearer to it than its training data, which is trillions of tokens stirred into a soup of parameters. — tap to centre the map on it What sits in a model's context isfar clearer to it than its trainingdata, which is trillions of tokensstirred into a soup of parameters. Last stated 4 months ago 30 Jul 2026 JD Jeff Dean — holds since 2026-07-30 — tap for who they are Same subject: Fine-tuning-based alignment does not remove a model's worrying knowledge and abilities; it only teaches the model not to output them. — tap to centre the map on it Fine-tuning-based alignment does notremove a model's worrying knowledgeand abilities; it only teaches themodel not to output them. Last stated 3 years ago 8 Aug 2023 DA Dario Amodei — holds since 2023-08-08 — tap for who they are Same subject: Full fine-tuning of large language models has become too costly, making parameter-efficient fine-tuning methods necessary. — tap to centre the map on it Full fine-tuning of large languagemodels has become too costly, makingparameter-efficient fine-tuningmethods necessary. Last stated 3 years ago 5 Dec 2023 SR Sebastian Ruder — holds since 2023-12-05 — tap for who they are Same subject: Automatic context given to coding models should clear a high bar for accuracy and relevance, since more context makes them slower, costlier and more confused. — tap to centre the map on it Automatic context given to codingmodels should clear a high bar foraccuracy and relevance, since morecontext makes them slower, costlierand more confused. Last stated 2 years ago 6 Oct 2024 MT Michael Truell — holds since 2024-10-06 — tap for who they are Same subject: Language models should be thought of as somewhat out of date, because pre-training is too expensive to repeat often. — tap to centre the map on it Language models should be thought ofas somewhat out of date, becausepre-training is too expensive torepeat often. Last stated 2 years ago 27 Feb 2025 AK Andrej Karpathy — holds since 2025-02-27 — tap for who they are Same subject: Long-context evaluation benchmarks are likely contaminated by model training data, making them unreliable as a sole evaluation method — tap to centre the map on it Long-context evaluation benchmarksare likely contaminated by modeltraining data, making themunreliable as a sole evaluationmethod Last stated a year ago 22 Jun 2025 EY Eugene Yan — holds since 2025-06-22 — tap for who they are Same subject: Fine-tuning is probably not dead, but companies should not rush into it because many underestimate the data it requires. — tap to centre the map on it Fine-tuning is probably not dead,but companies should not rush intoit because many underestimate thedata it requires. Last stated 2 weeks ago 5 Nov 2026 AR Aishwarya Naresh Reganti — holds since 2026-11-05 — tap for who they are Same subject: A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week. — tap to centre the map on it A PHP vulnerability found withGPT-5.6 Sol will cause havoc thisweek. Last stated a month ago 21 Oct 2026 PS Peter Steinberger — holds since 2026-10-21 — tap for who they are Same subject: A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests. — tap to centre the map on it A startup should not begin life as anonprofit and bolt a for-profit armon later, whatever OpenAI's ownhistory suggests. Last stated 3 years ago 18 Mar 2024 SA Sam Altman — holds since 2024-03-18 — tap for who they are Same subject: Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers. — tap to centre the map on it Advertising was a necessary phasefor the internet but a momentaryindustry, and an AI people pay foris better because they know theanswers are not influenced byadvertisers. Last stated 3 years ago 18 Mar 2024 SA Sam Altman — holds since 2024-03-18 — tap for who they are Same subject: "Scaling" was powerful because it was one word: naming a research direction is what tells a whole field what to do next. — tap to centre the map on it "Scaling" was powerful because itwas one word: naming a researchdirection is what tells a wholefield what to do next. Last stated 12 months ago 25 Nov 2025 IS Ilya Sutskever — holds since 2025-11-25 — tap for who they are Same subject: A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number. — tap to centre the map on it A benchmark result should bereported under a stated budget, oras a curve against test-time compute— never as a single number. Last stated 5 months ago 26 Jun 2026 NB Noam Brown — holds since 2026-06-26 — tap for who they are Same subject: A CPU and memory crunch is coming. — tap to centre the map on it A CPU and memory crunch is coming. Last stated 4 weeks ago 26 Oct 2026 DM Dillon Mulroy — holds since 2026-10-26 — tap for who they are Same subject: A business making hundreds of millions from an open source project owes it money or contribution, and can be refused its trademarks if it gives neither. — tap to centre the map on it A business making hundreds ofmillions from an open source projectowes it money or contribution, andcan be refused its trademarks if itgives neither. Last stated 2 years ago 26 Sept 2024 MM Matt Mullenweg — holds since 2024-09-26 — tap for who they are Same subject: A codec does not really exist until everyone can decode it. — tap to centre the map on it A codec does not really exist untileveryone can decode it. Last stated 6 months ago 31 May 2026 JK Jean-Baptiste Kempf — holds since 2026-05-31 — tap for who they are Same subject: A company that will not accept a project’s terms is free to go and use a more permissive project instead. — tap to centre the map on it A company that will not accept aproject’s terms is free to go anduse a more permissive projectinstead. Last stated 2 years ago 26 Sept 2024 MM Matt Mullenweg — holds since 2024-09-26 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 2015 to today — full is todaya face: someone who holds the claim — tap it for who they are

At the centre The argument that RAG and long context make fine-tuning unnecessary holds when information is missing, but not when the model struggles with the task itself. Last stated 5 Nov 2026 · 2 weeks ago Holds Aishwarya Naresh Reganti Read this korrent →