korrents

On the map

Tap a claim on the ring to put it at the centre.

← Until AI learns from something richer than text, its limited data will…

17 connected korrents · 16 moments from 18 Dec 2020 to 26 Oct 2026.

Everything filed under LLMs LLMs Everything filed under OpenAI OpenAI Everything filed under scaling laws scaling laws Everything filed under open source open source Everything filed under AI slop AI slop Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: Until AI learns from something richer than text, its limited data will leave it struggling with the richness of language. Until AI learns from something richer thantext, its limited data will leave itstruggling with the richness of language. Last stated 6 years ago 18 Dec 2020 MS Marcus du Sautoy — holds since 2020-12-18 — tap for who they are Same subject: Available online text data is becoming a limiting factor for AI training, and repeating it yields diminishing returns. — tap to centre the map on it Available online text data isbecoming a limiting factor for AItraining, and repeating it yieldsdiminishing returns. Last stated 3 years ago 19 Dec 2023 SR Sebastian Ruder — holds since 2023-12-19 — tap for who they are Same subject: Work on large language models is not progress toward artificial general intelligence, because the models do not understand what they read. — tap to centre the map on it Work on large language models is notprogress toward artificial generalintelligence, because the models donot understand what they read. Last stated a year ago 30 Jul 2025 AG Alexey Guzey — holds since 2024-08-09 — tap for who they are AG Alexey Guzey — no longer holds since 2025-07-30 — tap for who they are Same subject: Something genuinely new AI can do is read tens of thousands of pages of context in seconds and use it accurately, which no smart person can. — tap to centre the map on it Something genuinely new AI can do isread tens of thousands of pages ofcontext in seconds and use itaccurately, which no smart personcan. Last stated 3 months ago 23 Aug 2026 SA Sam Altman — holds since 2026-08-23 — tap for who they are Same subject: Computer-use agents had to wait for language models: without pre-trained representations the reward is too sparse to ever learn from. — tap to centre the map on it Computer-use agents had to wait forlanguage models: without pre-trainedrepresentations the reward is toosparse to ever learn from. Last stated a year ago 17 Oct 2025 AK Andrej Karpathy — holds since 2025-10-17 — tap for who they are Same subject: Large language models are broad and impressive but not precise, and are not fundamentally about deep computation. — tap to centre the map on it Large language models are broad andimpressive but not precise, and arenot fundamentally about deepcomputation. Last stated 9 months ago 23 Feb 2026 SW Stephen Wolfram — holds since 2026-02-23 — tap for who they are Same subject: The current capabilities of existing AI models are barely being used and are often not even well understood. — tap to centre the map on it The current capabilities of existingAI models are barely being used andare often not even well understood. Last stated 2 months ago 18 Sept 2026 EM Ethan Mollick — holds since 2026-09-18 — tap for who they are Same subject: The knowledge a model soaks up in pre-training is holding it back; what we actually want is the intelligence with the knowledge stripped out. — tap to centre the map on it The knowledge a model soaks up inpre-training is holding it back;what we actually want is theintelligence with the knowledgestripped out. Last stated a year ago 17 Oct 2025 AK Andrej Karpathy — holds since 2025-10-17 — tap for who they are Same subject: There is a risk that reading will be devalued due to low-quality AI-generated text. — tap to centre the map on it There is a risk that reading will bedevalued due to low-qualityAI-generated text. Last stated 2 months ago 26 Sept 2026 GR Guillermo Rauch — holds since 2026-09-26 — tap for who they are Same subject: A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week. — tap to centre the map on it A PHP vulnerability found withGPT-5.6 Sol will cause havoc thisweek. Last stated a month ago 21 Oct 2026 PS Peter Steinberger — holds since 2026-10-21 — tap for who they are Same subject: A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests. — tap to centre the map on it A startup should not begin life as anonprofit and bolt a for-profit armon later, whatever OpenAI's ownhistory suggests. Last stated 3 years ago 18 Mar 2024 SA Sam Altman — holds since 2024-03-18 — tap for who they are Same subject: Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers. — tap to centre the map on it Advertising was a necessary phasefor the internet but a momentaryindustry, and an AI people pay foris better because they know theanswers are not influenced byadvertisers. Last stated 3 years ago 18 Mar 2024 SA Sam Altman — holds since 2024-03-18 — tap for who they are Same subject: "Scaling" was powerful because it was one word: naming a research direction is what tells a whole field what to do next. — tap to centre the map on it "Scaling" was powerful because itwas one word: naming a researchdirection is what tells a wholefield what to do next. Last stated 12 months ago 25 Nov 2025 IS Ilya Sutskever — holds since 2025-11-25 — tap for who they are Same subject: A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number. — tap to centre the map on it A benchmark result should bereported under a stated budget, oras a curve against test-time compute— never as a single number. Last stated 5 months ago 26 Jun 2026 NB Noam Brown — holds since 2026-06-26 — tap for who they are Same subject: A CPU and memory crunch is coming. — tap to centre the map on it A CPU and memory crunch is coming. Last stated 4 weeks ago 26 Oct 2026 DM Dillon Mulroy — holds since 2026-10-26 — tap for who they are Same subject: A business making hundreds of millions from an open source project owes it money or contribution, and can be refused its trademarks if it gives neither. — tap to centre the map on it A business making hundreds ofmillions from an open source projectowes it money or contribution, andcan be refused its trademarks if itgives neither. Last stated 2 years ago 26 Sept 2024 MM Matt Mullenweg — holds since 2024-09-26 — tap for who they are Same subject: A codec does not really exist until everyone can decode it. — tap to centre the map on it A codec does not really exist untileveryone can decode it. Last stated 6 months ago 31 May 2026 JK Jean-Baptiste Kempf — holds since 2026-05-31 — tap for who they are Same subject: A company that will not accept a project’s terms is free to go and use a more permissive project instead. — tap to centre the map on it A company that will not accept aproject’s terms is free to go anduse a more permissive projectinstead. Last stated 2 years ago 26 Sept 2024 MM Matt Mullenweg — holds since 2024-09-26 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 2015 to today — full is todaya face: someone who holds the claim — tap it for who they arefaded, dashed ring: they no longer hold it — they changed their mind

At the centre Until AI learns from something richer than text, its limited data will leave it struggling with the richness of language. Last stated 18 Dec 2020 · 6 years ago Holds Marcus du Sautoy Read this korrent →