korrents

On the map

Tap a claim on the ring to put it at the centre.

← Common Crawl on its own is not a high-quality dataset: it is extremely noisy, much worse than you think.

17 connected korrents · 16 moments from 15 Mar 2024 to 26 Oct 2026.

Everything filed under LLMs LLMs Everything filed under scaling laws scaling laws Everything filed under open source open source Everything filed under OpenAI OpenAI Everything filed under Addiction Addiction Everything filed under AI slop AI slop Everything filed under metascience metascience Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: Common Crawl on its own is not a high-quality dataset: it is extremely noisy, much worse than you think. Common Crawl on its own is not ahigh-quality dataset: it is extremelynoisy, much worse than you think. Last stated 2 years ago 9 Jun 2024 AK Andrej Karpathy — holds since 2024-06-09 — tap for who they are Same subject: Models are enormous only because the internet is bad: most of that capacity does memory work, and a better dataset would need far less of it. — tap to centre the map on it Models are enormous only because theinternet is bad: most of thatcapacity does memory work, and abetter dataset would need far lessof it. Last stated a year ago 17 Oct 2025 AK Andrej Karpathy — holds since 2025-10-17 — tap for who they are Same subject: The internet is already past peak truth, and picking out training data worth learning from will only get harder. — tap to centre the map on it The internet is already past peaktruth, and picking out training dataworth learning from will only getharder. Last stated 6 months ago 13 May 2026 AH Anders Hejlsberg — holds since 2026-05-13 — tap for who they are Same subject: Proprietary data is not an advantage in training large language models, because no company's holdings are large enough to matter. — tap to centre the map on it Proprietary data is not an advantagein training large language models,because no company's holdings arelarge enough to matter. Last stated a year ago 2 Sept 2025 BE Benedict Evans — holds since 2025-09-02 — tap for who they are Same subject: X's algorithmic feed is not healthy for society: it surfaces addictive content and demotes nuance and smaller voices. — tap to centre the map on it X's algorithmic feed is not healthyfor society: it surfaces addictivecontent and demotes nuance andsmaller voices. Last stated 3 years ago 15 Mar 2024 EM Eoghan McCabe — holds since 2024-03-15 — tap for who they are Same subject: The same content rot that degraded web search will eventually come for AI answers. — tap to centre the map on it The same content rot that degradedweb search will eventually come forAI answers. Last stated 3 months ago 14 Aug 2026 HW Hadley Wickham — holds since 2026-08-14 — tap for who they are Same subject: If everyone publishing retrospective chart reviews had to post their data set, many would be exposed. — tap to centre the map on it If everyone publishing retrospectivechart reviews had to post their dataset, many would be exposed. Last stated 4 weeks ago 25 Oct 2026 VP Vinay Prasad — holds since 2026-10-25 — tap for who they are Same subject: AI labs used the web's data while ignoring copyright, yet object when others distill their models for training data. — tap to centre the map on it AI labs used the web's data whileignoring copyright, yet object whenothers distill their models fortraining data. Last stated 3 months ago 1 Sept 2026 NE NeetCode — holds since 2026-09-01 — tap for who they are Same subject: The bargain that funded the open web was that a crawler could take your pages because it would send you readers; an AI crawler that sends nobody has broken it. — tap to centre the map on it The bargain that funded the open webwas that a crawler could take yourpages because it would send youreaders; an AI crawler that sendsnobody has broken it. Last stated 8 months ago 27 Mar 2026 AD Anil Dash — holds since 2026-03-27 — tap for who they are Same subject: A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week. — tap to centre the map on it A PHP vulnerability found withGPT-5.6 Sol will cause havoc thisweek. Last stated a month ago 21 Oct 2026 PS Peter Steinberger — holds since 2026-10-21 — tap for who they are Same subject: A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests. — tap to centre the map on it A startup should not begin life as anonprofit and bolt a for-profit armon later, whatever OpenAI's ownhistory suggests. Last stated 3 years ago 18 Mar 2024 SA Sam Altman — holds since 2024-03-18 — tap for who they are Same subject: Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers. — tap to centre the map on it Advertising was a necessary phasefor the internet but a momentaryindustry, and an AI people pay foris better because they know theanswers are not influenced byadvertisers. Last stated 3 years ago 18 Mar 2024 SA Sam Altman — holds since 2024-03-18 — tap for who they are Same subject: "Scaling" was powerful because it was one word: naming a research direction is what tells a whole field what to do next. — tap to centre the map on it "Scaling" was powerful because itwas one word: naming a researchdirection is what tells a wholefield what to do next. Last stated 12 months ago 25 Nov 2025 IS Ilya Sutskever — holds since 2025-11-25 — tap for who they are Same subject: A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number. — tap to centre the map on it A benchmark result should bereported under a stated budget, oras a curve against test-time compute— never as a single number. Last stated 5 months ago 26 Jun 2026 NB Noam Brown — holds since 2026-06-26 — tap for who they are Same subject: A CPU and memory crunch is coming. — tap to centre the map on it A CPU and memory crunch is coming. Last stated 4 weeks ago 26 Oct 2026 DM Dillon Mulroy — holds since 2026-10-26 — tap for who they are Same subject: A business making hundreds of millions from an open source project owes it money or contribution, and can be refused its trademarks if it gives neither. — tap to centre the map on it A business making hundreds ofmillions from an open source projectowes it money or contribution, andcan be refused its trademarks if itgives neither. Last stated 2 years ago 26 Sept 2024 MM Matt Mullenweg — holds since 2024-09-26 — tap for who they are Same subject: A codec does not really exist until everyone can decode it. — tap to centre the map on it A codec does not really exist untileveryone can decode it. Last stated 6 months ago 31 May 2026 JK Jean-Baptiste Kempf — holds since 2026-05-31 — tap for who they are Same subject: A company that will not accept a project’s terms is free to go and use a more permissive project instead. — tap to centre the map on it A company that will not accept aproject’s terms is free to go anduse a more permissive projectinstead. Last stated 2 years ago 26 Sept 2024 MM Matt Mullenweg — holds since 2024-09-26 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 2015 to today — full is todaya face: someone who holds the claim — tap it for who they are

At the centre Common Crawl on its own is not a high-quality dataset: it is extremely noisy, much worse than you think. Last stated 9 Jun 2024 · 2 years ago Holds Andrej Karpathy Read this korrent →