korrents

On the map

Tap a claim on the ring to put it at the centre.

← Math, code and multilingual data in GPT-2's training set may have taken capacity away from English performance.

17 connected korrents · 13 moments from 15 Nov 2023 to 2 Nov 2026.

Everything filed under LLMs LLMs Everything filed under OpenAI OpenAI Everything filed under Anthropic Anthropic Everything filed under open source open source Everything filed under benchmarks benchmarks Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: Math, code and multilingual data in GPT-2's training set may have taken capacity away from English performance. Math, code and multilingual data inGPT-2's training set may have takencapacity away from English performance. Last stated 2 years ago 9 Jun 2024 AK Andrej Karpathy — holds since 2024-06-09 — tap for who they are Same subject: HellaSwag is largely solved by today's language models; the remaining few percent are probably dataset errors or very hard questions. — tap to centre the map on it HellaSwag is largely solved bytoday's language models; theremaining few percent are probablydataset errors or very hardquestions. Last stated 2 years ago 9 Jun 2024 AK Andrej Karpathy — holds since 2024-06-09 — tap for who they are Same subject: Proprietary data is not an advantage in training large language models, because no company's holdings are large enough to matter. — tap to centre the map on it Proprietary data is not an advantagein training large language models,because no company's holdings arelarge enough to matter. Last stated a year ago 2 Sept 2025 BE Benedict Evans — holds since 2025-09-02 — tap for who they are Same subject: An answer computed by a Python program deserves more trust than a language model's mental arithmetic. — tap to centre the map on it An answer computed by a Pythonprogram deserves more trust than alanguage model's mental arithmetic. Last stated 2 years ago 5 Feb 2025 AK Andrej Karpathy — holds since 2025-02-05 — tap for who they are Same subject: Language models should be thought of as somewhat out of date, because pre-training is too expensive to repeat often. — tap to centre the map on it Language models should be thought ofas somewhat out of date, becausepre-training is too expensive torepeat often. Last stated 2 years ago 27 Feb 2025 AK Andrej Karpathy — holds since 2025-02-27 — tap for who they are Same subject: Chinese labs more likely distill from US models because it is easier than getting more compute, not because it is decisive. — tap to centre the map on it Chinese labs more likely distillfrom US models because it is easierthan getting more compute, notbecause it is decisive. Last stated 4 weeks ago 26 Oct 2026 NL Nathan Lambert — holds since 2026-10-26 — tap for who they are Same subject: Language models perform better on benchmark problems released before their training data cutoff, indicating data contamination inflates scores. — tap to centre the map on it Language models perform better onbenchmark problems released beforetheir training data cutoff,indicating data contaminationinflates scores. Last stated 3 years ago 13 May 2024 SR Sebastian Ruder — holds since 2024-05-13 — tap for who they are Same subject: Models fine-tuned to imitate another model's outputs copy its style without acquiring its factual accuracy. — tap to centre the map on it Models fine-tuned to imitate anothermodel's outputs copy its stylewithout acquiring its factualaccuracy. Last stated 3 years ago 15 Nov 2023 SR Sebastian Ruder — holds since 2023-11-15 — tap for who they are Same subject: GPT-3's learning-rate warm-up is very mild and could probably be made significantly more aggressive. — tap to centre the map on it GPT-3's learning-rate warm-up isvery mild and could probably be madesignificantly more aggressive. Last stated 2 years ago 9 Jun 2024 AK Andrej Karpathy — holds since 2024-06-09 — tap for who they are Same subject: A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week. — tap to centre the map on it A PHP vulnerability found withGPT-5.6 Sol will cause havoc thisweek. Last stated a month ago 21 Oct 2026 PS Peter Steinberger — holds since 2026-10-21 — tap for who they are Same subject: A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests. — tap to centre the map on it A startup should not begin life as anonprofit and bolt a for-profit armon later, whatever OpenAI's ownhistory suggests. Last stated 3 years ago 18 Mar 2024 SA Sam Altman — holds since 2024-03-18 — tap for who they are Same subject: Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers. — tap to centre the map on it Advertising was a necessary phasefor the internet but a momentaryindustry, and an AI people pay foris better because they know theanswers are not influenced byadvertisers. Last stated 3 years ago 18 Mar 2024 SA Sam Altman — holds since 2024-03-18 — tap for who they are Same subject: A business making hundreds of millions from an open source project owes it money or contribution, and can be refused its trademarks if it gives neither. — tap to centre the map on it A business making hundreds ofmillions from an open source projectowes it money or contribution, andcan be refused its trademarks if itgives neither. Last stated 2 years ago 26 Sept 2024 MM Matt Mullenweg — holds since 2024-09-26 — tap for who they are Same subject: A codec does not really exist until everyone can decode it. — tap to centre the map on it A codec does not really exist untileveryone can decode it. Last stated 6 months ago 31 May 2026 JK Jean-Baptiste Kempf — holds since 2026-05-31 — tap for who they are Same subject: A company that will not accept a project’s terms is free to go and use a more permissive project instead. — tap to centre the map on it A company that will not accept aproject’s terms is free to go anduse a more permissive projectinstead. Last stated 2 years ago 26 Sept 2024 MM Matt Mullenweg — holds since 2024-09-26 — tap for who they are Same subject: "I don't know" becomes a kind of superpower when you can work with Claude Code to figure things out. — tap to centre the map on it "I don't know" becomes a kind ofsuperpower when you can work withClaude Code to figure things out. Last stated 8 months ago 19 Mar 2026 KP Kris Puckett — holds since 2026-03-19 — tap for who they are Same subject: A large share of Anthropic's revenue being consumption-based rather than subscriptions raises the question of how resilient that revenue is. — tap to centre the map on it A large share of Anthropic's revenuebeing consumption-based rather thansubscriptions raises the question ofhow resilient that revenue is. Last stated 3 weeks ago 2 Nov 2026 AA Azeem Azhar — holds since 2026-11-02 — tap for who they are Same subject: A skill is a set of repeatable, specific instructions that augments what Claude Code can do. — tap to centre the map on it A skill is a set of repeatable,specific instructions that augmentswhat Claude Code can do. Last stated 8 months ago 19 Mar 2026 KP Kris Puckett — holds since 2026-03-19 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 2015 to today — full is todaya face: someone who holds the claim — tap it for who they are

At the centre Math, code and multilingual data in GPT-2's training set may have taken capacity away from English performance. Last stated 9 Jun 2024 · 2 years ago Holds Andrej Karpathy Read this korrent →