Tap a claim on the ring to put it at the centre.
← Math, code and multilingual data in GPT-2's training set may have taken capacity away from English performance.
17 connected korrents · 13 moments from 15 Nov 2023 to 2 Nov 2026.
Everything filed under LLMs
LLMs
Everything filed under OpenAI
OpenAI
Everything filed under Anthropic
Anthropic
Everything filed under open source
open source
Everything filed under benchmarks
benchmarks
Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject
Read this korrent: Math, code and multilingual data in GPT-2's training set may have taken capacity away from English performance.
Math, code and multilingual data in GPT-2's training set may have taken capacity away from English performance.
Last stated 2 years ago
9 Jun 2024
AK
Andrej Karpathy — holds since 2024-06-09 — tap for who they are
Same subject: HellaSwag is largely solved by today's language models; the remaining few percent are probably dataset errors or very hard questions. — tap to centre the map on it
HellaSwag is largely solved by today's language models; the remaining few percent are probably dataset errors or very hard questions.
Last stated 2 years ago
9 Jun 2024
AK
Andrej Karpathy — holds since 2024-06-09 — tap for who they are
Same subject: Proprietary data is not an advantage in training large language models, because no company's holdings are large enough to matter. — tap to centre the map on it
Proprietary data is not an advantage in training large language models, because no company's holdings are large enough to matter.
Last stated a year ago
2 Sept 2025
BE
Benedict Evans — holds since 2025-09-02 — tap for who they are
Same subject: An answer computed by a Python program deserves more trust than a language model's mental arithmetic. — tap to centre the map on it
An answer computed by a Python program deserves more trust than a language model's mental arithmetic.
Last stated 2 years ago
5 Feb 2025
AK
Andrej Karpathy — holds since 2025-02-05 — tap for who they are
Same subject: Language models should be thought of as somewhat out of date, because pre-training is too expensive to repeat often. — tap to centre the map on it
Language models should be thought of as somewhat out of date, because pre-training is too expensive to repeat often.
Last stated 2 years ago
27 Feb 2025
AK
Andrej Karpathy — holds since 2025-02-27 — tap for who they are
Same subject: Chinese labs more likely distill from US models because it is easier than getting more compute, not because it is decisive. — tap to centre the map on it
Chinese labs more likely distill from US models because it is easier than getting more compute, not because it is decisive.
Last stated 4 weeks ago
26 Oct 2026
NL
Nathan Lambert — holds since 2026-10-26 — tap for who they are
Same subject: Language models perform better on benchmark problems released before their training data cutoff, indicating data contamination inflates scores. — tap to centre the map on it
Language models perform better on benchmark problems released before their training data cutoff, indicating data contamination inflates scores.
Last stated 3 years ago
13 May 2024
SR
Sebastian Ruder — holds since 2024-05-13 — tap for who they are
Same subject: Models fine-tuned to imitate another model's outputs copy its style without acquiring its factual accuracy. — tap to centre the map on it
Models fine-tuned to imitate another model's outputs copy its style without acquiring its factual accuracy.
Last stated 3 years ago
15 Nov 2023
SR
Sebastian Ruder — holds since 2023-11-15 — tap for who they are
Same subject: GPT-3's learning-rate warm-up is very mild and could probably be made significantly more aggressive. — tap to centre the map on it
GPT-3's learning-rate warm-up is very mild and could probably be made significantly more aggressive.
Last stated 2 years ago
9 Jun 2024
AK
Andrej Karpathy — holds since 2024-06-09 — tap for who they are
Same subject: A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week. — tap to centre the map on it
A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week.
Last stated a month ago
21 Oct 2026
PS
Peter Steinberger — holds since 2026-10-21 — tap for who they are
Same subject: A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests. — tap to centre the map on it
A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests.
Last stated 3 years ago
18 Mar 2024
SA
Sam Altman — holds since 2024-03-18 — tap for who they are
Same subject: Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers. — tap to centre the map on it
Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers.
Last stated 3 years ago
18 Mar 2024
SA
Sam Altman — holds since 2024-03-18 — tap for who they are
Same subject: A business making hundreds of millions from an open source project owes it money or contribution, and can be refused its trademarks if it gives neither. — tap to centre the map on it
A business making hundreds of millions from an open source project owes it money or contribution, and can be refused its trademarks if it gives neither.
Last stated 2 years ago
26 Sept 2024
MM
Matt Mullenweg — holds since 2024-09-26 — tap for who they are
Same subject: A codec does not really exist until everyone can decode it. — tap to centre the map on it
A codec does not really exist until everyone can decode it.
Last stated 6 months ago
31 May 2026
JK
Jean-Baptiste Kempf — holds since 2026-05-31 — tap for who they are
Same subject: A company that will not accept a project’s terms is free to go and use a more permissive project instead. — tap to centre the map on it
A company that will not accept a project’s terms is free to go and use a more permissive project instead.
Last stated 2 years ago
26 Sept 2024
MM
Matt Mullenweg — holds since 2024-09-26 — tap for who they are
Same subject: "I don't know" becomes a kind of superpower when you can work with Claude Code to figure things out. — tap to centre the map on it
"I don't know" becomes a kind of superpower when you can work with Claude Code to figure things out.
Last stated 8 months ago
19 Mar 2026
KP
Kris Puckett — holds since 2026-03-19 — tap for who they are
Same subject: A large share of Anthropic's revenue being consumption-based rather than subscriptions raises the question of how resilient that revenue is. — tap to centre the map on it
A large share of Anthropic's revenue being consumption-based rather than subscriptions raises the question of how resilient that revenue is.
Last stated 3 weeks ago
2 Nov 2026
AA
Azeem Azhar — holds since 2026-11-02 — tap for who they are
Same subject: A skill is a set of repeatable, specific instructions that augments what Claude Code can do. — tap to centre the map on it
A skill is a set of repeatable, specific instructions that augments what Claude Code can do.
Last stated 8 months ago
19 Mar 2026
KP
Kris Puckett — holds since 2026-03-19 — tap for who they are
same subject or similar wording a cloud: claims about one subject, named for it bar: when it was last stated, on a scale from 2015 to today — full is today a face: someone who holds the claim — tap it for who they are