Tap a claim on the ring to put it at the centre.
← It is empirically true that larger models and larger datasets learn more knowledge.
17 connected korrents · 17 moments from 16 Jan 2015 to 10 Oct 2026.
Everything filed under scaling laws
scaling laws
Everything filed under LLMs
LLMs
Everything filed under benchmarks
benchmarks
Everything filed under neural networks
neural networks
Everything filed under reinforcement learning
reinforcement learning
Everything filed under AI and science
AI and science
Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject
Read this korrent: It is empirically true that larger models and larger datasets learn more knowledge.
It is empirically true that larger models and larger datasets learn more knowledge.
Last stated 2 years ago
27 Jan 2025
JH
Jensen Huang — holds since 2025-01-27 — tap for who they are
Same subject: Bigger is smarter, always: bringing your special domain knowledge to the model is the wrong side of the bitter lesson. — tap to centre the map on it
Bigger is smarter, always: bringing your special domain knowledge to the model is the wrong side of the bitter lesson.
Last stated 8 months ago
11 Mar 2026
SY
Steve Yegge — holds since 2026-03-11 — tap for who they are
Same subject: Larger language models already have enough capacity that extra per-layer embedding tricks add little benefit to them. — tap to centre the map on it
Larger language models already have enough capacity that extra per-layer embedding tricks add little benefit to them.
Last stated 6 months ago
16 May 2026
SR
Sebastian Raschka — holds since 2026-05-16 — tap for who they are
Same subject: Understanding a machine learning model and understanding the data it operates on are inseparable tasks. — tap to centre the map on it
Understanding a machine learning model and understanding the data it operates on are inseparable tasks.
Last stated 12 years ago
16 Jan 2015
CO
Christopher Olah — holds since 2015-01-16 — tap for who they are
Same subject: Given good data, room to operate and sound numerical conditioning, models will learn on their own. — tap to centre the map on it
Given good data, room to operate and sound numerical conditioning, models will learn on their own.
Last stated 3 years ago
8 Aug 2023
DA
Dario Amodei — holds since 2023-08-08 — tap for who they are
Same subject: Data is becoming more valuable not only for training models but as a complement to cheaper intelligence. — tap to centre the map on it
Data is becoming more valuable not only for training models but as a complement to cheaper intelligence.
Last stated a month ago
9 Oct 2026
PC
Patrick Collison — holds since 2026-10-09 — tap for who they are
Same subject: The only reliable way to improve an AI model's reasoning today is to train it on more data and make it bigger. — tap to centre the map on it
The only reliable way to improve an AI model's reasoning today is to train it on more data and make it bigger.
Last stated 3 years ago
22 Mar 2024
EG
Elad Gil — holds since 2024-03-22 — tap for who they are
Same subject: The scaling curve really is S-shaped, but there are at least two cycles left in it, which means models sixteen times smarter and all knowledge work subsumed. — tap to centre the map on it
The scaling curve really is S-shaped, but there are at least two cycles left in it, which means models sixteen times smarter and all knowledge work subsumed.
Last stated 8 months ago
11 Mar 2026
SY
Steve Yegge — holds since 2026-03-11 — tap for who they are
Same subject: Training a model on principles rather than a list of rules is not an ideology but an empirical finding: its behaviour is more consistent and covers edge cases. — tap to centre the map on it
Training a model on principles rather than a list of rules is not an ideology but an empirical finding: its behaviour is more consistent and covers edge cases.
Last stated 9 months ago
13 Feb 2026
DA
Dario Amodei — holds since 2026-02-13 — tap for who they are
Same subject: A feedback loop that reinforces a behavior pulls it toward whatever improves the loop's own score. — tap to centre the map on it
A feedback loop that reinforces a behavior pulls it toward whatever improves the loop's own score.
Last stated 3 months ago
26 Aug 2026
HK
Henrik Karlsson — holds since 2026-08-26 — tap for who they are
Same subject: A format reward should only be added when the answer is already correct. — tap to centre the map on it
A format reward should only be added when the answer is already correct.
Last stated a month ago
10 Oct 2026
SR
Sebastian Raschka — holds since 2026-10-10 — tap for who they are
Same subject: A model should not be called a reasoning model unless it has been trained with reinforcement learning with verifiable rewards. — tap to centre the map on it
A model should not be called a reasoning model unless it has been trained with reinforcement learning with verifiable rewards.
Last stated 2 months ago
3 Oct 2026
SR
Sebastian Raschka — holds since 2026-10-03 — tap for who they are
Same subject: A curve, which is what a deep learning model is, is a very bad substrate for discrete computation. — tap to centre the map on it
A curve, which is what a deep learning model is, is a very bad substrate for discrete computation.
Last stated 2 years ago
6 Nov 2024
FC
François Chollet — holds since 2024-11-06 — tap for who they are
Same subject: A layer should learn a residual with reference to its own input rather than an unreferenced function, which is what makes great depth trainable. — tap to centre the map on it
A layer should learn a residual with reference to its own input rather than an unreferenced function, which is what makes great depth trainable.
Last stated 11 years ago
10 Dec 2015
JS
Jian Sun — holds since 2015-12-10 — tap for who they are
KH
Kaiming He — holds since 2015-12-10 — tap for who they are
Same subject: A project-level agent memory file works like a neural net, steering the agent much as a fine-tuned LoRA steers a model. — tap to centre the map on it
A project-level agent memory file works like a neural net, steering the agent much as a fine-tuned LoRA steers a model.
Last stated 3 months ago
23 Aug 2026
KC
Kun Chen — holds since 2026-08-23 — tap for who they are
Same subject: 'Everyone gets it wrong sometimes' is a bad argument when assessing track records. — tap to centre the map on it
'Everyone gets it wrong sometimes' is a bad argument when assessing track records.
Last stated 4 months ago
2 Aug 2026
AK
Adam Kucharski — holds since 2026-08-02 — tap for who they are
Same subject: A benchmark that ranks Claude Code last while it stays first in use is measuring the wrong thing, and has been for a year. — tap to centre the map on it
A benchmark that ranks Claude Code last while it stays first in use is measuring the wrong thing, and has been for a year.
Last stated 3 months ago
3 Sept 2026
DR
Dax Raad — holds since 2026-09-03 — tap for who they are
Same subject: A carmaker's claim to be the safest is mostly an artefact of comparing a new car against a fleet average twelve years old. — tap to centre the map on it
A carmaker's claim to be the safest is mostly an artefact of comparing a new car against a fleet average twelve years old.
Last stated 3 years ago
19 Dec 2023
PK
Philip Koopman — holds since 2023-12-19 — tap for who they are
same subject or similar wording a cloud: claims about one subject, named for it bar: when it was last stated, on a scale from 2015 to today — full is today a face: someone who holds the claim — tap it for who they are
At the centre
It is empirically true that larger models and larger datasets learn more knowledge.
Last stated 27 Jan 2025 · 2 years ago
Holds Jensen Huang
Read this korrent →
Similar wording
Bigger is smarter, always: bringing your special domain knowledge to the model is the wrong side of the bitter lesson.
Last stated 11 Mar 2026 · 8 months ago
Holds Steve Yegge
Similar wording
Larger language models already have enough capacity that extra per-layer embedding tricks add little benefit to them.
Last stated 16 May 2026 · 6 months ago
Holds Sebastian Raschka
Similar wording
Understanding a machine learning model and understanding the data it operates on are inseparable tasks.
Last stated 16 Jan 2015 · 12 years ago
Holds Christopher Olah
Similar wording
Given good data, room to operate and sound numerical conditioning, models will learn on their own.
Last stated 8 Aug 2023 · 3 years ago
Holds Dario Amodei
Similar wording
Data is becoming more valuable not only for training models but as a complement to cheaper intelligence.
Last stated 9 Oct 2026 · a month ago
Holds Patrick Collison
Similar wording
The only reliable way to improve an AI model's reasoning today is to train it on more data and make it bigger.
Last stated 22 Mar 2024 · 3 years ago
Holds Elad Gil
Similar wording
The scaling curve really is S-shaped, but there are at least two cycles left in it, which means models sixteen times smarter and all knowledge work subsumed.
Last stated 11 Mar 2026 · 8 months ago
Holds Steve Yegge
Similar wording
Training a model on principles rather than a list of rules is not an ideology but an empirical finding: its behaviour is more consistent and covers edge cases.
Last stated 13 Feb 2026 · 9 months ago
Holds Dario Amodei
Same subject: reinforcement learning
A feedback loop that reinforces a behavior pulls it toward whatever improves the loop's own score.
Last stated 26 Aug 2026 · 3 months ago
Holds Henrik Karlsson
Same subject: reinforcement learning
A format reward should only be added when the answer is already correct.
Last stated 10 Oct 2026 · a month ago
Holds Sebastian Raschka
Same subject: reinforcement learning
A model should not be called a reasoning model unless it has been trained with reinforcement learning with verifiable rewards.
Last stated 3 Oct 2026 · 2 months ago
Holds Sebastian Raschka
Same subject: neural networks
A curve, which is what a deep learning model is, is a very bad substrate for discrete computation.
Last stated 6 Nov 2024 · 2 years ago
Holds François Chollet
Same subject: neural networks
A layer should learn a residual with reference to its own input rather than an unreferenced function, which is what makes great depth trainable.
Last stated 10 Dec 2015 · 11 years ago
Holds Jian Sun Kaiming He
Same subject: neural networks
A project-level agent memory file works like a neural net, steering the agent much as a fine-tuned LoRA steers a model.
Last stated 23 Aug 2026 · 3 months ago
Holds Kun Chen
Same subject: benchmarks
'Everyone gets it wrong sometimes' is a bad argument when assessing track records.
Last stated 2 Aug 2026 · 4 months ago
Holds Adam Kucharski
Same subject: benchmarks
A benchmark that ranks Claude Code last while it stays first in use is measuring the wrong thing, and has been for a year.
Last stated 3 Sept 2026 · 3 months ago
Holds Dax Raad
Same subject: benchmarks
A carmaker's claim to be the safest is mostly an artefact of comparing a new car against a fleet average twelve years old.
Last stated 19 Dec 2023 · 3 years ago
Holds Philip Koopman