Tap a claim on the ring to put it at the centre.
← Research needs some compute but it is far from obvious that it needs the largest amount of compute in the world.
17 connected korrents · 16 moments from 3 Jun 2021 to 26 Oct 2026.
Everything filed under scaling laws
scaling laws
Everything filed under energy
energy
Everything filed under metascience
metascience
Everything filed under investing
investing
Everything filed under AI and science
AI and science
Everything filed under semiconductors
semiconductors
Everything filed under robotics
robotics
Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject
Read this korrent: Research needs some compute but it is far from obvious that it needs the largest amount of compute in the world.
Research needs some compute but it is far from obvious that it needs the largest amount of compute in the world.
Last stated 12 months ago
25 Nov 2025
IS
Ilya Sutskever — holds since 2025-11-25 — tap for who they are
Same subject: A lab should spend most of its compute on research rather than on building the next model, because research is where the tenfold yearly efficiency gains come from. — tap to centre the map on it
A lab should spend most of its compute on research rather than on building the next model, because research is where the tenfold yearly efficiency gains come from.
Last stated 8 months ago
13 Mar 2026
DP
Dylan Patel — holds since 2026-03-13 — tap for who they are
Same subject: Demanding that research be done cheaply tends to make it the most expensive kind of research. — tap to centre the map on it
Demanding that research be done cheaply tends to make it the most expensive kind of research.
Last stated 5 years ago
3 Jun 2021
GW
Gwern — holds since 2021-06-03 — tap for who they are
Same subject: Compute will be the currency of the future and the most precious commodity in the world, so we should be investing heavily to make far more of it. — tap to centre the map on it
Compute will be the currency of the future and the most precious commodity in the world, so we should be investing heavily to make far more of it.
Last stated 3 years ago
18 Mar 2024
SA
Sam Altman — holds since 2024-03-18 — tap for who they are
Same subject: What computing can achieve is ultimately limited by the energy available to it. — tap to centre the map on it
What computing can achieve is ultimately limited by the energy available to it.
Last stated 2 years ago
27 Jan 2025
JH
Jensen Huang — holds since 2025-01-27 — tap for who they are
Same subject: Cutting-edge AI/ML research should not be limited to large tech companies. — tap to centre the map on it
Cutting-edge AI/ML research should not be limited to large tech companies.
Last stated 3 years ago
9 Jan 2024
FW
Fred Wilson — holds since 2024-01-09 — tap for who they are
Same subject: The amount of compute being built is tiny compared to the amount that will be built. — tap to centre the map on it
The amount of compute being built is tiny compared to the amount that will be built.
Last stated a month ago
16 Oct 2026
NS
Noah Smith — holds since 2026-10-16 — tap for who they are
Same subject: The useful question about robot data is not how much is needed to finish but how much is needed to start a self-sustaining flywheel. — tap to centre the map on it
The useful question about robot data is not how much is needed to finish but how much is needed to start a self-sustaining flywheel.
Last stated a year ago
12 Sept 2025
SL
Sergey Levine — holds since 2025-09-12 — tap for who they are
Same subject: Compute is not a market like phones, where demand is capped by how many buyers there are; intelligence is priced like energy, so the only real question is how much the world uses at a given price. — tap to centre the map on it
Compute is not a market like phones, where demand is capped by how many buyers there are; intelligence is priced like energy, so the only real question is how much the world uses at a given price.
Last stated 3 years ago
18 Mar 2024
SA
Sam Altman — holds since 2024-03-18 — tap for who they are
Same subject: "Scaling" was powerful because it was one word: naming a research direction is what tells a whole field what to do next. — tap to centre the map on it
"Scaling" was powerful because it was one word: naming a research direction is what tells a whole field what to do next.
Last stated 12 months ago
25 Nov 2025
IS
Ilya Sutskever — holds since 2025-11-25 — tap for who they are
Same subject: A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number. — tap to centre the map on it
A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number.
Last stated 5 months ago
26 Jun 2026
NB
Noam Brown — holds since 2026-06-26 — tap for who they are
Same subject: A CPU and memory crunch is coming. — tap to centre the map on it
A CPU and memory crunch is coming.
Last stated 4 weeks ago
26 Oct 2026
DM
Dillon Mulroy — holds since 2026-10-26 — tap for who they are
Same subject: AI model improvements must tail off at some point, but there is no reason that point has to come soon. — tap to centre the map on it
AI model improvements must tail off at some point, but there is no reason that point has to come soon.
Last stated 2 months ago
20 Sept 2026
JB
Jamie Brandon — holds since 2026-09-20 — tap for who they are
Same subject: AI progress is faster than people expect, and ordinary scaling can be enough to solve problems that looked very hard. — tap to centre the map on it
AI progress is faster than people expect, and ordinary scaling can be enough to solve problems that looked very hard.
Last stated 2 years ago
2 Feb 2025
AC
Ajeya Cotra — holds since 2023-08-29 — tap for who they are
SA
Scott Alexander — holds since 2022-09-12 — tap for who they are
MB
Miles Brundage — holds since 2025-02-02 — tap for who they are
Same subject: As models keep growing, AI is running out of enough high-quality unique training tokens to keep up. — tap to centre the map on it
As models keep growing, AI is running out of enough high-quality unique training tokens to keep up.
Last stated 5 months ago
24 Jun 2026
LW
Lilian Weng — holds since 2026-06-24 — tap for who they are
Same subject: Before training a base model with RL to emit think tokens, it is better to do some continued pre-training or supervised fine-tuning with those tokens present. — tap to centre the map on it
Before training a base model with RL to emit think tokens, it is better to do some continued pre-training or supervised fine-tuning with those tokens present.
Last stated a month ago
10 Oct 2026
SR
Sebastian Raschka — holds since 2026-10-10 — tap for who they are
Same subject: In reinforcement learning for LLMs, the loss is not as informative as in classic deep learning or pre-training. — tap to centre the map on it
In reinforcement learning for LLMs, the loss is not as informative as in classic deep learning or pre-training.
Last stated a month ago
10 Oct 2026
SR
Sebastian Raschka — holds since 2026-10-10 — tap for who they are
Same subject: Models resemble each other because pre-training is the same everywhere; what differentiates labs now is RL and post-training. — tap to centre the map on it
Models resemble each other because pre-training is the same everywhere; what differentiates labs now is RL and post-training.
Last stated 12 months ago
25 Nov 2025
IS
Ilya Sutskever — holds since 2025-11-25 — tap for who they are
same subject or similar wording a cloud: claims about one subject, named for it bar: when it was last stated, on a scale from 2015 to today — full is today a face: someone who holds the claim — tap it for who they are
At the centre
Research needs some compute but it is far from obvious that it needs the largest amount of compute in the world.
Last stated 25 Nov 2025 · 12 months ago
Holds Ilya Sutskever
Read this korrent →
Similar wording
A lab should spend most of its compute on research rather than on building the next model, because research is where the tenfold yearly efficiency gains come from.
Last stated 13 Mar 2026 · 8 months ago
Holds Dylan Patel
Similar wording
Demanding that research be done cheaply tends to make it the most expensive kind of research.
Last stated 3 Jun 2021 · 5 years ago
Holds Gwern
Similar wording
Compute will be the currency of the future and the most precious commodity in the world, so we should be investing heavily to make far more of it.
Last stated 18 Mar 2024 · 3 years ago
Holds Sam Altman
Similar wording
What computing can achieve is ultimately limited by the energy available to it.
Last stated 27 Jan 2025 · 2 years ago
Holds Jensen Huang
Similar wording
Cutting-edge AI/ML research should not be limited to large tech companies.
Last stated 9 Jan 2024 · 3 years ago
Holds Fred Wilson
Similar wording
The amount of compute being built is tiny compared to the amount that will be built.
Last stated 16 Oct 2026 · a month ago
Holds Noah Smith
Similar wording
The useful question about robot data is not how much is needed to finish but how much is needed to start a self-sustaining flywheel.
Last stated 12 Sept 2025 · a year ago
Holds Sergey Levine
Similar wording
Compute is not a market like phones, where demand is capped by how many buyers there are; intelligence is priced like energy, so the only real question is how much the world uses at a given price.
Last stated 18 Mar 2024 · 3 years ago
Holds Sam Altman
Same subject: scaling laws
"Scaling" was powerful because it was one word: naming a research direction is what tells a whole field what to do next.
Last stated 25 Nov 2025 · 12 months ago
Holds Ilya Sutskever
Same subject: scaling laws
A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number.
Last stated 26 Jun 2026 · 5 months ago
Holds Noam Brown
Same subject: scaling laws
A CPU and memory crunch is coming.
Last stated 26 Oct 2026 · 4 weeks ago
Holds Dillon Mulroy
Same subject: LLMs
AI model improvements must tail off at some point, but there is no reason that point has to come soon.
Last stated 20 Sept 2026 · 2 months ago
Holds Jamie Brandon
Same subject: LLMs
AI progress is faster than people expect, and ordinary scaling can be enough to solve problems that looked very hard.
Last stated 2 Feb 2025 · 2 years ago
Holds Ajeya Cotra Scott Alexander Miles Brundage
Same subject: LLMs
As models keep growing, AI is running out of enough high-quality unique training tokens to keep up.
Last stated 24 Jun 2026 · 5 months ago
Holds Lilian Weng
Same subject: reinforcement learning
Before training a base model with RL to emit think tokens, it is better to do some continued pre-training or supervised fine-tuning with those tokens present.
Last stated 10 Oct 2026 · a month ago
Holds Sebastian Raschka
Same subject: reinforcement learning
In reinforcement learning for LLMs, the loss is not as informative as in classic deep learning or pre-training.
Last stated 10 Oct 2026 · a month ago
Holds Sebastian Raschka
Same subject: reinforcement learning
Models resemble each other because pre-training is the same everywhere; what differentiates labs now is RL and post-training.
Last stated 25 Nov 2025 · 12 months ago
Holds Ilya Sutskever