Tap a claim on the ring to put it at the centre.
← Nobody knows what is going on inside a large model, and the…
17 connected korrents · 16 moments from 10 Jun 2022 to 26 Oct 2026.
Everything filed under LLMs
LLMs
Everything filed under open source
open source
Everything filed under OpenAI
OpenAI
Everything filed under scaling laws
scaling laws
Everything filed under AI and science
AI and science
Everything filed under neural networks
neural networks
Everything filed under semiconductors
semiconductors
Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject
Read this korrent: Nobody knows what is going on inside a large model, and the interpretability pictures we can draw do not answer the only question that matters.
Nobody knows what is going on inside a large model, and the interpretability pictures we can draw do not answer the only question that matters.
Last stated 4 years ago
10 Jun 2022
EY
Eliezer Yudkowsky — holds since 2022-06-10 — tap for who they are
Same subject: The poor explanatory quality of AI-generated proofs today will probably improve. — tap to centre the map on it
The poor explanatory quality of AI-generated proofs today will probably improve.
Last stated a month ago
16 Oct 2026
GS
Grant Sanderson — holds since 2026-10-16 — tap for who they are
Same subject: Biology keeps turning up whole classes of things nobody knew existed, and that is what defeats attempts to model it. — tap to centre the map on it
Biology keeps turning up whole classes of things nobody knew existed, and that is what defeats attempts to model it.
Last stated 2 years ago
19 Sept 2024
DL
Derek Lowe — holds since 2024-09-19 — tap for who they are
Same subject: Current AI models do not actually understand things and still hallucinate. — tap to centre the map on it
Current AI models do not actually understand things and still hallucinate.
Last stated a year ago
13 Oct 2025
SG
Saul Griffith — holds since 2025-10-13 — tap for who they are
Same subject: Crude, high-level interpretability probes might get us pretty far without a herculean bottom-up understanding of models. — tap to centre the map on it
Crude, high-level interpretability probes might get us pretty far without a herculean bottom-up understanding of models.
Last stated 4 years ago
12 May 2023
AC
Ajeya Cotra — holds since 2023-05-12 — tap for who they are
Same subject: A model may internally represent that it is uncertain, but that signal is not wired up to it saying in words that it does not know. — tap to centre the map on it
A model may internally represent that it is uncertain, but that signal is not wired up to it saying in words that it does not know.
Last stated 2 years ago
5 Feb 2025
AK
Andrej Karpathy — holds since 2025-02-05 — tap for who they are
Same subject: Large language models do not think in words. — tap to centre the map on it
Large language models do not think in words.
Last stated 5 months ago
18 Jun 2026
KR
Kenneth Reitz — holds since 2026-06-18 — tap for who they are
Same subject: Progress in data, GPUs and neural nets is intertwined, so it is no coincidence they matured together. — tap to centre the map on it
Progress in data, GPUs and neural nets is intertwined, so it is no coincidence they matured together.
Last stated 4 years ago
27 Mar 2023
IS
Ilya Sutskever — holds since 2023-03-27 — tap for who they are
Same subject: Large language models are a bad way to do science, because they have been fed so much that nobody knows what they already knew. — tap to centre the map on it
Large language models are a bad way to do science, because they have been fed so much that nobody knows what they already knew.
Last stated a year ago
26 Sept 2025
RS
Richard Sutton — holds since 2025-09-26 — tap for who they are
Same subject: A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week. — tap to centre the map on it
A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week.
Last stated a month ago
21 Oct 2026
PS
Peter Steinberger — holds since 2026-10-21 — tap for who they are
Same subject: A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests. — tap to centre the map on it
A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests.
Last stated 3 years ago
18 Mar 2024
SA
Sam Altman — holds since 2024-03-18 — tap for who they are
Same subject: Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers. — tap to centre the map on it
Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers.
Last stated 3 years ago
18 Mar 2024
SA
Sam Altman — holds since 2024-03-18 — tap for who they are
Same subject: "Scaling" was powerful because it was one word: naming a research direction is what tells a whole field what to do next. — tap to centre the map on it
"Scaling" was powerful because it was one word: naming a research direction is what tells a whole field what to do next.
Last stated 12 months ago
25 Nov 2025
IS
Ilya Sutskever — holds since 2025-11-25 — tap for who they are
Same subject: A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number. — tap to centre the map on it
A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number.
Last stated 5 months ago
26 Jun 2026
NB
Noam Brown — holds since 2026-06-26 — tap for who they are
Same subject: A CPU and memory crunch is coming. — tap to centre the map on it
A CPU and memory crunch is coming.
Last stated 4 weeks ago
26 Oct 2026
DM
Dillon Mulroy — holds since 2026-10-26 — tap for who they are
Same subject: A business making hundreds of millions from an open source project owes it money or contribution, and can be refused its trademarks if it gives neither. — tap to centre the map on it
A business making hundreds of millions from an open source project owes it money or contribution, and can be refused its trademarks if it gives neither.
Last stated 2 years ago
26 Sept 2024
MM
Matt Mullenweg — holds since 2024-09-26 — tap for who they are
Same subject: A codec does not really exist until everyone can decode it. — tap to centre the map on it
A codec does not really exist until everyone can decode it.
Last stated 6 months ago
31 May 2026
JK
Jean-Baptiste Kempf — holds since 2026-05-31 — tap for who they are
Same subject: A company that will not accept a project’s terms is free to go and use a more permissive project instead. — tap to centre the map on it
A company that will not accept a project’s terms is free to go and use a more permissive project instead.
Last stated 2 years ago
26 Sept 2024
MM
Matt Mullenweg — holds since 2024-09-26 — tap for who they are
same subject or similar wording a cloud: claims about one subject, named for it bar: when it was last stated, on a scale from 2015 to today — full is today a face: someone who holds the claim — tap it for who they are
At the centre
Nobody knows what is going on inside a large model, and the interpretability pictures we can draw do not answer the only question that matters.
Last stated 10 Jun 2022 · 4 years ago
Holds Eliezer Yudkowsky
Read this korrent →
Similar wording
The poor explanatory quality of AI-generated proofs today will probably improve.
Last stated 16 Oct 2026 · a month ago
Holds Grant Sanderson
Similar wording
Biology keeps turning up whole classes of things nobody knew existed, and that is what defeats attempts to model it.
Last stated 19 Sept 2024 · 2 years ago
Holds Derek Lowe
Similar wording
Current AI models do not actually understand things and still hallucinate.
Last stated 13 Oct 2025 · a year ago
Holds Saul Griffith
Similar wording
Crude, high-level interpretability probes might get us pretty far without a herculean bottom-up understanding of models.
Last stated 12 May 2023 · 4 years ago
Holds Ajeya Cotra
Similar wording
A model may internally represent that it is uncertain, but that signal is not wired up to it saying in words that it does not know.
Last stated 5 Feb 2025 · 2 years ago
Holds Andrej Karpathy
Similar wording
Large language models do not think in words.
Last stated 18 Jun 2026 · 5 months ago
Holds Kenneth Reitz
Similar wording
Progress in data, GPUs and neural nets is intertwined, so it is no coincidence they matured together.
Last stated 27 Mar 2023 · 4 years ago
Holds Ilya Sutskever
Similar wording
Large language models are a bad way to do science, because they have been fed so much that nobody knows what they already knew.
Last stated 26 Sept 2025 · a year ago
Holds Richard Sutton
Same subject: OpenAI
A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week.
Last stated 21 Oct 2026 · a month ago
Holds Peter Steinberger
Same subject: OpenAI
A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests.
Last stated 18 Mar 2024 · 3 years ago
Holds Sam Altman
Same subject: OpenAI
Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers.
Last stated 18 Mar 2024 · 3 years ago
Holds Sam Altman
Same subject: scaling laws
"Scaling" was powerful because it was one word: naming a research direction is what tells a whole field what to do next.
Last stated 25 Nov 2025 · 12 months ago
Holds Ilya Sutskever
Same subject: scaling laws
A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number.
Last stated 26 Jun 2026 · 5 months ago
Holds Noam Brown
Same subject: scaling laws
A CPU and memory crunch is coming.
Last stated 26 Oct 2026 · 4 weeks ago
Holds Dillon Mulroy
Same subject: open source
A business making hundreds of millions from an open source project owes it money or contribution, and can be refused its trademarks if it gives neither.
Last stated 26 Sept 2024 · 2 years ago
Holds Matt Mullenweg
Same subject: open source
A codec does not really exist until everyone can decode it.
Last stated 31 May 2026 · 6 months ago
Holds Jean-Baptiste Kempf
Same subject: open source
A company that will not accept a project’s terms is free to go and use a more permissive project instead.
Last stated 26 Sept 2024 · 2 years ago
Holds Matt Mullenweg