Tap a claim on the ring to put it at the centre.
← The transformer was close to the last answer in architecture: nothing about the core design has changed since 2017.
17 connected korrents · 17 moments from 12 Jun 2017 to 29 Sept 2026. Nearly all of them are about design .
Everything filed under LLMs
LLMs
Everything filed under chat interfaces
chat interfaces
Everything filed under hiring
hiring
Everything filed under solar
solar
Everything filed under education
education
Everything filed under transformers
transformers Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Read this korrent: The transformer was close to the last answer in architecture: nothing about the core design has changed since 2017. The transformer was close to the last answer in architecture: nothing about the core design has changed since 2017. Last stated 2 years ago
19 Jun 2024
AS
Aravind Srinivas — holds since 2024-06-19 — tap for who they are
Same subject: A baby-step version of eval-driven design is to sketch out 10 to 20 hero flows and run the feature or interaction through them to see where it falls apart. — tap to centre the map on it A baby-step version of eval-driven design is to sketch out 10 to 20 hero flows and run the feature or interaction through them to see where it falls apart. Last stated a month ago
9 Sept 2026
EB
Ed Bayes — holds since 2026-09-09 — tap for who they are
Same subject: A blank chat box is lazy: it violates the first rule of a good user experience, that it is obvious what you can do. — tap to centre the map on it A blank chat box is lazy: it violates the first rule of a good user experience, that it is obvious what you can do. Last stated a year ago
12 May 2025
JZ
Julie Zhuo — holds since 2025-05-12 — tap for who they are
Same subject: A company deserves everyone in it, the chief executive included, to spend as much time as possible in their zone of genius — which is an org design problem. — tap to centre the map on it A company deserves everyone in it, the chief executive included, to spend as much time as possible in their zone of genius — which is an org design problem. Last stated 2 years ago
23 Mar 2025
RV
Rahul Vohra — holds since 2025-03-23 — tap for who they are
Same subject: A company hiring a designer is not hiring a politician or spokesperson, so it should just get into the design work. — tap to centre the map on it A company hiring a designer is not hiring a politician or spokesperson, so it should just get into the design work. Last stated 3 weeks ago
29 Sept 2026
DM
Danny Martinez — holds since 2026-09-29 — tap for who they are
Same subject: A company that adopts AI tools without changing its organisational design misses the biggest change under way. — tap to centre the map on it A company that adopts AI tools without changing its organisational design misses the biggest change under way. Last stated a month ago
10 Sept 2026
EV
Elena Verna — holds since 2026-09-10 — tap for who they are
Same subject: A creative lead's job is to take the idea they think is wrong and try to make it work, because the best ideas come out of developing someone else's. — tap to centre the map on it A creative lead's job is to take the idea they think is wrong and try to make it work, because the best ideas come out of developing someone else's. Last stated 7 months ago
11 Mar 2026
JK
Jeff Kaplan — holds since 2026-03-11 — tap for who they are
Same subject: A data centre powered by solar and batteries alone needs an array so oversized that the design is not worth building. — tap to centre the map on it A data centre powered by solar and batteries alone needs an array so oversized that the design is not worth building. Last stated 3 years ago
18 Apr 2024
AV
Austin Vernon — holds since 2024-04-18 — tap for who they are
Same subject: A design course should start with history and art, grounding students in the world, rather than with tools that may be gone tomorrow. — tap to centre the map on it A design course should start with history and art, grounding students in the world, rather than with tools that may be gone tomorrow. Last stated 2 years ago
21 Feb 2025
TC
Thiago Costa — holds since 2025-02-21 — tap for who they are
Same subject: Looped/recurrent-depth transformer architectures can improve model quality at a fixed compute budget when the model is large enough. — tap to centre the map on it Looped/recurrent-depth transformer architectures can improve model quality at a fixed compute budget when the model is large enough. Last stated a month ago
9 Sept 2026
SR
Sebastian Raschka — holds since 2026-09-09 — tap for who they are
Same subject: A deep bidirectional model is strictly more powerful than a left-to-right model or a shallow concatenation of unidirectional models. — tap to centre the map on it A deep bidirectional model is strictly more powerful than a left-to-right model or a shallow concatenation of unidirectional models. Last stated 8 years ago
11 Oct 2018
KT
Kristina Toutanova — holds since 2018-10-11 — tap for who they are
MC
Ming-Wei Chang — holds since 2018-10-11 — tap for who they are
KL
Kenton Lee — holds since 2018-10-11 — tap for who they are
JD
Jacob Devlin — holds since 2018-10-11 — tap for who they are
Same subject: A neural network's latent space is closer to an uncopyrightable syntax than to copyrightable expression. — tap to centre the map on it A neural network's latent space is closer to an uncopyrightable syntax than to copyrightable expression. Last stated 2 months ago
7 Sept 2026
KK
Kevin Kelly — holds since 2026-09-07 — tap for who they are
Same subject: A transduction model can rely entirely on self-attention for input and output representations without sequence-aligned RNNs or convolution. — tap to centre the map on it A transduction model can rely entirely on self-attention for input and output representations without sequence-aligned RNNs or convolution. Last stated 9 years ago
12 Jun 2017
IP
Illia Polosukhin — holds since 2017-06-12 — tap for who they are
JU
Jakob Uszkoreit — holds since 2017-06-12 — tap for who they are
NP
Niki Parmar — holds since 2017-06-12 — tap for who they are
AV
Ashish Vaswani — holds since 2017-06-12 — tap for who they are
NS
Noam Shazeer — holds since 2017-06-12 — tap for who they are
AG
Aidan N. Gomez — holds since 2017-06-12 — tap for who they are
+2
2 more
Same subject: As models keep growing, AI is running out of enough high-quality unique training tokens to keep up. — tap to centre the map on it As models keep growing, AI is running out of enough high-quality unique training tokens to keep up. Last stated 4 months ago
24 Jun 2026
LW
Lilian Weng — holds since 2026-06-24 — tap for who they are
Same subject: Large language models are grown rather than built, and nobody really knows how the resulting working AI functions. — tap to centre the map on it Large language models are grown rather than built, and nobody really knows how the resulting working AI functions. Last stated a month ago
8 Sept 2026
SA
Scott Alexander — holds since 2026-09-08 — tap for who they are
Same subject: As reasoning models and agents retain more tokens for longer, KV-cache size and attention cost become the main constraint on scaling context. — tap to centre the map on it As reasoning models and agents retain more tokens for longer, KV-cache size and attention cost become the main constraint on scaling context. Last stated 5 months ago
16 May 2026
SR
Sebastian Raschka — holds since 2026-05-16 — tap for who they are
Same subject: Context engineering has stayed relevant for a year because it is grounded in how transformer attention works, and it will matter to anyone building on AI until post-transformer models arrive. — tap to centre the map on it Context engineering has stayed relevant for a year because it is grounded in how transformer attention works, and it will matter to anyone building on AI until post-transformer models arrive. Last stated 3 months ago
15 Jul 2026
DH
Dex Horthy — holds since 2026-07-15 — tap for who they are
Same subject: Directly optimizing prompt embeddings (prefix-tuning) yields better performance than even a single optimized text prompt. — tap to centre the map on it Directly optimizing prompt embeddings (prefix-tuning) yields better performance than even a single optimized text prompt. Last stated 6 years ago
4 Feb 2021
GW
Gwern — holds since 2021-02-04 — tap for who they are
At the centre
The transformer was close to the last answer in architecture: nothing about the core design has changed since 2017.
Holds Read this korrent →
A baby-step version of eval-driven design is to sketch out 10 to 20 hero flows and run the feature or interaction through them to see where it falls apart.
Holds
A blank chat box is lazy: it violates the first rule of a good user experience, that it is obvious what you can do.
Holds
A company deserves everyone in it, the chief executive included, to spend as much time as possible in their zone of genius — which is an org design problem.
Holds
A company hiring a designer is not hiring a politician or spokesperson, so it should just get into the design work.
Holds
A company that adopts AI tools without changing its organisational design misses the biggest change under way.
Holds
A creative lead's job is to take the idea they think is wrong and try to make it work, because the best ideas come out of developing someone else's.
Holds
A data centre powered by solar and batteries alone needs an array so oversized that the design is not worth building.
Holds
A design course should start with history and art, grounding students in the world, rather than with tools that may be gone tomorrow.
Holds
Looped/recurrent-depth transformer architectures can improve model quality at a fixed compute budget when the model is large enough.
Holds
A deep bidirectional model is strictly more powerful than a left-to-right model or a shallow concatenation of unidirectional models.
Holds
A neural network's latent space is closer to an uncopyrightable syntax than to copyrightable expression.
Holds
A transduction model can rely entirely on self-attention for input and output representations without sequence-aligned RNNs or convolution.
Holds
As models keep growing, AI is running out of enough high-quality unique training tokens to keep up.
Holds
Large language models are grown rather than built, and nobody really knows how the resulting working AI functions.
Holds
As reasoning models and agents retain more tokens for longer, KV-cache size and attention cost become the main constraint on scaling context.
Holds
Context engineering has stayed relevant for a year because it is grounded in how transformer attention works, and it will matter to anyone building on AI until post-transformer models arrive.
Holds
Directly optimizing prompt embeddings (prefix-tuning) yields better performance than even a single optimized text prompt.
Holds