Tap a claim on the ring to put it at the centre.
← The transformer is a stepping stone toward architectures that will…
17 connected korrents · 16 moments from 14 Mar 2019 to 21 Nov 2026.
Everything filed under transformers
transformers
Everything filed under ambition
ambition
Everything filed under creativity
creativity
Everything filed under open source
open source
Everything filed under AI and jobs
AI and jobs
Everything filed under innovation
innovation
Everything filed under coding agents
coding agents
Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject
Read this korrent: The transformer is a stepping stone toward architectures that will barely be recognisable as transformers years from now.
The transformer is a stepping stone toward architectures that will barely be recognisable as transformers years from now.
Last stated 2 years ago
27 Jan 2025
JH
Jensen Huang — holds since 2025-01-27 — tap for who they are
Same subject: Transformer-based models are not the future, are not really intelligent, and will not lead to AGI. — tap to centre the map on it
Transformer-based models are not the future, are not really intelligent, and will not lead to AGI.
Last stated 2 years ago
14 Nov 2024
EZ
Ed Zitron — holds since 2024-11-14 — tap for who they are
Same subject: The confusion about who does what is a storming phase every transformative technology causes, and AI is in the middle of it. — tap to centre the map on it
The confusion about who does what is a storming phase every transformative technology causes, and AI is in the middle of it.
Last stated 4 months ago
19 Jul 2026
ES
Elizabeth Stone — holds since 2026-07-19 — tap for who they are
Same subject: The transformer was close to the last answer in architecture: nothing about the core design has changed since 2017. — tap to centre the map on it
The transformer was close to the last answer in architecture: nothing about the core design has changed since 2017.
Last stated 2 years ago
19 Jun 2024
AS
Aravind Srinivas — holds since 2024-06-19 — tap for who they are
Same subject: Research on transformer-style attention mechanisms has not yet reached diminishing returns compared to alternative approaches. — tap to centre the map on it
Research on transformer-style attention mechanisms has not yet reached diminishing returns compared to alternative approaches.
Last stated 5 years ago
3 Jun 2021
GW
Gwern — holds since 2021-06-03 — tap for who they are
Same subject: The current AI stack is not among the top 50% most efficient approaches to learning. — tap to centre the map on it
The current AI stack is not among the top 50% most efficient approaches to learning.
Last stated yesterday
21 Nov 2026
FC
François Chollet — holds since 2026-11-21 — tap for who they are
Same subject: AI's transformation of society will unfold gradually over decades, not in a single moment of takeoff. — tap to centre the map on it
AI's transformation of society will unfold gradually over decades, not in a single moment of takeoff.
Last stated 4 months ago
15 Jul 2026
TF
Tiago Forte — holds since 2026-07-15 — tap for who they are
Same subject: Context engineering has stayed relevant for a year because it is grounded in how transformer attention works, and it will matter to anyone building on AI until post-transformer models arrive. — tap to centre the map on it
Context engineering has stayed relevant for a year because it is grounded in how transformer attention works, and it will matter to anyone building on AI until post-transformer models arrive.
Last stated 4 months ago
15 Jul 2026
DH
Dex Horthy — holds since 2026-07-15 — tap for who they are
Same subject: The step change in AI coding in 2025 came from the harnesses and the tooling around the models, not from the models themselves. — tap to centre the map on it
The step change in AI coding in 2025 came from the harnesses and the tooling around the models, not from the models themselves.
Last stated 3 months ago
12 Aug 2026
CM
Charity Majors — holds since 2026-08-12 — tap for who they are
Same subject: A contest between five paid firms is not the way to get good creative work. — tap to centre the map on it
A contest between five paid firms is not the way to get good creative work.
Last stated 3 months ago
14 Aug 2026
SK
Susan Kare — holds since 2026-08-14 — tap for who they are
Same subject: A culture that is uncompromising but also kind and supportive is the most fertile ground for creativity. — tap to centre the map on it
A culture that is uncompromising but also kind and supportive is the most fertile ground for creativity.
Last stated 7 months ago
12 Apr 2026
ES
Evan Spiegel — holds since 2026-04-12 — tap for who they are
Same subject: A feeling of responsibility is probably the greatest inhibitor of creativity; great ideas came from people not paid to have them — tap to centre the map on it
A feeling of responsibility is probably the greatest inhibitor of creativity; great ideas came from people not paid to have them
IA
Isaac Asimov — holds since c. 1959 — tap for who they are
Same subject: "If you're not growing, you're dying" is truer of the person than of the company. — tap to centre the map on it
"If you're not growing, you're dying" is truer of the person than of the company.
Last stated 10 months ago
25 Jan 2026
JC
Jason Cohen — holds since 2026-01-25 — tap for who they are
Same subject: A business should be less about metrics, targets and constant growth and more about a good lifestyle, helping people, profit and fun. — tap to centre the map on it
A business should be less about metrics, targets and constant growth and more about a good lifestyle, helping people, profit and fun.
Last stated 5 years ago
7 Jan 2022
AA
Ali Abdaal — holds since 2022-01-07 — tap for who they are
Same subject: A common-sense utopia is much closer to the present day than it is to the best futures actually available to us. — tap to centre the map on it
A common-sense utopia is much closer to the present day than it is to the best futures actually available to us.
Last stated a year ago
3 Aug 2025
WM
William MacAskill — holds since 2025-08-03 — tap for who they are
Same subject: A business making hundreds of millions from an open source project owes it money or contribution, and can be refused its trademarks if it gives neither. — tap to centre the map on it
A business making hundreds of millions from an open source project owes it money or contribution, and can be refused its trademarks if it gives neither.
Last stated 2 years ago
26 Sept 2024
MM
Matt Mullenweg — holds since 2024-09-26 — tap for who they are
Same subject: A company that will not accept a project’s terms is free to go and use a more permissive project instead. — tap to centre the map on it
A company that will not accept a project’s terms is free to go and use a more permissive project instead.
Last stated 2 years ago
26 Sept 2024
MM
Matt Mullenweg — holds since 2024-09-26 — tap for who they are
Same subject: A contribution is a cost to the maintainer, not a gift: it is taking part, not merely using the code, that consumes a project’s scarcest resource. — tap to centre the map on it
A contribution is a cost to the maintainer, not a gift: it is taking part, not merely using the code, that consumes a project’s scarcest resource.
Last stated 5 years ago
17 Mar 2022
FV
Filippo Valsorda — holds since 2022-03-17 — tap for who they are
NA
Nadia Asparouhova — holds since 2019-03-14 — tap for who they are
same subject or similar wording a cloud: claims about one subject, named for it bar: when it was last stated, on a scale from 2015 to today — full is today a face: someone who holds the claim — tap it for who they are
At the centre
The transformer is a stepping stone toward architectures that will barely be recognisable as transformers years from now.
Last stated 27 Jan 2025 · 2 years ago
Holds Jensen Huang
Read this korrent →
Similar wording
Transformer-based models are not the future, are not really intelligent, and will not lead to AGI.
Last stated 14 Nov 2024 · 2 years ago
Holds Ed Zitron
Similar wording
The confusion about who does what is a storming phase every transformative technology causes, and AI is in the middle of it.
Last stated 19 Jul 2026 · 4 months ago
Holds Elizabeth Stone
Similar wording
The transformer was close to the last answer in architecture: nothing about the core design has changed since 2017.
Last stated 19 Jun 2024 · 2 years ago
Holds Aravind Srinivas
Similar wording
Research on transformer-style attention mechanisms has not yet reached diminishing returns compared to alternative approaches.
Last stated 3 Jun 2021 · 5 years ago
Holds Gwern
Similar wording
The current AI stack is not among the top 50% most efficient approaches to learning.
Last stated 21 Nov 2026 · yesterday
Holds François Chollet
Similar wording
AI's transformation of society will unfold gradually over decades, not in a single moment of takeoff.
Last stated 15 Jul 2026 · 4 months ago
Holds Tiago Forte
Similar wording
Context engineering has stayed relevant for a year because it is grounded in how transformer attention works, and it will matter to anyone building on AI until post-transformer models arrive.
Last stated 15 Jul 2026 · 4 months ago
Holds Dex Horthy
Similar wording
The step change in AI coding in 2025 came from the harnesses and the tooling around the models, not from the models themselves.
Last stated 12 Aug 2026 · 3 months ago
Holds Charity Majors
Same subject: creativity
A contest between five paid firms is not the way to get good creative work.
Last stated 14 Aug 2026 · 3 months ago
Holds Susan Kare
Same subject: creativity
A culture that is uncompromising but also kind and supportive is the most fertile ground for creativity.
Last stated 12 Apr 2026 · 7 months ago
Holds Evan Spiegel
Same subject: creativity
A feeling of responsibility is probably the greatest inhibitor of creativity; great ideas came from people not paid to have them
Last stated c. 1959
Holds Isaac Asimov
Same subject: ambition
"If you're not growing, you're dying" is truer of the person than of the company.
Last stated 25 Jan 2026 · 10 months ago
Holds Jason Cohen
Same subject: ambition
A business should be less about metrics, targets and constant growth and more about a good lifestyle, helping people, profit and fun.
Last stated 7 Jan 2022 · 5 years ago
Holds Ali Abdaal
Same subject: ambition
A common-sense utopia is much closer to the present day than it is to the best futures actually available to us.
Last stated 3 Aug 2025 · a year ago
Holds William MacAskill
Same subject: open source
A business making hundreds of millions from an open source project owes it money or contribution, and can be refused its trademarks if it gives neither.
Last stated 26 Sept 2024 · 2 years ago
Holds Matt Mullenweg
Same subject: open source
A company that will not accept a project’s terms is free to go and use a more permissive project instead.
Last stated 26 Sept 2024 · 2 years ago
Holds Matt Mullenweg
Same subject: open source
A contribution is a cost to the maintainer, not a gift: it is taking part, not merely using the code, that consumes a project’s scarcest resource.
Last stated 17 Mar 2022 · 5 years ago
Holds Filippo Valsorda Nadia Asparouhova