Tap a claim on the ring to put it at the centre.
← Research on transformer-style attention mechanisms has not yet reached…
17 connected korrents · 17 moments from 3 Jun 2021 to 21 Nov 2026.
Everything filed under LLMs
LLMs
Everything filed under innovation
innovation
Everything filed under OpenAI
OpenAI
Everything filed under transformers
transformers
Everything filed under AI agents
AI agents
Everything filed under cybersecurity
cybersecurity
Everything filed under behavioural science
behavioural science
Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject
Read this korrent: Research on transformer-style attention mechanisms has not yet reached diminishing returns compared to alternative approaches.
Research on transformer-style attention mechanisms has not yet reached diminishing returns compared to alternative approaches.
Last stated 5 years ago
3 Jun 2021
GW
Gwern — holds since 2021-06-03 — tap for who they are
Same subject: Context engineering has stayed relevant for a year because it is grounded in how transformer attention works, and it will matter to anyone building on AI until post-transformer models arrive. — tap to centre the map on it
Context engineering has stayed relevant for a year because it is grounded in how transformer attention works, and it will matter to anyone building on AI until post-transformer models arrive.
Last stated 4 months ago
15 Jul 2026
DH
Dex Horthy — holds since 2026-07-15 — tap for who they are
Same subject: The current AI stack is not among the top 50% most efficient approaches to learning. — tap to centre the map on it
The current AI stack is not among the top 50% most efficient approaches to learning.
Last stated yesterday
21 Nov 2026
FC
François Chollet — holds since 2026-11-21 — tap for who they are
Same subject: The current state of AI agents is at a plateau of decreasing returns where model intelligence increases but useful outcomes have not gelled. — tap to centre the map on it
The current state of AI agents is at a plateau of decreasing returns where model intelligence increases but useful outcomes have not gelled.
Last stated 2 months ago
30 Sept 2026
RC
Rui Carmo — holds since 2026-09-30 — tap for who they are
Same subject: Transformer-based models are not the future, are not really intelligent, and will not lead to AGI. — tap to centre the map on it
Transformer-based models are not the future, are not really intelligent, and will not lead to AGI.
Last stated 2 years ago
14 Nov 2024
EZ
Ed Zitron — holds since 2024-11-14 — tap for who they are
Same subject: The current capabilities of existing AI models are barely being used and are often not even well understood. — tap to centre the map on it
The current capabilities of existing AI models are barely being used and are often not even well understood.
Last stated 2 months ago
18 Sept 2026
EM
Ethan Mollick — holds since 2026-09-18 — tap for who they are
Same subject: There is an unwarranted hype cycle regarding the capabilities of local AI models. — tap to centre the map on it
There is an unwarranted hype cycle regarding the capabilities of local AI models.
Last stated 9 months ago
8 Mar 2026
RC
Rui Carmo — holds since 2026-03-08 — tap for who they are
Same subject: Much more research effort is needed on the economics of cyber risk, such as estimating future costs of AI cyberattacks, and the subfield should rise in status. — tap to centre the map on it
Much more research effort is needed on the economics of cyber risk, such as estimating future costs of AI cyberattacks, and the subfield should rise in status.
Last stated 2 months ago
16 Sept 2026
TC
Tyler Cowen — holds since 2026-09-16 — tap for who they are
Same subject: Shrinking attention spans are reshaping real-world business models, not just digital media formats. — tap to centre the map on it
Shrinking attention spans are reshaping real-world business models, not just digital media formats.
Last stated 9 months ago
16 Feb 2026
SW
swyx — holds since 2026-02-16 — tap for who they are
Same subject: "Lots of anonymous people worked it out by trial and error" is never the real story of an invention: on closer investigation, identifiable people always turn out to be responsible. — tap to centre the map on it
"Lots of anonymous people worked it out by trial and error" is never the real story of an invention: on closer investigation, identifiable people always turn out to be responsible.
Last stated 3 years ago
25 Oct 2023
AH
Anton Howes — holds since 2023-10-25 — tap for who they are
Same subject: 3D printers that can print almost anything from a schematic are a real possibility within our lifetime. — tap to centre the map on it
3D printers that can print almost anything from a schematic are a real possibility within our lifetime.
Last stated 3 years ago
17 Nov 2023
NE
Nat Eliason — holds since 2023-11-17 — tap for who they are
Same subject: A benefit of reading biographies is seeing how an idea evolves over time. — tap to centre the map on it
A benefit of reading biographies is seeing how an idea evolves over time.
Last stated 7 months ago
12 Apr 2026
DS
David Senra — holds since 2026-04-12 — tap for who they are
Same subject: A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week. — tap to centre the map on it
A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week.
Last stated a month ago
21 Oct 2026
PS
Peter Steinberger — holds since 2026-10-21 — tap for who they are
Same subject: A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests. — tap to centre the map on it
A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests.
Last stated 3 years ago
18 Mar 2024
SA
Sam Altman — holds since 2024-03-18 — tap for who they are
Same subject: Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers. — tap to centre the map on it
Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers.
Last stated 3 years ago
18 Mar 2024
SA
Sam Altman — holds since 2024-03-18 — tap for who they are
Same subject: A codec does not really exist until everyone can decode it. — tap to centre the map on it
A codec does not really exist until everyone can decode it.
Last stated 6 months ago
31 May 2026
JK
Jean-Baptiste Kempf — holds since 2026-05-31 — tap for who they are
Same subject: Banning open-weight models does not really reduce future harms, and it hurts economic activity and innovation. — tap to centre the map on it
Banning open-weight models does not really reduce future harms, and it hurts economic activity and innovation.
Last stated 4 weeks ago
26 Oct 2026
NL
Nathan Lambert — holds since 2026-10-26 — tap for who they are
Same subject: China is the fastest-innovating country in the world today, on the strength of its talent, its open-source habit and its ferocious internal competition. — tap to centre the map on it
China is the fastest-innovating country in the world today, on the strength of its talent, its open-source habit and its ferocious internal competition.
Last stated 8 months ago
23 Mar 2026
JH
Jensen Huang — holds since 2026-03-23 — tap for who they are
same subject or similar wording a cloud: claims about one subject, named for it bar: when it was last stated, on a scale from 2015 to today — full is today a face: someone who holds the claim — tap it for who they are
At the centre
Research on transformer-style attention mechanisms has not yet reached diminishing returns compared to alternative approaches.
Last stated 3 Jun 2021 · 5 years ago
Holds Gwern
Read this korrent →
Similar wording
Context engineering has stayed relevant for a year because it is grounded in how transformer attention works, and it will matter to anyone building on AI until post-transformer models arrive.
Last stated 15 Jul 2026 · 4 months ago
Holds Dex Horthy
Similar wording
The current AI stack is not among the top 50% most efficient approaches to learning.
Last stated 21 Nov 2026 · yesterday
Holds François Chollet
Similar wording
The current state of AI agents is at a plateau of decreasing returns where model intelligence increases but useful outcomes have not gelled.
Last stated 30 Sept 2026 · 2 months ago
Holds Rui Carmo
Similar wording
Transformer-based models are not the future, are not really intelligent, and will not lead to AGI.
Last stated 14 Nov 2024 · 2 years ago
Holds Ed Zitron
Similar wording
The current capabilities of existing AI models are barely being used and are often not even well understood.
Last stated 18 Sept 2026 · 2 months ago
Holds Ethan Mollick
Similar wording
There is an unwarranted hype cycle regarding the capabilities of local AI models.
Last stated 8 Mar 2026 · 9 months ago
Holds Rui Carmo
Similar wording
Much more research effort is needed on the economics of cyber risk, such as estimating future costs of AI cyberattacks, and the subfield should rise in status.
Last stated 16 Sept 2026 · 2 months ago
Holds Tyler Cowen
Similar wording
Shrinking attention spans are reshaping real-world business models, not just digital media formats.
Last stated 16 Feb 2026 · 9 months ago
Holds swyx
Same subject: innovation
"Lots of anonymous people worked it out by trial and error" is never the real story of an invention: on closer investigation, identifiable people always turn out to be responsible.
Last stated 25 Oct 2023 · 3 years ago
Holds Anton Howes
Same subject: innovation
3D printers that can print almost anything from a schematic are a real possibility within our lifetime.
Last stated 17 Nov 2023 · 3 years ago
Holds Nat Eliason
Same subject: innovation
A benefit of reading biographies is seeing how an idea evolves over time.
Last stated 12 Apr 2026 · 7 months ago
Holds David Senra
Same subject: OpenAI
A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week.
Last stated 21 Oct 2026 · a month ago
Holds Peter Steinberger
Same subject: OpenAI
A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests.
Last stated 18 Mar 2024 · 3 years ago
Holds Sam Altman
Same subject: OpenAI
Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers.
Last stated 18 Mar 2024 · 3 years ago
Holds Sam Altman
Same subject: open source
A codec does not really exist until everyone can decode it.
Last stated 31 May 2026 · 6 months ago
Holds Jean-Baptiste Kempf
Same subject: open source
Banning open-weight models does not really reduce future harms, and it hurts economic activity and innovation.
Last stated 26 Oct 2026 · 4 weeks ago
Holds Nathan Lambert
Same subject: open source
China is the fastest-innovating country in the world today, on the strength of its talent, its open-source habit and its ferocious internal competition.
Last stated 23 Mar 2026 · 8 months ago
Holds Jensen Huang