korrents

On the map

Tap a claim on the ring to put it at the centre.

← Research on transformer-style attention mechanisms has not yet reached…

17 connected korrents · 17 moments from 3 Jun 2021 to 21 Nov 2026.

Everything filed under LLMs LLMs Everything filed under innovation innovation Everything filed under OpenAI OpenAI Everything filed under transformers transformers Everything filed under AI agents AI agents Everything filed under cybersecurity cybersecurity Everything filed under behavioural science behavioural science Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: Research on transformer-style attention mechanisms has not yet reached diminishing returns compared to alternative approaches. Research on transformer-style attentionmechanisms has not yet reached diminishingreturns compared to alternativeapproaches. Last stated 5 years ago 3 Jun 2021 GW Gwern — holds since 2021-06-03 — tap for who they are Same subject: Context engineering has stayed relevant for a year because it is grounded in how transformer attention works, and it will matter to anyone building on AI until post-transformer models arrive. — tap to centre the map on it Context engineering has stayedrelevant for a year because it isgrounded in how transformerattention works, and it will matterto anyone building on AI untilpost-transformer models arrive. Last stated 4 months ago 15 Jul 2026 DH Dex Horthy — holds since 2026-07-15 — tap for who they are Same subject: The current AI stack is not among the top 50% most efficient approaches to learning. — tap to centre the map on it The current AI stack is not amongthe top 50% most efficientapproaches to learning. Last stated yesterday 21 Nov 2026 FC François Chollet — holds since 2026-11-21 — tap for who they are Same subject: The current state of AI agents is at a plateau of decreasing returns where model intelligence increases but useful outcomes have not gelled. — tap to centre the map on it The current state of AI agents is ata plateau of decreasing returnswhere model intelligence increasesbut useful outcomes have not gelled. Last stated 2 months ago 30 Sept 2026 RC Rui Carmo — holds since 2026-09-30 — tap for who they are Same subject: Transformer-based models are not the future, are not really intelligent, and will not lead to AGI. — tap to centre the map on it Transformer-based models are not thefuture, are not really intelligent,and will not lead to AGI. Last stated 2 years ago 14 Nov 2024 EZ Ed Zitron — holds since 2024-11-14 — tap for who they are Same subject: The current capabilities of existing AI models are barely being used and are often not even well understood. — tap to centre the map on it The current capabilities of existingAI models are barely being used andare often not even well understood. Last stated 2 months ago 18 Sept 2026 EM Ethan Mollick — holds since 2026-09-18 — tap for who they are Same subject: There is an unwarranted hype cycle regarding the capabilities of local AI models. — tap to centre the map on it There is an unwarranted hype cycleregarding the capabilities of localAI models. Last stated 9 months ago 8 Mar 2026 RC Rui Carmo — holds since 2026-03-08 — tap for who they are Same subject: Much more research effort is needed on the economics of cyber risk, such as estimating future costs of AI cyberattacks, and the subfield should rise in status. — tap to centre the map on it Much more research effort is neededon the economics of cyber risk, suchas estimating future costs of AIcyberattacks, and the subfieldshould rise in status. Last stated 2 months ago 16 Sept 2026 TC Tyler Cowen — holds since 2026-09-16 — tap for who they are Same subject: Shrinking attention spans are reshaping real-world business models, not just digital media formats. — tap to centre the map on it Shrinking attention spans arereshaping real-world businessmodels, not just digital mediaformats. Last stated 9 months ago 16 Feb 2026 SW swyx — holds since 2026-02-16 — tap for who they are Same subject: "Lots of anonymous people worked it out by trial and error" is never the real story of an invention: on closer investigation, identifiable people always turn out to be responsible. — tap to centre the map on it "Lots of anonymous people worked itout by trial and error" is never thereal story of an invention: oncloser investigation, identifiablepeople always turn out to beresponsible. Last stated 3 years ago 25 Oct 2023 AH Anton Howes — holds since 2023-10-25 — tap for who they are Same subject: 3D printers that can print almost anything from a schematic are a real possibility within our lifetime. — tap to centre the map on it 3D printers that can print almostanything from a schematic are a realpossibility within our lifetime. Last stated 3 years ago 17 Nov 2023 NE Nat Eliason — holds since 2023-11-17 — tap for who they are Same subject: A benefit of reading biographies is seeing how an idea evolves over time. — tap to centre the map on it A benefit of reading biographies isseeing how an idea evolves overtime. Last stated 7 months ago 12 Apr 2026 DS David Senra — holds since 2026-04-12 — tap for who they are Same subject: A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week. — tap to centre the map on it A PHP vulnerability found withGPT-5.6 Sol will cause havoc thisweek. Last stated a month ago 21 Oct 2026 PS Peter Steinberger — holds since 2026-10-21 — tap for who they are Same subject: A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests. — tap to centre the map on it A startup should not begin life as anonprofit and bolt a for-profit armon later, whatever OpenAI's ownhistory suggests. Last stated 3 years ago 18 Mar 2024 SA Sam Altman — holds since 2024-03-18 — tap for who they are Same subject: Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers. — tap to centre the map on it Advertising was a necessary phasefor the internet but a momentaryindustry, and an AI people pay foris better because they know theanswers are not influenced byadvertisers. Last stated 3 years ago 18 Mar 2024 SA Sam Altman — holds since 2024-03-18 — tap for who they are Same subject: A codec does not really exist until everyone can decode it. — tap to centre the map on it A codec does not really exist untileveryone can decode it. Last stated 6 months ago 31 May 2026 JK Jean-Baptiste Kempf — holds since 2026-05-31 — tap for who they are Same subject: Banning open-weight models does not really reduce future harms, and it hurts economic activity and innovation. — tap to centre the map on it Banning open-weight models does notreally reduce future harms, and ithurts economic activity andinnovation. Last stated 4 weeks ago 26 Oct 2026 NL Nathan Lambert — holds since 2026-10-26 — tap for who they are Same subject: China is the fastest-innovating country in the world today, on the strength of its talent, its open-source habit and its ferocious internal competition. — tap to centre the map on it China is the fastest-innovatingcountry in the world today, on thestrength of its talent, itsopen-source habit and its ferociousinternal competition. Last stated 8 months ago 23 Mar 2026 JH Jensen Huang — holds since 2026-03-23 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 2015 to today — full is todaya face: someone who holds the claim — tap it for who they are

At the centre Research on transformer-style attention mechanisms has not yet reached diminishing returns compared to alternative approaches. Last stated 3 Jun 2021 · 5 years ago Holds Gwern Read this korrent →