korrents

On the map

Tap a claim on the ring to put it at the centre.

← Transformer-based models are not the future, are not really intelligent, and will not lead to AGI.

17 connected korrents · 16 moments from 12 Jun 2017 to 15 Nov 2026. Nearly all of them are about AGI.

Everything filed under transformers transformers Everything filed under AI alignment AI alignment Everything filed under measuring intelligence measuring intelligence Everything filed under energy energy Everything filed under LLMs LLMs Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: Transformer-based models are not the future, are not really intelligent, and will not lead to AGI. Transformer-based models are not thefuture, are not really intelligent, andwill not lead to AGI. Last stated 2 years ago 14 Nov 2024 EZ Ed Zitron — holds since 2024-11-14 — tap for who they are Same subject: A country outside the AI supply chain should just buy the index — which works only in the world where AI ends up commoditised rather than concentrated. — tap to centre the map on it A country outside the AI supplychain should just buy the index —which works only in the world whereAI ends up commoditised rather thanconcentrated. Last stated 6 months ago 4 Jun 2026 AI Alex Imas — holds since 2026-06-04 — tap for who they are Same subject: A human being is not an AGI: we lack a huge amount of knowledge and rely on continual learning instead, so continual learning is what superintelligence should mean. — tap to centre the map on it A human being is not an AGI: we lacka huge amount of knowledge and relyon continual learning instead, socontinual learning is whatsuperintelligence should mean. Last stated 12 months ago 25 Nov 2025 IS Ilya Sutskever — holds since 2025-11-25 — tap for who they are Same subject: A language model is no substitute for a well-specified conventional algorithm, so it cannot simply be dropped into a complex problem and trusted. — tap to centre the map on it A language model is no substitutefor a well-specified conventionalalgorithm, so it cannot simply bedropped into a complex problem andtrusted. Last stated a year ago 7 Jun 2025 GM Gary Marcus — holds since 2025-06-07 — tap for who they are Same subject: A poor country should prioritise owning a piece of AI over retraining its workers, but it should not bet everything on that. — tap to centre the map on it A poor country should prioritiseowning a piece of AI over retrainingits workers, but it should not beteverything on that. Last stated 6 months ago 4 Jun 2026 PT Phil Trammell — holds since 2026-06-04 — tap for who they are Same subject: A program that generates rich enough tests of intelligence would be as hard to build as AGI itself. — tap to centre the map on it A program that generates rich enoughtests of intelligence would be ashard to build as AGI itself. Last stated 2 years ago 6 Nov 2024 FC François Chollet — holds since 2024-11-06 — tap for who they are Same subject: A strong track record in a technical field is only weak evidence that someone has good strategic judgment about AGI. — tap to centre the map on it A strong track record in a technicalfield is only weak evidence thatsomeone has good strategic judgmentabout AGI. Last stated 2 years ago 22 Mar 2025 NN Neel Nanda — holds since 2025-03-22 — tap for who they are Same subject: A true artificial general intelligence cannot exist without being recognized as a moral subject. — tap to centre the map on it A true artificial generalintelligence cannot exist withoutbeing recognized as a moral subject. Last stated a year ago 10 Jun 2025 SH Samuel Hammond — holds since 2025-06-10 — tap for who they are Same subject: Abstract talk of AGI and superintelligence is too abstract; AI has to actually work. — tap to centre the map on it Abstract talk of AGI andsuperintelligence is too abstract;AI has to actually work. Last stated 2 years ago 26 Jan 2025 MA Marc Andreessen — holds since 2025-01-26 — tap for who they are Same subject: A single AI paper rarely changes everything; the last one that did was 'Attention Is All You Need' in 2017. — tap to centre the map on it A single AI paper rarely changeseverything; the last one that didwas 'Attention Is All You Need' in2017. Last stated 2 years ago 6 Jan 2025 AR Aishwarya Naresh Reganti — holds since 2025-01-06 — tap for who they are Same subject: A transduction model can rely entirely on self-attention for input and output representations without sequence-aligned RNNs or convolution. — tap to centre the map on it A transduction model can relyentirely on self-attention for inputand output representations withoutsequence-aligned RNNs orconvolution. Last stated 9 years ago 12 Jun 2017 IP Illia Polosukhin — holds since 2017-06-12 — tap for who they are JU Jakob Uszkoreit — holds since 2017-06-12 — tap for who they are NP Niki Parmar — holds since 2017-06-12 — tap for who they are AV Ashish Vaswani — holds since 2017-06-12 — tap for who they are NS Noam Shazeer — holds since 2017-06-12 — tap for who they are AG Aidan N. Gomez — holds since 2017-06-12 — tap for who they are +2 2 more Same subject: As reasoning models and agents retain more tokens for longer, KV-cache size and attention cost become the main constraint on scaling context. — tap to centre the map on it As reasoning models and agentsretain more tokens for longer,KV-cache size and attention costbecome the main constraint onscaling context. Last stated 6 months ago 16 May 2026 SR Sebastian Raschka — holds since 2026-05-16 — tap for who they are Same subject: Linear probes are very strong classifiers, and attention-head probes are even stronger. — tap to centre the map on it Linear probes are very strongclassifiers, and attention-headprobes are even stronger. Last stated 11 months ago 20 Dec 2025 NN Neel Nanda — holds since 2025-12-20 — tap for who they are Same subject: Looped/recurrent-depth transformer architectures can improve model quality at a fixed compute budget when the model is large enough. — tap to centre the map on it Looped/recurrent-depth transformerarchitectures can improve modelquality at a fixed compute budgetwhen the model is large enough. Last stated 2 months ago 9 Sept 2026 SR Sebastian Raschka — holds since 2026-09-09 — tap for who they are Same subject: Self-attention can yield more interpretable models. — tap to centre the map on it Self-attention can yield moreinterpretable models. Last stated 9 years ago 12 Jun 2017 IP Illia Polosukhin — holds since 2017-06-12 — tap for who they are JU Jakob Uszkoreit — holds since 2017-06-12 — tap for who they are NP Niki Parmar — holds since 2017-06-12 — tap for who they are AV Ashish Vaswani — holds since 2017-06-12 — tap for who they are NS Noam Shazeer — holds since 2017-06-12 — tap for who they are AG Aidan N. Gomez — holds since 2017-06-12 — tap for who they are +2 2 more Same subject: Context engineering has stayed relevant for a year because it is grounded in how transformer attention works, and it will matter to anyone building on AI until post-transformer models arrive. — tap to centre the map on it Context engineering has stayedrelevant for a year because it isgrounded in how transformerattention works, and it will matterto anyone building on AI untilpost-transformer models arrive. Last stated 4 months ago 15 Jul 2026 DH Dex Horthy — holds since 2026-07-15 — tap for who they are Same subject: Directly optimizing prompt embeddings (prefix-tuning) yields better performance than even a single optimized text prompt. — tap to centre the map on it Directly optimizing promptembeddings (prefix-tuning) yieldsbetter performance than even asingle optimized text prompt. Last stated 6 years ago 4 Feb 2021 GW Gwern — holds since 2021-02-04 — tap for who they are Same subject: Explicit positional methods are useful or essential because they provide attention with a direct signal about positions. — tap to centre the map on it Explicit positional methods areuseful or essential because theyprovide attention with a directsignal about positions. Last stated a week ago 15 Nov 2026 SR Sebastian Raschka — holds since 2026-11-15 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 2015 to today — full is todaya face: someone who holds the claim — tap it for who they are

At the centre Transformer-based models are not the future, are not really intelligent, and will not lead to AGI. Last stated 14 Nov 2024 · 2 years ago Holds Ed Zitron Read this korrent →