LLMs
- DH
26 Aug 2026
David Heinemeier Hansson quoted
So we should also have the humility. As amazing as the LLMs are now, it could be that they eventually plateau. We haven't seen any evidence of it yet, and I think this is also why we're seeing this absolute gobsmacking levels of investment, because so far the scaling laws are true, and the more billions are poured in, the more intelligence comes out.
- 3 days earlier
- PG
23 Aug 2026
Paul Graham quoted
Someone asked what I'd do if I were 17. I'd learn how to build LLMs from scratch, and then train ones as powerful as I could with whatever hardware I could get access to.
- 2 weeks earlier
- FC
7 Aug 2026
François Chollet quoted
No longer holdsThe LLM line of research will reach a capability plateau.
In the era of base LLM scaling (2022-2024), I believed the LLM line of research would reach a capability plateau (as later seen with base LLMs). In late 2024, after the o3 test-time compute demo, I changed my views: the new models were showing genuine fluid intelligence, and with this new line of work, the LLM line of research could achieve unbounded capability scaling. "There will be no wall."
SaidIn the era of base LLM scaling (2022-2024), I believed the LLM line of research would reach a capability plateau (as later seen with base LLMs). In late 2024, after the o3 test-time compute demo, I changed my views: the new models were showing genuine fluid intelligence, and with this new line of work, the LLM line of research could achieve unbounded capability scaling. "There will be no wall."
- 4 months earlier
- AK
28 Mar 2026
Andrej Karpathy quoted
The LLMs may elicit an opinion when asked but are extremely competent in arguing almost any direction. This is actually super useful as a tool for forming your own opinions, just make sure to ask different directions and be careful with the sycophancy.
- 3 days earlier
- AK
25 Mar 2026
Andrej Karpathy quoted
One common issue with personalization in all LLMs is how distracting memory seems to be for the models. A single question from 2 months ago about some topic can keep coming up as some kind of a deep interest of mine with undue mentions in perpetuity.
- 4 weeks earlier
- BC
25 Feb 2026
Boris Cherny quoted
HoldsBuild for the model six months from now, not the model of today.
At Anthropic, we don't build for the model of today, we build for the model of six months from now. And that's still my advice to founders that are building on LLMs.
↗Y Combinator, quoting Boris Cherny on the Lightcone Podcastx.com
- 9 months earlier
- TP
2 Jun 2025
Thomas Ptacek quoted
All progress on LLMs could halt today, and LLMs would remain the 2nd most important thing to happen over the course of my career.
- TP
2 Jun 2025
Thomas Ptacek quoted
LLMs can write a large fraction of all the tedious code you’ll ever need to write. And most code on most projects is tedious. LLMs drastically reduce the number of things you’ll ever need to Google.
- 8 weeks earlier
- AK
7 Apr 2025
Andrej Karpathy quoted
So it strikes me as quite unique and remarkable that LLMs display a dramatic reversal of this pattern - they generate disproportionate benefit for regular people, while their impact is a lot more muted and lagging in corporations and governments.
↗Power to the people: How LLMs flip the script on technology diffusionkarpathy.bearblog.dev
- 4 months earlier
- FC
20 Dec 2024
François Chollet quoted
This "memorize, fetch, apply" paradigm can achieve arbitrary levels of skills at arbitrary tasks given appropriate training data, but it cannot adapt to novelty or pick up new skills on the fly (which is to say that there is no fluid intelligence at play here.)
↗OpenAI o3 Breakthrough High Score on ARC-AGI-Pubarcprize.org
- FC
20 Dec 2024
François Chollet quoted
OpenAI's new o3 model represents a significant leap forward in AI's ability to adapt to novel tasks. This is not merely incremental improvement, but a genuine breakthrough, marking a qualitative shift in AI capabilities compared to the prior limitations of LLMs.
SaidOpenAI's new o3 model represents a significant leap forward in AI's ability to adapt to novel tasks. This is not merely incremental improvement, but a genuine breakthrough, marking a qualitative shift in AI capabilities compared to the prior limitations of LLMs.
↗OpenAI o3 Breakthrough High Score on ARC-AGI-Pubarcprize.org