On the map

At the centre Future AI, say in fifteen years, will not be built on the LLM stack; it will have to move to symbolic learning. Holds François Chollet Read this korrent →

• In tension with Scaling laws are still working, but the models people actually use run a few months behind the maximum capability Google can deliver, because the biggest model is too slow and expensive to serve. Holds Sundar Pichai
• Same subject: LLMs A language model is no substitute for a well-specified conventional algorithm, so it cannot simply be dropped into a complex problem and trusted. Holds GMGary Marcus
• Same subject: LLMs A language model is not using language at all, because language requires an intention to communicate. Holds TCTed Chiang
• Same subject: LLMs A language model's apparent mind is mostly our own bias: it predicts text, and leverages our evolved habit of attributing intentionality to anything that acts human. Holds SCSean Carroll
• Same subject: LLMs A large language model is the genetic system for language: it stores the dynamics of a structure that until now lived only across human brains. Holds SWSara Walker
• Same subject: LLMs A swarm of untrusted volunteers on the internet could improve models and run circles around the frontier labs, because the earth has far more compute than they do. Holds Andrej Karpathy
• Same subject: LLMs AI-written code makes formal proof necessary, because human review of all that generated code becomes the bottleneck. Holds MKMartin Kleppmann
• Same subject: LLMs Almost every major figure in AI has now arrived at the critique of large language models he began making in 2019. Holds GMGary Marcus