On the map

At the centre Process supervision by an LLM judge cannot be run for long, because a judge with billions of parameters is gameable and RL will find its cracks. Holds AKAndrej Karpathy Read this korrent →

• Same subject: LLMs A language model is no substitute for a well-specified conventional algorithm, so it cannot simply be dropped into a complex problem and trusted. Holds GMGary Marcus
• Same subject: LLMs A language model is not using language at all, because language requires an intention to communicate. Holds TCTed Chiang
• Same subject: LLMs A language model's apparent mind is mostly our own bias: it predicts text, and leverages our evolved habit of attributing intentionality to anything that acts human. Holds SCSean Carroll
• Same subject: LLMs A large language model is the genetic system for language: it stores the dynamics of a structure that until now lived only across human brains. Holds SWSara Walker
• Same subject: LLMs A swarm of untrusted volunteers on the internet could improve models and run circles around the frontier labs, because the earth has far more compute than they do. Holds AKAndrej Karpathy
• Same subject: LLMs AI-written code makes formal proof necessary, because human review of all that generated code becomes the bottleneck. Holds MKMartin Kleppmann
• Same subject: LLMs Almost every major figure in AI has now arrived at the critique of large language models he began making in 2019. Holds GMGary Marcus
• Same subject: LLMs AlphaGo and MuZero are far more impressive than large language models, because they play beyond the best humans while the models write middle-school essays. Holds GHGeorge Hotz