Language models cannot be a prior for learning from experience, because a prior needs a ground truth to be a prior about and they have none.

Added to korrents 26 Sept 2025 · How quotes work · Something wrong? Tell us

Related korrents

Our reading — they may agree, disagree or merely touch the same thing. Closest first: a shared subject counts for most, then how near the wording is.

• A language model can predict what a person would say but not what will happen, and only the second of those is a model of the world. RSRichard Sutton26 Sept 2025similar wording
• Large language models start in exactly the wrong place, because they try to get by without a goal and therefore without any sense of better or worse. RSRichard Sutton26 Sept 2025similar wording
• Large language models are a bad way to do science, because they have been fed so much that nobody knows what they already knew. RSRichard Sutton26 Sept 2025similar wording
• Language models have not made misinformation meaningfully worse, because distribution, not the cost of writing convincing text, was always the limiting factor. NLNathan Lambert3 Feb 2025similar wording
• The knowledge a model soaks up in pre-training is holding it back; what we actually want is the intelligence with the knowledge stripped out. AKAndrej Karpathy17 Oct 2025similar wording

On the map

Open the map on its own page →