korrents

← People and their mental models

Nathan Lambert's mental models

5 claims Nathan Lambert made fit 4 mental models. Most often: Bottlenecks, Emergence, Feedback loops. Everything they said here.

Models they name

Their own words name the idea.

Feedback loops

Shorten the loop between doing and finding out; whatever a loop rewards is what you become.

Used by 60 others

Open-source AI is still an ideological mission rather than an ecosystem, because it has none of the feedback loops that make open-source software compound.

  1. Nathan Lambert Machine-learning researcher on open language models until there are feedback loops of open source AI, it seems like mostly an ideological mission. People like Mark Zuckerberg, which is like America needs this and I agree with him, but in the time where the motivation ideologically is high, we need to capitalize and build this ecosystem around, what benefits do you get from seeing the language model data? DeepSeek, China, OpenAI, NVIDIA, xAI, TSMC, Stargate, and AI Megaclusters | Lex Fridman Podcast #459youtube.com · 3 Feb 2025 · 4:46:12 into the videoAll korrents from this video
    Their wordsuntil there are feedback loops of open source AI, it seems like mostly an ideological mission. People like Mark Zuckerberg, which is like America needs this and I agree with him, but in the time where the motivation ideologically is high, we need to capitalize and build this ecosystem around, what benefits do you get from seeing the language model data?

    Where this was said

    Watch from 4:46:12 plays here

    ↗DeepSeek, China, OpenAI, NVIDIA, xAI, TSMC, Stargate, and AI Megaclusters | Lex Fridman Podcast #459youtube.com

    3 Feb 2025 · video · 5h 06m · spoken · official transcript

Models we see in what they say

Our reading: their claim applies the idea without naming it. The claim is theirs; filing it here is ours.

Bottlenecks

A system moves only as fast as its narrowest point; speed up anything else and nothing changes.

Used by 88 others

Language models have not made misinformation meaningfully worse, because distribution, not the cost of writing convincing text, was always the limiting factor.

  1. Nathan Lambert Machine-learning researcher on open language models There's some research that shows that the distribution is actually the limiting factor. So language models haven't yet made misinformation particularly change the equation there. DeepSeek, China, OpenAI, NVIDIA, xAI, TSMC, Stargate, and AI Megaclusters | Lex Fridman Podcast #459youtube.com · 3 Feb 2025 · 1:12:49 into the videoAll korrents from this video
    Their wordsThere's some research that shows that the distribution is actually the limiting factor. So language models haven't yet made misinformation particularly change the equation there.

    Where this was said

    Watch from 1:12:49 plays here

    ↗DeepSeek, China, OpenAI, NVIDIA, xAI, TSMC, Stargate, and AI Megaclusters | Lex Fridman Podcast #459youtube.com

    3 Feb 2025 · video · 5h 06m · spoken · official transcript

Progress toward AI autonomously solving major open scientific problems requires first mastering the organization and presentation of established knowledge in long-form writing.

  1. Nathan Lambert Machine-learning researcher on open language models Models being stagnant in long-form, non-fiction writing should be alarming to those reliant on models autonomously solving grand, open science problems in the near future. I wrote an AI textbook — how long until AI can do it better?interconnects.ai · 12 Aug 2026All korrents from this piece
    Their wordsModels being stagnant in long-form, non-fiction writing should be alarming to those reliant on models autonomously solving grand, open science problems in the near future.

    ↗I wrote an AI textbook — how long until AI can do it better?interconnects.ai

    12 Aug 2026

Emergence

Whole systems do things none of their parts do, and nobody has to design that order for it to appear.

Used by 22 others

Reasoning is not taught to a model by people: it emerges from reinforcement learning on questions with checkable answers, with no human preference data at all.

  1. Nathan Lambert Machine-learning researcher on open language models And these reasoning behaviors emerge naturally. So these things like, "Wait, let me see. Wait, let me check this. Oh, that might be a mistake." And they emerge from only having questions and answers. DeepSeek, China, OpenAI, NVIDIA, xAI, TSMC, Stargate, and AI Megaclusters | Lex Fridman Podcast #459youtube.com · 3 Feb 2025 · 2:43:31 into the videoAll korrents from this video
    Their wordsAnd these reasoning behaviors emerge naturally. So these things like, "Wait, let me see. Wait, let me check this. Oh, that might be a mistake." And they emerge from only having questions and answers.

    Where this was said

    Watch from 2:43:31 plays here

    ↗DeepSeek, China, OpenAI, NVIDIA, xAI, TSMC, Stargate, and AI Megaclusters | Lex Fridman Podcast #459youtube.com

    3 Feb 2025 · video · 5h 06m · spoken · official transcript

Trade-offs

Every choice gives something up, so name the cost; and check, because some trade-offs everyone assumes are not real.

Used by 60 others

Making safety your number one goal costs real release speed, and on a steep progress curve that shows up directly as a worse-looking model.

  1. Nathan Lambert Machine-learning researcher on open language models We know that a lot of the American companies are very invested in safety, and that is the central culture of a place like Anthropic. And I think Anthropic sounds like a wonderful place to work, but if safety is your number one goal, it takes way longer to get artifacts out. DeepSeek, China, OpenAI, NVIDIA, xAI, TSMC, Stargate, and AI Megaclusters | Lex Fridman Podcast #459youtube.com · 3 Feb 2025 · 2:17:46 into the videoAll korrents from this video
    Their wordsWe know that a lot of the American companies are very invested in safety, and that is the central culture of a place like Anthropic. And I think Anthropic sounds like a wonderful place to work, but if safety is your number one goal, it takes way longer to get artifacts out.

    Where this was said

    Watch from 2:17:46 plays here

    ↗DeepSeek, China, OpenAI, NVIDIA, xAI, TSMC, Stargate, and AI Megaclusters | Lex Fridman Podcast #459youtube.com

    3 Feb 2025 · video · 5h 06m · spoken · official transcript