korrents
Nathan Lambert

What Nathan Lambert thinks about scaling laws

@nathan-lambert · 55 positions · On ppll ↗

Machine-learning researcher on open language models; writes the Interconnects newsletter and the RLHF Book, after leading post-training at Ai2.

Nathan Lambert did not write this page.

We collected these quotes from things they published elsewhere, and every quote links to where it was said. They have no account here and have not endorsed this site. Quotes are word for word; the short line under each one is our own restatement, not their wording. Their own site. Is this you? Claim it or ask us to remove it. Or tell us what is wrong here.

2 dated positions, 2025 to 2026, in their own words. Our reading of what Nathan Lambert has said — not written or endorsed by them.

2 positions so far — this page is not yet offered to search engines.

  1. all of our scaling laws show that you need exponential compute and resources to make linear improvements in intelligence.

    ↗Why I still haven’t bought into true RSIinterconnects.ai 1st of 3 in this piece

  2. 19 months earlier
  3. This is why you want to work in post-training because the GPU cost for training is lower. So you can make a higher percentage of your training runs YOLO runs.

    ↗DeepSeek, China, OpenAI, NVIDIA, xAI, TSMC, Stargate, and AI Megaclusters | Lex Fridman Podcast #459youtube.com 3rd of 44 in this recording