korrents
Nathan Lambert

What Nathan Lambert thinks about benchmarks

@nathan-lambert · 93 positions · 1 change of mind · On ppll ↗

Machine-learning researcher on open language models; writes the Interconnects newsletter and the RLHF Book, after leading post-training at Ai2.

Nathan Lambert did not write this page.

We collected these quotes from things they published elsewhere, and every quote links to where it was said. They have no account here and have not endorsed this site. Quotes are word for word; the short line under each one is our own restatement, not their wording. Their own site. Is this you? Claim it or ask us to remove it. Or tell us what is wrong here.

1 dated position, 2026, in their own words. Our reading of what Nathan Lambert has said — not written or endorsed by them.

1 position so far — this page is not yet offered to search engines.

  1. they have such a financial incentive to show that they are keeping up. So even if the best intention of the researchers there is to be fair, they are going to figure out ways to make themselves look a bit better on the benchmarks for economic value and for the narrative of the company.

    ↗Open Language Models: Overview, Open Source History, Distillation, Risks, & Chinese Labsyoutube.com 8th of 19 in this recording