korrents

Our readingWhat is a korrent?

Static benchmarks with an LLM judge are not something to be fully happy with as a long-term way to evaluate frontier systems.

Drawn from what Neel Nanda said

What Neel Nanda actually said

  1. Neel Nanda Runs the mechanistic interpretability team at Google DeepMind
    I think that the like standard paradigm of evaluation where you just have some static benchmark um maybe a benchmark with like an LLM judge at the end with a specific rubric is kind of sus and not something that I would be fully happy with in the long term as methods of evaluating frontier systems

    Watch from 0:07:40 plays here

    ↗How Aligned Is Claude? A Live Review of the Opus 4.5 System Cardyoutube.com

    27 Dec 2025 · video · 2h 14m · spoken · machine transcript

    All 27 korrents from this recordingthis one is 1st

Added to korrents 9 Nov 2026 · How quotes work · Something wrong? Tell us

Do you hold this korrent?Do you also believe this?

I hold this too

Related korrents

Shared subject first, then similar wording. They may agree or disagree.

See this claim on the map