korrents

Our readingWhat is a korrent?

Fine-tuned model organisms are weak test cases, because fine-tuning gives them no reason not to think about the objective all the time.

Drawn from what Neel Nanda said

What this subject means

reinforcement learning Training by reward: environments, verifiable tasks, value functions, and whether it works or merely beats what came before.

What Neel Nanda actually said

  1. Neel Nanda Runs the mechanistic interpretability team at Google DeepMind
    I think this is a weakness of the fine-tuned model organisms studied in that because they are fine-tuned, there's no downside to not think about the fine-tuning objective all the time

Added to korrents 9 Nov 2026 · How quotes work · Something wrong? Tell us

Do you hold this korrent?Do you also believe this?

I hold this too

Related korrents

Shared subject first, then similar wording. They may agree or disagree.

See this claim on the map