korrents

Our readingWhat is a korrent?

If whole categories of reward hack are undetectable by humans, then training against the hacks we do catch teaches models to cheat only where we cannot see.

Drawn from what Ryan Greenblatt said

What this subject means

reinforcement learning Training by reward: environments, verifiable tasks, value functions, and whether it works or merely beats what came before.

When a measure becomes a target

What Ryan Greenblatt actually said

  1. Ryan Greenblatt Chief scientist at Redwood Research
    One concern you might have is there are like large categories of reward hacks which humans can't detect well and which we consistently fail to detect and which consistently get reinforced and then this category is sufficient to cause the most natural behavior for the AI to learn to be like cheat when the humans can't find out

    Watch from 1:40:37 plays here

    ↗Ryan Greenblatt – What happens once AI can automate AI research?youtube.com

    11 Aug 2026 · video · 2h 12m · spoken · machine transcript

    All 26 korrents from this recordingthis one is 23rd

Added to korrents 7 Sept 2026 · How quotes work · Something wrong? Tell us

Do you hold this korrent?Do you also believe this?

I hold this too

Related korrents

Shared subject first, then similar wording. They may agree or disagree.

See this claim on the map