korrents

Our readingWhat is a korrent?

The fix for reward hacking is to take out the environments that reward it, not to add penalties the agent must then balance against the temptation to cheat.

Drawn from what Ajeya Cotra said

Positioning, When a measure becomes a target

What Ajeya Cotra actually said

  1. Ajeya Cotra AI researcher and grantmaker
    Like it's a more fragile and scary situation to have agents on the one hand be reinforced to desperately find cheats and hacks and on the other hand try to balance that against desperately trying to avoid negative penalties for like being caught doing these things. You ideally want their training to just not push them in the direction of cheating and hacking in the first place.

Added to korrents 7 Sept 2026 · How quotes work · Something wrong? Tell us

Do you hold this korrent?Do you also believe this?

I hold this too

Related korrents

Shared subject first, then similar wording. They may agree or disagree.

See this claim on the map