korrents

korrents · piece

Should we control AI instead of aligning it?

Jan Leike · 24 Jan 2025 · aligned.substack.com ↗

2 korrents from this piece

Jan Leike did not write this page.

Every claim below was made in this piece, quoted word for word and numbered in the order the piece makes them, so you can read it there rather than take our word for it. The sentence above each quote is our reading of the claim, not their wording. Each quote was checked against a stored copy of the page at build time; where the two differ, the quote is the fact.

  1. Our reading

    We cannot know how much safety a control measure buys until we understand elicitation, so control adds a margin of unknown size.

    Their wordsHowever, without having a good handle on elicitation, we cannot be confident that our control techniques are effective.
    Interesting

  2. Our reading

    Building AI that can actually be trusted is the goal; containing an AI known to be misaligned is not a substitute for it.

    Their wordsMore generally, we should actually solve alignment instead of just trying to control misaligned AI.
    Interesting