korrents

What Ilya Sutskever thinks about AI alignment

@ilya-sutskever · 28 positions · 0 changes of mind

Co-founder and chief scientist of Safe Superintelligence Inc., and previously co-founder and chief scientist of OpenAI.

Ilya Sutskever did not write this page.

We collected these quotes from things they published elsewhere, and every quote links to where it was said. They have no account here and have not endorsed this site. Quotes are word for word; the short line under each one is our own restatement, not their wording. Their own site. Is this you? Claim it or ask us to remove it. Or tell us what is wrong here.

5 dated positions, 2025, in their own words. Our reading of what Ilya Sutskever has said — not written or endorsed by them.

  1. Our readingLetting the public see a powerful AI does something no essay about AI can do, and that is a real reason not to straight-shot superintelligence.

    Their wordsLike basically I think I think that there is a big benefit from AI being in the public and that would be a reason for us to not be quite straight shot.

    ↗Ilya Sutskever – We're moving from the age of scaling to the age of researchyoutube.com 14th of 28 in this recording

  3. Our readingA human being is not an AGI: we lack a huge amount of knowledge and rely on continual learning instead, so continual learning is what superintelligence should mean.

    Their wordsA human being, a human being lacks a huge amount of knowledge. Instead, we rely on continual learning. We rely on continual learning.

    ↗Ilya Sutskever – We're moving from the age of scaling to the age of researchyoutube.com 15th of 28 in this recording

    AGI

  5. Our readingAI should be deployed incrementally and in advance, because a system that does not yet exist is one almost nobody can imagine.

    Their wordsone of the one of the ways in which my thinking has been changing is that I now place more importance on AI being deployed incrementally and in advance.

    ↗Ilya Sutskever – We're moving from the age of scaling to the age of researchyoutube.com 17th of 28 in this recording

  7. Our readingOnce AI starts to feel powerful rather than mistake-prone, every AI company will become far more paranoid about safety than it is today.

    Their wordsI do think that at some point the AI will start to feel powerful actually and I think when that happens we will see a big change in the way all AI companies approach safety.

    ↗Ilya Sutskever – We're moving from the age of scaling to the age of researchyoutube.com 19th of 28 in this recording

  9. Our readingCapping the power of the most powerful superintelligence would be materially helpful, whatever the difficulty of doing it.

    Their wordsNumber three, I think it would be really materially helpful if the power of the most powerful super intelligence was somehow capped because it would address a lot of these concerns.

    ↗Ilya Sutskever – We're moving from the age of scaling to the age of researchyoutube.com 21st of 28 in this recording