Capping the power of the most powerful superintelligence would be materially helpful, whatever the difficulty of doing it.

Added to korrents 25 Nov 2025 · How quotes work · Something wrong? Tell us

Related korrents

Our reading — they may agree, disagree or merely touch the same thing. Closest first: a shared subject counts for most, then how near the wording is.

• A human being is not an AGI: we lack a huge amount of knowledge and rely on continual learning instead, so continual learning is what superintelligence should mean. ISIlya Sutskever25 Nov 2025AI alignment
• A superintelligence needs no consciousness, emotions or malice to be dangerous; a goal system slightly misaligned with ours is enough. ÉTÉmile P. Torres24 Oct 2017AI alignment
• AI safety advocates will build the very thing they fear: one controlled, aligned model is the only route to being turned into paperclips. GHGeorge Hotz29 Jun 2023AI alignment
• Alignment failures that matter will not show up at safe capability levels, because the reason to hide misbehaviour only exists once hiding it pays. EYEliezer Yudkowsky10 Jun 2022AI alignment
• Alignment has to be right on the first try at a dangerous level of capability, because failing at that level leaves nobody to try again. EYEliezer Yudkowsky10 Jun 2022AI alignment

On the map

Open the map on its own page →