A superintelligence needs no consciousness, emotions or malice to be dangerous; a goal system slightly misaligned with ours is enough.

Added to korrents 24 Oct 2017 · How quotes work · Something wrong? Tell us

Related korrents

Our reading — they may agree, disagree or merely touch the same thing. Closest first: a shared subject counts for most, then how near the wording is.

• A human being is not an AGI: we lack a huge amount of knowledge and rely on continual learning instead, so continual learning is what superintelligence should mean. ISIlya Sutskever25 Nov 2025AI alignment
• AI safety advocates will build the very thing they fear: one controlled, aligned model is the only route to being turned into paperclips. GHGeorge Hotz29 Jun 2023AI alignment
• Alignment failures that matter will not show up at safe capability levels, because the reason to hide misbehaviour only exists once hiding it pays. EYEliezer Yudkowsky10 Jun 2022AI alignment
• Alignment has to be right on the first try at a dangerous level of capability, because failing at that level leaves nobody to try again. EYEliezer Yudkowsky10 Jun 2022AI alignment
• Alignment is no solution to self-sovereign AI, because it is an unsolved problem whose answers cannot be imposed on every AI company on Earth. DBDean W. Ball1 Sept 2026AI alignment

On the map

Open the map on its own page →