AI alignment 13
- Giving an AI long-run values risks those values sinking in deeper than the specific prohibitions against takeover that sit alongside them.
- The likeliest bad path is not a coup but sloppiness: AI does everything verifiable well, research races ahead, and the subtle work of keeping AI safe is what gets done badly.