Relying on gradual, continuous shifts in AI training behavior to catch misalignment will eventually fail because the dangerous shift itself may be discontinuous.
Zvi Mowshowitz I worry a lot about reliances on continuity failing at exactly the most dangerous time.
Writes Don't Worry About the Vase
Their wordsI worry a lot about reliances on continuity failing at exactly the most dangerous time.