Jakub Pachocki's mental models

Their wordsStill, I expect general AI progress to increasingly be bottlenecked by confidence in monitoring.

Their wordsScaling AI systems has to be constrained by our confidence in safety.

Their wordsI expect and hope for voluntary slowdowns to become commonplace until shared safety bars are established.

Their wordsAnd I believe that international coordination on future AI development needs to become a top priority for governments around the world.

Their wordsAI is grown more than designed - it is, to first degree, the product of repeating a straightforward optimization step many times on a hard-to-imagine amount of compute.