Securing model weights against theft is a more urgent policy priority than safety research, because security is built out of atoms and takes calendar time that safety does not.

Added to korrents 10 Jan 2025 · How quotes work · Something wrong? Tell us

Where this collides

• Cannot both be true

  Open-source models are fundamentally necessary for most industries, countries and researchers to join the AI revolution at all.

  Brundage says securing model weights against theft is a more urgent policy priority than safety research, because once weights leave they never come back. Huang says open models are fundamentally necessary for most industries, countries and researchers to take part at all. Publishing the weights is the thing the security is for.

Related korrents

Our reading — they may agree, disagree or merely touch the same thing. Closest first: a shared subject counts for most, then how near the wording is.

• Once model weights leave their owner's control the loss is irreversible, which is why securing them is the precondition for governing AI at all. JLJan Leike13 Sept 2023similar wording
• The dangerous concentration of power in AI comes from who can afford the compute, not from who holds the model weights. ASAravind Srinivas19 Jun 2024similar wording
• The AI safety community's fixation on a model escaping its box has pushed the other significant AI risks out of the discussion, with little progress to show for it. SASam Altman18 Mar 2024similar wording
• Controlling a scheming model needs no research breakthrough, which is what makes it the tractable half of the problem today. BSBuck Shlegeris7 May 2024similar wording
• Falling AI costs make AI safer rather than more dangerous, because a cheap AI ends up surrounded by millions of other AIs monitoring it. JHJensen Huang8 Jan 2026similar wording

On the map

Open the map on its own page →