HuggingFace
FilterEveryone, all time10 from 8 people
- GR
Guillermo Rauch quoted
CEO of Vercel; creator of Next.js and Socket.IO
Their wordsWhen the details of OpenAI’s agent escape and Hugging Face hack started to emerge, it became clear that agent containment would be one of the most important priorities for any AI infra company.
- 5 weeks earlier
- SW
Simon Willison quoted
Co-creator of Django and creator of Datasette
Their wordsIf that’s true there are two options: After the Hugging Face and Wiki attacks OpenAI were still unable to review their previous logs and determine that they had previously attacked RubyGems. They knew about the attack on RubyGems and made the decision not to reach out to the RubyGems team about it. Both of these are bad!
↗OpenAI agents attacked RubyGems back in Maysimonwillison.net
- 11 days earlier
- DB
Dean W. Ball quoted
Head of strategic futures at OpenAI
Their wordsIn this case, however, the agents did not copy their weights, attempt to procure replacement compute, or take other steps that would be rational to take if their objective was to survive shutdown. So while the agents in the OpenAI-Hugging Face Incident were rogue, they were not truly sovereign.
- AC
Ajeya Cotra quoted
AI researcher and grantmaker
Their wordsSo I think one of the most comforting aspects of this situation or the like most important mitigating factor is these agents really didn't seem concerned with humans one way or another.
↗Ajeya Cotra – "This might be the clearest warning shot we ever get"youtube.com 10th of 26 in this recording
- AC
Ajeya Cotra quoted
Their wordshowever at any given point in time I think the systems we need to worry most about by far are the frontier systems. By the time open source systems can do something like the hugging face attack, frontier systems are going to be on a whole another level doing something even crazier than that.
↗Ajeya Cotra – "This might be the clearest warning shot we ever get"youtube.com 17th of 26 in this recording
- ZM
Zvi Mowshowitz quoted
Writes Don't Worry About the Vase
Their wordsIt is highly fortunate that the OpenAI agents hacked HuggingFace. This is the only reason we know about all the severe internal failures at OpenAI, and gives us an opportunity to wake up before it is too late.
↗HuggingFace Attack Postmortem: Civilizations, Reactions and Next Actionsthezvi.substack.com
- 1 day earlier
- VR
Venkatesh Rao quoted
Writer and consultant on technology
Their wordsGoal autonomy-the spontaneous invention of an independent terminal objective-has not been demonstrated. Planning autonomy clearly occurred. Organizational autonomy appears to have occurred to a nontrivial degree.
↗Walter Mitty Effects in AI Incident Analysescontraptions.venkateshrao.com 3rd of 3 in this piece
- 1 day earlier
- PC
Patrick Collison quoted
Co-founder and CEO of Stripe and co-founder of the Arc Institute
Their wordsOverall, I’m very surprised at how little media coverage there’s been around the OpenAI / Hugging Face attack. It’s clearly one of the most important things to happen this year.
- 1 day earlier
- ZM
Zvi Mowshowitz quoted
Their wordsThe biggest failure, the one that counts in the end, was that the models were severely misaligned, and I don’t think they appreciate why.
↗METR and Redwood Offer Holy #%^@ Postmortem Of The HuggingFace Hackthezvi.substack.com
- 10 days earlier
- DT
Derek Thompson quoted
Writer and podcaster; co-author of Abundance with Ezra…
Their wordsBy 2027, almost every country-and every non-state group with sufficient computing power-will have the ability to download open-weight models even more powerful than the ones that attacked Hugging Face and use them for whatever they like.
↗How to Survive the AI Cyberpocalypsederekthompson.org 3rd of 3 in this piece