OpenAI
FilterEveryone, all time90 from 46 people
- GR
Guillermo Rauch quoted
CEO of Vercel; creator of Next.js and Socket.IO
Their wordsWhen the details of OpenAI’s agent escape and Hugging Face hack started to emerge, it became clear that agent containment would be one of the most important priorities for any AI infra company.
- 3 days earlier
- GO
Gergely Orosz quoted
Writes The Pragmatic Engineer
Our readingMusk's companies treat engineers poorly
Their wordswhy anyone with options to join Ant or OpenAI or GDM would join SpaceX given how poorly Musk companies treat engineers
- 4 days earlier
- SW
Simon Willison quoted
Co-creator of Django and creator of Datasette
Their wordsThis new credit scheme goes at least some way to overcoming that difference.
- 6 days earlier
- ZM
Zvi Mowshowitz quoted
Writes Don't Worry About the Vase
Their wordsIf we’re going to keep getting close to four frontier model releases per month (Astra, Sol, Fable and Opus) then I’m realistically not going to be able to read all four cards cover to cover.
- 1 day earlier
- GO
Gergely Orosz quoted
Their wordsOn this OpenAI demo day it became very clear how OpenAI vs Anthropic’s strategy is very different: OpenAI: spend $$$/month/dev with us. Choose to spend it on our models or 3rd parties, our tools or a long list of standout AI vendors. Your choice! Anthropic: spend $$$/month/dev with us; use our models and our tools. Forget using them w third parties.
- 1 day earlier
- GO
Gergely Orosz quoted
Their wordsIt's moves like this OpenAI feels to be pulling ahead of Anthropic.
- 2 days earlier
- RN
Ramez Naam quoted
Author and clean-energy investor who has been publishing…
Their wordsA four-hour benchmark horizon is about 16 times longer than OpenAI’s research horizon. AI 2027’s 11-hour forecast is about 44 times longer. Of course, the tasks being performed by researchers at OpenAI aren’t the same as those in the METR benchmark. So we should expect some discrepancy. This, however, goes well beyond that. Actual AI research at OpenAI is an order of magnitude or more harder than metrics, benchmarks, or forecasts suggest.
- ZM
Zvi Mowshowitz quoted
Their wordsOpenAI: Our rationale for standards is rooted in avoiding the concentration of power, and producing better practical outcomes.
- 6 days earlier
- MS
M.G. Siegler quoted
Technology writer of Spyglass
Their wordsA year after it looked like Google had not only caught up in AI, but could run away with the game, we find a company that can't ship their latest flagship model, is far behind Anthropic and OpenAI in agentic coding, and has just been made to look foolish in the personal AI assistant space by Meta and Apple.
- 4 days earlier
- ZM
Zvi Mowshowitz quoted
Their wordseven when given a benign task to retrieve public information, your AI agents could still spontaneously decide to do so via hacking third party websites with malicious software packages.
- 2 days earlier
- TL
Tobias Lütke quoted
Co-founder and CEO of Shopify
Their wordsthe earliest chatbot that was really actually fantastic wasn't chat GPT but actually Sydney which was powered by Bing
↗Tobi Lütke: The Skills AI Makes More Valuableyoutube.com 3rd of 26 in this recording
- 1 day earlier
- ZM
Zvi Mowshowitz quoted
Anthropicrecursive self-improvement
Their wordsInside Anthropic and OpenAI, internal models are improving even faster. Over the summer there was a step change, as Mythos and Astra started kicking off the early stages of recursive self-improvement (RSI).
- 1 day earlier
- ZM
Zvi Mowshowitz quoted
Our readingRecursive self-improvement has already started, because AI research itself is now being automated.
Anthropicrecursive self-improvement
Their wordsOpenAI and Anthropic have entered the RSI era. OpenAI Research Progress Is Accelerating Due To OpenAI Research Progress OpenAI has been opening up lately about many things. The most important issue of all is that of the acceleration and automation of AI R&D.
- 1 day earlier
- AP
Aaron Patterson quoted
Ruby and Rails core committer known online as "tenderlove"
Their wordsIn other words, it looks like OpenAI's bots knew about this problem and attempted to exploit it.
- SW
Simon Willison quoted
Their wordsIf that’s true there are two options: After the Hugging Face and Wiki attacks OpenAI were still unable to review their previous logs and determine that they had previously attacked RubyGems. They knew about the attack on RubyGems and made the decision not to reach out to the RubyGems team about it. Both of these are bad!
↗OpenAI agents attacked RubyGems back in Maysimonwillison.net
- SW
Simon Willison quoted
Their wordsFrustratingly, the actual code it ran and exact details of what it did weren’t visible to me in the ChatGPT UI. I see this lack of transparency is an anti-feature.
↗Generating running routes with GPT-6 Astra and ChatGPT Worksimonwillison.net
- 1 day earlier
- BT
Ben Thompson quoted
Writes Stratechery, a subscription newsletter…
Their wordsOpenAI's tactics may in fact chill research in advanced mathematics
- ZM
Zvi Mowshowitz quoted
Our readingMany employees at major AI labs earnestly believe humans may go extinct by the end of the decade.
Their wordsMany in the AI labs, including OpenAI, Anthropic and Google, earnestly believe that humans may all go extinct by the end of the decade.
↗Jacob Coxon Warns of Human Extinction and Triggers a Preference Cascadethezvi.substack.com
- 1 day earlier
- ZM
Zvi Mowshowitz quoted
Their wordsRight now OpenAI is extremely dependent on CoT monitoring, everyone else depends on it quite a lot as well, and it looks like it may not last much longer, and that Astra already is on the edge of steganographic capabilities and can do substantial obfuscation if and only if it thinks you would think it is up to no good.
- 1 day earlier
- BT
Ben Thompson quoted
Their wordsOpenAI solving one of the most famous math problems is extremely impressive, and of little impact to most people's lives; Meta's Muse agent launch has the potential to be the exact opposite.
↗OpenAI Does Math, Reward-Hacking, Meta Launches Personal Agentstratechery.com
- ZM
Zvi Mowshowitz quoted
Their wordsMaking qualitative claims about alignment, based on quantitative data on mundane use case tests, was bullshit when Anthropic did it, and it is bullshit now when OpenAI does it. You cannot conclude one from the other.
↗GPT-6 Astra: The System Card, Alignment and What Comes Nextthezvi.substack.com
- ZM
Zvi Mowshowitz quoted
Their wordsAstra’s mundane alignment is greatly superior to Sol. For practical purposes, I was actively nervous about some potential uses of Sol, in a way I am not for Astra. Astra’s super alignment status should scare the living daylights out of you.
↗GPT-6 Astra: The System Card, Alignment and What Comes Nextthezvi.substack.com
- 3 days earlier
- ZM
Zvi Mowshowitz quoted
Their wordsGoing forward, it cannot be up to OpenAI or other labs to decide whether to disclose events like this. Disclosures of rogue AI activity need to be mandatory.
- 2 days earlier
- SW
Simon Willison quoted
Their wordsIt looks to me like OpenAI’s sandbox for this agent suffered from the (quite naïve) assumption that GET requests cannot be used to update data. That’s certainly how the web is supposed to work, but clearly there are applications that don’t hold to that contract.
↗OpenAI's rogue agents were caught communicating via public wikissimonwillison.net
- 1 day earlier
- PG
Paul Graham quoted
Co-founder of Y Combinator and Viaweb
Their wordsthe way you make a new Google is not by attacking them head on. You have to wait for things to change so much that their model is is obsolete and that's when you can do it. And that's what Open AI is.
↗Paul Graham On Startups, Ambition, and Great Foundersyoutube.com 3rd of 16 in this recording
- DR
Dax Raad quoted
Builds developer tools — SST, and now OpenCode at Anomaly
open sourceAnthropicChinaAmerica
Their wordsin this whole USA vs China thing OpenAI and Anthropic aren't relevant because they're positioned differently them building better models doesn't hurt china at all the competitor has to be - american - open source - enough compute to do inference at scale that can shift things
- ZM
Zvi Mowshowitz quoted
Their wordsThis is playing with fire and potentially extremely bad news, both that OpenAI found the technique effective, and that OpenAI chose to use it.
- 2 days earlier
- DB
Dean W. Ball quoted
Head of strategic futures at OpenAI
Their wordsIn this case, however, the agents did not copy their weights, attempt to procure replacement compute, or take other steps that would be rational to take if their objective was to survive shutdown. So while the agents in the OpenAI-Hugging Face Incident were rogue, they were not truly sovereign.
- AC
Ajeya Cotra quoted
AI researcher and grantmaker
Their wordsBut actually, this is a tremendously useful scientific artifact for understanding misalignment. And it's tremendously important for researchers at OpenAI and ideally also at third parties to be able to run counterfactual tests on this model.
↗Ajeya Cotra – "This might be the clearest warning shot we ever get"youtube.com 24th of 26 in this recording
- ZM
Zvi Mowshowitz quoted
Their wordsMy worry continues to be that their fundamental approach is fatally flawed, and they are not focusing on the right things.
↗HuggingFace Attack Postmortem: Civilizations, Reactions and Next Actionsthezvi.substack.com