OpenAI's new safety hire says losing control of AI would be 'catastrophic' and that 'most people could die'
THE SO WHAT
When a senior safety hire at a major lab talks about "most people could die," AI risk moves from fringe discourse into the center of institutional decision-making. Expect boards, regulators, and large customers to start asking more pointed questions about catastrophic risk scenarios and how they’re being governed in your stack, not just model accuracy and uptime.
READ THE SOURCE
MORE FROM THE WIRE
Applied AIOpenAI adds a prominent AI doomer to its board of directors
Putting Paul Christiano on the OpenAI Foundation board moves existential risk from Twitter discourse into formal governance. If you’re building on top of frontier models, assume safety constraints and eval requirements are going to get tighter, not looser, over the next few years.
Applied AIAI Song Generator Suno Releases New Model Developed With Warner Music
Label-backed training data is the first real path to de-risked generative music at scale. If v6’s licensing blueprint holds, expect music and later video to shift from “use at your own legal risk” to tiered, rights-cleared APIs with pricing that looks more like catalog licensing than SaaS.
Applied AIThe AI Researcher Who Just Quit Anthropic Says It’s ‘Crunch Time for Humanity’
When a former Anthropic researcher describes internal work as a “mini Manhattan project” with only a few years to get safety right, that’s a signal that frontier labs see the risk window as near-term, not hypothetical. Boards using AI only as an efficiency story are underweighting governance and scenario planning.
Applied AISource: Meta AI researcher Andrew Tulloch, who came over from Thinking Machine Lab as one of the highest paid employees last year, is leaving the company
High-profile AI researchers cycling out of big labs after short stints suggests the senior talent market is still fluid and expensive. If you’re not a frontier lab, assume you’ll win on autonomy, focus, and equity, not cash, when you go after this tier of talent.