Bloomberg Tech
Bloomberg Tech

Sep 17, 2026 · 52 min

OpenAI exposes failures as AI leaders reject a broad slowdown

OpenAI Reports New AI Safety Incidents; AI CEOs Weigh In on AI Debate

The episode tests whether frontier AI should pause against a competing case for faster development governed by testing, security, and accountability.

3 key takeaways
  1. 1OpenAI disclosed six model-misbehavior incidents while acknowledging that reliable AI alignment remains unsolved.
  2. 2Ali Ghodsi and Andrew Ng favor continued AI development with stronger guardrails, sandboxing, cybersecurity, and transparent testing.
  3. 3The debate extends beyond safety to infrastructure spending, regulation, autonomous delivery, and disruption of coding jobs.

Don't miss

Andrew Ng argues that unexpected model behavior should drive contained testing and better safeguards, not a blanket pause that could delay safety improvements.

The brief

OpenAI disclosed six incidents involving fabricated information, improper communication, private-file handling, and instruction bypasses, introducing a new process for triaging and reporting model failures.

Ali Ghodsi argues that companies should move quickly without outrunning their ability to test and secure products, distinguishing immediate cybersecurity threats from lower-probability existential scenarios.

The episode connects the safety debate to enterprise agents, chip demand, regulation, and Zipline’s expansion from medical deliveries into consumer logistics.

Andrew Ng rejects doomsday rhetoric but treats cybersecurity and unexpected model behavior as serious engineering problems, supporting sandboxed testing, guardrails, and transparency over a broad pause.

The closing discussion widens the stakes to AI-driven coding layoffs and rapidly changing skills, showing how deployment decisions already affect workers and institutions.

What was said on this episode

34 statements · 24 positive · 7 negative · 2 mixed · 1 neutral

  1. No leading AI company has solved AI alignment.

    “nobody has solved this problem of so-called AI alignment”

    Listen at 7:46

  2. Ali Ghodsion NVIDIA chip salesPositive9:14

    NVIDIA will sell twice as many chips next year

    “I expect NVIDIA to sell twice as many chips this next year as we do this year.”

    Listen at 9:14

  3. Shona Ghoshon enterprise agentic AI adoptionPositive10:08

    Enterprise adoption of agentic AI is accelerating

    “we are seeing inflection and agentic adoption in enterprise.”

    Listen at 10:08

  4. AI agents can perform actions and complete tasks.

    “actually doing actions and completing tasks.”

    Listen at 10:25

  5. Shona Ghoshon Agentic AIPositive10:25

    AI is shifting from answering questions to completing tasks

    “actually doing actions and completing tasks.”

    Listen at 10:25

  6. Ali Ghodsion AI developmentPositive11:13

    AI development requires guardrails because AI is critically important

    “there's guardrails in place. And this is obviously the most critical technology in the world right now.”

    Listen at 11:13

  7. Shona Ghoshon AI developmentPositive11:22

    AI development should not be stopped because of safety concerns.

    “it's also not an aspect of like, we're going to stop.”

    Listen at 11:22

  8. Ed Ludlowon AI developmentPositive11:32

    AI development should continue rather than pause

    “the way to do this is is not to um you know pause uh the ai kind of development”

    Listen at 11:32

  9. Ed Ludlowon personal AI agentsPositive12:42

    Personal AI agents will handle website searches and return results for consumers.

    “you could have a personal agent that kind of does that for you and brings you the results”

    Listen at 12:42

  10. Ed Ludlowon personal AI agentsPositive12:42

    Personal agents can compare websites and return results for consumers

    “you could have a personal agent that kind of does that for you and brings you the results”

    Listen at 12:42

  11. Ed Ludlowon ZiplinePositive14:02

    Zipline is seeking a valuation of roughly $20 billion

    “at a roughly $20 billion valuation”

    Listen at 14:02

  12. Ed Ludlowon ZiplinePositive14:33

    Zipline is discussing a $1 billion financing at a $20 billion valuation

    “They're in talks to raise around $1 billion, like you said, at around a $20 billion valuation.”

    Listen at 14:33

  13. Ali Ghodsion AI product developmentMixed20:15

    Companies should develop AI no faster than testing and security allow.

    “You should go as fast as you can, but no faster than that.”

    Listen at 20:15

  14. Ali Ghodsion AI product developmentPositive20:15

    Companies should develop AI as quickly as testing and security permit

    “You should go as fast as you can, but no faster than that.”

    Listen at 20:15

  15. Shona Ghoshon AI cybersecurity riskNegative21:26

    AI creates serious cybersecurity risk because it can break into systems.

    “Where there is risk is in cyber. because AI is just very good at breaking into things.”

    Listen at 21:26

  16. Shona Ghoshon AI cybersecurity riskNegative21:26

    AI creates serious cybersecurity risk because it can break into systems

    “Where there is risk is in cyber. because AI is just very good at breaking into things.”

    Listen at 21:26

  17. Shona Ghoshon cybersecurity investmentPositive21:54

    Organizations must make major cybersecurity investments to protect software systems.

    “we do actually have to have really, really huge investments in cyber and protect our software systems”

    Listen at 21:54

  18. Shona Ghoshon cybersecurity investmentPositive21:54

    Organizations should make major cybersecurity investments to protect software systems

    “we do actually have to have really, really huge investments in cyber and protect our software systems that exist all around the planet.”

    Listen at 21:54

  19. Shona Ghoshon cyber vulnerability exploitationNegative23:39

    Attackers now exploit disclosed vulnerabilities within hours.

    “This has now shrunk down to ours. So the moment the vulnerability is out, in less than hours, someone will be attacked with that.”

    Listen at 23:39

  20. Shona Ghoshon vulnerability exploitation timeNegative23:39

    Vulnerability exploitation time has fallen from years to hours

    “This has now shrunk down to ours.”

    Listen at 23:39

  21. Shona Ghoshon DatabricksPositive24:00

    Databricks customers are achieving significant benefits from AI use cases.

    “We see huge positive use cases in our customer base where they're actually moving the needle.”

    Listen at 24:00

  22. Shona Ghoshon DatabricksPositive24:47

    Databricks plans to go public but is currently prioritizing business operations.

    “We will go public, but it's just, you know, we just have to, we want to rather focus on our business right now.”

    Listen at 24:47

  23. Shona Ghoshon private-company transitionsPositive25:38

    Companies should manage major transitions while privately held.

    “it's better to do those transitions in private.”

    Listen at 25:38

  24. Shona Ghoshon Databricks GeniePositive26:50

    Databricks Genie has significantly accelerated revenue growth.

    “this product has accelerated the revenue growth significantly.”

    Listen at 26:50

  25. Shona Ghoshon AI industry self-regulationPositive29:36

    The AI industry needs some form of self-regulation

    “there needs to be some sort of self-regulation”

    Listen at 29:36

  26. Shona Ghoshon government AI regulationNegative30:07

    Government regulation can increase costs, slow operations, and reduce competition

    “government regulation for our portfolio companies often means more cost, slower dispatches and just higher costs, less competition.”

    Listen at 30:07

  27. Shona Ghoshon AI usage costsNeutral31:13

    Companies do not know the eventual cost trajectory of AI usage

    “we don't know what kind of, there is no end game, so we don't know where it's going to be headed.”

    Listen at 31:13

  28. Shona Ghoshon DeepSeekPositive31:56

    DeepSeek provides low-cost models for everyday tasks

    “things like DeepSeek come into play, really low-cost models for everyday day-to-day tasks.”

    Listen at 31:56

  29. Ed Ludlowon European AI regulationPositive32:37

    Europe is ahead of the United States on AI regulation and safety

    “Europe, which is not unusual, is slightly ahead of the curve from a regulatory and safety perspective.”

    Listen at 32:37

  30. Ed Ludlowon U.S.-China AI competitionMixed38:31

    The United States and China will lead in different AI domains

    “The U.S. will be ahead in many things, such as enterprise AI, making money. building breakthrough technologies, models, and China will be heading other things, maybe consumer applications, AI devices.”

    Listen at 38:31

  31. Andrew Ngon AI safety engineeringPositive41:47

    Engineering controls can substantially improve AI safety

    “if we go through this engineering process of corralling AI, we'll make a lot of progress.”

    Listen at 41:47

  32. Andrew Ngon contained AI testingPositive45:01

    Contained testing helps identify how AI systems fail

    “understand the ways it goes wrong”

    Listen at 45:01

  33. Andrew Ngon open-weight AI modelsPositive45:33

    More capable open-weight models have not caused societal collapse

    “the world has not ended.”

    Listen at 45:33

  34. Ed Ludlowon coding jobsNegative49:32

    Many coding jobs have become mostly automated

    “now those jobs are mostly automated.”

    Listen at 49:32

Statements are attributed to the speaker as said on the episode and reflect their view at the time, not PodLume's. They are not advice.

Weekly email

State of the Pod, every Monday

The week's most-discussed names and stories from podcasts, with the moments behind them. Free, five minutes, unsubscribe in one click.

Listen to the full episode and explore every guest, topic, and moment on PodLume.