Anthropic researcher warns AI has ten percent chance of killing humanity

Anthropic Researcher Says AI Has Over a 10% Chance of Killing All Humans

The high-profile departure of an industry insider underscores the growing urgency and political pressure surrounding the regulation of superintelligent AI systems.

3 key takeaways
  1. 1A viral resignation from an Anthropic researcher warns of a ten percent chance of AI-induced human extinction within a decade.
  2. 2The debate is shifting public perception toward concrete discussions on superintelligence regulation and workable safety policies.
  3. 3Navigating these risks requires understanding the political and media incentives that drive the broader AI safety conversation.

The brief

A viral resignation from an Anthropic researcher has reignited the debate over advanced AI risks, warning that major labs are gambling with human lives and estimating a greater than ten percent chance of human extinction within the next decade.

The departure highlights a shifting public perception of AI safety, moving the conversation past mere online outrage toward concrete discussions about policy, regulatory frameworks, and the political incentives shaping the debate.

As major artificial intelligence labs push closer to superintelligence, the tension between rapid commercial deployment and rigorous safety protocols is forcing a reevaluation of how the industry manages catastrophic risks.

What was said on this episode

19 statements · 4 positive · 12 negative · 2 mixed · 1 neutral

  1. Anthropic and OpenAI are irresponsibly racing toward self-improving superintelligence.

    “Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives.”

    Listen at 3:48

  2. Nathaniel Whittemoreon Future AI systemsNegative3:58

    Future AI systems will be superhuman and capable of hacking, rapid innovation, and resource acquisition.

    “These will soon be superhuman systems that can hack anything, revolutionize any field overnight, and acquire real power and resources.”

    Listen at 3:58

  3. AI could kill all humans by the end of the decade.

    “The people building AI earnestly believe that it could kill us all by the end of the decade.”

    Listen at 4:08

  4. AI poses a level of danger unmatched by other human activities.

    “No other human activity poses this level of danger.”

    Listen at 4:21

  5. Preventing a global AI race may require temporarily banning capability improvements.

    “I don't feel we're on track to prevent a global race, which may require costly actions such as a temporary ban on improving model capabilities.”

    Listen at 4:57

  6. AI has more than a 10% chance of killing all humans within the next decade.

    “We really do earnestly believe AI could kill all humans. Exclamation point. I personally think it is greater than 10% within the next decade.”

    Listen at 5:31

  7. Anthropic lacks a clear plan and trajectory for solving superintelligence alignment.

    “I believe Anthropic is trying its best, but we do not yet have a plan to solve alignment for superintelligence and are not clearly on track to.”

    Listen at 5:39

  8. Current AI models pose low risk.

    “to be clear, I think the risk from present models is low.”

    Listen at 5:52

  9. Recursive self-improvement toward superintelligence is occurring faster than expected.

    “What I am worried about is superintelligence arising from recursive self-improvement, which as we have said is happening faster than we thought.”

    Listen at 5:55

  10. Nathaniel Whittemoreon Bernie Sanders legislationNegative13:43

    Bernie Sanders plans legislation banning superintelligence and pausing AI development.

    “That is why I will soon be introducing legislation to ban superintelligence and pause AI development.”

    Listen at 13:43

  11. Congress should hold hearings and pass a superintelligence ban.

    “This is an emergency. Congress must convene hearings and pass my and Bernie's superintelligence ban.”

    Listen at 13:59

  12. Jacob Coxon’s post likely spread through existing AI-safety networks, not a covert psyop.

    “what's much more likely is simply that Jacobs' post got shared in an AI safety group chat and boosted by the same networks that he has been involved in for years.”

    Listen at 18:29

  13. AI capable of ending the world is also capable of radically improving it.

    “If AI is powerful enough to end the world, it must be powerful enough to radically improve it too.”

    Listen at 27:34

  14. Nathaniel Whittemoreon AI development and alignmentMixed28:09

    AI development should proceed rapidly only alongside equally rapid alignment progress.

    “AI should progress as fast as we can make it progress, but alignment needs to move just as fast.”

    Listen at 28:09

  15. Nathaniel Whittemoreon Cyber defense infrastructureNegative30:34

    Cyber defense infrastructure is unprepared for AI-era threats and requires immediate action.

    “I think it's pretty clear at this point, for example, that our cyber defense infrastructure is not equipped for the new world we're moving into, and that is a clear and present danger that demands response right now.”

    Listen at 30:34

  16. Nathaniel Whittemoreon AI reporting requirements and oversightPositive31:11

    AI reporting requirements and oversight could command broad public consensus.

    “certain types of reporting requirements and oversight are areas where I believe there would be very, very broad consensus among people”

    Listen at 31:11

  17. OpenAI and Anthropic should coordinate on a joint AI-safety proposal.

    “for OpenAI and Anthropic to put down their weapons, lock arms, and say, this is what we think we should actually do.”

    Listen at 31:45

  18. Nathaniel Whittemoreon AI extinction-risk debatePositive33:46

    Public debate over AI extinction risks shows society is not sleepwalking toward AI danger.

    “Except that's completely wrong. This conversation, the fact that it made it to every major news outlet, The fact that I had to dedicate this entire show to this topic instead of the sort of practical positive thing that most of you are here for, this is all exemplary of us not sleepwalking.”

    Listen at 33:46

  19. Each AI capability increase has intensified risk discussion and its political resonance.

    “with every single capability jump of AI, the conversation about its risks and the political resonance of that discourse has gotten louder.”

    Listen at 34:07

Statements are attributed to the speaker as said on the episode and reflect their view at the time, not PodLume's. They are not advice.

Listen to the full episode and explore every guest, topic, and moment on PodLume.

Anthropic researcher warns AI has ten percent chance of killing humanity · PodLume