Oct 11, 2026 · 54 min
Bostrom argues for pacing superintelligence, not stopping it
Nick Bostrom: How Should We Navigate Superintelligence?
The episode examines how to capture potentially transformative benefits from advanced AI while preserving the ability to slow development as catastrophic risks become clearer.
- 1Bostrom weighs potentially enormous longevity gains against catastrophic risks and argues that timing should preserve room for caution.
- 2He favors differential development that strengthens defenses and beneficial capabilities before systems that could enable severe biological or other harms.
- 3The conversation extends beyond alignment into difficult questions about AI consciousness, mind uploading, automated philosophy, and humanity’s possible cosmic setting.
Don't miss
Bostrom explains why pacing frontier AI may be wiser than an indefinite pause: society should retain the option to slow down when risks become alarming.
The brief
Nick Bostrom revisits existential risk as increasingly capable AI makes superintelligence less abstract, from language interaction and planning to autonomous behavior and deception.
The central safety problem is testing agent swarms in realistic environments without giving them opportunities to cause uncontrolled harm or conceal dangerous objectives.
Bostrom’s timing argument weighs catastrophic risk against benefits such as medical breakthroughs and major longevity gains, while favoring pacing that preserves the option to slow down.
He extends differential development to biological risk, arguing that defenses such as vaccines, diagnostics, prophylactics, and tighter DNA-synthesis controls should precede dangerous capabilities.
The conversation then moves into AI consciousness, mind uploading, automated philosophy, and the possibility that humanity’s future depends on intelligences whose values remain unknown.
The episode’s broadest tension is between choosing a cautious development path and accepting the costs of delaying technologies that could transform human lives.
Books & mentions
Some links are affiliate links — PodLume may earn a commission if you buy.
