
Nov 19, 2026 · 40 min
Bostrom urges caution without freezing superintelligence
How Fast Should We Build Superintelligence? | Nick Bostrom
The choices made before advanced AI arrives could shape both humanity’s survival and the benefits, purposes, and forms of life that follow.
- 1Bostrom favors targeted pauses when safety lags capabilities, while warning that permanent restrictions could block major benefits.
- 2Alignment may improve with more control yet become harder as systems grow strategically aware, deceptive, and opaque.
- 3Superintelligence could transform longevity, suffering, governance, and human purpose, making development speed a moral decision.
Don't miss
Bostrom argues that humans may soon need to decide what they want before superintelligent systems surpass them in philosophy and other intellectual tasks.
The brief
Nick Bostrom argues that AI policy should avoid two extremes: an unrestricted race toward superintelligence and an indefinite pause that could forfeit profound benefits.
The central tension is timing. Delaying development may improve safety and coordination, but safe superintelligence could also advance medicine, longevity, poverty reduction, and suffering relief.
Bostrom says alignment could become more precise in some respects while growing harder in others, as systems become situationally aware, strategically deceptive, and less transparent.
The conversation widens from governance to humanity’s long-term future: posthuman possibilities, radically expanded existence, and whether AI will eventually surpass humans in philosophy.
Bostrom’s standout claim is that the present may be a uniquely important window for deciding what humanity wants before advanced systems take over more intellectual work.
Books & mentions
Some links are affiliate links — PodLume may earn a commission if you buy.
Weekly email
State of the Pod, every Monday
The week's most-discussed names and stories from podcasts, with the moments behind them. Free, five minutes, unsubscribe in one click.

