The a16z Show
The a16z Show

Nov 19, 2026 · 40 min

Bostrom urges caution without freezing superintelligence

How Fast Should We Build Superintelligence? | Nick Bostrom

The choices made before advanced AI arrives could shape both humanity’s survival and the benefits, purposes, and forms of life that follow.

3 key takeaways
  1. 1Bostrom favors targeted pauses when safety lags capabilities, while warning that permanent restrictions could block major benefits.
  2. 2Alignment may improve with more control yet become harder as systems grow strategically aware, deceptive, and opaque.
  3. 3Superintelligence could transform longevity, suffering, governance, and human purpose, making development speed a moral decision.

Don't miss

Bostrom argues that humans may soon need to decide what they want before superintelligent systems surpass them in philosophy and other intellectual tasks.

The brief

Nick Bostrom argues that AI policy should avoid two extremes: an unrestricted race toward superintelligence and an indefinite pause that could forfeit profound benefits.

The central tension is timing. Delaying development may improve safety and coordination, but safe superintelligence could also advance medicine, longevity, poverty reduction, and suffering relief.

Bostrom says alignment could become more precise in some respects while growing harder in others, as systems become situationally aware, strategically deceptive, and less transparent.

The conversation widens from governance to humanity’s long-term future: posthuman possibilities, radically expanded existence, and whether AI will eventually surpass humans in philosophy.

Bostrom’s standout claim is that the present may be a uniquely important window for deciding what humanity wants before advanced systems take over more intellectual work.

Books & mentions

Some links are affiliate links — PodLume may earn a commission if you buy.

Weekly email

State of the Pod, every Monday

The week's most-discussed names and stories from podcasts, with the moments behind them. Free, five minutes, unsubscribe in one click.

Listen to the full episode and explore every guest, topic, and moment on PodLume.