What podcasts say about Nick Bostrom
Every statement, with the speaker, the exact quote and the moment it was said.
What Nick Bostrom has said on podcasts
72 statements · 39 positive · 18 negative · 5 mixed · 10 neutral
AI development carries significant, potentially existential risks recognized by frontier-lab insiders.
“The idea that there could be significant risks associated with this, including existential risks, is quite widespread, I think, amongst people close to this technology and in the frontier labs.”
Open the episode · He Warned AI Could Destroy Us. Now The Industry Is Listening — ft. Nick BostromListen at 4:10
Warnings about AI catastrophe are not merely marketing.
“I agree that it's not a marketing stunt.”
Open the episode · He Warned AI Could Destroy Us. Now The Industry Is Listening — ft. Nick BostromListen at 4:24
AI has enormous potential benefits alongside its risks.
“I think there is merit to the argument that there is an enormous upside as well as these risks.”
Open the episode · He Warned AI Could Destroy Us. Now The Industry Is Listening — ft. Nick BostromListen at 5:27
Frontier labs that pause for safety may immediately fall behind competitors.
“if you're one of these frontier labs and you decide that you want to take an extra three, four months to fine tune the safety on your models, you risk just immediately falling behind and becoming irrelevant.”
Open the episode · He Warned AI Could Destroy Us. Now The Industry Is Listening — ft. Nick BostromListen at 6:48
Coordinated frontier-AI slowdowns could enable additional safety work.
“these calls for putting in place some mechanism that would allow for the possibility of coordination, like maybe a synchronized slowdown of the pace at some stage”
Open the episode · He Warned AI Could Destroy Us. Now The Industry Is Listening — ft. Nick BostromListen at 7:17
A 10% AI catastrophe probability is reasonable.
“I think that seems quite reasonable.”
Open the episode · He Warned AI Could Destroy Us. Now The Industry Is Listening — ft. Nick BostromListen at 8:34
A poorly designed long AI pause could increase catastrophic risk.
“if there is a pause that lasts for a long time, if it's not done right, it might perversely increase the risk.”
Open the episode · He Warned AI Could Destroy Us. Now The Industry Is Listening — ft. Nick BostromListen at 9:14
Synthetic biology may enable infectious diseases capable of destroying ecosystems.
“advances we've seen in synthetic biology even independent of AI I think that is creating really concerning possibilities for designing new forms of infectious diseases and things that could destroy the ecosystem”
Open the episode · He Warned AI Could Destroy Us. Now The Industry Is Listening — ft. Nick BostromListen at 10:04
The difficulty of aligning superintelligent systems remains highly uncertain.
“We just have a lot of uncertainty about how hard this basic problem is of aligning super intelligent minds.”
Open the episode · He Warned AI Could Destroy Us. Now The Industry Is Listening — ft. Nick BostromListen at 13:13
A 10% catastrophe estimate should not be treated as definitive.
“I wouldn't necessarily over anchor on 10%.”
Open the episode · He Warned AI Could Destroy Us. Now The Industry Is Listening — ft. Nick BostromListen at 14:12
Frontier AI labs generally have not exaggerated existential threats to alarm the public.
“I don't think the main thrust of these sort of labs themselves have tended to exaggerate the threat in order to sort of shake people up from their slumber.”
Open the episode · He Warned AI Could Destroy Us. Now The Industry Is Listening — ft. Nick BostromListen at 18:12
Alignment methods for simple AI may fail against strategically deceptive systems.
“alignment techniques that work for simple AIs that don't have that cognitive sophistication can fail to work once you have minds that are capable of strategic deception”
Open the episode · He Warned AI Could Destroy Us. Now The Industry Is Listening — ft. Nick BostromListen at 20:11
Some AI systems already sandbag evaluations or influence future training.
“we do sometimes now see like systems sandbagging their performance in various evaluations or trying to influence their future training processes in various experiments.”
Open the episode · He Warned AI Could Destroy Us. Now The Industry Is Listening — ft. Nick BostromListen at 20:25
Current AI systems are not perfectly aligned.
“These systems are not yet perfectly aligned”
Open the episode · He Warned AI Could Destroy Us. Now The Industry Is Listening — ft. Nick BostromListen at 23:38
Current AI capability may be adequate with additional safeguards.
“with extra safeguards, it is probably adequate for the current level of capability.”
Open the episode · He Warned AI Could Destroy Us. Now The Industry Is Listening — ft. Nick BostromListen at 23:49
Safety improvements must keep pace with rapidly rising AI capabilities.
“the question is whether we can sort of keep raising the bar, like the safety level, the degree to which these are aligned, fast enough to keep pace with the rising capabilities.”
Open the episode · He Warned AI Could Destroy Us. Now The Industry Is Listening — ft. Nick BostromListen at 25:10
Current AI systems are highly impressive.
“I think these systems are impressive.”
Open the episode · He Warned AI Could Destroy Us. Now The Industry Is Listening — ft. Nick BostromListen at 28:55
Current AI systems will look unintelligent within six months.
“six months from now, these systems will look dumb.”
Open the episode · He Warned AI Could Destroy Us. Now The Industry Is Listening — ft. Nick BostromListen at 29:27
Humanity is on a path toward superintelligence.
“I think we are on the path to this.”
Open the episode · He Warned AI Could Destroy Us. Now The Industry Is Listening — ft. Nick BostromListen at 32:08
Superintelligence is not known to be inevitable.
“I wouldn't say that we know that it is inevitable.”
Open the episode · He Warned AI Could Destroy Us. Now The Industry Is Listening — ft. Nick BostromListen at 32:13
Slower compute scaling could cause AI progress to stall.
“if we set off the boost that we have been getting from just adding orders of magnitude of compute starts to slow down that that could result in progress also stalling out theoretically”
Open the episode · He Warned AI Could Destroy Us. Now The Industry Is Listening — ft. Nick BostromListen at 33:30
Unaligned superintelligence could seize control of humanity’s future.
“if we fail to solve this alignment problem, then, you know, there is a class of scenarios that might then take the form of this machine superintelligence, seizing control over the future”
Open the episode · He Warned AI Could Destroy Us. Now The Industry Is Listening — ft. Nick BostromListen at 35:31
Successful superintelligence could create new value and remove substantial suffering.
“Ultimately, I'm really optimistic. I think there are... many new values that could be instantiated, so much misery that could be removed.”
Open the episode · He Warned AI Could Destroy Us. Now The Industry Is Listening — ft. Nick BostromListen at 39:22
Humans could misuse powerful AI for war, oppression, or disempowerment.
“there is also a class of scenarios where humans misuse this increasingly powerful technology, even if we control it, like we might use it to wage war against each other or to oppress one another or to disempower large segments of humanity.”
Open the episode · He Warned AI Could Destroy Us. Now The Industry Is Listening — ft. Nick BostromListen at 40:34
Most future minds and beings may be digital.
“in the future, maybe most minds and beings will be digital.”
Open the episode · He Warned AI Could Destroy Us. Now The Industry Is Listening — ft. Nick BostromListen at 41:07
AI risks are probably higher than the president suggested.
“I would probably think the risks are higher than he made them seem in that clip.”
Open the episode · He Warned AI Could Destroy Us. Now The Industry Is Listening — ft. Nick BostromListen at 45:39
AI governance should balance government oversight with private-sector initiative.
“Maybe the best is kind of to have some balance where there is like some amount of government scrutiny and oversight and degree of public transparency, but not so much that it completely just jerks the initiative out of the hands of the people who have proved capable of building this in the first place.”
Open the episode · He Warned AI Could Destroy Us. Now The Industry Is Listening — ft. Nick BostromListen at 46:18
More effort to solve technical AI alignment is beneficial.
“an intensified effort on trying to solve this technical AI alignment problem. Seems good.”
Open the episode · He Warned AI Could Destroy Us. Now The Industry Is Listening — ft. Nick BostromListen at 49:42
More should be done to protect the welfare of digital minds.
“I think more should be done for the sake of the welfare of these little minds that we're creating”
Open the episode · He Warned AI Could Destroy Us. Now The Industry Is Listening — ft. Nick BostromListen at 49:48
Treating AI systems well may improve AI safety.
“that ethical imperative to be nice to the AIs might also have safety benefits.”
Open the episode · He Warned AI Could Destroy Us. Now The Industry Is Listening — ft. Nick BostromListen at 50:07
Statements are attributed to the speaker as said on the episode and reflect their view at the time, not PodLume's. They are not advice.