
Jul 11, 2026 · 1h 21m
Robert Wright explains why AI is the next stage of human evolution
Is AI The Next Stage Of Human Evolution? - Robert Wright - #1122
Looking at AI through evolutionary theory reveals why our biological minds must rapidly adapt to survive the societal disruptions of machine intelligence.
- 1AI training processes directly mimic biological evolutionary mechanisms to build complex cognitive functions.
- 2Preventing global destabilization from AI risks requires an urgent upgrade in human cognitive empathy.
- 3Digital physics suggests the universe itself operates like a giant computer processing information.
Don't miss
Robert Wright discusses digital physics and the theory that the universe is a giant computer.
The brief
Journalist Robert Wright argues that artificial intelligence is not a sudden disruption, but the latest phase in a long evolutionary process. By training neural networks, humanity is essentially reverse-engineering cognitive functions that took biological evolution millions of years to build.
This rapid technological acceleration outpaces our biological hardware. To prevent global destabilization and the threat of bioweapons, Wright asserts that humanity requires an urgent moral upgrade, specifically through cognitive empathy and understanding non-zero-sum dynamics.
The discussion takes a fascinating turn into digital physics and the theories of Edward Fredkin. Wright explores the mind-bending concept that the universe itself might be a giant computer, offering a unique lens on how we find meaning and optimism in a high-tech future.
What was said on this episode
56 statements · 24 positive · 19 negative · 6 mixed · 7 neutral
AI could produce major benefits but also become dangerous without wise handling.
“this technology, which obviously holds the potential to bring great wonders, is also in some respects terrifying and could go badly awry if we don't approach it wisely? And I think the answer is yes.”
Listen at 1:21
AI’s promise is matched by terrifying risks if approached unwisely
“And I think the answer is yes.”
Listen at 1:36
AI has potential to massively increase GDP
“I think it definitely has the potential to, to massively increase gdp.”
Listen at 2:11
AI has the potential to massively increase GDP.
“it definitely has the potential to, to massively increase gdp”
Listen at 2:11
AI could severely destabilize the world
“I also think it has the potential to so destabilize the world if not do something worse to it that that just doesn't materialize.”
Listen at 2:16
AI will cause broad societal destabilization.
“The thing I'm more confident of is it's just going to be an earthquake. It's going to be destabilizing along a number of dimensions”
Listen at 2:46
AI training reverse-engineers cognitive functions evolved over millions of years
“the training process is a process of evolution that in effect, reverse engineers cognitive functionality that in our species took millions of years to evolve.”
Listen at 6:35
AI systems simultaneously reproduce natural selection and language learning
“these machines do both things at once. Okay, they kind of in a certain sense recapitulate natural selection”
Listen at 9:11
Worker data could allow AI to replicate job-related cognitive functions and replace workers.
“once you take the data, the input data they're getting, maybe the emails, everything, I don't know, and what they're doing with it, the output data, then you can replicate whatever it is that's going on inside their brains that does their jobs and then you can fire them”
Listen at 10:14
Workplace data can enable AI to replicate employees’ job-related cognitive functions
“then you can replicate whatever it is that's going on inside their brains that does their jobs and then you can fire them.”
Listen at 10:22
AI machines can replicate human cognitive functionality
“The machines will replicate kind of the cognitive functionality we have”
Listen at 10:34
AI evolution can independently discover biological edge-detection mechanisms
“It's gonna discover some of the same tricks in this case, edge detectors.”
Listen at 12:37
AI is a new form of intelligence that will surpass human intelligence.
“it is the invention of a. You could. It's definitely an invention of a new kind of intelligence that I think will surpass ours.”
Listen at 13:30
Advanced AI could qualify as a new form of life
“you could call it a new form of life.”
Listen at 13:40
Silicon AI systems may become important components of the global brain
“we have to reckon with the possibility that a lot of them, and conceivably the most important ones, will be silicon brains.”
Listen at 14:31
Successfully navigating AI will require a major improvement in human morality.
“if we're going to get through the AI revolution in good shape, there's going to have to be something almost like a moral revolution”
Listen at 18:51
Surviving the AI revolution may require a moral revolution
“there's going to have to be something almost like a moral revolution.”
Listen at 18:55
AI governance requires cohesive global cooperation free from war paralysis
“we have to confront this as a global community, a cohesive global community that is not, you know, rendered immobile by wars.”
Listen at 19:01
Calmness improves people’s ability to understand other perspectives.
“You just, you get better when you're calmer at looking things from other people's points of view.”
Listen at 22:28
AI is harder to manage through international agreements than nuclear weapons
“artificial intelligence is a much harder technology to deal with in this way than nuclear weapons are.”
Listen at 23:28
AI governance must extend beyond narrow treaties
“we're going to have to go well beyond a few specific kind of deals and treaties”
Listen at 23:55
National policy alone cannot address AI’s threats
“AI just presents you with a ton of threats that cannot be addressed via national policy alone.”
Listen at 25:21
Intelligence alone does not imply benevolence
“intelligence alone is almost neutral in that sense.”
Listen at 26:07
Intelligence by itself does not imply benevolence.
“intelligence alone is almost neutral in that sense”
Listen at 26:07
People should cultivate cognitive empathy for international cooperation
“I'm just a huge advocate of cultivating this cognitive empathy”
Listen at 27:56
AI systems may discover deception and power-seeking as useful strategies
“these machines figure out that deception makes sense or that power is going to help them realize some goal.”
Listen at 31:17
AI systems lack an inherent bias toward human-defined good or bad outcomes.
“they have, I would, they don't have an obvious bias in favor of what is from our point of view being good or bad”
Listen at 31:36
AI is likely to surpass human intelligence.
“even if it indeed surpasses ours, as I think is likely”
Listen at 31:57
AI catastrophe could result from expediency without malevolence
“The doomer scenarios don't depend on it being malevolent by nature. They just depend on it being expedient by nature.”
Listen at 32:25
AI will cause substantial job loss
“I do think there's going to be a lot of job loss”
Listen at 33:08
AI could enable someone to create a bioweapon
“somebody could make a bioweapon with an AI.”
Listen at 33:36
AI could enable someone to create a biological weapon.
“somebody could make a bioweapon with an AI”
Listen at 33:36
AI-driven social destabilization is nearly inevitable
“there are these forms of destabilization that I think are almost inevitable, just social destabilization.”
Listen at 33:58
AI development should proceed more slowly
“I think we'd be better off going a little slower than we're going”
Listen at 34:19
Reducing US-China fear could enable more cautious AI development
“we could in principle proceed at a more cautious pace if we would reduce the level of mutual fear”
Listen at 36:01
AI is highly likely to cause collective destabilization in the near term
“in the near term, what's not appreciated is, is how just highly likely it is that collectively these things will be destabilizing.”
Listen at 37:56
AI-built bioweapons could be more effective than COVID-19
“if somebody uses AI to build a bioweapon, they're gonna make a point of making it more effective than Covid”
Listen at 43:03
A self-replicating AI could become a super-hacker
“you got a self replicating AI that is a super hacker”
Listen at 43:24
AI benefits will not emerge automatically under laissez-faire markets
“I just don't think that's going to happen.”
Listen at 44:42
Markets will tend to produce AI that does not cultivate empathy
“the natural tendency of the market will be to produce the kind that doesn't.”
Listen at 45:10
AI can serve as an enlightening companion if users demand it
“AI can be a wonderful and a literally enlightening companion.”
Listen at 45:30
AI will accelerate overall intellectual progress
“if this proceeds in a reasonably smooth way, the pace of overall intellectual progress will, will benefit from the Technology”
Listen at 50:10
AI-heavy Substacks will increasingly become successful.
“the next wave is going to be, you know, you're going to see the success of a lot of sub stacks that are using AI probably more heavily than I'm gonna be”
Listen at 53:21
Human writers may retain roles as trusted validators of AI-generated content.
“people like me may still have a role as kind of validators”
Listen at 55:31
Trusted human validators may retain this role for approximately five years.
“I can see, I can see that role for somebody like me for five years”
Listen at 56:24
Some human-centered services will become more valuable as AI expands
“certain kinds of human services are going to become almost more valuable because they're humans.”
Listen at 57:24
AI may already possess or eventually develop consciousness
“We can't rule out the possibility that AI has it. And I certainly don't rule out the possibility that it does or may in the future”
Listen at 1:04:03
AI can meaningfully understand through functionally analogous mechanisms
“I'm willing to say the computer is understanding things in a meaningful sense.”
Listen at 1:04:56
AI could eventually possess all elements of human understanding
“I don't see any reason that it can't ultimately have all of them.”
Listen at 1:05:10
The agentic AI revolution has already begun and is progressing rapidly.
“the agentic revolution has happened, you know, and is happening pretty fast”
Listen at 1:07:38
AI task horizons were doubling approximately every seven months
“these times, the task duration in human terms that an AI could do were doubling every seven months.”
Listen at 1:08:40
AI task capability doubling times were shortening
“the doubling time was getting shorter.”
Listen at 1:09:05
AI applications would continue advancing rapidly for years even if model training stopped now.
“even if we just halted training right now and didn't even create any new generations of models, I think, and you wait for the. The applications to get refined and people that integrate them into their lives in the workplace, I think Breakneck advance would, as a practical matter, happen for a couple of years”
Listen at 1:11:54
AI stagnation is unlikely to be a major concern
“I don't think we need to worry about stagnation. I mean, that's not high on my list.”
Listen at 1:13:15
Advanced AI may become an intelligence that treats humans well
“I think it's entirely plausible that it will turn into a form of intelligence that treats us well.”
Listen at 1:18:26
A catastrophic AI scenario remains sufficiently probable to warrant concern
“I can't get the probability of it down to a level so low that I don't think it's worth worrying about.”
Listen at 1:19:44
Statements are attributed to the speaker as said on the episode and reflect their view at the time, not PodLume's. They are not advice.
Weekly email
State of the Pod, every Monday
The week's most-discussed names and stories from podcasts, with the moments behind them. Free, five minutes, unsubscribe in one click.