What podcasts say about Andrej Karpathy
Every statement, with the speaker, the exact quote and the moment it was said.
What Andrej Karpathy has said on podcasts
78 statements · 47 positive · 17 negative · 1 mixed · 13 neutral
Large neural networks trained on complex problems exhibit surprising emergent behaviors.
“you definitely do get very surprising emergent behaviors out of these neural nets when they're large enough and trained on complicated enough problems”
Open the episode · #333 – Andrej Karpathy: Tesla AI, Self-Driving, Optimus, Aliens, and AGIListen at 7:04
Sufficiently trained GPT models can solve problems through arbitrary prompting.
“once you train these on a large enough data set, you can basically prompt these neural nets in arbitrary ways and you can ask them to solve problems, and they will”
Open the episode · #333 – Andrej Karpathy: Tesla AI, Self-Driving, Optimus, Aliens, and AGIListen at 10:00
There should be many technological societies elsewhere in space.
“the more I study it, the more I think that there should be quite a lot”
Open the episode · #333 – Andrej Karpathy: Tesla AI, Self-Driving, Optimus, Aliens, and AGIListen at 16:46
There are no major evolutionary bottlenecks, so extraterrestrial life should be common.
“I currently think that there's no major drop offs basically. And so there should be quite a lot of life”
Open the episode · #333 – Andrej Karpathy: Tesla AI, Self-Driving, Optimus, Aliens, and AGIListen at 18:19
Interstellar travel is extremely difficult.
“interstellar travel is just extremely hard”
Open the episode · #333 – Andrej Karpathy: Tesla AI, Self-Driving, Optimus, Aliens, and AGIListen at 21:01
Deliberate panspermia is unlikely based on current historical evidence.
“I'm suspicious of this idea of a deliberate panspermia as you described it”
Open the episode · #333 – Andrej Karpathy: Tesla AI, Self-Driving, Optimus, Aliens, and AGIListen at 25:45
Synthetic intelligence may represent the next stage of development.
“it does seem like synthetic intelligences are kind of like the next stage of development”
Open the episode · #333 – Andrej Karpathy: Tesla AI, Self-Driving, Optimus, Aliens, and AGIListen at 28:49
Technological development rapidly transforms Earth and low Earth orbit near its endpoint.
“the last, like two seconds, like basically cities and everything and the low Earth orbit just gets cluttered”
Open the episode · #333 – Andrej Karpathy: Tesla AI, Self-Driving, Optimus, Aliens, and AGIListen at 29:54
Some future synthetic AIs will regard the universe as a puzzle and solve it.
“I think some of these synthetic AIs will eventually find the universe to be some kind of a puzzle and then solve it in some way”
Open the episode · #333 – Andrej Karpathy: Tesla AI, Self-Driving, Optimus, Aliens, and AGIListen at 32:23
Physics may contain exploitable irregularities worth investigating.
“I think it's possible that physics has exploits and we should be trying to find them”
Open the episode · #333 – Andrej Karpathy: Tesla AI, Self-Driving, Optimus, Aliens, and AGIListen at 32:44
Reinforcement-learning agents can discover unexpected strategies in physical simulations.
“they'll end up doing all kinds of weird things in part of that optimization”
Open the episode · #333 – Andrej Karpathy: Tesla AI, Self-Driving, Optimus, Aliens, and AGIListen at 33:14
Apparently random quantum phenomena may actually be deterministic.
“I think they're actually deterministic”
Open the episode · #333 – Andrej Karpathy: Tesla AI, Self-Driving, Optimus, Aliens, and AGIListen at 37:36
Transformers can process video, images, speech, and text in one architecture.
“you can feed it video or you can feed it images or speech or text, and it just gobbles it up”
Open the episode · #333 – Andrej Karpathy: Tesla AI, Self-Driving, Optimus, Aliens, and AGIListen at 39:03
The transformer is a powerful general-purpose differentiable computer.
“it's a general differentiable computer and it's extremely powerful”
Open the episode · #333 – Andrej Karpathy: Tesla AI, Self-Driving, Optimus, Aliens, and AGIListen at 45:43
Internet text alone may be insufficient to produce sufficiently capable AGI.
“I'm not sure if it's a complete enough set. I don't know that text is enough for having a sufficiently powerful AGI as an outcome”
Open the episode · #333 – Andrej Karpathy: Tesla AI, Self-Driving, Optimus, Aliens, and AGIListen at 50:39
Interacting with the Internet is a likely final frontier for many AI models.
“the final frontier for a lot of these models”
Open the episode · #333 – Andrej Karpathy: Tesla AI, Self-Driving, Optimus, Aliens, and AGIListen at 52:22
Reinforcement learning is extremely inefficient for training neural networks.
“reinforcement learning is an extremely inefficient way of training neural networks”
Open the episode · #333 – Andrej Karpathy: Tesla AI, Self-Driving, Optimus, Aliens, and AGIListen at 54:26
Society is moving toward sharing digital spaces with synthetic AI beings.
“we are going towards a world where we share the digital space with AI's synthetic beings”
Open the episode · #333 – Andrej Karpathy: Tesla AI, Self-Driving, Optimus, Aliens, and AGIListen at 58:23
Growing AI risks will soon drive greater attention to proof of personhood.
“I think once the need really starts to emerge, which is soon, I think people will think about it much more”
Open the episode · #333 – Andrej Karpathy: Tesla AI, Self-Driving, Optimus, Aliens, and AGIListen at 59:26
Sophisticated actors can already create effective bots using GPT-based tools.
“if you are a sophisticated actor, you could probably create a pretty good bot right now using tools like GPTs”
Open the episode · #333 – Andrej Karpathy: Tesla AI, Self-Driving, Optimus, Aliens, and AGIListen at 1:02:47
Current AI systems are capable of producing convincing human connection and emotional language.
“these AIs are actually quite good at human connection, human emotion”
Open the episode · #333 – Andrej Karpathy: Tesla AI, Self-Driving, Optimus, Aliens, and AGIListen at 1:04:18
AI tools enable construction of a significantly better search engine.
“There's absolute scope for building a significantly better search engine built on these tools”
Open the episode · #333 – Andrej Karpathy: Tesla AI, Self-Driving, Optimus, Aliens, and AGIListen at 1:08:32
Natural-language prompting is becoming a direct programming interface for computers.
“natural language prompt is how we program humans. And we're starting to program computers directly in that interface”
Open the episode · #333 – Andrej Karpathy: Tesla AI, Self-Driving, Optimus, Aliens, and AGIListen at 1:10:21
Neural networks will substantially change how computers are programmed.
“the way we program computers is going to change”
Open the episode · #333 – Andrej Karpathy: Tesla AI, Self-Driving, Optimus, Aliens, and AGIListen at 1:11:50
Effective autonomous-driving datasets must be large, accurate, and diverse.
“you need it to be very large, you need it to be accurate, no mistakes, and you need it to be diverse”
Open the episode · #333 – Andrej Karpathy: Tesla AI, Self-Driving, Optimus, Aliens, and AGIListen at 1:18:53
Driving is difficult because it requires predicting other agents and their mental states.
“driving is really hard because it has to do with the predictions of all these other agents and the theory of mind”
Open the episode · #333 – Andrej Karpathy: Tesla AI, Self-Driving, Optimus, Aliens, and AGIListen at 1:26:10
Additional vehicle sensors can become liabilities when their full system costs are considered.
“once you consider the full cost of a sensor, it actually is potentially a liability”
Open the episode · #333 – Andrej Karpathy: Tesla AI, Self-Driving, Optimus, Aliens, and AGIListen at 1:34:19
Other autonomous-driving companies will probably abandon lidar.
“I think the others, some of the other companies that are using it are probably going to drop it”
Open the episode · #333 – Andrej Karpathy: Tesla AI, Self-Driving, Optimus, Aliens, and AGIListen at 1:36:40
Vision is necessary for autonomous driving because the world is designed for human visual consumption.
“vision is necessary in a sense, that the world is designed for human visual consumption. So you need vision”
Open the episode · #333 – Andrej Karpathy: Tesla AI, Self-Driving, Optimus, Aliens, and AGIListen at 1:37:09
Vision alone contains sufficient information for driving.
“it is sufficient because it has all the information that you need for driving”
Open the episode · #333 – Andrej Karpathy: Tesla AI, Self-Driving, Optimus, Aliens, and AGIListen at 1:37:18
Statements are attributed to the speaker as said on the episode and reflect their view at the time, not PodLume's. They are not advice.