The a16z Show
The a16z Show

Oct 8, 2026 · 56 min

AWS bets agents will remake cloud infrastructure

Building the Cloud for an Agentic World | AWS CEO Matt Garman

The episode examines whether cloud providers can expand AI capacity fast enough while making autonomous systems secure, affordable, and useful to enterprises.

3 key takeaways
  1. 1AWS is redesigning core cloud services around agents, including secure sandboxes, short-lived databases, and coding-focused tools.
  2. 2GPU shortages, power constraints, chip supply, and data-center construction now shape AWS infrastructure planning as much as customer demand.
  3. 3Enterprise adoption starts with supervised workflows, but evaluation, permissions, monitoring, and organizational redesign become harder as agents gain autonomy.

Don't miss

Garman explains how Amazon’s internal agent use is accelerating software and product development while pushing teams toward smaller, more mobile pods.

The brief

AWS CEO Matt Garman argues that startups remain central to the cloud business even as AI-native companies arrive with far larger ambitions and infrastructure demands.

AWS is adapting its platform for agents through AgentCore, Bedrock, coding-oriented services, short-lived databases, and secure Firecracker-based compute environments.

The infrastructure buildout is constrained by more than demand: GPUs, memory, power, manufacturing, and data-center construction determine how quickly capacity can arrive.

Garman describes Trainium and Graviton as part of AWS’s effort to control performance and cost across training and inference, rather than rely entirely on external chips.

For enterprises, the path to autonomous agent fleets runs through evaluation, permissions, monitoring, backtesting, and protection against model drift and security failures.

Amazon’s internal experiments point toward smaller, faster-moving teams, but Garman acknowledges that the durable organizational model for the agent era remains unsettled.

Books & mentions

Some links are affiliate links — PodLume may earn a commission if you buy.

Listen to the full episode and explore every guest, topic, and moment on PodLume.

AWS bets agents will remake cloud infrastructure · PodLume