Sep 2, 2026 · 56 min
Listen from 39:32
Listen at 39:32
AI agents threaten the economics of the open web
Cloudflare CEO: We're Ready To Block Millions of Websites From AI — With Matthew Prince
As AI systems absorb and mediate online information, publishers face a choice between blocking access and surrendering the traffic that funds them.
- 1AI-generated traffic already exceeds human browsing and could multiply as agents handle more knowledge work and commerce.
- 2Cloudflare is building controls that let publishers restrict AI crawlers, but compensation systems and business models remain unsettled.
- 3Matthew Prince argues Google should pay for content access as traditional SEO and link-based discovery lose influence.
Don't miss
Matthew Prince predicts that millions of websites could disappear from Google’s radar unless AI companies and publishers reach a new economic arrangement.
The brief
Cloudflare CEO Matthew Prince says automated AI traffic has already overtaken human browsing, challenging the assumption that people remain the web’s primary users.
The growth comes from model training, new AI providers, and agents interacting with sites; Prince expects automated requests to expand dramatically as agents handle work and purchases.
That traffic threatens publishers because AI systems can extract reporting and information without sending readers back, weakening advertising, subscriptions, and the incentive to create.
Cloudflare plans tools and defaults that let ad-supported and subscription sites control AI access, while the industry still lacks a workable micropayment system.
Prince says Google should face the same access rules as other AI companies and predicts traditional SEO and ten-blue-link search will fade.
The episode’s sharpest warning is that millions of sites could vanish from Google’s radar unless AI access produces a sustainable market for content.
What was said on this episode
22 statements · 11 positive · 11 negative
Cloudflare estimates automated web traffic will reach 1,000 times human traffic within five years
“if you just fast forward five years from now, we estimate now that automated traffic online will be a thousand times what human traffic is”
Listen at 3:52
AI-enabled creation is currently making the internet better rather than worse
“I actually think the internet's getting better right now”
Listen at 6:23
AI has increased the number of valuable things available online overall
“I think that the net has been that we're getting more things out there”
Listen at 7:36
The internet will increasingly move away from the conventional app-store model
“I do think that we're going to move more and more away from kind of an app store model”
Listen at 7:40
AI will enable more people to create and pursue interesting projects
“ai is no different it's going to enable more people to be able to be creative and do interesting things”
Listen at 10:07
Autonomous agent-to-agent commerce will become a large source of AI traffic
“I think that will grow and become a pretty large category”
Listen at 12:30
Agents will browse vastly more websites and pages than humans for comparable tasks
“My agent is going to visit... thousand websites and visit every page on all of them”
Listen at 13:10
Internet infrastructure has finite capacity and can be overwhelmed by traffic growth
“there's a finite capacity to all this stuff”
Listen at 15:41
The 1,000-times automated-traffic forecast may be an underestimate
“it might actually be a low estimate”
Listen at 20:39
Publisher crawl-to-click ratios have approximately doubled over the past year
“everything has gotten basically, assuming you're a publisher, from the publisher's perspective, it's gotten... twice as bad”
Listen at 24:24
Advertising and subscriptions will not support the web’s next 30 years
“the business model, which has supported the web for the last 30 years, which has been advertising and subscription based, isn't going to be the business model that supports it for the next 30 years”
Listen at 25:26
One to ten percent of Cloudflare internet transactions could initially support agent micropayments
“we think that somewhere between 1% and 10% of those will, day one, be monetizable through agents with a micropayments transaction”
Listen at 26:31
Agent micropayment infrastructure must support over 100 million transactions per second at scale
“you've got to build a payments infrastructure that can day one support somewhere around 10 and then be able to scale to over 100 million financial transactions per second”
Listen at 26:42
Traditional ten-blue-link search results will disappear
“10 blue links are going away”
Listen at 32:07
Content creators will begin receiving meaningful payment in 2026
“2026 is going to be the year that in the media space in the content space that you're going to see a real shift and then content creators are going to get paid”
Listen at 36:47
Google will eventually pay publishers for content access
“i think it's inevitable that they'll pay up”
Listen at 37:37
Millions of ad- or subscription-supported sites will leave Google’s radar
“we expect that the vast, vast majority of people that have ad or subscription supported businesses will do this. So there will be millions of sites that will drop off of Google's radar.”
Listen at 38:15
Without correcting Google’s market power, incentives for content creation will disappear
“the incentives for content creation just go away”
Listen at 39:26
Agentic commerce could cause major-company consolidation if new entrants cannot enter easily
“if we can't be in a place where new entrants can easily enter the market then what happens over time is that the big companies will acquire each other will have massive consolidation”
Listen at 47:21
Agentic commerce will favor large companies over small businesses through consolidation
“agentic commerce becomes this massive tool of consolidation and that's going to favor the big companies over the little companies”
Listen at 48:15
Unregulated agentic commerce will increase market consolidation
“left to its own devices agentic commerce is going to be a consolidating factor”
Listen at 51:30
AI will substantially widen the divide between rich and poor
“AI is this massive divider between the rich and the poor”
Listen at 53:51
Statements are attributed to the speaker as said on the episode and reflect their view at the time, not PodLume's. They are not advice.