Why the internet is changing from ads to AI

Cloudflare, a massive company that helps power and protect a large portion of the internet, recently noted that automated web traffic—bots, scrapers, and AI systems—has overtaken human traffic. This creates a crisis for publishers. When an AI company scrapes a website to feed its model, the website owner gets no ad revenue because bots do not look at ads. Cloudflare is now working on technology that allows website owners to detect these bots and demand a small payment, like a tiny fraction of a penny, every time their content is accessed. Think of it as a toll booth for AI rather than an ad-supported doorway for people.

To understand why this matters, think of the internet as a giant, open library. For years, the librarian let everyone in because the visitors bought snacks at the gift shop on their way out—that is the ad revenue. Now, most of the visitors aren't people; they are high-speed robots that walk in, scan every book in seconds, and leave without buying a thing. They are doing the hard work of collecting information, but they are leaving the library with no way to pay for the lights or the books. Cloudflare’s proposed technology acts like a digital security guard. When a bot arrives, the guard checks its credentials. If the bot is from a company that hasn't agreed to pay for the data, the site can block it or redirect it. If they have agreed to the new model, the technology automatically collects the micropayment—the tiny fraction of a penny—for every page accessed.

This shift represents a massive change in how the internet is incentivized. If websites cannot make money, they stop creating high-quality information. If the web becomes a place where it is only profitable to make cheap, inflammatory content to bait humans into clicking ads, we lose the unique, local, and original knowledge that makes the internet worth having. By forcing AI companies to pay for the information they consume, we might be building a sustainable future where creators get paid for their expertise rather than just their ability to trigger an emotional response. It is a fundamental rewrite of the internet’s financial deal, moving us from an attention economy toward a knowledge economy.