For the first time, bots generate more than half of all web traffic. Cloudflare Precursor, the company’s new tool, stops checking IDs at the door and starts watching how visitors behave once they are inside.
The internet just passed a strange milestone. Bots now generate more web requests than people do. By Cloudflare’s count, automated traffic makes up roughly 57 percent of everything hitting the web.
That shift is the backdrop to a product the company launched on Monday. It is called Cloudflare Precursor, and it changes how the web tells humans and machines apart.
Watching the whole visit, not the doorway
Traditional defences work like a bouncer checking one ID at the gate. A CAPTCHA asks you to prove you are human once, then waves you through. Modern bots are good enough to fake that single moment.
The 💜 of EU tech
The latest rumblings from the EU tech scene, a story from our wise ol' founder Boris, and some questionable AI art. It's free, every week, in your inbox. Sign up now!
Precursor takes a different tack. It runs inside the browser and watches an entire session. That means mouse movement, scrolling rhythm, typing cadence, clipboard use, and how long a page stays visible. Faking one click is easy. Faking a whole human visit is a real engineering problem.
“Traditional security checks look at a single moment in time, but modern bots have gotten smart enough to fake their way through the front door”, said Dane Knecht, Cloudflare’s chief technology officer. The space between login and checkout, he said, was a black box. Precursor is meant to close it.
Cloudflare says the tool is privacy-led. It logs behavioural patterns rather than content, recording typing as rhythm and cadence, never the actual keystrokes. It turns on with one click and needs no code changes.
Sorting the machines by what they want
Precursor is one half of a bigger rethink. The other is about the good bots.
Not all automation is hostile. Cloudflare now sorts AI traffic into three buckets. Search bots index a page to answer questions later. Agent bots act in real time for a person. Training bots absorb your content into a model.
From 15 September, new sites on Cloudflare will block Training and Agent bots by default on pages that carry ads, while letting Search through. The logic is money. Search sends readers back; the others often do not. It is the next turn of a fight in which Cloudflare has already told AI crawlers to pay publishers or get blocked.
The company is also adding a way for sites to set how bots may reuse their content: store nothing, index and link back, or summarise and reproduce. A new database called BotBase names every known crawler. It all builds on Cloudflare’s earlier push for a privacy-first anti-bot standard with the big browsers.
Trust you can carry, and lose
The trickiest part is that the bot at your door often is not run by the company that built it. Cloudflare wants operators to declare themselves, using an existing web header, so a site can allow “OpenAI” and have that choice hold even through layers of middlemen.
Losing that trusted status across the more than 20 percent of web domains behind Cloudflare, the company argues, is a deterrent with teeth. It is a softer cousin of ideas like Estonia’s plan to give every AI agent an ID number. The stakes rise as agents start to shop and pay for us. It also echoes the push to let publishers opt out of AI without vanishing from search.
The plumbing is changing too
The rewiring runs deeper than one vendor. On the same day, the Internet Engineering Task Force published a new HTTP method called QUERY, the Register reported. It gives complex searches their own verb, safe and cacheable, instead of forcing them to masquerade as data-changing requests.
Cloudflare and Akamai engineers co-wrote the standard. That is the theme running through all of it. The web’s basic machinery was built for human clicks. It is now being quietly rebuilt for a place where most of the visitors are machines.
Get the TNW newsletter
Get the most important tech news in your inbox each week.