AI Crawlers vs AI Referrals: 204 Bot Visits per Click
Across 11 sites over 90 days, AI bots made 37,045 requests while AI assistants sent 182 human visits: about 204 crawls per referral. Which bots crawl, which assistants send traffic.
How much do AI crawlers visit compared with AI referrals?
Key takeaways
- AI bots crawl far more than AI assistants refer: about 204 requests for every human visit.
- Amazonbot and ClaudeBot crawled most.
- ChatGPT sent the most referrals, 157 of 182.
- Only 51–56% of AI bot requests verified as genuine, so check before you trust a bot dashboard.
AI engines read a lot more than they send. Across 11 sites using the Yozigo tracker, from 29 June to 27 September 2026, AI bots made 37,045 requests. AI assistants referred 182 human visits in the same period: about one visit per 204 bot requests.
That doesn't mean the crawling is wasted. Crawls feed indexes and answers, and the answer is often where the buyer decides. But it does mean referral traffic alone badly understates how much AI engines use your content.
Which AI bots crawl websites the most?
| Bot | Requests | Sites visited |
|---|---|---|
| Amazonbot | 8,488 | 8 |
| ClaudeBot | 7,154 | 9 |
| OAI-SearchBot (ChatGPT search) | 2,936 | 9 |
| Meta AI crawler | 2,626 | 8 |
| ChatGPT-User | 2,504 | 9 |
| Google AI agent | 2,068 | 3 |
| GPTBot | 2,030 | 8 |
| Applebot-Extended | 1,355 | 2 |
| Bytespider | 1,319 | 8 |
| PerplexityBot | 1,309 | 9 |
Requests from AI bots, self-crawls excluded, 11 sites, 29 June – 27 September 2026.
Which AI assistants send the most visitors?
ChatGPT, by far: 157 of 182 AI-referred visits, or 86%.
ChatGPT sent 157 of the 182 AI-referred visits, Perplexity 19 and Gemini 3, with DeepSeek, Copilot and Claude one each. For comparison, Google Search referred 101 tracked visits on the same sites over the same period, so for these sites ChatGPT already sent more tracked visits than Google Search.
Treat the sample with care
11 sites is small. But the direction matches what most teams report: ChatGPT is the biggest AI referrer by a wide margin.
Are AI crawler visits real?
Only about half
55.6% of AI search bot requests and 51.1% of indexing bot requests verified.
Verification checks the vendors' published IP ranges or reverse DNS; the rest used a real bot's name without proof. We explain the method in how to verify AI crawler traffic, and AI Traffic applies it automatically.
Why do AI engines crawl so much more than they refer?
An AI answer is built from many pages
13.8 sources per answer in our citation study. Each needs fetching, and indexing bots also re-crawl pages to keep their copies fresh. Meanwhile a buyer who gets a full answer often has no reason to click.
So a page can shape hundreds of answers and still send almost no visits. That's why we track citations and mentions alongside referrals, and why a crawl from OAI-SearchBot or ChatGPT-User, which fetch pages to answer a live question, tells you more than a crawl from a training bot.
Limits
11 sites over 90 days is a small sample and skews to B2B software and services. Referral counts cover visits the tracker could attribute, so the true AI share is likely somewhat higher.
What should you do with crawler data?
Four actions, starting with the 4 search-and-answer bots you should never block.
Keep AI search bots allowed in robots.txt
OAI-SearchBot, ChatGPT-User, PerplexityBot and Claude-User fetch pages to answer live questions.
2. Decide separately on training bots such as GPTBot, ClaudeBot and Bytespider.
3. Check which pages get crawled; pages that are never fetched can't be cited.
4. Measure referrals and answers together. See how to measure ROI from AI search.
Vendor documentation lists each bot's purpose: see OpenAI's crawlers and Perplexity's crawlers.
Frequently Asked Questions: AI crawlers and referrals
In our 90-day sample of 11 sites, Amazonbot made 8,488 requests and ClaudeBot 7,154, ahead of OpenAI's search crawler at 2,936.
ChatGPT sent 157 of 182 AI-referred visits across 11 sites in 90 days, more than Google Search's 101 on the same sites. AI referral volumes are still small for most sites.
Keep search-and-answer bots allowed if you want to be cited. Blocking OAI-SearchBot or PerplexityBot removes you from those answers. Training bots are a separate business decision.
Engines read many pages to write one answer, and many buyers get what they need from the answer itself. That's why citations and mentions matter as much as clicks.
