Crawl-to-Referral Ratio
How many visits a platform sends back for every 1,000 crawls. One number to decide what to block, allow or optimize.
Early access Launching 2026
Can AI See It analyzes every request that reaches your site: which AI bots crawl your pages, which of them are fake, and how much real traffic each platform sends back.
Profiling crawlers from 392 operators, including
The problem
For twenty years the deal was simple: let Googlebot read your pages, get people back from search. AI bots read the same pages to train models, answer questions and fetch sources for chat assistants. Many of those answers never send a visitor your way.
Your analytics tool won't show any of this. It counts browsers that run its script, and bots rarely do. The full picture only shows up in the traffic that reaches your CDN, proxy or server.
Source: Can AI See It bot catalogue, data updated 22 November 2026.
How it works
Plug in where it fits your stack: at the CDN, through a proxy, with a WordPress plugin or from server logs. Every bot request passes through there, including the ones analytics never sees.
Each request is matched against official user-agent strings and the verification methods operators publish, such as reverse DNS and IP ranges. Bots that only borrow a famous name get flagged as fake.
Put crawls next to referral visits for each platform. The Crawl-to-Referral Ratio shows which bots send people back and which only take.
The product
Built for SEO teams, e-commerce managers and agencies who need numbers, not guesses.
How many visits a platform sends back for every 1,000 crawls. One number to decide what to block, allow or optimize.
A user-agent string is easy to copy. A matching reverse DNS record is not. We check both.
Block, allow or measure. Your call. Toggle a bot to see the rule change.
User-agent: GPTBot
User-agent: PerplexityBot
Disallow: /
User-agent: ClaudeBot
User-agent: meta-externalagent
Allow: / A weekly summary in your inbox, and an alert as soon as a new crawler shows up.
Every request is identified against 487 bot profiles built from what operators publish.
Our approach
Prompt testing asks an AI model about your brand and records the answer. It's useful, but it only covers the questions you thought of, and the answers change between runs. Traffic analysis records what actually happened on your site.
Read: Bot monitoring vs prompt testingFree today
487 bots with user-agent strings, robots.txt rules and verification steps. Free to use, no signup.
Crawl activity, 25 Oct - 21 Nov 2026 Activity trend: Cloudflare Radar
Profiles are built from what operators publish, not from forum rumors.
If an operator doesn't document something, we say so instead of guessing.
We measure requests that happened, not answers a model might give.
Built in the EU, with coffee and ambition.
FAQ
Can AI See It is a traffic-based analytics platform for AI crawlers. It shows which bots visit your website, validates whether they are who they claim to be, and measures how much traffic each AI platform sends back.
Wherever it fits your stack: at your CDN, through a proxy, with a WordPress plugin or from your server logs.
Prompt testing asks AI models questions and records what they say about you. Traffic analysis records what bots actually requested from your site. One is a sample of answers, the other is a complete record of behavior.
Our open catalogue profiles 487 bots from 392 operators: AI training crawlers like GPTBot, AI search bots like OAI-SearchBot, AI assistants like ChatGPT-User, plus search engines, SEO tools, monitoring services and more.
Anyone can copy a user-agent string. We compare each request with the verification methods operators publish, such as reverse DNS records and official IP ranges. A request that claims to be Googlebot but fails those checks is flagged as fake.
Yes. The catalogue, guides and robots.txt examples are free to use, and you don't need an account.
Can AI See It launches in 2026. Join the waitlist and we'll email you as soon as your access is ready.
Waitlist open
Be among the first to see what AI crawlers take from your site, and what they give back.