Optimize your site for the next kind of visitor: agents
See which AI agents visit your site and which answers send you visitors. Turn server logs and GA4 data into page-by-page fixes. No tag to install.

Agent Analytics turns AI traffic into answers: which AI agents read which pages, what they can’t reach, which pages AI cites and sends visitors to, and what to optimize next.
See which AI agents visit your site, and why.
Quotable reads requests from your CDN or host and checks each one against the provider’s published IP ranges and reverse DNS. You see every agent, how often it comes, which pages it requests and what it came to do.
See what each agent reads
Sort pages by requests, agents, errors or response time, narrow to a folder, and open any page in Citations or AI Referrals.
Pages agents request most
Last 30 daysPage Requests Citations /best-crm-software 1,284 42 /crm-comparison 926 31 /product 748 18 /pricing 392 7 /blog/crm-for-startups 311 12 /integrations 247 5 /docs/api 198 3 /customers 126 2 Citations come from a separate dataset and are shown for context.
Tell real AI bots from fakes
Any bot can call itself GPTBot. Every request is marked Verified, Unverified or Spoofed. Unverified isn’t spoofed: some providers publish no IP ranges.
Verification
IP ranges · reverse DNSUnverified is not spoofed: some providers publish no IP ranges.
Watch requests as they land
The newest agent requests, with the path, the status, how long the response took and whether the agent is who it says it is.
Live traffic
StreamingTime Agent Status Verification Path Duration 09:41:07 ChatGPT-UserUser query / retrieval 200 Verified /best-crm-software182 ms 09:41:02 PerplexityBotSearch / index 200 Verified /crm-comparison240 ms 09:40:55 GPTBotTraining 503 Verified /product2,410 ms 09:40:41 GPTBotTraining 404 Spoofed /wp-login.php38 ms 09:40:33 Claude-UserUser query / retrieval 200 Verified /integrations201 ms
Know why each bot came
Every recognised agent is classified by one of four intents.
User query / retrieval
Fetching a page to answer someone's question right now: ChatGPT-User, Claude-User, Perplexity-User.
Search / index
Discovering content for later answers: OAI-SearchBot, PerplexityBot, Googlebot, Bingbot.
Training
Collecting data to build models: GPTBot, ClaudeBot, Bytespider.
Agent / action
Agents that do more than read: sending a form, a booking or an API call on someone's behalf.
Catch what stops agents from understanding and fetching your site.
Audit your robots.txt, test a page for what trips agents up, and see every URL that returns an error to an AI agent. Checks run on demand, against your own domain.
Know which bots robots.txt lets in
See which AI agents your current rules allow at the site root, which sitemaps you declare and what changed since the last audit.
robots.txt audit
Site root · todayAgent Rule ChatGPT-User Allowed OAI-SearchBotChanged since last audit Blocked GPTBot Blocked PerplexityBot Allowed ClaudeBot Allowed Googlebot Allowed 1 sitemap declared: /sitemap.xml
Find the URLs that fail agents
Every URL that returned a 4xx or 5xx to a recognised AI agent, and how often.
Crawler request failures
4xx and 5xx · 30 daysURL Status Agent Requests /docs/api/v1 404 ChatGPT-User 214 /product 503 GPTBot 96 /blog/crm-trends-2023 404 PerplexityBot 61 /customers/acme 403 Claude-User 38 Test any page for what trips agents up
Content that needs JavaScript or a challenge page, missing structured data, noindex and canonical problems, and pages too few others link to.
Page test · /integrations
2 to fix- Content without JavaScriptMain content needs JavaScriptFix
- Challenge pageNone servedPass
- Structured dataNone foundFix
- IndexableNo noindexPass
- CanonicalPoints to itselfPass
- Internal links2 links in from other pagesCheck
Connect every crawl to the answers it feeds.
Quotable puts agent requests beside your citation data. Where the two disagree, you get a fix. None of them promises a citation: they remove the reasons an agent can’t use your page.
Read, but never cited
Pages agents request again and again that no tracked answer cites. They are being read, and not used.
Cited, but never fetched
Pages AI answers cite that no recognised agent has requested. Check the answer still matches what the page says.
Cited, but failing
Pages AI answers cite that return errors to the agents fetching them. Fix them before the next fetch.
Know what to fix first
Every fix shows its evidence, the effort and Quotable’s confidence, so you can weigh them side by side and mark each one useful or not.
Recommended fixes
Sorted by priorityFix Page Evidence Effort Confidence Crawled, not cited /integrations611 agent requests, 0 citations Medium High Review AI search crawler blocks robots.txtOAI-SearchBot blocked at / Low High Cited, but failing /product18 citations, 2.1% of requests fail Low High Serve the page without JavaScript /integrationsPage test: content needs JavaScript Medium Medium Not fetched by any agent /blog/crm-migration12 citations, 0 agent requests Low Medium
Plug in the logs you already have.
Ten log sources, read out of band on all but the Cloudflare Worker, and GA4 for AI Referrals. No tag to install, nothing added to your pages.
- Cloudflare LogpushLogpush HTTP destination
- Cloudflare WorkerFail-open Worker, any plan
- VercelLog Drain
- Amazon CloudFrontReal-time logs via Firehose
- Google Cloud CDNLog Router sink to Pub/Sub
- FastlyHTTPS logging endpoint
- AkamaiDataStream 2
- NetlifyLog Drain
- Log file importCSV, CLF or NDJSON upload
- Custom HTTPJSON or NDJSON POST
- Google Analytics 4AI Referrals, Pro and above
- See all integrationsCMS, analytics and more
Measure the visitors AI answers send you.
AI Referrals reads your GA4 and splits sessions, engagement and key events by engine.
Count the people AI sends you
90-day backfill when you connect, daily sync after. Clicks from Google AI Overviews arrive in GA4 as Google organic, so they aren’t counted here.
AI Referrals
From GA4- Sessions2,481+31% vs prior period
- Engagement rate64%+4 pts
- Key events1245.0% of sessions
By engine
See where they land, and what they do
See which landing pages AI sends people to, and which of those visits lead to a key event.
Top landing pages
AI sessionsLanding page Sessions Key events /best-crm-software 317 21 /crm-comparison 184 12 /product 126 9 /pricing 94 14
Know the moment something changes.
Each alert states its threshold, its baseline and what resolves it. Active alerts sit in Needs attention and are emailed to the people with access to the brand, at most once a day.
Get told the day something breaks
Failure rates, slow responses, traffic that drops or spikes, new agents and robots.txt changes.
Needs attention
4 active- Crawler failure rate is elevated12% of agent requests fail. Threshold 10%.Warning
- robots.txt policy changedOAI-SearchBot is now blocked at /.Warning
- Crawler activity dropped−54% against the previous 7 days.Warning
- New agentMistralAI-User, first seen today.Info
Keep visitor data out of it
Quotable keeps only what the analysis needs. The rest never reaches storage.
What never reaches storage
Every request- No JavaScript tagRead from your server or CDN logs
- No IP addressesUsed in memory to verify, then discarded
- No query stringsStripped from every path
- No cookies, headers or bodiesNever read from the log record
- No IDs or emails in pathsReplaced before storage
- No human trafficDropped on arrival
Find out what to optimize for AI.
Connect your CDN or host and link GA4. No tag to install.
Frequently Asked
Do I need to install a JavaScript tag?
No. AI crawlers do not run JavaScript, so a browser tag cannot see them. Quotable reads the requests from your server or CDN logs instead, through one of ten log sources, from Cloudflare and Vercel to a plain log file.
What do you store from my logs?
Only what the analysis needs. IP addresses are not stored, user agents are reduced to the agent and provider, query strings are stripped, and human traffic is dropped on arrival.
How do you know a request really came from an AI crawler?
Each request is checked against the provider's published IP ranges and, where there are none, forward-confirmed reverse DNS. Requests are marked Verified, Unverified or Spoofed. Unverified does not mean spoofed: some providers publish no ranges at all.
Which AI agents does Quotable recognise?
Nineteen, including GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-SearchBot, Claude-User, PerplexityBot, Perplexity-User, Googlebot and Bingbot. Requests from bots outside that list are not stored.
Why is Googlebot in my AI agents?
Googlebot feeds Google's AI Overviews and AI Mode as well as classic search, so it's tracked and classified as Search / index.
How do I know what to optimize first?
Each recommended fix shows the evidence, the metric it targets, the effort and Quotable's confidence, so you can weigh them side by side.
How is this different from my CDN's bot reports?
Those count requests. Quotable verifies each agent, classifies why it came, checks what blocks it, and puts every page next to the citations it earns and the visits AI sends.
Does a crawler visit mean my page will be cited?
No. A request shows that an agent fetched the page, not that an answer used it or that anyone clicked through. That is why the citations and the referrals sit beside the crawler data rather than being inferred from it.
Which AI platforms do AI Referrals cover?
ChatGPT, Perplexity, Gemini, Copilot and Claude, read from your GA4 property with a 90-day backfill and a daily sync. Clicks from Google AI Overviews arrive as ordinary Google organic traffic, so they cannot be separated and are not counted.
Can Quotable check my robots.txt?
Yes. The robots.txt audit checks which AI agents your current rules allow at the site root, lists the sitemaps you declare and shows what changed since the previous audit. It runs on demand, from our network, against your own domain, and a change between two audits raises an alert.
What alerts does Agent Analytics send?
Alerts fire when a log source errors or falls behind, when 10% or more of agent requests fail, when p95 response time reaches 2,000 ms, when requests rise or fall 50% against the previous equal window, when a new agent appears, and when your robots.txt or sitemap changes. Each states its threshold and baseline, shows in Needs attention and is emailed to the people with access to the brand, at most once a day while it stays active.
Which plans include Agent Analytics?
AI crawler analytics is on every plan, with a daily event allowance that grows with the plan. AI Referrals, which reads your GA4, is on Pro and above.