Skip to content

Optimize your site for the next kind of visitor: agents

See which AI agents visit your site and which answers send you visitors. Turn server logs and GA4 data into page-by-page fixes. No tag to install.

The Agent Analytics overview: 13,499 answer visits in the last 30 days, up 91%, with index crawls, training crawls and all AI visits beside it; a daily chart of answer visits against the previous period; and the start of the breakdowns by AI system, led by OpenAI at 59%, and by visit type.
Agent Analytics overview: answer visits, index and training crawls, and the AI systems behind them.
  • Detus

Agent Analytics turns AI traffic into answers: which AI agents read which pages, what they can’t reach, which pages AI cites and sends visitors to, and what to optimize next.

See which AI agents visit your site, and why.

Quotable reads requests from your CDN or host and checks each one against the provider’s published IP ranges and reverse DNS. You see every agent, how often it comes, which pages it requests and what it came to do.

  • See what each agent reads

    Sort pages by requests, agents, errors or response time, narrow to a folder, and open any page in Citations or AI Referrals.

    Pages agents request most

    Last 30 days
    PageRequestsCitations
    /best-crm-software1,28442
    /crm-comparison92631
    /product74818
    /pricing3927
    /blog/crm-for-startups31112
    /integrations2475
    /docs/api1983
    /customers1262

    Citations come from a separate dataset and are shown for context.

  • Tell real AI bots from fakes

    Any bot can call itself GPTBot. Every request is marked Verified, Unverified or Spoofed. Unverified isn’t spoofed: some providers publish no IP ranges.

    Verification

    IP ranges · reverse DNS
    • Verified16,754
    • Unverified1,421
    • Spoofed237

    Unverified is not spoofed: some providers publish no IP ranges.

  • Watch requests as they land

    The newest agent requests, with the path, the status, how long the response took and whether the agent is who it says it is.

    Live traffic

    Streaming
    TimeAgentStatusVerificationPathDuration
    09:41:07ChatGPT-UserUser query / retrieval200Verified/best-crm-software182 ms
    09:41:02PerplexityBotSearch / index200Verified/crm-comparison240 ms
    09:40:55GPTBotTraining503Verified/product2,410 ms
    09:40:41GPTBotTraining404Spoofed/wp-login.php38 ms
    09:40:33Claude-UserUser query / retrieval200Verified/integrations201 ms

Know why each bot came

Every recognised agent is classified by one of four intents.

  • User query / retrieval

    Fetching a page to answer someone's question right now: ChatGPT-User, Claude-User, Perplexity-User.

  • Search / index

    Discovering content for later answers: OAI-SearchBot, PerplexityBot, Googlebot, Bingbot.

  • Training

    Collecting data to build models: GPTBot, ClaudeBot, Bytespider.

  • Agent / action

    Agents that do more than read: sending a form, a booking or an API call on someone's behalf.

Catch what stops agents from understanding and fetching your site.

Audit your robots.txt, test a page for what trips agents up, and see every URL that returns an error to an AI agent. Checks run on demand, against your own domain.

  • Know which bots robots.txt lets in

    See which AI agents your current rules allow at the site root, which sitemaps you declare and what changed since the last audit.

    robots.txt audit

    Site root · today
    AgentRule
    ChatGPT-UserAllowed
    OAI-SearchBotChanged since last auditBlocked
    GPTBotBlocked
    PerplexityBotAllowed
    ClaudeBotAllowed
    GooglebotAllowed

    1 sitemap declared: /sitemap.xml

  • Find the URLs that fail agents

    Every URL that returned a 4xx or 5xx to a recognised AI agent, and how often.

    Crawler request failures

    4xx and 5xx · 30 days
    URLStatusAgentRequests
    /docs/api/v1404ChatGPT-User214
    /product503GPTBot96
    /blog/crm-trends-2023404PerplexityBot61
    /customers/acme403Claude-User38
  • Test any page for what trips agents up

    Content that needs JavaScript or a challenge page, missing structured data, noindex and canonical problems, and pages too few others link to.

    Page test · /integrations

    2 to fix
    • Content without JavaScriptMain content needs JavaScriptFix
    • Challenge pageNone servedPass
    • Structured dataNone foundFix
    • IndexableNo noindexPass
    • CanonicalPoints to itselfPass
    • Internal links2 links in from other pagesCheck

Connect every crawl to the answers it feeds.

Quotable puts agent requests beside your citation data. Where the two disagree, you get a fix. None of them promises a citation: they remove the reasons an agent can’t use your page.

  • Read, but never cited

    Pages agents request again and again that no tracked answer cites. They are being read, and not used.

  • Cited, but never fetched

    Pages AI answers cite that no recognised agent has requested. Check the answer still matches what the page says.

  • Cited, but failing

    Pages AI answers cite that return errors to the agents fetching them. Fix them before the next fetch.

  • Know what to fix first

    Every fix shows its evidence, the effort and Quotable’s confidence, so you can weigh them side by side and mark each one useful or not.

    Recommended fixes

    Sorted by priority
    FixPageEvidenceEffortConfidence
    Crawled, not cited/integrations611 agent requests, 0 citationsMediumHigh
    Review AI search crawler blocksrobots.txtOAI-SearchBot blocked at /LowHigh
    Cited, but failing/product18 citations, 2.1% of requests failLowHigh
    Serve the page without JavaScript/integrationsPage test: content needs JavaScriptMediumMedium
    Not fetched by any agent/blog/crm-migration12 citations, 0 agent requestsLowMedium

Plug in the logs you already have.

Ten log sources, read out of band on all but the Cloudflare Worker, and GA4 for AI Referrals. No tag to install, nothing added to your pages.

  • Cloudflare LogpushLogpush HTTP destination
  • Cloudflare WorkerFail-open Worker, any plan
  • VercelLog Drain
  • Amazon CloudFrontReal-time logs via Firehose
  • Google Cloud CDNLog Router sink to Pub/Sub
  • FastlyHTTPS logging endpoint
  • AkamaiDataStream 2
  • NetlifyLog Drain
  • Log file importCSV, CLF or NDJSON upload
  • Custom HTTPJSON or NDJSON POST
  • Google Analytics 4AI Referrals, Pro and above
  • See all integrationsCMS, analytics and more

Measure the visitors AI answers send you.

AI Referrals reads your GA4 and splits sessions, engagement and key events by engine.

  • Count the people AI sends you

    90-day backfill when you connect, daily sync after. Clicks from Google AI Overviews arrive in GA4 as Google organic, so they aren’t counted here.

    AI Referrals

    From GA4
    • Sessions2,481+31% vs prior period
    • Engagement rate64%+4 pts
    • Key events1245.0% of sessions

    By engine

    • ChatGPT1,284
    • Perplexity617
    • Gemini391
    • Copilot121
    • Claude68
  • See where they land, and what they do

    See which landing pages AI sends people to, and which of those visits lead to a key event.

    Top landing pages

    AI sessions
    Landing pageSessionsKey events
    /best-crm-software31721
    /crm-comparison18412
    /product1269
    /pricing9414

Know the moment something changes.

Each alert states its threshold, its baseline and what resolves it. Active alerts sit in Needs attention and are emailed to the people with access to the brand, at most once a day.

  • Get told the day something breaks

    Failure rates, slow responses, traffic that drops or spikes, new agents and robots.txt changes.

    Needs attention

    4 active
    • Crawler failure rate is elevated12% of agent requests fail. Threshold 10%.Warning
    • robots.txt policy changedOAI-SearchBot is now blocked at /.Warning
    • Crawler activity dropped−54% against the previous 7 days.Warning
    • New agentMistralAI-User, first seen today.Info
  • Keep visitor data out of it

    Quotable keeps only what the analysis needs. The rest never reaches storage.

    What never reaches storage

    Every request
    • No JavaScript tagRead from your server or CDN logs
    • No IP addressesUsed in memory to verify, then discarded
    • No query stringsStripped from every path
    • No cookies, headers or bodiesNever read from the log record
    • No IDs or emails in pathsReplaced before storage
    • No human trafficDropped on arrival

Find out what to optimize for AI.

Connect your CDN or host and link GA4. No tag to install.

Frequently Asked

Do I need to install a JavaScript tag?

No. AI crawlers do not run JavaScript, so a browser tag cannot see them. Quotable reads the requests from your server or CDN logs instead, through one of ten log sources, from Cloudflare and Vercel to a plain log file.

What do you store from my logs?

Only what the analysis needs. IP addresses are not stored, user agents are reduced to the agent and provider, query strings are stripped, and human traffic is dropped on arrival.

How do you know a request really came from an AI crawler?

Each request is checked against the provider's published IP ranges and, where there are none, forward-confirmed reverse DNS. Requests are marked Verified, Unverified or Spoofed. Unverified does not mean spoofed: some providers publish no ranges at all.

Which AI agents does Quotable recognise?

Nineteen, including GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-SearchBot, Claude-User, PerplexityBot, Perplexity-User, Googlebot and Bingbot. Requests from bots outside that list are not stored.

Why is Googlebot in my AI agents?

Googlebot feeds Google's AI Overviews and AI Mode as well as classic search, so it's tracked and classified as Search / index.

How do I know what to optimize first?

Each recommended fix shows the evidence, the metric it targets, the effort and Quotable's confidence, so you can weigh them side by side.

How is this different from my CDN's bot reports?

Those count requests. Quotable verifies each agent, classifies why it came, checks what blocks it, and puts every page next to the citations it earns and the visits AI sends.

Does a crawler visit mean my page will be cited?

No. A request shows that an agent fetched the page, not that an answer used it or that anyone clicked through. That is why the citations and the referrals sit beside the crawler data rather than being inferred from it.

Which AI platforms do AI Referrals cover?

ChatGPT, Perplexity, Gemini, Copilot and Claude, read from your GA4 property with a 90-day backfill and a daily sync. Clicks from Google AI Overviews arrive as ordinary Google organic traffic, so they cannot be separated and are not counted.

Can Quotable check my robots.txt?

Yes. The robots.txt audit checks which AI agents your current rules allow at the site root, lists the sitemaps you declare and shows what changed since the previous audit. It runs on demand, from our network, against your own domain, and a change between two audits raises an alert.

What alerts does Agent Analytics send?

Alerts fire when a log source errors or falls behind, when 10% or more of agent requests fail, when p95 response time reaches 2,000 ms, when requests rise or fall 50% against the previous equal window, when a new agent appears, and when your robots.txt or sitemap changes. Each states its threshold and baseline, shows in Needs attention and is emailed to the people with access to the brand, at most once a day while it stays active.

Which plans include Agent Analytics?

AI crawler analytics is on every plan, with a daily event allowance that grows with the plan. AI Referrals, which reads your GA4, is on Pro and above.