Scrunch detects AI bot traffic visiting users’ websites through direct CDN and hosting integrations that capture real-time bot visits. These integrations identify which AI agents are accessing site content, what they're requesting, how frequently they visit, and more.

Additional context: Scrunch distinguishes between training bots (collecting data to train AI models), indexer bots (building search indexes), and retrieval bots (fetching content for live user queries).

Example

For example, if a Scrunch user connects their CDN or hosting provider, they can see the following in the Agent Traffic tab:

Bot traffic trends

Volume of AI bot visits over time, broken down by specific AI models like ChatGPT, Perplexity, and more.

Request type classification

Whether bots are training on content, indexing it for future retrieval, or actively retrieving it for user queries.

Top performers

Which AI agents visit most frequently and which webpages receive the most bot attention.

Real-time monitoring

Bot requests sorted by recency to track current AI platform activity.

This visibility helps users understand which AI platforms actively engage with their content and which bots and pages drive the most AI search visibility.

Follow-up question: Which CDN and hosting providers does Scrunch integrate with?

Scrunch offers native integrations with major CDN and hosting providers, including Akamai, AWS CloudFront, Cloudflare, Fastly, Vercel, and WordPress.

If you're using a CMS that doesn’t provide direct access to raw CDN logs: HubSpot CMS, BigCommerce, Shopify, Squarespace, Uberflip, Webflow, and Wix users can still integrate with Scrunch via proxy through Cloudflare.