Scrunch serves bot-friendly HTML and pre-rendered pages to AI crawlers via its Agent Experience Platform (AXP). The user’s CDN routes AI user agents to AXP, which delivers AI-optimized content directly to AI crawlers.

Additional context: Content served via AXP is clean, server-rendered HTML with no JavaScript dependency. This includes structured summaries and context blocks, clarified entity definitions and claims, removed or simplified dynamic components, and any approved page-level or template-level enhancements.

Example

For example, a Scrunch user using Cloudflare as their CDN would follow this automated workflow:

Initial request: AI user agent (e.g., ChatGPT-User, PerplexityBot, etc.) retrieves webpage using the existing URL already indexed in search.

Routing logic: Cloudflare routes AI agent to the Agent Experience Platform origin.

Optimized delivery: AXP serves the agent an optimized version of the page designed for AI comprehension.

Result: AI agents receive structured, easily parseable content while the human web visitor experience remains unchanged.

Follow-up question: Does Agent Experience Platform change search indexing?

No, Agent Experience Platform does not change search indexing. AXP only affects real-time AI retrieval bots, not search indexing bots. Search engine crawlers like Googlebot and Bingbot are not routed to AXP.