How does Scrunch make a JavaScript-heavy website crawlable for AI bots?

Also asked as
  • How does Scrunch handle JavaScript for AI agents?
  • Does Agent Pages solve JavaScript crawling issues?

Scrunch makes JavaScript-heavy websites crawlable for AI bots through Agent Pages, which delivers an optimized version of page content directly to AI agents without any JavaScript dependency.

Image from Agent Pages tab in Scrunch

Example

For example, when a Scrunch user enables Agent Pages, their CDN automatically routes AI agent traffic to an AI-optimized version of site content.

Agent Pages delivers clean, server-rendered HTML without JavaScript dependencies, making all content immediately accessible to AI bots.

Best-practice technical fixes are automatically applied to content to improve AI readability.

The human-facing version of the website is not changed in any way.

Follow-up question: Does Agent Pages require code changes to my existing JavaScript framework?

No, Agent Pages doesn't require code changes to an existing JavaScript framework. It works at the CDN level to automatically transform content for AI agents without modifying the codebase or affecting human visitors.