ISR and Crawlers

[st11x]

Hi,

In Next.js 12, when a bot was detected, the ISR fallback behavior automatically switched to blocking, so crawlers would always receive a freshly rendered page even if ISR was enabled.

In Next.js 14, this doesn’t seem to happen anymore. When I request the page using a Googlebot user-agent, it still serves the stale cached version.

As a result, my crawler is indexing outdated content. Is there something else I need to configure in my requests?

Thanks,
Matt