Skip to main content

0.15.66.63 is invisible to AI search

Cloudflare blocked our crawler with HTTP 403 and served a bot challenge page instead of your site's content.

AI crawlers (GPTBot, ClaudeBot, PerplexityBot, Google-Extended…) see the same HTTP 403 challenge page that we did — not your real content. Until the challenge is bypassed for legitimate AI bots, this site cannot be cited or summarized by any LLM.

How to fix it (site owner)

  1. In Cloudflare → Security → Bots, set "Verified bots" to Allow. This lets Googlebot, GPTBot, ClaudeBot and other verified AI crawlers through automatically.
  2. Under Security → WAF → Custom rules, add a Skip rule for the user agents you want to allow, e.g.(http.user_agent contains "GPTBot") or (http.user_agent contains "ClaudeBot") or (http.user_agent contains "PerplexityBot") or (http.user_agent contains "CrawlableBot")→ Action: Skip → All remaining custom rules, Bot Fight Mode, Super Bot Fight Mode, and Managed Challenge.
  3. Optional: lower Security Level to "Medium" or "Essentially Off" for the paths AI bots need (usually / and your content routes).
  4. Re-run this scan. You should see HTTP 200 and a real score.

Full guide with copy-pasteable rules: docs/allowlist-crawlable

Checks (0)

    Scanned 6/5/2026, 5:45:13 PM · https://0.15.66.63/