Skip to main content
New scan
25
score
AI crawler score

burtosu.eu

Poor · 25/100Scanned in 0.1s

We fetched your site exactly like an AI bot would — no JavaScript, server response only — and ran 9 weighted checks.

Changed something?
Last scanned 54 min ago. Re-run all checks against your live site to see updated results.

Top fixes

  1. 1
    AI crawlers don't run JavaScript. Switch to SSR/SSG or add prerendering for bots.
    Worth up to 25 pointsRead the fix guide →
  2. 2
    Add a real /llms.txt at your site root (plain text, first line starts with '# ') and make sure your SPA fallback doesn't intercept it.
    Worth up to 10 pointsRead the fix guide →
  3. 3
    Publish a real /sitemap.xml so crawlers can discover every important page, and ensure your SPA fallback doesn't intercept it.
    Worth up to 10 pointsRead the fix guide →

Checks (9)

  • AI crawler access
    No usable robots.txt: your server returned an HTML page for /robots.txt (HTTP 200 · text/html) — that's a single-page-app fallback, not a real robots file. Crawlers will treat the site as fully allowed, but you should serve a real robots.txt.
    25/25 pts
  • Server-side content
    0/1 pages pass · avg 0/25 pts.
    Fix: AI crawlers don't run JavaScript. Switch to SSR/SSG or add prerendering for bots. Read the full guide →
    0/25 pts
  • llms.txt
    Your server returned an HTML page for /llms.txt (HTTP 200 · text/html) — this is a single-page-app fallback, not a real llms.txt file.
    Fix: Add a real /llms.txt at your site root (plain text, first line starts with '# ') and make sure your SPA fallback doesn't intercept it. Read the full guide →
    0/10 pts
  • Sitemap
    Your server returned an HTML page for /sitemap.xml (HTTP 200 · text/html) — this is a single-page-app fallback, not a real sitemap.
    Fix: Publish a real /sitemap.xml so crawlers can discover every important page, and ensure your SPA fallback doesn't intercept it. Read the full guide →
    0/10 pts
  • Structured data (JSON-LD)
    0/1 pages pass · avg 0/8 pts.
    Fix: Add schema.org JSON-LD (Organization, Article, Product…) to help AI parse your content. Read the full guide →
    0/8 pts
  • Heading structure
    0/1 pages pass · avg 0/7 pts.
    Fix: Use exactly one <h1> per page describing the topic, then <h2>s for sections. Read the full guide →
    0/7 pts
  • Title & Open Graph
    0/1 pages pass · avg 0/8 pts.
    Fix: Set <title>, meta description, and Open Graph tags. Read the full guide →
    0/8 pts
  • Canonical URL
    0/1 pages pass · avg 0/4 pts.
    Fix: Add <link rel="canonical" href="…"> to avoid duplicate-content confusion. Read the full guide →
    0/4 pts
  • llms.txt format
    Skipped — no llms.txt to validate.
    0/3 pts

How the score is calculated

Each of the 9 checks has a fixed weight. Your score is the sum of points earned — out of 100.

Bands
  • 85–100 · Great — crawlers can read everything.
  • 65–84 · Good — minor gaps to fix.
  • 40–64 · Needs work — important signals missing.
  • 0–39 · Poor — likely invisible to AI search.

AI crawler access and Server-side content carry the most weight (25 pts each, 50% combined). Failing either one usually drops the band by at least one tier.

  • AI crawler access
    25/2525%
  • Server-side content
    0/2525%
  • llms.txt
    0/1010%
  • Sitemap
    0/1010%
  • Structured data (JSON-LD)
    0/88%
  • Title & Open Graph
    0/88%
  • Heading structure
    0/77.000000000000001%
  • Canonical URL
    0/44%
  • llms.txt format
    0/33%

How to interpret this report

We fetch your site the same way an AI bot does — no JavaScript, raw server response only. Each check shows the HTTP status and content-type we received so you can verify the result.

  • SPA fallback caveat. Many single-page apps (Vite, Next.js, React Router) serve index.html with HTTP 200 for any missing path — including /llms.txt, /robots.txt, and /sitemap.xml. We detect this and treat the file as missing. If a check says "SPA fallback", the file isn't really there — your server is just hiding the 404.
  • Valid file signatures. A real llms.txt starts with # Title; a real sitemap contains <urlset> or <sitemapindex>; a real robots.txt has directives like User-agent:. HTML responses fail these signatures even when the status is 200.
  • How to verify. Open the file in your browser or run curl -I https://yourdomain.com/llms.txt. If the content-type is text/html, the file isn't there — configure your host or framework to serve the real file before the SPA fallback.

FAQ · Common false positives

  • Many single-page apps (Vite, Next.js, React Router, Vercel/Netlify defaults) return your index.html with a 200 status for any missing path. We detect this and treat the file as missing — AI crawlers will too.

    Run these against your live site. If content-type is text/html, the real file isn't being served:

    Check headers — llms.txt
    curl -sI -A "GPTBot" https://burtosu.eu/llms.txt
    Check headers — robots.txt
    curl -sI -A "GPTBot" https://burtosu.eu/robots.txt
    Check headers — sitemap.xml
    curl -sI -A "GPTBot" https://burtosu.eu/sitemap.xml

llms.txt for burtosu.eu

Spec-compliant llms.txt generated from your sitemap and homepage metadata — drop it at /llms.txt so AI crawlers can index your site faster.

Checking for a cached version…

Embed your score

Show off your AI-readiness — add this live badge to your README or footer. It updates automatically on every scan.

Crawlable score badge for burtosu.eu
HTML
<a href="https://getcrawlable.com/report/burtosu.eu" target="_blank" rel="noopener"><img src="https://getcrawlable.com/api/badge/burtosu.eu.svg" alt="AI crawler readability score by Crawlable" height="40"></a>
Markdown
[![AI crawler readability score by Crawlable](https://getcrawlable.com/api/badge/burtosu.eu.svg)](https://getcrawlable.com/report/burtosu.eu)
Scanned 6/4/2026, 6:51:21 PM · https://burtosu.eu/