burtosu.eu
We fetched your site exactly like an AI bot would — no JavaScript, server response only — and ran 9 weighted checks.
Top fixes
- 1AI crawlers don't run JavaScript. Switch to SSR/SSG or add prerendering for bots.Worth up to 25 pointsRead the fix guide →
- 2Add a real /llms.txt at your site root (plain text, first line starts with '# ') and make sure your SPA fallback doesn't intercept it.Worth up to 10 pointsRead the fix guide →
- 3Publish a real /sitemap.xml so crawlers can discover every important page, and ensure your SPA fallback doesn't intercept it.Worth up to 10 pointsRead the fix guide →
Checks (9)
- AI crawler accessNo usable robots.txt: your server returned an HTML page for /robots.txt (HTTP 200 · text/html) — that's a single-page-app fallback, not a real robots file. Crawlers will treat the site as fully allowed, but you should serve a real robots.txt.25/25 pts
- Server-side content0/1 pages pass · avg 0/25 pts.Fix: AI crawlers don't run JavaScript. Switch to SSR/SSG or add prerendering for bots. Read the full guide →0/25 pts
- llms.txtYour server returned an HTML page for /llms.txt (HTTP 200 · text/html) — this is a single-page-app fallback, not a real llms.txt file.Fix: Add a real /llms.txt at your site root (plain text, first line starts with '# ') and make sure your SPA fallback doesn't intercept it. Read the full guide →0/10 pts
- SitemapYour server returned an HTML page for /sitemap.xml (HTTP 200 · text/html) — this is a single-page-app fallback, not a real sitemap.Fix: Publish a real /sitemap.xml so crawlers can discover every important page, and ensure your SPA fallback doesn't intercept it. Read the full guide →0/10 pts
- Structured data (JSON-LD)0/1 pages pass · avg 0/8 pts.Fix: Add schema.org JSON-LD (Organization, Article, Product…) to help AI parse your content. Read the full guide →0/8 pts
- Heading structure0/1 pages pass · avg 0/7 pts.Fix: Use exactly one <h1> per page describing the topic, then <h2>s for sections. Read the full guide →0/7 pts
- Title & Open Graph0/1 pages pass · avg 0/8 pts.Fix: Set <title>, meta description, and Open Graph tags. Read the full guide →0/8 pts
- Canonical URL0/1 pages pass · avg 0/4 pts.Fix: Add <link rel="canonical" href="…"> to avoid duplicate-content confusion. Read the full guide →0/4 pts
- llms.txt formatSkipped — no llms.txt to validate.0/3 pts
How the score is calculated
Each of the 9 checks has a fixed weight. Your score is the sum of points earned — out of 100.
- 85–100 · Great — crawlers can read everything.
- 65–84 · Good — minor gaps to fix.
- 40–64 · Needs work — important signals missing.
- 0–39 · Poor — likely invisible to AI search.
AI crawler access and Server-side content carry the most weight (25 pts each, 50% combined). Failing either one usually drops the band by at least one tier.
- AI crawler access25/2525%
- Server-side content0/2525%
- llms.txt0/1010%
- Sitemap0/1010%
- Structured data (JSON-LD)0/88%
- Title & Open Graph0/88%
- Heading structure0/77.000000000000001%
- Canonical URL0/44%
- llms.txt format0/33%
How to interpret this report
We fetch your site the same way an AI bot does — no JavaScript, raw server response only. Each check shows the HTTP status and content-type we received so you can verify the result.
- SPA fallback caveat. Many single-page apps (Vite, Next.js, React Router) serve
index.htmlwithHTTP 200for any missing path — including/llms.txt,/robots.txt, and/sitemap.xml. We detect this and treat the file as missing. If a check says "SPA fallback", the file isn't really there — your server is just hiding the 404. - Valid file signatures. A real
llms.txtstarts with# Title; a real sitemap contains<urlset>or<sitemapindex>; a real robots.txt has directives likeUser-agent:. HTML responses fail these signatures even when the status is 200. - How to verify. Open the file in your browser or run
curl -I https://yourdomain.com/llms.txt. If the content-type istext/html, the file isn't there — configure your host or framework to serve the real file before the SPA fallback.
FAQ · Common false positives
Many single-page apps (Vite, Next.js, React Router, Vercel/Netlify defaults) return your
index.htmlwith a 200 status for any missing path. We detect this and treat the file as missing — AI crawlers will too.Run these against your live site. If
content-typeistext/html, the real file isn't being served:Check headers — llms.txtcurl -sI -A "GPTBot" https://burtosu.eu/llms.txtCheck headers — robots.txtcurl -sI -A "GPTBot" https://burtosu.eu/robots.txtCheck headers — sitemap.xmlcurl -sI -A "GPTBot" https://burtosu.eu/sitemap.xml
llms.txt for burtosu.eu
Spec-compliant llms.txt generated from your sitemap and homepage metadata — drop it at /llms.txt so AI crawlers can index your site faster.
Embed your score
Show off your AI-readiness — add this live badge to your README or footer. It updates automatically on every scan.
<a href="https://getcrawlable.com/report/burtosu.eu" target="_blank" rel="noopener"><img src="https://getcrawlable.com/api/badge/burtosu.eu.svg" alt="AI crawler readability score by Crawlable" height="40"></a>
[](https://getcrawlable.com/report/burtosu.eu)