x.com
We fetched your site exactly like an AI bot would — no JavaScript, server response only — and ran 9 weighted checks.
Unlock the full report
Upgrade to Pro or buy a one-time report to see every fix, check detail, crawled page, and your llms.txt.
One-time unlock: full report for x.com for 30 days.
How the score is calculated
Each of the 9 checks has a fixed weight. Your score is the sum of points earned — out of 100.
- 85–100 · Great — crawlers can read everything.
- 65–84 · Good — minor gaps to fix.
- 40–64 · Needs work — important signals missing.
- 0–39 · Poor — likely invisible to AI search.
AI crawler access and Server-side content carry the most weight (25 pts each, 50% combined). Failing either one usually drops the band by at least one tier.
- AI crawler access0/2525%
- Server-side content0/2525%
- llms.txt0/1010%
- Sitemap0/1010%
- Structured data (JSON-LD)8/88%
- Title & Open Graph4/88%
- Heading structure4/77.000000000000001%
- Canonical URL4/44%
- llms.txt format0/33%
How to interpret this report
We fetch your site the same way an AI bot does — no JavaScript, raw server response only. Each check shows the HTTP status and content-type we received so you can verify the result.
- SPA fallback caveat. Many single-page apps (Vite, Next.js, React Router) serve
index.htmlwithHTTP 200for any missing path — including/llms.txt,/robots.txt, and/sitemap.xml. We detect this and treat the file as missing. If a check says "SPA fallback", the file isn't really there — your server is just hiding the 404. - Valid file signatures. A real
llms.txtstarts with# Title; a real sitemap contains<urlset>or<sitemapindex>; a real robots.txt has directives likeUser-agent:. HTML responses fail these signatures even when the status is 200. - How to verify. Open the file in your browser or run
curl -I https://yourdomain.com/llms.txt. If the content-type istext/html, the file isn't there — configure your host or framework to serve the real file before the SPA fallback.
FAQ · Common false positives
Many single-page apps (Vite, Next.js, React Router, Vercel/Netlify defaults) return your
index.htmlwith a 200 status for any missing path. We detect this and treat the file as missing — AI crawlers will too.Run these against your live site. If
content-typeistext/html, the real file isn't being served:Check headers — llms.txtcurl -sI -A "GPTBot" https://x.com/llms.txtCheck headers — robots.txtcurl -sI -A "GPTBot" https://x.com/robots.txtCheck headers — sitemap.xmlcurl -sI -A "GPTBot" https://x.com/sitemap.xml
Unlock the full report for x.com for 30 days — full llms.txt + llms-full.txt downloads, unlimited re-scans, and every Pro report feature for this single site.
Embed your score
Show off your AI-readiness — add this live badge to your README or footer. It updates automatically on every scan.
<a href="https://getcrawlable.com/report/x.com" target="_blank" rel="noopener"><img src="https://getcrawlable.com/api/badge/x.com.svg" alt="AI crawler readability score by Crawlable" height="40"></a>
[](https://getcrawlable.com/report/x.com)