Generate a spec-compliant llms.txt in seconds
Paste any URL. We crawl your sitemap, summarize each page with AI, and assemble an llms.txt that follows the spec — so AI assistants index your site correctly.
Free preview of the first ~30 lines. Full download with Crawlable Pro.
What is llms.txt?
llms.txt is a proposed standard (llmstxt.org) that gives large language models a curated, machine-readable map of your site. Where robots.txt tells crawlers what they may visit, llms.txt tells AI assistants what your site is about, which pages matter, and how to describe them.
llms.txt (example)
# Acme > Acme is a B2B analytics platform helping product teams measure feature adoption. ## Docs - [Getting started](https://acme.com/docs/start): install the SDK in 2 minutes. - [Event model](https://acme.com/docs/events): how Acme structures product events. ## Product - [Pricing](https://acme.com/pricing): plans and what's included.
How it works
- 1
We crawl your site
We fetch your sitemap, robots, and metadata server-side — no install, no scripts.
- 2
AI summarizes each page
We use a fast LLM to write one-line descriptions for every URL, grouped into sections.
- 3
You get a spec-compliant file
Drop it at /llms.txt on your domain. Preview is free, full download is Pro.
Why publish one?
- ChatGPT, Claude, Perplexity, and Gemini cite sites they can quickly understand.
- JS-rendered apps lose context for AI crawlers — llms.txt gives them a static map.
- Editorial summaries let you control how your product is described.
- It's tiny, costs nothing to host, and works alongside robots.txt and sitemap.xml.
Ready to generate yours?
Free preview in under 30 seconds. Upgrade to Pro for the full download and weekly monitoring.