Part of Generative Engine Optimization
llms.txt
A plain-text Markdown file at /llms.txt that lists the highest-signal URLs on your site for LLM crawlers.
Overview
llms.txt is a community standard (originally proposed by Jeremy Howard) for a Markdown file at the root of a domain. It functions like a curator's note for LLMs: instead of crawling everything, models can read llms.txt and prioritize the canonical pages — docs, key landing pages, changelogs, glossaries. Pair it with llms-full.txt for long-form context that fits inside a single LLM ingestion.
Components
- llms.txt generator
Build the file
- Per-CMS guides
WordPress, Shopify, Webflow setup
Related entities
- robots.txt — complementary file
- sitemap.xml — complementary file
- llms-full.txt — long-form variant
Key facts
- llms.txt lives at the domain root, exactly like robots.txt.
- It is Markdown, not XML — designed for LLMs to read directly.
- Most sites publish a 30–80 line file; bigger isn't better.