AI discovery workflow
How to build a useful llms.txt file
llms.txt is a small Markdown file placed at the site root to help AI assistants understand what a site is, which pages matter, and where to find authoritative context. Treat it as a curated guide, not as a replacement for sitemap.xml or robots.txt.
What to include
Start with an H1 site name and a short blockquote summary. Add sections for documentation, product pages, policies, examples, and important evergreen guides. Each link should have a clear title and a short explanation of why an assistant should read it.
What to leave out
Do not dump every URL from the sitemap. Avoid login-only pages, duplicate tag pages, thin pages, expired promotions, and internal dashboards. A concise file with 10 to 30 important links is more useful than a long file that forces an assistant to guess priorities.
Maintenance rhythm
Update llms.txt when your positioning changes, when you publish important guides, or when legal and pricing pages move. Keep it under a practical size limit so an AI assistant can read the whole file in one request without truncation.