llms.txt
Definition: llms.txt is a proposed Markdown file served at the root of a website that gives language models a short summary of the site and a curated list of links to its most useful content.
Also called: LLMs.txt, llms txt file
Updated
What the proposal says
Jeremy Howard proposed llms.txt in September 2024 (llmstxt.org). The file lives at /llms.txt and is written in Markdown. Only the H1 with the site or project name is required. After it come an optional blockquote summary, optional notes, and H2 sections that list links, each with an optional short description. A section titled “Optional” marks links an agent can skip when it needs a shorter context.
# Example Co
> Example Co makes invoicing software for small agencies.
## Docs
- [Getting started](https://example.com/docs/start.md): setup in five minutes
- [API reference](https://example.com/docs/api.md)
## Optional
- [Changelog](https://example.com/changelog.md)The proposal also suggests serving a clean Markdown copy of each page at the same URL with .md added.
Who reads it
Google says you do not need AI text files to appear in Google Search, and that Google Search ignores them (Google Search Central). No major AI search provider has documented using llms.txt to choose what to cite. Its most practical use today is developer documentation read by coding assistants and agents. Chrome’s Lighthouse has an llms.txt audit, but it only flags server errors and treats a missing file as not applicable (Chrome for Developers).
Is it worth adding?
Our view: the cost is low and so is the expected benefit. Add one if you publish documentation, an API or a product catalogue that agents might work through. Do not expect it to change rankings or citations. The llms.txt generator builds and validates one, and the llms.txt guide covers the debate in full.