Skip to content
All terms

What is llms.txt?

llms.txt is a plain-markdown file at a website's root that tells AI systems what the site is, what it offers, and which pages matter most.

Generate one free: llms.txt generator

The convention mirrors robots.txt in location but inverts its purpose: instead of restricting crawlers, it curates for them. A standard llms.txt contains an H1 with the site name, a blockquote one-line summary, and grouped links to key pages with short descriptions. A companion llms-full.txt can carry extended detail.

Its most useful line is the summary, which gives any tool that does read the file a clean, accurate description of the site. Keep it factual and in sync with the sitemap: a stale llms.txt misdescribes you wherever it is used. It remains a proposal rather than a standard, and it is not known to influence rankings or AI citations.

The format

The file is markdown with a fixed shape: an H1 with the site name (the only required element), a blockquote with a short summary, optional context paragraphs, then H2 sections containing lists of links written as - name: notes. A section titled Optional marks links a model may skip when its context is limited.

Does anyone actually read it?

llms.txt was proposed in September 2024 and is a community convention, not an official standard. Google's search team has said it does not use the file, and the AI companies have not published commitments to read it. Independent server-log studies have found that most llms.txt files receive little or no traffic from AI crawlers. It is genuinely useful with agents and developer tools that fetch it on purpose, such as assistants reading documentation.

Should you add one?

It costs little, so there is no real downside if you keep it accurate. But it is not where AI visibility is won. Allowing AI search crawlers in robots.txt, serving key content in the HTML and adding structured data have far more evidence behind them. Do those first, then add llms.txt.

Frequently asked questions

Does llms.txt improve rankings or AI citations?

There is no good evidence that it does. Treat it as optional hygiene, not a lever.

How is llms.txt different from robots.txt?

robots.txt tells crawlers what they may fetch, and the AI companies document and honor it. llms.txt is an optional, human-readable guide that models may choose to read. One controls access; the other only describes.

How do I create one?

Use the free llms.txt generator to draft one from a live scan of your site, review every line, then upload it to your web root.

Related terms

Primary technical references & standards

See how your site scores on this

The free Website Verdict scan measures your SEO and AI visibility in under a minute.

Run a free scan