Skip to content
All free tools

Free llms.txt Generator

llms.txt is a plain-markdown file at your site root that tells AI systems what your site is and which pages matter. Paste your URL and we'll draft one from a live scan of your site — ready to edit and upload.

What llms.txt is, and what it is not

llms.txt is a plain-markdown file served from your site root (yourdomain.com/llms.txt) that gives a language model a short, curated overview of your site: what it is, and which pages are worth reading. It was proposed in September 2024 by Jeremy Howard of Answer.AI. It is a community proposal, not an official web standard, and no standards body governs it.

Be realistic about what it does. Google's search team has said Google does not use llms.txt, and the AI companies have not published commitments to read it. Independent server-log studies have found that most llms.txt files receive little or no traffic from AI crawlers. Where it does earn its keep is with tools and agents that fetch it deliberately, such as coding assistants reading developer documentation, and as a tidy, maintained description of your site.

So treat it as cheap hygiene, not a ranking or citation lever. If you only have an hour to spend on AI visibility, spend it on crawler access and server-rendered content first.

The format, with an example

The proposal specifies markdown with a fixed shape: an H1 with the site or project name (the only required part), a blockquote containing a short summary, optional plain paragraphs of context, then H2 sections that each hold a list of links in the form - [name](url): optional notes. A section named Optional marks links that can be skipped when a model has limited context.

llms.txt
# Acme Plumbing

> Acme Plumbing is a licensed plumber serving Columbus, Ohio, covering emergency repairs, water heaters and repiping.

Founded in 2009. Service area: Franklin County. Licensed and insured.

## Services
- [Emergency repairs](https://acme.example/emergency): 24/7 same-day leak and burst-pipe repair
- [Water heaters](https://acme.example/water-heaters): Tank and tankless installation and replacement

## Company
- [About](https://acme.example/about): Team, licences and service area
- [Contact](https://acme.example/contact): Phone number and booking form

## Optional
- [Maintenance guides](https://acme.example/blog): Seasonal plumbing tips

How to install it

Review the generated draft line by line before you publish. It is built from a live scan of your site, but it is your own description of yourself, so accuracy matters more than polish.

  1. Save the file as llms.txt, plain text, UTF-8.
  2. Upload it to your web root so it loads at https://yourdomain.com/llms.txt with a 200 status, not a redirect.
  3. Check that your robots.txt and any CDN or firewall rules do not block it.
  4. Link only to canonical pages that return 200 and are indexable.
  5. Update it when you add, rename or remove an important page.

Common mistakes

Most llms.txt files that go wrong do so in one of these ways.

  • Marketing copy in the summary — keep it factual: what you are, who you serve, where. A model gets nothing from a slogan.
  • Dumping every URL — that is the sitemap's job. List the handful of pages that explain your site.
  • Linking to redirects, noindex pages or 404s — every link should resolve and be a page you want read.
  • Letting it go stale — an out-of-date file describes a business you no longer are.
  • Treating it as a substitute for crawler access — a bot that is blocked in robots.txt or by your CDN never gets as far as reading it.
  • Serving HTML instead of markdown — it should be plain text.

llms.txt, robots.txt and sitemap.xml are three different files

They are often confused. robots.txt tells crawlers what they may fetch; it is the file AI companies document and honor. sitemap.xml lists the URLs you want discovered, for search engines. llms.txt is an optional, human-readable guide for models. They complement each other and none replaces another.

If your goal is to be cited by AI engines

Start with the free AI Visibility Checker, which tests the things that demonstrably gate AI citation: crawler access, server-rendered content and structured data. Come back to llms.txt once those are in place.

Frequently asked questions

What is an llms.txt file?

A markdown file at your site root that gives language models a curated overview of your site: its name, a one-line summary and links to key pages with short notes. It was proposed in September 2024 and is a community convention rather than an official standard.

Does llms.txt help me rank in Google or get cited by ChatGPT?

There is no good evidence that it does. Google has said it does not use llms.txt, and the AI companies have not committed to reading it. Server-log studies suggest most AI crawlers rarely request it. It is harmless and cheap to add, but do not expect it to move rankings or citations.

Do ChatGPT, Claude or Perplexity read llms.txt?

None has publicly confirmed using it to decide what to cite. Some agents and developer tools do fetch it on purpose, which is where it is most useful. robots.txt, by contrast, is documented and honored by all the major AI crawlers.

Where do I put the llms.txt file?

In your site's web root, next to robots.txt, so it resolves at https://yourdomain.com/llms.txt. On most frameworks that is the public or static folder.

What is llms-full.txt?

An optional companion that holds the full text of your key documentation in one markdown file, for tools that want everything in one request. It mainly makes sense for developer docs, not for most marketing sites.

Should I add llms.txt to my site?

If it takes you under an hour and you will keep it current, there is no downside. Just do it after the things with real evidence behind them: allowing AI search crawlers, rendering content on the server, and adding structured data.

Go deeper

More free tools

Primary technical references & standards