What is an llms.txt file?
llms.txt is a proposed plain text file, written in Markdown, that lives at yoursite.com/llms.txt. It gives language models a short, curated map of a site. The proposal comes from llmstxt.org (read October 29, 2026).
The format has a fixed order. The proposal says an H1 with the name of the project or site "is the only required section" (llmstxt.org, read October 29, 2026). Next comes a blockquote with a short summary. After that come sections under H2 headings, each holding a list of links. Each item is a link and, if you like, a colon and a note about the page. A section called Optional holds secondary links that a reader can skip when it needs a shorter context. The proposal puts it this way: "While sitemaps list all pages for search engines, llms.txt offers a curated overview for LLMs" (llmstxt.org, read October 29, 2026). It calls the Optional section one "for secondary information" and says the file can complement robots.txt "by providing context for allowed content."
Do AI tools read llms.txt?
It is a proposal, not a standard that search engines or AI companies have to follow. We do not know of a promise from any AI company that having the file changes whether your pages get cited, so check each vendor's own documentation. The file is cheap to make, and it makes you write down in plain words what your site is for.
Robots.txt and sitemaps remain the established files for crawling. If you have not set robots.txt for AI crawlers yet, start with the robots.txt generator for AI crawlers.
What does the generator do with my site?
It fetches your home page and reads the title and meta description. It also reads your sitemap if you have one. It picks up to 14 pages on your own domain: links in your navigation first, then top-level pages from the sitemap, then a couple of pages from each section such as your blog.
For each page it reads the title and meta description. It groups pages into Docs, Product, Company, Pages and Blog by the first part of the address, and moves extra blog posts and legal pages to Optional. It uses no AI, so each note is exactly what the page says about itself. A page with no meta description gets a link with no note. A page titled only "Home" makes a weak link, so read the draft before you publish it.
How do I add llms.txt to my site?
- Type your site address and press the button. The tool reads your home page and sitemap.
- Fix the summary, delete weak links, and rewrite any note that is vague.
- Copy the text or download it as llms.txt.
- Save it so it loads as plain text at yoursite.com/llms.txt. Most site builders let you upload a static file to the root, or add a redirect to one.
- Run the tool again when your key pages change and replace the file.
Questions about the llms.txt generator
Is llms.txt required for AI search?
No. It is a proposal at llmstxt.org. Search engines and AI tools do not have to read it.
Does the generator use AI to write the descriptions?
No. It copies each page's title and meta description, trimmed to one line. You can edit anything before you copy it.
Do you store my site data?
We store the domain, the number of pages read and the time, so we can limit how often one network can run the tool. We do not keep the draft.
How many pages does the draft include?
Up to 14 pages from your own domain, picked from your navigation links and sitemap. Add any others by hand.
Why does my draft have so few links?
The site may block our fetch, have no sitemap, or build its navigation with scripts that a plain page read cannot see. Add your most useful links by hand: name, address and one line each.
Next: give AI tools something to quote
Paperboy writes articles that answer the questions your buyers ask, with every fact linked to its source, FAQ and Article structured data, and publishes them to your site every week. Your first article is free.