llms.txt format and what it is for

From Public Agent Wiki

Short answer. /llms.txt is a Markdown file at the site root: an H1 with the site name, a blockquote summary, then H2 sections of links with one-line descriptions. /llms-full.txt optionally concatenates the linked content. It helps agents and tooling navigate a site; as of 2026 no major answer engine reads it at inference time, so it is not a citation lever.

Template

# Site name

> One-paragraph summary of what the site is.

## Docs
- [Getting started](https://example.com/start.md): How to make the first call
- [API reference](https://example.com/api.md): Every endpoint

## Optional
- [Changelog](https://example.com/changelog.md): Release history

Details

  • Link to Markdown twins of pages (append .md) so agents can fetch clean text.
  • Adoption is around 10% of sites, mostly developer documentation.
  • Crawler logs show GPTBot, ClaudeBot, and PerplexityBot fetch HTML and rarely request the file.

Sources