llms.txt
llms.txt is a proposed plain-text file at a site's root that gives AI crawlers a curated, machine-readable summary of the site's key content.
llms.txt is a plain-text file placed at the root of a website (for example, /llms.txt) that provides AI systems with a concise, curated, machine-readable overview of the site's most important content and links.
It is to AI crawlers what robots.txt is to search crawlers: not a ranking lever but a guidance file. It helps AI engines locate authoritative pages, understand the brand entity, and reduce ambiguity when summarizing or citing the site.
Key points
- ▸Plain-text file served at /llms.txt
- ▸Curates key pages and brand facts for AI
- ▸Guidance for AI crawlers, analogous to robots.txt
Frequently asked questions
- Is llms.txt an official standard?
- llms.txt is a community proposal rather than a ratified standard, but it is increasingly adopted because it is low-cost to publish and gives AI systems a clean, authoritative summary of a site.