standknwn
Concepts

What is llms.txt?

The robots.txt for AI crawlers — a curated summary of your site, written for machines.

TL;DR

llms.txt is a plain-text file at the root of your domain that tells AI crawlers what your site is about and where the most important pages live. It is the fastest way to improve how ChatGPT, Claude, and Perplexity understand your business.

What llms.txt is

A plain Markdown file at /llms.txt that gives AI crawlers a human-curated summary of your site: who you are, what you offer, where your most important pages live, and any disambiguating facts. It was proposed in 2025 and adopted broadly through 2026.

Why it exists

AI crawlers face a problem: your site may have hundreds of pages, some outdated, some promotional, some canonical. llms.txt lets you tell crawlers "here are the pages that matter and here is what they say". It is similar in spirit to robots.txt and sitemap.xml but written for AI consumption rather than classical search bots.

What a good llms.txt contains

A short H1 and tagline. A paragraph explaining who you are and who you serve. Linked lists of your core pages grouped by category (services, locations, pricing, guarantees). Contact info. Nothing promotional — just structured facts.

Which AI engines read it

As of late 2026, Perplexity reads it explicitly. ChatGPT's browsing agent uses it when present. Claude's agents respect it. Google's AI surfaces have not formally adopted it but experimental signals suggest they prefer sites that provide one.

FAQ

Common questions.

Where do I put llms.txt?

At the root of your domain — e.g. standknown.com/llms.txt. Not in a subfolder.

Does llms.txt replace sitemap.xml?

No. sitemap.xml is for classical search crawlers. llms.txt is for AI. Both should exist.

What happens if I do not have one?

AI crawlers fall back to indexing your site like a classical crawler would — slower, less accurate, and more likely to pick up outdated or low-signal pages.

Ready?

Be the business AI
recommends by name.

Free 30-minute AI visibility audit — we score where you appear across six engines and show you the gaps before you decide anything.

90-day traffic guarantee · No long-term contract · You own everything