llms.txt: what it is and whether your business needs one

llms.txt is a proposed file that gives AI tools a plain summary of your website. What it is, who proposed it, what Google says about it, and whether it's worth the 20 minutes.

November 10, 2026 · 3 min read

llms.txt is a plain text file, written in Markdown, that sits at the root of a website (yoursite.com/llms.txt) and gives AI tools a short summary of the site with links to its most important pages.

It was proposed by Jeremy Howard on September 3, 2024, as "a proposal to standardise on using an /llms.txt file to provide information to help agents use a website." The proposal lives at llmstxt.org and is still open for community input.

The short version

  • It's a proposal, not a standard. No major AI company has said it relies on llms.txt to decide what to recommend.
  • Google says you don't need it for AI Overviews or AI Mode: "You don't need to create new machine readable files, AI text files, or markup to appear in these features."
  • It's cheap to add and does no harm. It can help AI agents and coding tools that read it.
  • It won't fix AI visibility on its own. Being on the pages AI reads, and having clear pages of your own, matter far more.

If you're not sure AI can find you at all, check your AI visibility for free before you spend time on llms.txt.

What an llms.txt file looks like

An example llms.txt file for a made-up CRM called Brightlane, with a title, a two-line summary and links to features, pricing, integrations, getting started and FAQ pages
The format from llmstxt.org: a title, a short summary in a quote block, then sections of links.

The structure is simple:

  1. A heading with your name
  2. A short summary in a quote block: what you do, for whom, and a key fact or two
  3. Sections of links to your most important pages, each with a few words on what's there

Some sites also publish an llms-full.txt with the full text of their key pages in one file.

llms.txt vs robots.txt

They do different jobs. As the proposal itself notes, robots.txt and llms.txt "have different purposes."

robots.txt llms.txt
What it does Tells crawlers what they may and may not fetch Gives AI tools a summary and a map of key pages
Status Long-established standard, honored by major AI crawlers Proposal (2024)
Effect on AI search Blocking a search crawler can remove you from answers No confirmed effect
Must you have one? Yes, check it Optional

robots.txt matters far more. If it blocks OAI-SearchBot, PerplexityBot or Claude-SearchBot, you can drop out of those platforms' answers.

Should your business add one?

Yes, if you have a documentation-heavy site, sell to developers, or simply want to cover the bases. It takes about 20 minutes.

Don't prioritize it if you haven't yet checked robots.txt, fixed your key pages, or worked on getting onto the lists and review sites AI reads. Those move the needle; llms.txt, as far as anyone can show today, doesn't.

How to write one in 20 minutes

  1. Write two sentences on what your business does, for whom and where.
  2. List your 5 to 15 most important pages: services, pricing, locations, about, FAQ.
  3. Add a few words on what each page covers.
  4. Save it as llms.txt at the root of your site.
  5. Keep it updated when you add or remove key pages.

What to do instead (or as well)

Free AI visibility report

See what actually moves your AI visibility

Enter your website and get a free AI visibility report. It takes a few minutes, and you'll see:

  • Your AI visibility score, overall and for ChatGPT, Gemini, Claude, Perplexity and Google's AI Overviews and AI Mode
  • Who AI recommends instead of you, and how often
  • Which topics you win and lose, and how often each one is searched
  • What AI gets wrong about you, and what to fix first
  • A downloadable PDF you can share with your team

← All articles