llms.txt: Why Your Site Needs It and What to Put Inside

An llms.txt file is a plain text document at the root of your domain that gives AI models a structured summary of your website's most important content. It helps ChatGPT, Perplexity, and other AI tools read your site accurately without parsing JavaScript-heavy pages. This article explains what to put inside, where to place it, and how it changes your visibility in AI-generated answers.

Short version

• llms.txt is a markdown-style text file placed at the root of your domain, like https://example.com/llms.txt.
• It tells AI models which pages matter most and what your site is about, in plain language.
• Keep it under 100 lines with 10 to 30 links to core pages, each with a short description.
• It complements robots.txt and sitemaps; it does not replace them.
• AI search engines and chatbots now read websites directly, and this file gives them a clean path.

What is an llms.txt file and where does it go?

An llms.txt file is a plain text document that provides a structured, machine-readable summary of a website's content for AI models. You place it at the root of your domain, so the full URL looks like https://example.com/llms.txt. The file uses simple markdown-style formatting: a title, a summary block, and a list of links with short descriptions.

The format was proposed in 2024 as a way to help large language models understand websites faster and more accurately. Think of it as an elevator pitch for AI crawlers. Instead of scanning every page and guessing what matters, the model reads your llms.txt and knows immediately what your site covers and which pages carry the most weight.

The file itself is lightweight. It has no code, no scripts, and no tracking pixels. Any text editor can create one, and you can host it on any static file server. The simplicity is the point: AI models parse it in milliseconds.

Why does your website need an llms.txt file in 2025?

Because AI search engines and chatbots now read websites directly, and they often struggle with JavaScript-heavy pages. When a model cannot render your site, it either skips you entirely or guesses based on fragments of text. An llms.txt file removes that guesswork.

The shift is real. People now ask ChatGPT for product recommendations, Perplexity for research summaries, and Google's AI Overviews for quick answers. These tools cite sources, and they prefer pages they can read reliably. If your site is built on React, Angular, or another framework that renders content client-side, an AI crawler may see an empty shell.

Your llms.txt file solves that problem. It gives AI models a clean, text-based path to your key pages. This can boost your visibility in AI-generated answers and recommendations, especially for commercial queries where the model must choose which sources to trust.

The file also helps with accuracy. When an AI model reads your entire site, it can mix up services, prices, or contact details. A well-structured llms.txt file tells the model exactly what you offer and which pages confirm it. Fewer hallucinations, better citations, more traffic from AI referrals.

What should you put inside the llms.txt file?

Start with a one-sentence summary of your site, then add a list of links to your most important pages, each with a short description. Keep it under 100 lines for the best results, and leave out boilerplate pages like privacy policies or login screens.

# Example Company

> Example Company provides accounting software for small businesses in the UK.

- [Pricing](https://example.com/pricing): Plans for freelancers, startups, and growing teams
- [Features](https://example.com/features): Invoicing, expense tracking, and VAT reports
- [Integrations](https://example.com/integrations): Works with Stripe, PayPal, and Shopify
- [Help Center](https://example.com/help): Setup guides and troubleshooting articles

The summary line matters most. It should be a single sentence that states who you are and what you do. Avoid marketing language. Write it the way you would explain your business to a colleague, not the way you would write an ad.

Each link should have a description of no more than 10 to 15 words. The description tells the AI model what it will find on that page. If the page answers a specific question, say so. For example, "Setup guide for connecting your bank account" is better than "Documentation".

Leave out pages that do not help a user make a decision: privacy policies, terms of service, login screens, and thank-you pages. These add noise and dilute the signal.

Which pages deserve a spot in the file?

Your homepage always goes first. After that, prioritize pages that answer commercial questions: pricing, features, comparisons, case studies, and product documentation. If you run a blog, include your most authoritative articles, not every post you have ever published.

Here is a quick filter for deciding what belongs in the file:

1. Does this page help someone decide whether to buy, sign up, or contact you?
2. Does this page answer a question people frequently ask AI assistants?
3. Does this page represent a core service or product line?

If you answered yes to at least two of these, the page belongs in the file. If not, leave it out.

How is llms.txt different from robots.txt or a sitemap?

Robots.txt tells crawlers what not to scan, and sitemaps list every URL for search engines. The llms.txt file goes further by telling AI models what your content is about and which links matter most, so they don't have to parse your whole site.

The three files work together. Robots.txt sets the boundaries. The sitemap ensures search engines know every page exists. The llms.txt file tells AI models which of those pages actually matter and why.

A common mistake is treating llms.txt as a replacement for a sitemap. It is not. Search engines still need your sitemap to discover new pages. And you still need robots.txt to block sensitive areas. Add llms.txt alongside them, not instead of them.

Another difference is the format. Sitemaps use XML, which is verbose and rigid. Robots.txt uses plain text but only supports directives like allow and disallow. The llms.txt file uses markdown-style formatting that carries semantic meaning: a title, a summary, and annotated links.

How many links should you include in the llms.txt file?

Aim for 10 to 30 links that cover your core services or articles. Adding too many dilutes the signal, just like stuffing a sitemap with low-value pages can hurt your SEO.

The upper limit matters. An AI model reading your llms.txt file treats it as a curated list. If you include 80 links, the model cannot tell which pages are truly important. The signal becomes noise.

For most small and medium businesses, 15 to 20 links is the sweet spot. You cover your main service pages, your pricing page, your most popular articles, and your contact information. If you run an e-commerce store, include category pages rather than individual product pages. If you run a SaaS company, include feature pages and documentation.

For enterprise sites with hundreds of products or services, consider creating multiple llms.txt files for different sections. The main file points to section hubs, and each hub has its own llms.txt file. This keeps each file under the recommended limit while still covering your full catalog.

The quality of your descriptions matters more than the number of links. Ten links with precise descriptions will outperform thirty links with vague ones. Write each description as if it is the only thing the AI model will read about that page.

How does llms.txt fit into your AI visibility strategy?

An llms.txt file is one part of a broader approach to AI search optimization. You still need clear page titles, descriptive headings, and content that answers real questions. The file does not fix a poorly structured site. It simply makes your best content easier for AI models to find.

You should also monitor what AI assistants actually say about your company. The answers they give shape what potential customers believe about you. If an AI model describes your product incorrectly, no llms.txt file will fix that. You need to audit the answers and adjust both your content and your file. A practical guide for that process is the What AI Answers Say About Your Company: Audit Guide.

The file also works alongside your tracking setup. If you want to measure how much traffic comes from AI referrals, you need reliable conversion tracking. JavaScript-based tracking often misses bot traffic, so many teams use server-side tracking. The article on server-side conversion tracking: how to enable without double-counting explains how to set that up without inflating your numbers.

And when you review performance, pay attention to attribution windows. AI assistants often send traffic days or weeks after the initial query. The piece on the Attribution Window: Why the Same Period Shows Different Numbers shows why your reports may disagree depending on which window you look at.

Common mistakes when creating an llms.txt file

The most frequent error is treating the file like a sitemap and dumping every URL into it. That defeats the purpose. The file is a curated summary, not an index.

Another mistake is writing vague descriptions. A link that says "Products" tells the AI model nothing. A link that says "Cloud storage plans with 2TB to 10TB options" tells it exactly what the page offers. Write for clarity, not for length.

Some site owners forget to update the file. Your site changes, new products launch, old articles get removed. The llms.txt file needs the same maintenance as your sitemap. Set a reminder to review it quarterly.

A subtle issue is the summary line. If you write a paragraph instead of a sentence, some AI models will truncate it. Keep the summary under 200 characters. And if you operate in multiple languages, consider creating separate llms.txt files for each language version of your site.

Finally, do not block the file in robots.txt. Some security scanners flag llms.txt as an information leak, so they add a disallow rule. That blocks the very crawlers you want to attract. The file is public by design, just like your homepage.

Your next step: create the file today

The file takes about fifteen minutes to create, and you can host it as a static file on any server. Write a one-sentence summary of your business, list your top 15 to 20 pages with clear descriptions, and upload the file to your domain root. Then verify it loads by visiting https://yourdomain.com/llms.txt in a browser.

After that, integrate llms.txt into how you measure and improve your AI presence. If you manage marketing for multiple clients or run paid campaigns, you need to know which traffic actually converts. That is where ad operations for agencies come in: structured ad operations that separate AI referral traffic from other channels and show you what works.

FAQ

What is an llms.txt file and where should I put it?

An llms.txt file is a plain text document that gives AI models a quick, structured summary of your website's content. You place it at the root of your domain, like https://example.com/llms.txt. The file uses markdown-style formatting with a title, a one-sentence summary, and a list of annotated links.

Why does my website need an llms.txt file in 2025?

Because AI search engines and chatbots now read websites directly, and they often struggle with JavaScript-heavy pages. This file gives them a clean path to your key pages, which can boost your visibility in AI-generated answers and recommendations.

What should I put inside the llms.txt file?

Start with a one-sentence summary of your site, then add a list of links to your most important pages, each with a short description. Keep it under 100 lines for the best results, and leave out boilerplate pages like privacy policies or login screens.

How is llms.txt different from robots.txt or a sitemap?

Robots.txt tells crawlers what not to scan, and sitemaps list every URL for search engines. The llms.txt file goes further by telling AI models what your content is about and which links matter most, so they don't have to parse your whole site.

How many links should I include in my llms.txt file?

Aim for 10 to 30 links that cover your core services or articles. Adding too many dilutes the signal, just like stuffing a sitemap with low-value pages can hurt your SEO.

Does llms.txt replace my sitemap?

No. Search engines still need your sitemap to discover new pages. The llms.txt file works alongside robots.txt and sitemaps. Use all three: robots.txt sets boundaries, sitemap ensures indexing, and llms.txt helps AI models understand your content.

Can llms.txt hurt my search rankings?

No. Search engines treat it as an additional signal, not a ranking factor. A poorly written file simply does not help. It cannot penalize your site, because it does not affect how search engines crawl or index your pages.

Do I need a separate llms.txt for each language of my site?

If you run a multilingual site, create separate llms.txt files for each language version and place them in the corresponding subdirectory or subdomain. For example, https://example.com/llms.txt for English and https://example.com/fr/llms.txt for French.

How often should I update my llms.txt file?

Review it quarterly or whenever you launch a major new product or service. Remove links to pages that no longer exist, add new core pages, and update descriptions if your offerings change.

Will llms.txt guarantee that AI assistants cite my site?

No. The file improves your chances by making your content easier to read, but AI models decide what to cite based on relevance, authority, and the specific query. The file is one factor among many.

Related reading

If you want to understand how AI assistants currently describe your business, start with the What AI Answers Say About Your Company: Audit Guide. It walks through the exact steps to find and fix inaccurate AI citations.

For measuring the impact of AI traffic, check the Attribution Window: Why the Same Period Shows Different Numbers article. It explains why the same week can show different conversion counts depending on your reporting window.

If you run paid campaigns, read When you have enough data to switch an ad off to learn how to make data-driven decisions about your ad spend.

And for a full breakdown of where your budget actually goes, the piece on Where the budget quietly goes: Audience Network, Search Partners and Pangle shows which ad placements often underperform.

See how this works in ADS Beast: llms.txt.