llms.txt: what it is and how to write one
llms.txt is a short Markdown file that gives AI assistants a map of your most important content. Here is the format, an example and how to keep it useful.
A step-by-step playbook to increase the chance that AI assistants mention your brand and link your pages.
When someone asks an assistant “what is the best project management tool for a small agency?”, the answer is assembled from a few sources. Being one of them is the new page-one. Here is a playbook that works across ChatGPT search, Perplexity, Copilot, Gemini and Google AI Overviews.
Assistants turn a prompt into one or more search queries. If your page does not rank for those queries, it is rarely retrieved. Start with the basics: a page that targets the topic, matches the search intent and is technically healthy. In BoostSEO, each keyword cluster shows whether you have a clear pillar page and which supporting articles are missing.
Different companies use different crawlers. Training crawlers (for example GPTBot or ClaudeBot) collect data to train models; search and user bots (for example OAI-SearchBot, ChatGPT-User, Claude-SearchBot, PerplexityBot) fetch pages to answer questions. Blocking training is a business decision; blocking answer bots usually means you will not be cited. Google AI Overviews use the normal Googlebot index — the Google-Extended token controls use for Gemini model training and grounding, not normal search indexing.
AI answers like specifics: prices, dates, definitions, thresholds, survey results. If you have first-party data — benchmarks, customer surveys, test results — publish it with a clear methodology. When you use others' data, cite and link the primary source. Pages that are merely opinions without evidence are easy to skip.
Use the same name, description and logo everywhere. Add Organization schema with sameAs links to your LinkedIn, social profiles, Crunchbase or Wikipedia entry. Earn mentions in reputable publications, directories and comparison articles — assistants often recommend brands that many independent sources agree on.
Show the updated date and actually update: new features, current prices, the current year in titles only when the content truly changed. Stale pages lose trust with both people and machines.
Pick the questions that drive revenue and check them monthly. Note which competitors are cited and study those pages: what do they answer that you don't? Turn the gaps into tasks — BoostSEO's competitor comparison and AI visibility check do this for you.
llms.txt is a short Markdown file that gives AI assistants a map of your most important content. Here is the format, an example and how to keep it useful.
GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot, Google-Extended… what each one does and ready-to-use robots.txt examples.
AI assistants now answer many questions before anyone clicks a link. GEO is how you make sure your content is the one they read, trust and cite.