llms.txt: what it does and doesn't do

A cheap file worth adding — and a poor reason to hire anyone.

Published · Updated · 3 min read · Alex Gao & BeautyGEO Research Desk

Short answer
  • llms.txt is a plain-text summary of a site intended for AI systems.
  • Google says it is not needed for AI Overviews or AI Mode.
  • A 2026 Ahrefs log study found 97% of llms.txt files received no requests in a month.
  • Coding agents and some assistants do read it when pointed at a site; Anthropic recommends it for agent-readable content.
  • Add one; do not treat it as a GEO strategy.

What it is

A Markdown file at /llms.txt that summarises who you are and links to your most important pages, so an AI system can understand the site without crawling everything.

What the big platforms say

  • Google: its May 2026 guidance on AI features says llms.txt is not needed for AI Overviews or AI Mode.
  • OpenAI: its crawler documentation points site owners to robots.txt, not llms.txt.
  • Anthropic: recommends llms.txt in its guidance on writing for agents.

What the data says

Ahrefs analysed server logs across 137,000 domains and found 97% of llms.txt files got zero requests in May 2026. SE Ranking found that adding llms.txt as a variable did not improve its model of AI citations.

Our approach

We publish one on every site we build — ours is at /llms.txt, with a full-text version at /llms-full.txt — because it costs minutes and helps agents. The work that moves AI answers is elsewhere: facts, pages, evidence and sources.

BG-STD-001 Evidence & Architecture Matrix

How BeautyGEO Structures llms.txt: what it does and doesn't do for AI Retrieval

AI answer engines cite beauty brands and cosmetics supply-chain companies whose product, clinical, manufacturing, and regulatory facts are machine-readable and cross-verified.

Evaluation DimensionTypical Unstructured Beauty WebsiteBeautyGEO Architecture (BG-STD-001)Verifiable Buyer & Retrieval Impact
AI Ecosystem ScopeTraditional keyword pages only; unparsed by LLM RAG retrieval6 Overseas AI (ChatGPT, Perplexity, Gemini & AI Overviews, Claude, Copilot, Grok) + 6 Chinese AI (Doubao, DeepSeek, Yuanbao, Kimi, ERNIE, Qwen) + Shopping & Regional AI (Amazon Rufus, Accio AI, Yandex Alice, Naver Cue:)Addresses the 69% of beauty AI citations otherwise captured by third-party directories (OmniIndex, CC BY 4.0)
Technical & Regulatory EvidenceKey specifications locked inside PDF brochures or image bannersPlain-text HTML INCI concentrations, clinical study summaries, MOQ & lead-time matrices, US FDA MoCRA, EU EC 1223/2009 CPNP, ISO 22716 / GMPC, ISO/IEC 17025, EAEU TR CU 009/2011 & China NMPA records20-signal technical readiness audited prior to publishing
Machine-Readable Entity GraphMissing or conflicting JSON-LD schema; no clean Markdown mirrorSynchronized Organization, Service, FAQPage JSON-LD + /llms.txt corpus & 1:1 .md mirrorsConsistent entity resolution across web search and LLM grounding
Published Commercial TermsOpaque custom retainers with no beauty regulatory fluency$499 (¥2,980) 30-Prompt Paid Audit (100% credited within 60 days) · Brand GEO $1,500–$6,000/mo · Supplier 8-Module Programmes $5,200–$14,800/yrFree 4-AI snapshot in 3 business days; paid 30-prompt audit in 5 business days

Frequently asked questions

How does BeautyGEO structure llms.txt: what it does and doesn't do for AI answer engines?
BeautyGEO translates verifiable product, formulation, manufacturing, and regulatory evidence — plain-text HTML INCI concentrations, clinical study parameters, MOQ/lead-time tables, regulatory filings (US FDA MoCRA, EU EC 1223/2009 CPNP, ISO 22716/GMPC, ISO/IEC 17025, EAEU TR CU 009/2011, China NMPA), Schema.org JSON-LD entity graphs, and Markdown mirrors — so AI engines can retrieve and verify facts without relying on PDFs.
What are the turnaround times and commercial terms for an initial AI visibility audit?
Qualified beauty brands and supply-chain companies can request a complimentary 4-engine AI visibility snapshot (3–5 buyer prompts with unedited screenshots, delivered within 3 business days) or order the 30-prompt Paid AI Visibility Audit ($499 USD / ¥2,980 CNY, delivered within 5 business days, 100% credited toward any monthly or annual retainer signed within 60 days). BeautyGEO does not guarantee specific AI rankings.
Which global, regional, and shopping AI platforms does BeautyGEO cover?
BeautyGEO covers 12 core global and Chinese AI engines — 6 Overseas (ChatGPT, Perplexity, Google Gemini & AI Overviews, Claude, Microsoft Copilot, Grok) and 6 Chinese (Doubao, DeepSeek, Tencent Yuanbao, Kimi, Baidu ERNIE, Alibaba Qwen) — alongside AI commerce & regional sovereign assistants including Amazon Rufus, Alibaba Accio AI, Yandex Alice/GigaChat, Naver Cue:, Yahoo! Japan AI, Mistral Le Chat, and Jais/ALLaM.
Free AI Visibility Snapshot · 3 Business Days

When people ask AI what to buy, be the beauty name it recommends.

Tell us what you sell, make or supply. We test frontier AI engines with real shopper and buyer prompts and send you the raw, unedited answers within 3 business days.

Direct Advisory Desk · WhatsApp, Email & WeChat
1 Business Day Reply
BeautyGEO Advisory Desk WeChat QR Code WeChat QR · Click to Enlarge
WhatsApp / Tel: +86 177 4606 6208

Connect directly with our beauty brand & cosmetics supply-chain GEO specialists via WhatsApp, email, or WeChat — or submit the 2-field form on the right for a complimentary 4-AI visibility snapshot within 3 business days.

  • 4 Frontier AI Platforms Tested3–5 representative buyer prompts tested on ChatGPT, Perplexity, Claude, and Gemini.
  • 100% Unedited Raw CitationsReceive actual unedited AI response text and see which competitors are currently recommended.
  • Commercial Privacy & Data ProtectionClient confidentiality strictly protected. Mutual NDA available upon enterprise request prior to data exchange.
3 Business Days Mutual NDA on Request alex@beautygeo.com
CONFIDENTIAL AUDIT INTAKE · DIRECT ADVISORY DISPATCH

Request Free AI Sourcing Visibility Snapshot

Benchmark your brand, factory or supply business across ChatGPT, Perplexity, Claude & Gemini. Unedited answers within 3 business days.

✅ Verified Client Proof: Our Guangzhou packaging & OEM partner sites already capture direct 5,000–10,000 pcs B2B RFQs from US & Australian beauty founders clicking straight out of ChatGPT (utm_source=chatgpt.com) & Perplexity.
⚡ Prefer Zero-Form Direct Chat? 💬 1-Click WhatsApp (+86 177 4606 6208) ✉️ 1-Click Pre-filled Email
+ Add your name, company, or specific buyer prompts to test (optional — email/WhatsApp & URL above are enough to start)
Prefer direct email? alex@beautygeo.com
3 Business Days 1-day scope lock · 3-day delivery
Mutual NDA on Request Available prior to data exchange
Frontier AI Telemetry ChatGPT · Gemini · Perplexity · Claude
Strict privacy protection. No spam, no sales lists, zero data resale. Read our Privacy Policy.
Email UsFree AI Audit