llms.txt generator

Build a plain-text guide to your site for AI tools in a minute. Start from your home page or type it in, then copy the file or download it.

1. Start from your site (optional)

We read your home page's title, description and links to fill in the form below, and check whether you already have an llms.txt.

This sends only the domain to our checker, which fetches your home page, /robots.txt and /llms.txt once. Everything else on this page stays in your browser. Up to 5 lookups a minute.

2. Describe your site

3. Your llms.txt

Format check

    Check an llms.txt you already have

      Want the full picture?

      This free check reads three public files once. The Site Signal Audit goes further: analytics and ad tags, cookie consent and Consent Mode, structured data, SEO basics and AI-crawler access, across as many pages as you choose, as a ranked fix list.

      Run the full audit on Apify

      Pay per page audited on Apify; the price is on the Actor page. Building an agent? The same checks are pay-per-call endpoints, no account or API key: GET https://x402.agentharbor.agency/ai-crawlers?domain= ($0.01) and GET https://x402.agentharbor.agency/audit?domain= ($0.05), paid in USDC over x402. How paying per call works.

      Questions

      What is llms.txt?

      A Markdown file at /llms.txt, proposed at llmstxt.org in 2024, that describes your site for AI tools: a title, a one-line summary, then sections of links to the pages that matter, each with a short note.

      Do AI assistants actually use llms.txt?

      Support is limited. Some AI tools and coding assistants read it, but no major AI provider has committed to using it for search or answers. It takes a few minutes and costs nothing to publish, so it is a low-risk extra, not a ranking factor.

      Where do I put the file?

      At your site root, so it loads at https://yourdomain/llms.txt, served as plain text. If that address shows your normal web page or a 404 page, the file is not in place yet; the AI crawler checker will tell you.

      What should go in it?

      The pages someone needs to understand and use your business: about, services or products, prices, hours and location, contact, and any guides or docs. Put secondary pages such as policies under an ## Optional section.

      Is llms.txt the same as robots.txt?

      No. robots.txt tells crawlers what they may fetch; llms.txt is only a guide and does not allow or block anything. Use the AI crawler checker to see what your robots.txt allows.

      Is what I type sent anywhere?

      No. The form and the format check run in your browser. Only the optional “Fill in from my site” step sends the domain to our checker, which fetches your home page, robots.txt and llms.txt once.

      More free tools: robots.txt tester and rule builder and AI crawler checker. No sign-up, no tracking scripts.