Can AI assistants read your site?
Checks whether robots.txt lets in ChatGPT, Claude, Perplexity, Gemini and others, and drafts an llms.txt for you to publish.
What it checks
- GPTBot, ChatGPT search and browsing
- ClaudeBot, PerplexityBot, Google-Extended
- Common Crawl and ByteDance
- Whether llms.txt exists, and a draft to publish
Questions
- Why would an AI crawler be blocked?
- Often by accident: a "block everything" rule in robots.txt, or a security plugin. A blocked crawler cannot recommend you in AI answers.
- What is llms.txt?
- A short Markdown guide to your site at /llms.txt that AI assistants can read: what you do and your most useful pages.