Generate clean, AI-ready llms.txt files for your website or docs. Supports crawling, sitemaps, static builds, and framework-aware adapters (Next.js, Vite, Nuxt, Astro, Remix). Includes Markdown/MDX docs mode and robots.txt generator for LLM and search crawlers.
Official documentation, crawler user agents, specifications, research, and tools for Answer Engine Optimization (AEO) and Generative Engine Optimization (GEO).
AI Citation Toolkit — 14 MCP tools to audit, score, and rewrite web pages for AI-citation eligibility (AEO/GEO/LLM visibility). Read-only, no API keys, works in any MCP client.
Make your Node.js app visible and citable by AI crawlers (GPTBot, ClaudeBot, PerplexityBot). Auto-generate robots.txt, llms.txt & JSON-LD schema for AI SEO/AEO/GEO, plus bot-detection middleware and crawler analytics.
Free, open-source CLI and MCP server that checks whether AI crawlers (GPTBot, ClaudeBot, PerplexityBot, CCBot) and search engines can access your website: robots.txt, llms.txt, sitemap, JSON-LD, meta tags, JavaScript rendering and Common Crawl presence. Runs locally.
Is your site ready for AI search? Open-source SEO, AEO & GEO audits: AI crawler access, llms.txt, answer-ready pages, AI visibility, and an AI analyst's to-do list. CLI, GitHub Action, Claude Code plugin, MCP server.
robots.txt for AI crawlers: copy-paste templates that allow AI search bots (OAI-SearchBot, Claude-SearchBot, PerplexityBot) and let you block AI training (GPTBot, ClaudeBot, Google-Extended), a verified AI crawler list, an llms.txt template and access tests. For generative engine optimization (GEO) and AI SEO.
A practical reference for making medical practice websites visible to AI answer engines including ChatGPT, Perplexity, Google AI Overviews, and Bing Copilot.
Free, open-source AI visibility and SEO audit. Crawl your whole site with 643 checks for technical SEO, AEO/GEO, 40 AI crawlers and agentic-web readiness (llms.txt, MCP, A2A), then track whether ChatGPT, Claude, Gemini and Perplexity name you. Fixes for your stack. CLI, dashboard and MCP server; runs locally.
Score any site's readiness for AI agents and search: llms.txt, robots.txt AI crawler rules, structured data, link previews, OpenAPI, MCP, skills and A2A. An evidence-based standard and a read-only CLI.
MCP server that checks a website's AI readiness: can GPTBot, ClaudeBot, PerplexityBot and 50+ other AI crawlers access it? Generates llms.txt, AI-crawler robots.txt and JSON-LD, and reads LLM Monitor trends. For Claude Desktop, Cursor, Cline and Windsurf.
Prove which AI fetched your page: secret canary links, a Cloudflare Worker log and published-IP checks. Tested on ChatGPT, Claude, Gemini, Grok, Perplexity and Copilot (Oct 2026).
Does blocking GPTBot remove you from ChatGPT? No — OAI-SearchBot is the token that does. Free robots.txt AI-crawler checker (CLI + MCP server) and open data on 165 AI crawlers: which cost you AI answers in ChatGPT, Perplexity and Claude when blocked, and which cost nothing. Includes a 70-store survey.
Agent skills and open methodology for auditing whether AI answer engines can crawl and cite your site. GEO/AEO, AI search visibility, robots.txt for AI crawlers. English + Chinese.