GITHUB PROJECTS / RECORDED SOURCE METADATA

Projects worth exploring

Discover projects by topic and publisher. Inspect the source, license and activity before using their code or skills.

Clear

deeflect/awesome-geo

awesome-geo

0 catalogued skills

Curated GEO platforms, repositories, and verification scripts for AI-era discoverability.

17TypeScriptCC0-1.0

henu-wang/ai-robots-txt-generator

ai-robots-txt-generator

0 catalogued skills

🤖 Generate optimized robots.txt files for AI search engine crawlers (GPTBot, PerplexityBot, ClaudeBot, and more)

3PythonLicense unavailable

vasco-branco06/geo-check

geo-check

0 catalogued skills

Check whether a website is reachable and readable by AI crawlers, and score it. Two scores, never averaged. Blocking model training costs no points.

3PythonMIT

henu-wang/ai-crawlers-reference

ai-crawlers-reference

0 catalogued skills

Complete database of AI search engine crawler user-agents (GPTBot, PerplexityBot, ClaudeBot) with robots.txt configuration examples

1HTMLLicense unavailable

picked-so/crawler-detect

crawler-detect

0 catalogued skills

Detect AI crawlers (GPTBot, ChatGPT-User, ClaudeBot, PerplexityBot, Google-Agent) and send their visits to Picked.

1TypeScriptMIT

snapdevio/aeo-geo-audit

aeo-geo-audit

0 catalogued skills

Agent skill that audits and fixes any website so AI answer engines — ChatGPT, Perplexity, Google AI Overviews, Claude, Copilot — can crawl, extract, and cite it. Any CMS, framework, or hosted builder; no repo required. Runs in 20+ AI coding tools.

1ShellMIT

aicw-io/aicw-visibility

aicw-visibility

0 catalogued skills

Free, open-source CLI and MCP server that checks whether AI crawlers (GPTBot, ClaudeBot, PerplexityBot, CCBot) and search engines can access your website: robots.txt, llms.txt, sitemap, JSON-LD, meta tags, JavaScript rendering and Common Crawl presence. Runs locally.

0TypeScriptMIT

anas660/claude-seo-desk

claude-seo-desk

0 catalogued skills

Is your site ready for AI search? Open-source SEO, AEO & GEO audits: AI crawler access, llms.txt, answer-ready pages, AI visibility, and an AI analyst's to-do list. CLI, GitHub Action, Claude Code plugin, MCP server.

0PythonMIT

cited-io/ai-search-crawlers-robots-txt

ai-search-crawlers-robots-txt

0 catalogued skills

robots.txt for AI crawlers: copy-paste templates that allow AI search bots (OAI-SearchBot, Claude-SearchBot, PerplexityBot) and let you block AI training (GPTBot, ClaudeBot, Google-Extended), a verified AI crawler list, an llms.txt template and access tests. For generative engine optimization (GEO) and AI SEO.

0TypeScriptMIT

cliniccred/ai-crawlability-medical-websites

ai-crawlability-medical-websites

0 catalogued skills

A practical reference for making medical practice websites visible to AI answer engines including ChatGPT, Perplexity, Google AI Overviews, and Bing Copilot.

0MIT

geeks-accelerator/agent-and-search-readiness

agent-and-search-readiness

0 catalogued skills

Score any site's readiness for AI agents and search: llms.txt, robots.txt AI crawler rules, structured data, link previews, OpenAPI, MCP, skills and A2A. An evidence-based standard and a read-only CLI.

0JavaScriptMIT

grubbomatic/crawl-readiness-mcp

crawl-readiness-mcp

0 catalogued skills

MCP server that checks a website's AI readiness: can GPTBot, ClaudeBot, PerplexityBot and 50+ other AI crawlers access it? Generates llms.txt, AI-crawler robots.txt and JSON-LD, and reads LLM Monitor trends. For Claude Desktop, Cursor, Cline and Windsurf.

0JavaScriptMIT

hemangjoshi37a/hjlabs.in-aitools

hjlabs.in-aitools

0 catalogued skills

llms.txt generator, AI crawler robots.txt builder (GPTBot/ClaudeBot/CCBot), GPT/Claude token counter - Live at https://aitools.hjlabs.in

0JavaScriptLicense unavailable

intikhab49/whofetched

whofetched

0 catalogued skills

Prove which AI fetched your page: secret canary links, a Cloudflare Worker log and published-IP checks. Tested on ChatGPT, Claude, Gemini, Grok, Perplexity and Copilot (Oct 2026).

0JavaScriptApache-2.0

krisdiallo/ecom-agent

ecom-agent

0 catalogued skills

Does blocking GPTBot remove you from ChatGPT? No — OAI-SearchBot is the token that does. Free robots.txt AI-crawler checker (CLI + MCP server) and open data on 165 AI crawlers: which cost you AI answers in ChatGPT, Perplexity and Claude when blocked, and which cost nothing. Includes a 70-store survey.

0PythonMIT

seellm/cloudflare-worker

cloudflare-worker

0 catalogued skills

Open-source Cloudflare Worker for SeeLLM AI visibility monitoring.

0TypeScriptMIT