GITHUB PROJECTS / RECORDED SOURCE METADATA

Projects worth exploring

Discover projects by topic and publisher. Inspect the source, license and activity before using their code or skills.

Clear

saqierma/miaowageo

miaowageo

0 catalogued skills

免费开源的 GEO 检测工具 | Free open-source GEO (Generative Engine Optimization) checker — 检测网站能否被 ChatGPT、Claude、Perplexity、Gemini 抓取、理解与引用

12JavaScriptAGPL-3.0

henu-wang/ai-robots-txt-generator

ai-robots-txt-generator

0 catalogued skills

🤖 Generate optimized robots.txt files for AI search engine crawlers (GPTBot, PerplexityBot, ClaudeBot, and more)

3PythonLicense unavailable

vasco-branco06/geo-check

geo-check

0 catalogued skills

Check whether a website is reachable and readable by AI crawlers, and score it. Two scores, never averaged. Blocking model training costs no points.

3PythonMIT

virt92/agentfix-oss-scanner

agentfix-oss-scanner

0 catalogued skills

Free CLI to scan AI-agent readiness (12/33 signals, MIT). Bad score? Get ready-to-install ZIP fix-pack with llms.txt, schema, A2A, MCP for $1/$29/$99 at agentfix.pro.

3JavaScriptMIT

henu-wang/ai-crawlers-reference

ai-crawlers-reference

0 catalogued skills

Complete database of AI search engine crawler user-agents (GPTBot, PerplexityBot, ClaudeBot) with robots.txt configuration examples

1HTMLLicense unavailable

picked-so/crawler-detect

crawler-detect

0 catalogued skills

Detect AI crawlers (GPTBot, ChatGPT-User, ClaudeBot, PerplexityBot, Google-Agent) and send their visits to Picked.

1TypeScriptMIT

aicw-io/aicw-visibility

aicw-visibility

0 catalogued skills

Free, open-source CLI and MCP server that checks whether AI crawlers (GPTBot, ClaudeBot, PerplexityBot, CCBot) and search engines can access your website: robots.txt, llms.txt, sitemap, JSON-LD, meta tags, JavaScript rendering and Common Crawl presence. Runs locally.

0TypeScriptMIT

alternatefutures/ai-crawler-access-reference

ai-crawler-access-reference

0 catalogued skills

Open AI crawler dataset and zero-dependency robots.txt policy generator for OpenAI, Anthropic, Perplexity, and Google.

0JavaScriptMIT

cited-io/ai-search-crawlers-robots-txt

ai-search-crawlers-robots-txt

0 catalogued skills

robots.txt for AI crawlers: copy-paste templates that allow AI search bots (OAI-SearchBot, Claude-SearchBot, PerplexityBot) and let you block AI training (GPTBot, ClaudeBot, Google-Extended), a verified AI crawler list, an llms.txt template and access tests. For generative engine optimization (GEO) and AI SEO.

0TypeScriptMIT

deeplumenclaw/agentic-commerce-toolkit

agentic-commerce-toolkit

0 catalogued skills

Open-source toolkit for Agentic Commerce. Make your Shopify store AI-ready for ChatGPT, Claude, and other AI agents. Built by DeepLumen.

0TypeScriptMIT

grubbomatic/crawl-readiness-mcp

crawl-readiness-mcp

0 catalogued skills

MCP server that checks a website's AI readiness: can GPTBot, ClaudeBot, PerplexityBot and 50+ other AI crawlers access it? Generates llms.txt, AI-crawler robots.txt and JSON-LD, and reads LLM Monitor trends. For Claude Desktop, Cursor, Cline and Windsurf.

0JavaScriptMIT

hemangjoshi37a/hjlabs.in-aitools

hjlabs.in-aitools

0 catalogued skills

llms.txt generator, AI crawler robots.txt builder (GPTBot/ClaudeBot/CCBot), GPT/Claude token counter - Live at https://aitools.hjlabs.in

0JavaScriptLicense unavailable

krisdiallo/ecom-agent

ecom-agent

0 catalogued skills

Does blocking GPTBot remove you from ChatGPT? No — OAI-SearchBot is the token that does. Free robots.txt AI-crawler checker (CLI + MCP server) and open data on 165 AI crawlers: which cost you AI answers in ChatGPT, Perplexity and Claude when blocked, and which cost nothing. Includes a 70-store survey.

0PythonMIT

oguzhanglotier/ai-readiness-check

ai-readiness-check

0 catalogued skills

Tiny zero-dependency CLI: check which AI crawlers (GPTBot, ClaudeBot, PerplexityBot, Google-Extended...) a website's robots.txt allows or blocks, and whether it serves llms.txt. By Glotier.

0JavaScriptMIT