Source evidence
- Publisher
- Cited-io
- Repository license
- MIT
- Last upstream push / UTC
- 2026-10-15 15:43:12
- Observed / UTC
- 2026-10-26 14:32:43
- Forks
- 0
GITHUB PROJECTS / RECORDED SOURCE METADATA
ai-search-crawlers-robots-txt
robots.txt for AI crawlers: copy-paste templates that allow AI search bots (OAI-SearchBot, Claude-SearchBot, PerplexityBot) and let you block AI training (GPTBot, ClaudeBot, Google-Extended), a verified AI crawler list, an llms.txt template and access tests. For generative engine optimization (GEO) and AI SEO.
cited-io/ai-search-crawlers-robots-txt 0 repository starsactiveTypeScript
Topics
Discover skills
Repository file discovery is pending or in progress.
Repository metadata and stars describe the whole project. They do not certify quality, compatibility or safety.