GITHUB PROJECTS / RECORDED SOURCE METADATA

ai-crawlers-reference

Complete database of AI search engine crawler user-agents (GPTBot, PerplexityBot, ClaudeBot) with robots.txt configuration examples

henu-wang/ai-crawlers-reference 1 repository starsactiveHTML

Source evidence

Publisher
henu-wang
Repository license
Not provided
Last upstream push / UTC
2026-03-09 08:28:14
Observed / UTC
2026-10-26 14:31:45
Forks
1

اكتشف المهارات

Repository file discovery is pending or in progress.

Repository metadata and stars describe the whole project. They do not certify quality, compatibility or safety.