See which AI crawlers your robots.txt allows or blocks (GPTBot, ClaudeBot, PerplexityBot, and 14 more), and generate a policy you actually chose.

0 stars 0 forks 0 watchers JavaScript MIT License
ai-crawlers browser-tool claudebot cli content-rights gptbot llms-txt robots-txt seo web-crawlers
1 Open Issue Need Help Last updated: Jul 6, 2026

Open Issues Need Help

View All on GitHub
documentation good first issue

See which AI crawlers your robots.txt allows or blocks (GPTBot, ClaudeBot, PerplexityBot, and 14 more), and generate a policy you actually chose.

JavaScript
#ai-crawlers#browser-tool#claudebot#cli#content-rights#gptbot#llms-txt#robots-txt#seo#web-crawlers