Open Issues Need Help
View All on GitHub Verify Meta's crawlers via AS32934 24 days ago
help wanted data
daniel63194/crawlerid daniel63194/crawlerid Identify and verify web crawlers and AI agents against official IP ranges and DNS
Open project →
0
Identify and verify web crawlers and AI agents against official IP ranges and DNS
TypeScript
#ai-crawlers#bot-detection#crawler#gptbot#robots-txt#seo#typescript
Verify Web Bot Auth signed requests (RFC 9421) 24 days ago
help wanted
daniel63194/crawlerid daniel63194/crawlerid Identify and verify web crawlers and AI agents against official IP ranges and DNS
Open project →
0
Identify and verify web crawlers and AI agents against official IP ranges and DNS
TypeScript
#ai-crawlers#bot-detection#crawler#gptbot#robots-txt#seo#typescript
Python reader for the registry and IP data 24 days ago
help wanted
daniel63194/crawlerid daniel63194/crawlerid Identify and verify web crawlers and AI agents against official IP ranges and DNS
Open project →
0
Identify and verify web crawlers and AI agents against official IP ranges and DNS
TypeScript
#ai-crawlers#bot-detection#crawler#gptbot#robots-txt#seo#typescript
Hono and Fastify recipes or adapters 24 days ago
good first issue
daniel63194/crawlerid daniel63194/crawlerid Identify and verify web crawlers and AI agents against official IP ranges and DNS
Open project →
0
Identify and verify web crawlers and AI agents against official IP ranges and DNS
TypeScript
#ai-crawlers#bot-detection#crawler#gptbot#robots-txt#seo#typescript
Support JSON access logs in `crawlerid logs` 24 days ago
good first issue
daniel63194/crawlerid daniel63194/crawlerid Identify and verify web crawlers and AI agents against official IP ranges and DNS
Open project →
0
Identify and verify web crawlers and AI agents against official IP ranges and DNS
TypeScript
#ai-crawlers#bot-detection#crawler#gptbot#robots-txt#seo#typescript
Add crawlers: Baidu, Seznam and Naver 24 days ago
good first issue data new crawler
daniel63194/crawlerid daniel63194/crawlerid Identify and verify web crawlers and AI agents against official IP ranges and DNS
Open project →
0
Identify and verify web crawlers and AI agents against official IP ranges and DNS
TypeScript
#ai-crawlers#bot-detection#crawler#gptbot#robots-txt#seo#typescript
Add crawler: Bytespider (ByteDance) 24 days ago
good first issue data new crawler
daniel63194/crawlerid daniel63194/crawlerid Identify and verify web crawlers and AI agents against official IP ranges and DNS
Open project →
0
Identify and verify web crawlers and AI agents against official IP ranges and DNS
TypeScript
#ai-crawlers#bot-detection#crawler#gptbot#robots-txt#seo#typescript
good first issue data
daniel63194/crawlerid daniel63194/crawlerid Identify and verify web crawlers and AI agents against official IP ranges and DNS
Open project →
0
Identify and verify web crawlers and AI agents against official IP ranges and DNS
TypeScript
#ai-crawlers#bot-detection#crawler#gptbot#robots-txt#seo#typescript