data-helm

data-helm/crawler

Generic Scrapy-like web crawler for Laravel — auto-detects lists, pagination, fields, and supports API/SPA, infinite scroll, image downloading, dedup, resumable crawls, LLM-ready Markdown output, and pluggable output sinks

7 good first / help-wanted issues · PHP · last activity Aug 11, 2026

7 Open Issues Need Help Last updated: Aug 11, 2026

Open Issues Need Help

View All on GitHub
data-helm/crawler
0

Generic Scrapy-like web crawler for Laravel — auto-detects lists, pagination, fields, and supports API/SPA, infinite scroll, image downloading, dedup, resumable crawls, LLM-ready Markdown output, and pluggable output sinks

PHP
data-helm/crawler
0

Generic Scrapy-like web crawler for Laravel — auto-detects lists, pagination, fields, and supports API/SPA, infinite scroll, image downloading, dedup, resumable crawls, LLM-ready Markdown output, and pluggable output sinks

PHP
data-helm/crawler
0

Generic Scrapy-like web crawler for Laravel — auto-detects lists, pagination, fields, and supports API/SPA, infinite scroll, image downloading, dedup, resumable crawls, LLM-ready Markdown output, and pluggable output sinks

PHP
data-helm/crawler
0

Generic Scrapy-like web crawler for Laravel — auto-detects lists, pagination, fields, and supports API/SPA, infinite scroll, image downloading, dedup, resumable crawls, LLM-ready Markdown output, and pluggable output sinks

PHP
good first issue test-coverage
data-helm/crawler
0

Generic Scrapy-like web crawler for Laravel — auto-detects lists, pagination, fields, and supports API/SPA, infinite scroll, image downloading, dedup, resumable crawls, LLM-ready Markdown output, and pluggable output sinks

PHP
data-helm/crawler
0

Generic Scrapy-like web crawler for Laravel — auto-detects lists, pagination, fields, and supports API/SPA, infinite scroll, image downloading, dedup, resumable crawls, LLM-ready Markdown output, and pluggable output sinks

PHP
documentation good first issue
data-helm/crawler
0

Generic Scrapy-like web crawler for Laravel — auto-detects lists, pagination, fields, and supports API/SPA, infinite scroll, image downloading, dedup, resumable crawls, LLM-ready Markdown output, and pluggable output sinks

PHP