PyScrappy good first issues (Python)

--render-js is silently ignored for .html output in pyscrappy extract about 1 month ago

bug good first issue

94

Python web scraping toolkit and MCP server that gives AI agents clean, structured web data from any URL or built-in scrapers.

Python

#ai#ai-agents#ecommerce-scrapper#food-scrapper#image-scrapper#mcp#mcp-server#news-scrapper#pyscrappy#python#social-media-scrapper#song-scrapper#stock-scrapper#web-scrapping#wikipedia-scrapper

Numbered pagination never advances from a page-1 URL that has no page parameter about 1 month ago

bug good first issue

mldsveda/PyScrappy

94

Python web scraping toolkit and MCP server that gives AI agents clean, structured web data from any URL or built-in scrapers.

Python

#ai#ai-agents#ecommerce-scrapper#food-scrapper#image-scrapper#mcp#mcp-server#news-scrapper#pyscrappy#python#social-media-scrapper#song-scrapper#stock-scrapper#web-scrapping#wikipedia-scrapper

Noise-removal regex over-matches, silently deleting real article content about 1 month ago

bug good first issue

mldsveda/PyScrappy

94

Python web scraping toolkit and MCP server that gives AI agents clean, structured web data from any URL or built-in scrapers.

Python

#ai#ai-agents#ecommerce-scrapper#food-scrapper#image-scrapper#mcp#mcp-server#news-scrapper#pyscrappy#python#social-media-scrapper#song-scrapper#stock-scrapper#web-scrapping#wikipedia-scrapper

On-disk cache (cache_dir) grows unbounded — no size cap or eviction about 2 months ago

bug good first issue

mldsveda/PyScrappy

94

Python web scraping toolkit and MCP server that gives AI agents clean, structured web data from any URL or built-in scrapers.

Python

#ai#ai-agents#ecommerce-scrapper#food-scrapper#image-scrapper#mcp#mcp-server#news-scrapper#pyscrappy#python#social-media-scrapper#song-scrapper#stock-scrapper#web-scrapping#wikipedia-scrapper

::attr() returns a Python list repr for multi-valued attributes (class, rel, …) about 2 months ago

bug good first issue

mldsveda/PyScrappy

94

Python web scraping toolkit and MCP server that gives AI agents clean, structured web data from any URL or built-in scrapers.

Python

#ai#ai-agents#ecommerce-scrapper#food-scrapper#image-scrapper#mcp#mcp-server#news-scrapper#pyscrappy#python#social-media-scrapper#song-scrapper#stock-scrapper#web-scrapping#wikipedia-scrapper

to_markdown() drops surplus cells from ragged tables (defeats TableExtractor's guarantee) about 2 months ago

bug good first issue

mldsveda/PyScrappy

94

Python web scraping toolkit and MCP server that gives AI agents clean, structured web data from any URL or built-in scrapers.

Python

#ai#ai-agents#ecommerce-scrapper#food-scrapper#image-scrapper#mcp#mcp-server#news-scrapper#pyscrappy#python#social-media-scrapper#song-scrapper#stock-scrapper#web-scrapping#wikipedia-scrapper

AsyncHttpClient rate limit has a check-then-act race for concurrent requests on one client about 2 months ago

bug good first issue

mldsveda/PyScrappy

94

Python web scraping toolkit and MCP server that gives AI agents clean, structured web data from any URL or built-in scrapers.

Python

#ai#ai-agents#ecommerce-scrapper#food-scrapper#image-scrapper#mcp#mcp-server#news-scrapper#pyscrappy#python#social-media-scrapper#song-scrapper#stock-scrapper#web-scrapping#wikipedia-scrapper

Add to_parquet() and to_excel() exporters on ScrapeResult 2 months ago

enhancement good first issue

mldsveda/PyScrappy

94

Python web scraping toolkit and MCP server that gives AI agents clean, structured web data from any URL or built-in scrapers.

Python

#ai#ai-agents#ecommerce-scrapper#food-scrapper#image-scrapper#mcp#mcp-server#news-scrapper#pyscrappy#python#social-media-scrapper#song-scrapper#stock-scrapper#web-scrapping#wikipedia-scrapper

Add jitter to retry backoff to avoid synchronized retries 2 months ago

enhancement good first issue

mldsveda/PyScrappy

94

Python web scraping toolkit and MCP server that gives AI agents clean, structured web data from any URL or built-in scrapers.

Python

#ai#ai-agents#ecommerce-scrapper#food-scrapper#image-scrapper#mcp#mcp-server#news-scrapper#pyscrappy#python#social-media-scrapper#song-scrapper#stock-scrapper#web-scrapping#wikipedia-scrapper

save() fails when the target directory does not exist 2 months ago

bug good first issue

mldsveda/PyScrappy

94

Python web scraping toolkit and MCP server that gives AI agents clean, structured web data from any URL or built-in scrapers.

Python

#ai#ai-agents#ecommerce-scrapper#food-scrapper#image-scrapper#mcp#mcp-server#news-scrapper#pyscrappy#python#social-media-scrapper#song-scrapper#stock-scrapper#web-scrapping#wikipedia-scrapper

ScrapeResult: add NDJSON (and YAML) exporters + extension-aware save() 2 months ago

enhancement good first issue

mldsveda/PyScrappy

94

Python web scraping toolkit and MCP server that gives AI agents clean, structured web data from any URL or built-in scrapers.

Python

#ai#ai-agents#ecommerce-scrapper#food-scrapper#image-scrapper#mcp#mcp-server#news-scrapper#pyscrappy#python#social-media-scrapper#song-scrapper#stock-scrapper#web-scrapping#wikipedia-scrapper

Selector child selectors drop url/adaptive_store, breaking per-site adaptive namespacing 2 months ago

bug good first issue

mldsveda/PyScrappy

94

Python web scraping toolkit and MCP server that gives AI agents clean, structured web data from any URL or built-in scrapers.

Python

#ai#ai-agents#ecommerce-scrapper#food-scrapper#image-scrapper#mcp#mcp-server#news-scrapper#pyscrappy#python#social-media-scrapper#song-scrapper#stock-scrapper#web-scrapping#wikipedia-scrapper

Retry-After: crashes on an HTTP-date value, and 503 ignores the header (sync + async) 2 months ago

bug good first issue

mldsveda/PyScrappy

94

Python web scraping toolkit and MCP server that gives AI agents clean, structured web data from any URL or built-in scrapers.

Python

#ai#ai-agents#ecommerce-scrapper#food-scrapper#image-scrapper#mcp#mcp-server#news-scrapper#pyscrappy#python#social-media-scrapper#song-scrapper#stock-scrapper#web-scrapping#wikipedia-scrapper

AdaptiveStore.save() writes the JSON store non-atomically, risking corruption on a crash or concurrent write 3 months ago

enhancement good first issue

mldsveda/PyScrappy

94

Python web scraping toolkit and MCP server that gives AI agents clean, structured web data from any URL or built-in scrapers.

Python

#ai#ai-agents#ecommerce-scrapper#food-scrapper#image-scrapper#mcp#mcp-server#news-scrapper#pyscrappy#python#social-media-scrapper#song-scrapper#stock-scrapper#web-scrapping#wikipedia-scrapper

MetadataExtractor keeps empty "" entries in keywords from trailing/double commas 3 months ago

bug good first issue

mldsveda/PyScrappy

94

Python web scraping toolkit and MCP server that gives AI agents clean, structured web data from any URL or built-in scrapers.

Python

#ai#ai-agents#ecommerce-scrapper#food-scrapper#image-scrapper#mcp#mcp-server#news-scrapper#pyscrappy#python#social-media-scrapper#song-scrapper#stock-scrapper#web-scrapping#wikipedia-scrapper

Selector.xpath() crashes on a scalar XPath like count(...) or boolean(...) 3 months ago

bug good first issue

mldsveda/PyScrappy

94

Python web scraping toolkit and MCP server that gives AI agents clean, structured web data from any URL or built-in scrapers.

Python

#ai#ai-agents#ecommerce-scrapper#food-scrapper#image-scrapper#mcp#mcp-server#news-scrapper#pyscrappy#python#social-media-scrapper#song-scrapper#stock-scrapper#web-scrapping#wikipedia-scrapper

IMDBScraper title search makes N+1 OMDb calls with no way to opt out 3 months ago

enhancement good first issue

mldsveda/PyScrappy

94

Python web scraping toolkit and MCP server that gives AI agents clean, structured web data from any URL or built-in scrapers.

Python

#ai#ai-agents#ecommerce-scrapper#food-scrapper#image-scrapper#mcp#mcp-server#news-scrapper#pyscrappy#python#social-media-scrapper#song-scrapper#stock-scrapper#web-scrapping#wikipedia-scrapper

Selector: ::attr(name) on an element missing that attribute returns "" and ignores .get(default) 3 months ago

bug good first issue

mldsveda/PyScrappy

94

Python web scraping toolkit and MCP server that gives AI agents clean, structured web data from any URL or built-in scrapers.

Python

#ai#ai-agents#ecommerce-scrapper#food-scrapper#image-scrapper#mcp#mcp-server#news-scrapper#pyscrappy#python#social-media-scrapper#song-scrapper#stock-scrapper#web-scrapping#wikipedia-scrapper

SoundCloudScraper.scrape_async drops render_js/scroll_pages, so async search can never render JS 3 months ago

bug good first issue

mldsveda/PyScrappy

94

Python web scraping toolkit and MCP server that gives AI agents clean, structured web data from any URL or built-in scrapers.

Python

#ai#ai-agents#ecommerce-scrapper#food-scrapper#image-scrapper#mcp#mcp-server#news-scrapper#pyscrappy#python#social-media-scrapper#song-scrapper#stock-scrapper#web-scrapping#wikipedia-scrapper

scrape_stock MCP tool documents quote/profile fields the scraper never returns 3 months ago

bug documentation good first issue

mldsveda/PyScrappy

94

Python web scraping toolkit and MCP server that gives AI agents clean, structured web data from any URL or built-in scrapers.

Python

#ai#ai-agents#ecommerce-scrapper#food-scrapper#image-scrapper#mcp#mcp-server#news-scrapper#pyscrappy#python#social-media-scrapper#song-scrapper#stock-scrapper#web-scrapping#wikipedia-scrapper

YouTubeScraper.scrape_async drops render_js/scroll_pages, so async channel scraping can never render JS 3 months ago

bug good first issue

mldsveda/PyScrappy

94

Python web scraping toolkit and MCP server that gives AI agents clean, structured web data from any URL or built-in scrapers.

Python

#ai#ai-agents#ecommerce-scrapper#food-scrapper#image-scrapper#mcp#mcp-server#news-scrapper#pyscrappy#python#social-media-scrapper#song-scrapper#stock-scrapper#web-scrapping#wikipedia-scrapper

to_markdown() produces broken tables when a cell contains a pipe or newline 3 months ago

bug good first issue

mldsveda/PyScrappy

94

Python web scraping toolkit and MCP server that gives AI agents clean, structured web data from any URL or built-in scrapers.

Python

#ai#ai-agents#ecommerce-scrapper#food-scrapper#image-scrapper#mcp#mcp-server#news-scrapper#pyscrappy#python#social-media-scrapper#song-scrapper#stock-scrapper#web-scrapping#wikipedia-scrapper

HTTP cache key can collide when a param value contains & or =, returning a wrong cached response 3 months ago

bug good first issue

mldsveda/PyScrappy

94

Python web scraping toolkit and MCP server that gives AI agents clean, structured web data from any URL or built-in scrapers.

Python

#ai#ai-agents#ecommerce-scrapper#food-scrapper#image-scrapper#mcp#mcp-server#news-scrapper#pyscrappy#python#social-media-scrapper#song-scrapper#stock-scrapper#web-scrapping#wikipedia-scrapper

search_images doc lists keys (image_url/thumbnail_url/source_url) the scraper doesn't emit 3 months ago

bug good first issue

mldsveda/PyScrappy

94

Python web scraping toolkit and MCP server that gives AI agents clean, structured web data from any URL or built-in scrapers.

Python

#ai#ai-agents#ecommerce-scrapper#food-scrapper#image-scrapper#mcp#mcp-server#news-scrapper#pyscrappy#python#social-media-scrapper#song-scrapper#stock-scrapper#web-scrapping#wikipedia-scrapper

TableExtractor silently drops rows whose cell count differs from the header 3 months ago

enhancement good first issue

mldsveda/PyScrappy

94

Python web scraping toolkit and MCP server that gives AI agents clean, structured web data from any URL or built-in scrapers.

Python

#ai#ai-agents#ecommerce-scrapper#food-scrapper#image-scrapper#mcp#mcp-server#news-scrapper#pyscrappy#python#social-media-scrapper#song-scrapper#stock-scrapper#web-scrapping#wikipedia-scrapper

search_hackernews doc says 'comments' but the scraper emits 'num_comments' 3 months ago

bug good first issue

mldsveda/PyScrappy

94

Python web scraping toolkit and MCP server that gives AI agents clean, structured web data from any URL or built-in scrapers.

Python

#ai#ai-agents#ecommerce-scrapper#food-scrapper#image-scrapper#mcp#mcp-server#news-scrapper#pyscrappy#python#social-media-scrapper#song-scrapper#stock-scrapper#web-scrapping#wikipedia-scrapper

convert_currency docstring states wrong defaults for base and to 3 months ago

bug good first issue

mldsveda/PyScrappy

94

Python web scraping toolkit and MCP server that gives AI agents clean, structured web data from any URL or built-in scrapers.

Python

#ai#ai-agents#ecommerce-scrapper#food-scrapper#image-scrapper#mcp#mcp-server#news-scrapper#pyscrappy#python#social-media-scrapper#song-scrapper#stock-scrapper#web-scrapping#wikipedia-scrapper

get_weather docstring promises a 'wind' key but the scraper emits 'wind_speed' 3 months ago

bug good first issue

mldsveda/PyScrappy

94

Python web scraping toolkit and MCP server that gives AI agents clean, structured web data from any URL or built-in scrapers.

Python

#ai#ai-agents#ecommerce-scrapper#food-scrapper#image-scrapper#mcp#mcp-server#news-scrapper#pyscrappy#python#social-media-scrapper#song-scrapper#stock-scrapper#web-scrapping#wikipedia-scrapper

Validate the image-search engine (unknown engine silently runs Bing) 3 months ago

enhancement good first issue

mldsveda/PyScrappy

94

Python web scraping toolkit and MCP server that gives AI agents clean, structured web data from any URL or built-in scrapers.

Python

#ai#ai-agents#ecommerce-scrapper#food-scrapper#image-scrapper#mcp#mcp-server#news-scrapper#pyscrappy#python#social-media-scrapper#song-scrapper#stock-scrapper#web-scrapping#wikipedia-scrapper

search_hackernews MCP tool drops the tags filter the scraper supports 3 months ago

enhancement good first issue

mldsveda/PyScrappy

94

Python web scraping toolkit and MCP server that gives AI agents clean, structured web data from any URL or built-in scrapers.

Python

#ai#ai-agents#ecommerce-scrapper#food-scrapper#image-scrapper#mcp#mcp-server#news-scrapper#pyscrappy#python#social-media-scrapper#song-scrapper#stock-scrapper#web-scrapping#wikipedia-scrapper

scrape_stock MCP tool drops the interval param (history locked to daily) 3 months ago

enhancement good first issue

mldsveda/PyScrappy

94

Python web scraping toolkit and MCP server that gives AI agents clean, structured web data from any URL or built-in scrapers.

Python

#ai#ai-agents#ecommerce-scrapper#food-scrapper#image-scrapper#mcp#mcp-server#news-scrapper#pyscrappy#python#social-media-scrapper#song-scrapper#stock-scrapper#web-scrapping#wikipedia-scrapper

GitHubScraper default max_results (30) disagrees with its MCP tool (20) 3 months ago

bug good first issue

mldsveda/PyScrappy

94

Python web scraping toolkit and MCP server that gives AI agents clean, structured web data from any URL or built-in scrapers.

Python

#ai#ai-agents#ecommerce-scrapper#food-scrapper#image-scrapper#mcp#mcp-server#news-scrapper#pyscrappy#python#social-media-scrapper#song-scrapper#stock-scrapper#web-scrapping#wikipedia-scrapper

Proxy is picked once at client build, never rotated per-request or on failure 3 months ago

enhancement help wanted

mldsveda/PyScrappy

94

Python web scraping toolkit and MCP server that gives AI agents clean, structured web data from any URL or built-in scrapers.

Python

#ai#ai-agents#ecommerce-scrapper#food-scrapper#image-scrapper#mcp#mcp-server#news-scrapper#pyscrappy#python#social-media-scrapper#song-scrapper#stock-scrapper#web-scrapping#wikipedia-scrapper

ImageExtractor returns non-string width/height/alt, breaking its dict[str, str] type 3 months ago

good first issue

mldsveda/PyScrappy

94

Python web scraping toolkit and MCP server that gives AI agents clean, structured web data from any URL or built-in scrapers.

Python

#ai#ai-agents#ecommerce-scrapper#food-scrapper#image-scrapper#mcp#mcp-server#news-scrapper#pyscrappy#python#social-media-scrapper#song-scrapper#stock-scrapper#web-scrapping#wikipedia-scrapper

Add to_csv() and save(path) to ScrapeResult 3 months ago

enhancement good first issue

mldsveda/PyScrappy

94

Python web scraping toolkit and MCP server that gives AI agents clean, structured web data from any URL or built-in scrapers.

Python

#ai#ai-agents#ecommerce-scrapper#food-scrapper#image-scrapper#mcp#mcp-server#news-scrapper#pyscrappy#python#social-media-scrapper#song-scrapper#stock-scrapper#web-scrapping#wikipedia-scrapper

Opt-in robots.txt / politeness support (obey_robots + Crawl-delay) 3 months ago

enhancement help wanted good first issue

mldsveda/PyScrappy

94

Python web scraping toolkit and MCP server that gives AI agents clean, structured web data from any URL or built-in scrapers.

Python

#ai#ai-agents#ecommerce-scrapper#food-scrapper#image-scrapper#mcp#mcp-server#news-scrapper#pyscrappy#python#social-media-scrapper#song-scrapper#stock-scrapper#web-scrapping#wikipedia-scrapper

Add async concurrency helpers (scrape_many_async / scrape_all_async) 3 months ago

enhancement help wanted

mldsveda/PyScrappy

94

Python web scraping toolkit and MCP server that gives AI agents clean, structured web data from any URL or built-in scrapers.

Python

#ai#ai-agents#ecommerce-scrapper#food-scrapper#image-scrapper#mcp#mcp-server#news-scrapper#pyscrappy#python#social-media-scrapper#song-scrapper#stock-scrapper#web-scrapping#wikipedia-scrapper

Add a native async scraping API (asyncio) 3 months ago

enhancement help wanted

mldsveda/PyScrappy

94

Python web scraping toolkit and MCP server that gives AI agents clean, structured web data from any URL or built-in scrapers.

Python

#ai#ai-agents#ecommerce-scrapper#food-scrapper#image-scrapper#mcp#mcp-server#news-scrapper#pyscrappy#python#social-media-scrapper#song-scrapper#stock-scrapper#web-scrapping#wikipedia-scrapper

Make the MCP server's cache TTL configurable (env var) 3 months ago

enhancement good first issue

mldsveda/PyScrappy

94

Python web scraping toolkit and MCP server that gives AI agents clean, structured web data from any URL or built-in scrapers.

Python

#ai#ai-agents#ecommerce-scrapper#food-scrapper#image-scrapper#mcp#mcp-server#news-scrapper#pyscrappy#python#social-media-scrapper#song-scrapper#stock-scrapper#web-scrapping#wikipedia-scrapper

Run the opt-in integration tests on a schedule (nightly/weekly) 3 months ago

enhancement help wanted

mldsveda/PyScrappy

94

Python web scraping toolkit and MCP server that gives AI agents clean, structured web data from any URL or built-in scrapers.

Python

#ai#ai-agents#ecommerce-scrapper#food-scrapper#image-scrapper#mcp#mcp-server#news-scrapper#pyscrappy#python#social-media-scrapper#song-scrapper#stock-scrapper#web-scrapping#wikipedia-scrapper

Add a --json output option to the pyscrappy CLI agent 3 months ago

enhancement good first issue

mldsveda/PyScrappy

94

Python web scraping toolkit and MCP server that gives AI agents clean, structured web data from any URL or built-in scrapers.

Python

#ai#ai-agents#ecommerce-scrapper#food-scrapper#image-scrapper#mcp#mcp-server#news-scrapper#pyscrappy#python#social-media-scrapper#song-scrapper#stock-scrapper#web-scrapping#wikipedia-scrapper

Document the fastmcp requirement and pyscrappy[mcp] extra in the README 3 months ago

documentation good first issue

mldsveda/PyScrappy

94

Python web scraping toolkit and MCP server that gives AI agents clean, structured web data from any URL or built-in scrapers.

Python

#ai#ai-agents#ecommerce-scrapper#food-scrapper#image-scrapper#mcp#mcp-server#news-scrapper#pyscrappy#python#social-media-scrapper#song-scrapper#stock-scrapper#web-scrapping#wikipedia-scrapper

mldsveda/PyScrappy

Open Issues Need Help