Open Issues Need Help
View All on GitHub Software Development • Web Scraping/Crawling
Optimise until 5 minutes about 1 month ago
AI Summary: Optimize a Python script that scrapes proxy data from a website, stores it in a JSON file, and uploads it to a specified platform. The current script takes approximately 8 minutes to complete; the goal is to reduce the execution time to under 5 minutes. This involves optimizing the scraping, data handling, and API interaction processes, potentially by investigating rate limiting strategies and API request batching.
Complexity:
4/5
enhancement help wanted
The code for the coding task to apply to a job in a [redacted company]
Python