Asynchronous web crawler with NextJS and PostgreSQL persistence. Captures and stores links based on configurable keywords.

1 stars 0 forks 1 watchers TypeScript MIT License
2 Open Issues Need Help Last updated: Sep 14, 2025

Open Issues Need Help

View All on GitHub

AI Summary: This GitHub issue describes the task of creating a comprehensive test suite for the V1 release of the Web Scop API. It includes implementing unit tests for key services and controllers, an integration test against a real database for the repository, and a full end-to-end test for the `/search` feature covering its CRUD operations. The goal is to ensure code quality and stability, requiring the configuration of a separate test environment.

Complexity: 4/5
good first issue

Asynchronous web crawler with NextJS and PostgreSQL persistence. Captures and stores links based on configurable keywords.

TypeScript
Create cache maneger about 2 months ago

AI Summary: This issue proposes implementing a cache manager using Redis and the Cache-Aside strategy to optimize read performance. The system will first check Redis for data, fetching from PostgreSQL and caching the result on a miss, and will invalidate cache entries upon data updates or deletions to ensure data consistency.

Complexity: 3/5
good first issue

Asynchronous web crawler with NextJS and PostgreSQL persistence. Captures and stores links based on configurable keywords.

TypeScript