Asynchronous web crawler with NextJS and PostgreSQL persistence. Captures and stores links based on configurable keywords.

1 stars 0 forks 1 watchers TypeScript MIT License
1 Open Issue Need Help Last updated: Sep 14, 2025

Open Issues Need Help

View All on GitHub
Create cache maneger about 3 hours ago

AI Summary: This issue proposes implementing a cache manager using Redis and the Cache-Aside strategy to optimize read performance. The system will first check Redis for data, fetching from PostgreSQL and caching the result on a miss, and will invalidate cache entries upon data updates or deletions to ensure data consistency.

Complexity: 3/5
good first issue

Asynchronous web crawler with NextJS and PostgreSQL persistence. Captures and stores links based on configurable keywords.

TypeScript