dipeshbabu

dipeshbabu/pari

Similarity indexing and deduplication for large datasets, with Rust, Python, and CLI interfaces.

2 good first / help-wanted issues · Rust · last activity Sep 8, 2026

data-quality datasets deduplication locality-sensitive-hashing lsh minhash python rust similarity-search training-data
2 Open Issues Need Help Last updated: Sep 8, 2026

Open Issues Need Help

View All on GitHub
help wanted priority: p1 area: architecture status: blocked
dipeshbabu/pari
8

Similarity indexing and deduplication for large datasets, with Rust, Python, and CLI interfaces.

Rust
#data-quality#datasets#deduplication#locality-sensitive-hashing#lsh#minhash#python#rust#similarity-search#training-data
help wanted priority: p1 area: benchmarks area: scale status: blocked
dipeshbabu/pari
8

Similarity indexing and deduplication for large datasets, with Rust, Python, and CLI interfaces.

Rust
#data-quality#datasets#deduplication#locality-sensitive-hashing#lsh#minhash#python#rust#similarity-search#training-data