AsdithyaKrishna2131

AsdithyaKrishna2131/webshart

Fast and memory-efficient webdataset shard reader - Rust core with Python bindings, streaming metadata, and a bucketed dataloader.

1 good first / help-wanted issue · Rust · last activity Sep 10, 2026

8 stars 1 forks 8 watchers Rust MIT License
bindings cli dataloader machine-learning python pytorch rust shard streaming webdataset
View on GitHub
1 Open Issue Need Help Last updated: Sep 10, 2026

Open Issues Need Help

View All on GitHub
Hugging Face Hub upload path 9 days ago
enhancement help wanted
AsdithyaKrishna2131/webshart
8

Fast and memory-efficient webdataset shard reader - Rust core with Python bindings, streaming metadata, and a bucketed dataloader.

Rust
#bindings#cli#dataloader#machine-learning#python#pytorch#rust#shard#streaming#webdataset