Part of the sai3 project that delivers multi-protocol storage access for AI/ML workflows. This project provides a CLI, along with Rust and Python libraries for AI/ML storage workflows. Supporting S3, File and Azure Blob using the latest Rust SDKs.

5 stars 0 forks 5 watchers Rust GNU Affero General Public License v3.0
ai-ml ai-storage aws-s3 azure-blob file-io jax python-library pytorch rust rust-crate s3 tensorflow
5 Open Issues Need Help Last updated: Sep 6, 2025

Open Issues Need Help

View All on GitHub
enhancement help wanted

Part of the sai3 project that delivers multi-protocol storage access for AI/ML workflows. This project provides a CLI, along with Rust and Python libraries for AI/ML storage workflows. Supporting S3, File and Azure Blob using the latest Rust SDKs.

Rust
#ai-ml#ai-storage#aws-s3#azure-blob#file-io#jax#python-library#pytorch#rust#rust-crate#s3#tensorflow
enhancement help wanted

Part of the sai3 project that delivers multi-protocol storage access for AI/ML workflows. This project provides a CLI, along with Rust and Python libraries for AI/ML storage workflows. Supporting S3, File and Azure Blob using the latest Rust SDKs.

Rust
#ai-ml#ai-storage#aws-s3#azure-blob#file-io#jax#python-library#pytorch#rust#rust-crate#s3#tensorflow
enhancement help wanted

Part of the sai3 project that delivers multi-protocol storage access for AI/ML workflows. This project provides a CLI, along with Rust and Python libraries for AI/ML storage workflows. Supporting S3, File and Azure Blob using the latest Rust SDKs.

Rust
#ai-ml#ai-storage#aws-s3#azure-blob#file-io#jax#python-library#pytorch#rust#rust-crate#s3#tensorflow

AI Summary: Implement a framework-agnostic AI/ML data loader for the existing S3 Python library. This data loader should randomly access and return batches of objects from an S3 bucket, supporting multiple epochs. The implementation should be compatible with various AI/ML frameworks like PyTorch and TensorFlow.

Complexity: 4/5
enhancement help wanted

Part of the sai3 project that delivers multi-protocol storage access for AI/ML workflows. This project provides a CLI, along with Rust and Python libraries for AI/ML storage workflows. Supporting S3, File and Azure Blob using the latest Rust SDKs.

Rust
#ai-ml#ai-storage#aws-s3#azure-blob#file-io#jax#python-library#pytorch#rust#rust-crate#s3#tensorflow

AI Summary: Optimize the `GET` operation in the s3dlio library to improve its performance. This involves investigating and implementing the recommendations from the discussion thread linked in the issue description, aiming to achieve closer to the maximum GET performance observed in comparative testing.

Complexity: 4/5
enhancement help wanted

Part of the sai3 project that delivers multi-protocol storage access for AI/ML workflows. This project provides a CLI, along with Rust and Python libraries for AI/ML storage workflows. Supporting S3, File and Azure Blob using the latest Rust SDKs.

Rust
#ai-ml#ai-storage#aws-s3#azure-blob#file-io#jax#python-library#pytorch#rust#rust-crate#s3#tensorflow