Open Issues Need Help
View All on GitHub Add DeepSeek-V3 to the model catalog about 2 hours ago
good first issue catalog
Distributed inference infrastructure for Mixture-of-Experts models. Run large MoE models on consumer GPUs.
Rust
#ai#consumer-hardware#distributed-systems#expert-sharding#inference#infrastructure#llm#moe#rust
Add unit tests for the Model Catalog module about 2 hours ago
good first issue
Distributed inference infrastructure for Mixture-of-Experts models. Run large MoE models on consumer GPUs.
Rust
#ai#consumer-hardware#distributed-systems#expert-sharding#inference#infrastructure#llm#moe#rust
Add a Dockerfile for one-command setup about 2 hours ago
good first issue
Distributed inference infrastructure for Mixture-of-Experts models. Run large MoE models on consumer GPUs.
Rust
#ai#consumer-hardware#distributed-systems#expert-sharding#inference#infrastructure#llm#moe#rust
Improve scheduler error messages about 2 hours ago
good first issue
Distributed inference infrastructure for Mixture-of-Experts models. Run large MoE models on consumer GPUs.
Rust
#ai#consumer-hardware#distributed-systems#expert-sharding#inference#infrastructure#llm#moe#rust
Add property tests for Job status transitions about 2 hours ago
good first issue
Distributed inference infrastructure for Mixture-of-Experts models. Run large MoE models on consumer GPUs.
Rust
#ai#consumer-hardware#distributed-systems#expert-sharding#inference#infrastructure#llm#moe#rust
Fix clippy warnings in native_moe module about 2 hours ago
good first issue
Distributed inference infrastructure for Mixture-of-Experts models. Run large MoE models on consumer GPUs.
Rust
#ai#consumer-hardware#distributed-systems#expert-sharding#inference#infrastructure#llm#moe#rust