Avarok-Cybersecurity

Avarok-Cybersecurity/atlas

Pure Rust Inference Engine

2 good first / help-wanted issues · Rust · last activity Jul 1, 2026

541 stars 79 forks 541 watchers Rust GNU Affero General Public License v3.0
cuda dgx dgx-spark gb10 llm-inference mamba nvfp4 openai-api rust speculative-decoding ssm transformers
View on GitHub Website
2 Open Issues Need Help Last updated: Jul 1, 2026

Open Issues Need Help

View All on GitHub
[feat] Canonical internal chat IR: convert every API surface into one model-agnostic request/response type (unblocks images in tool results) 4 months ago
enhancement good first issue
Avarok-Cybersecurity/atlas
541

Pure Rust Inference Engine

Rust
#cuda#dgx#dgx-spark#gb10#llm-inference#mamba#nvfp4#openai-api#rust#speculative-decoding#ssm#transformers
[feat] Auto-gpu-utilization 4 months ago
enhancement good first issue
Avarok-Cybersecurity/atlas
541

Pure Rust Inference Engine

Rust
#cuda#dgx#dgx-spark#gb10#llm-inference#mamba#nvfp4#openai-api#rust#speculative-decoding#ssm#transformers