aosama

aosama/astronomical

Set one RAM ceiling. Run bigger sparse language and vision models on Apple Silicon — experts stream from SSD when they don't fit, without hidden quantization. https://aosama.github.io/astronomical/ Join Discord Server https://discord.gg/dc4E6r4WD

1 good first / help-wanted issue · Rust · last activity Oct 1, 2026

22 stars 4 forks 22 watchers Rust Apache License 2.0
apple-silicon local-llm macos mlx moe rust vision-language-model
View on GitHub Website
1 Open Issue Need Help Last updated: Oct 1, 2026

Open Issues Need Help

View All on GitHub
chore(deps): trim icu/url idn baggage from reqwest transitive dependencies 24 days ago
good first issue dependencies later
aosama/astronomical
22

Set one RAM ceiling. Run bigger sparse language and vision models on Apple Silicon — experts stream from SSD when they don't fit, without hidden quantization. https://aosama.github.io/astronomical/ Join Discord Server https://discord.gg/dc4E6r4WD

Rust
#apple-silicon#local-llm#macos#mlx#moe#rust#vision-language-model