sqliteai/waste

Run the full 2.78-trillion-parameter Kimi K3 model beyond available RAM by streaming activated weights directly from NVMe. A dependency-free, embeddable C inference engine.

501 stars 38 forks 501 watchers C Apache License 2.0

View on GitHub

1 Open Issue Need Help Last updated: Aug 1, 2026

Open Issues Need Help

View All on GitHub

CUDA backend: what would have to be true for it to pay about 9 hours ago

enhancement help wanted

sqliteai/waste

501

Run the full 2.78-trillion-parameter Kimi K3 model beyond available RAM by streaming activated weights directly from NVMe. A dependency-free, embeddable C inference engine.