penberg

penberg/noodle

An on-device, GPU-accelerated language model in Rust.

3 good first / help-wanted issues · Rust · last activity Jul 4, 2026

25 stars 1 forks 25 watchers Rust MIT License

gpu language-model rust

3 Open Issues Need Help Last updated: Jul 4, 2026

Open Issues Need Help

View All on GitHub

Mamba SSM architecture support 4 months ago

enhancement help wanted

25

An on-device, GPU-accelerated language model in Rust.

Rust

#gpu#language-model#rust

KV cache for faster inference 9 months ago

enhancement help wanted

25

An on-device, GPU-accelerated language model in Rust.

Rust

#gpu#language-model#rust

Finetuning support 9 months ago

enhancement help wanted

25

An on-device, GPU-accelerated language model in Rust.

Rust

#gpu#language-model#rust