penberg

penberg/noodle

An on-device, GPU-accelerated language model in Rust.

25 stars 1 forks 25 watchers Rust MIT License

gpu language-model rust

3 Open Issues Need Help Last updated: Jul 4, 2026

Open Issues Need Help

View All on GitHub

Mamba SSM architecture support 3 days ago

enhancement help wanted

25

An on-device, GPU-accelerated language model in Rust.

Rust

#gpu#language-model#rust

KV cache for faster inference 5 months ago

enhancement help wanted

25

An on-device, GPU-accelerated language model in Rust.

Rust

#gpu#language-model#rust

Finetuning support 5 months ago

enhancement help wanted

25

An on-device, GPU-accelerated language model in Rust.

Rust

#gpu#language-model#rust