Tandemn-Labs

Tandemn-Labs/tandemn-vllm

Basically Heterogenous Inference

120 stars 2 forks 120 watchers Python

View on GitHub Website

4 Open Issues Need Help Last updated: Sep 14, 2025

Open Issues Need Help

View All on GitHub

Need to fill the bubbles - proper ring buffer 3 months ago

enhancement help wanted

Tandemn-Labs/tandemn-vllm

120

Basically Heterogenous Inference

Python

Making sure that mixed topology (2d parallelism?) is supported 3 months ago

enhancement help wanted

Tandemn-Labs/tandemn-vllm

120

Basically Heterogenous Inference

Python

double /deploy unchecking the state of the deployed model 3 months ago

bug good first issue

Tandemn-Labs/tandemn-vllm

120

Basically Heterogenous Inference

Python

In sharding script when I try to Ctrl+C, it does not exit, and the sharding keeps on going. 3 months ago

good first issue

Tandemn-Labs/tandemn-vllm

120

Basically Heterogenous Inference

Python