torch-spyre

torch-spyre/sendnn-inference

Community maintained hardware plugin for vLLM on Spyre

52 stars 56 forks 52 watchers Python Apache License 2.0
View on GitHub Website
2 Open Issues Need Help Last updated: Jul 7, 2026

Open Issues Need Help

View All on GitHub
Investigate chunked prefill scheduler optimizations about 2 months ago
good first issue help wanted stale
torch-spyre/sendnn-inference
52

Community maintained hardware plugin for vLLM on Spyre

Python
Wrap the ParallelLMHead for torch-spyre 4 months ago
good first issue vllm-spyre-next
torch-spyre/sendnn-inference
52

Community maintained hardware plugin for vLLM on Spyre

Python