torch-spyre

torch-spyre/spyre-inference

vLLM plugin for Spyre based on torch-spyre

6 stars 27 forks 6 watchers Python Apache License 2.0
View on GitHub Website
18 Open Issues Need Help Last updated: Jul 1, 2026

Open Issues Need Help

View All on GitHub
Evaluate whether vLLM IR can be used to wrap layers for torch-spyre about 12 hours ago
good first issue vllm-spyre-next July2026
torch-spyre/spyre-inference
6

vLLM plugin for Spyre based on torch-spyre

Python
[Feature]: Configure individual layers on spyre about 16 hours ago
enhancement good first issue vllm-spyre-next
torch-spyre/spyre-inference
6

vLLM plugin for Spyre based on torch-spyre

Python
[Epic] Ensure that the new plugin is robust to upstream changes about 16 hours ago
help wanted vllm-spyre-next
torch-spyre/spyre-inference
6

vLLM plugin for Spyre based on torch-spyre

Python
[Epic] Develop KVCacheConnector for Spyre 14 days ago
help wanted vllm-spyre-next
torch-spyre/spyre-inference
6

vLLM plugin for Spyre based on torch-spyre

Python
[Epic] Support prefill/decode disaggregation 14 days ago
help wanted vllm-spyre-next
torch-spyre/spyre-inference
6

vLLM plugin for Spyre based on torch-spyre

Python
[FP8] Add FP8 tensor initialization kernels for spyre device 19 days ago
enhancement help wanted vllm-spyre-next
torch-spyre/spyre-inference
6

vLLM plugin for Spyre based on torch-spyre

Python
[FP8] Support block-wise FP8 quantization 22 days ago
enhancement help wanted vllm-spyre-next
torch-spyre/spyre-inference
6

vLLM plugin for Spyre based on torch-spyre

Python
[FP8] Support FP8 KV cache for attention 22 days ago
enhancement help wanted vllm-spyre-next
torch-spyre/spyre-inference
6

vLLM plugin for Spyre based on torch-spyre

Python
[FP8] Support online FP8 quantization (W8A16 dynamic) 22 days ago
enhancement help wanted vllm-spyre-next
torch-spyre/spyre-inference
6

vLLM plugin for Spyre based on torch-spyre

Python
[FP8] Add FP8 test infrastructure and reference tests 22 days ago
enhancement help wanted vllm-spyre-next tests
torch-spyre/spyre-inference
6

vLLM plugin for Spyre based on torch-spyre

Python
[FP8] Add FP8 support to ParallelLMHead 22 days ago
enhancement help wanted vllm-spyre-next
torch-spyre/spyre-inference
6

vLLM plugin for Spyre based on torch-spyre

Python
[FP8] Implement SpyreFp8LinearMethod for custom linear layers 22 days ago
enhancement help wanted vllm-spyre-next
torch-spyre/spyre-inference
6

vLLM plugin for Spyre based on torch-spyre

Python
[FP8] Fix Inductor compatibility for FP8 tensors (torch-spyre #1474) 22 days ago
enhancement help wanted vllm-spyre-next
torch-spyre/spyre-inference
6

vLLM plugin for Spyre based on torch-spyre

Python
[FP8] Implement scaled_mm operator support in torch-spyre 22 days ago
enhancement help wanted vllm-spyre-next
torch-spyre/spyre-inference
6

vLLM plugin for Spyre based on torch-spyre

Python
Verify the 4D matmul in the attention computation about 1 month ago
good first issue vllm-spyre-next June2026
torch-spyre/spyre-inference
6

vLLM plugin for Spyre based on torch-spyre

Python
Write design docs for key features about 2 months ago
good first issue May2026
torch-spyre/spyre-inference
6

vLLM plugin for Spyre based on torch-spyre

Python
Wrap the ParallelLMHead for torch-spyre about 2 months ago
good first issue vllm-spyre-next
torch-spyre/spyre-inference
6

vLLM plugin for Spyre based on torch-spyre

Python
[doc] add a README.md 2 months ago
documentation good first issue
torch-spyre/spyre-inference
6

vLLM plugin for Spyre based on torch-spyre

Python