torch-spyre/spyre-inference

remove cpu-roundtrip for `reshape_and_cache` 2 days ago

help wanted vllm-spyre-next vllm-spyre-attention-backend August2026

6

vLLM plugin for Spyre based on torch-spyre

Python

[FP8] Support block-wise FP8 quantization 3 days ago

enhancement help wanted vllm-spyre-next August2026

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

[FP8] Support FP8 KV cache for attention 3 days ago

enhancement help wanted vllm-spyre-next August2026

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

[FP8] Support online FP8 quantization (W8A16 dynamic) 3 days ago

enhancement help wanted vllm-spyre-next August2026

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

[FP8] Add FP8 test infrastructure and reference tests 3 days ago

enhancement help wanted vllm-spyre-next tests August2026

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

[FP8] Add FP8 support to ParallelLMHead 3 days ago

enhancement help wanted vllm-spyre-next August2026

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

[FP8] Implement SpyreFp8LinearMethod for custom linear layers 3 days ago

enhancement help wanted vllm-spyre-next August2026

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

[FP8] Fix Inductor compatibility for FP8 tensors (torch-spyre #1474) 3 days ago

enhancement help wanted vllm-spyre-next August2026

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

[FP8] Add FP8 tensor initialization kernels for spyre device 3 days ago

enhancement help wanted vllm-spyre-next August2026

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

[FP8] Implement scaled_mm operator support in torch-spyre 3 days ago

enhancement help wanted vllm-spyre-next August2026

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

[Feature]: Check compile support for encoder models 3 days ago

enhancement help wanted vllm-spyre-next August2026

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

add indirect access for matmul in online softmax 3 days ago

help wanted vllm-spyre-next vllm-spyre-attention-backend August2026

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

remove CPU round-trip for attention result-reshape 11 days ago

help wanted vllm-spyre-next vllm-spyre-attention-backend

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

Evaluate whether vLLM IR can be used to wrap layers for torch-spyre about 2 months ago

good first issue vllm-spyre-next July2026

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

[Feature]: Configure individual layers on spyre about 2 months ago

enhancement good first issue vllm-spyre-next

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

[Epic] Ensure that the new plugin is robust to upstream changes about 2 months ago

help wanted vllm-spyre-next

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

[Epic] Develop KVCacheConnector for Spyre about 2 months ago

help wanted vllm-spyre-next

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

[Epic] Support prefill/decode disaggregation about 2 months ago

help wanted vllm-spyre-next

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

Verify the 4D matmul in the attention computation 3 months ago

good first issue vllm-spyre-next June2026

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

Write design docs for key features 3 months ago

good first issue May2026

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

Wrap the ParallelLMHead for torch-spyre 3 months ago

good first issue vllm-spyre-next

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

[doc] add a README.md 4 months ago

documentation good first issue

torch-spyre/spyre-inference

6

vLLM plugin for Spyre based on torch-spyre

Python

Open Issues Need Help