vllm-project

vllm-project/vllm-gguf-plugin

vLLM Quantization plugin for GGUF

20 stars 17 forks 20 watchers Python Apache License 2.0

3 Open Issues Need Help Last updated: Jul 12, 2026

Open Issues Need Help

View All on GitHub

Feature request: hy_v3 (Tencent Hy3) architecture support - working proof-of-concept adapter available 29 days ago

help wanted good first issue

vllm-project/vllm-gguf-plugin

20

vLLM Quantization plugin for GGUF

Python

GGUF Qwen 3.5/3.6 MoE architecture not supported about 1 month ago

help wanted good first issue

vllm-project/vllm-gguf-plugin

20

vLLM Quantization plugin for GGUF

Python

List of supported GGUF model types about 2 months ago

help wanted good first issue

vllm-project/vllm-gguf-plugin

20

vLLM Quantization plugin for GGUF

Python