vllm-project

vllm-project/vllm-gguf-plugin

vLLM Quantization plugin for GGUF

20 stars 17 forks 20 watchers Python Apache License 2.0

2 Open Issues Need Help Last updated: Jul 12, 2026

Open Issues Need Help

View All on GitHub

List of supported GGUF model types about 2 hours ago

help wanted good first issue

vllm-project/vllm-gguf-plugin

20

vLLM Quantization plugin for GGUF

Python

GGUF Qwen 3.5/3.6 MoE architecture not supported about 2 hours ago

help wanted good first issue

vllm-project/vllm-gguf-plugin

20

vLLM Quantization plugin for GGUF

Python