vllm-project

vllm-project/speculators

A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM

42 stars 8 forks 42 watchers Python Apache License 2.0

View on GitHub Website

2 Open Issues Need Help Last updated: Sep 12, 2025

Open Issues Need Help

View All on GitHub

Feature Request: Enable Initial Base Support for MLP Speculators about 2 months ago

enhancement good first issue

vllm-project/speculators

42

A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM

Python

Feature Request: Enable Initial Base Support for Independent Speculators about 2 months ago

enhancement good first issue

vllm-project/speculators

42

A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM

Python