Open Issues Need Help
View All on GitHub [Perf] Onboard omni encoder stages to the upstream multimodal encoder CUDA Graph framework about 10 hours ago
enhancement help wanted
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
help wanted good first issue
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[RFC]: Qwen-Image 2.1 performance optimization — low-latency, high-throughput, and memory-efficient serving about 20 hours ago
enhancement help wanted diffusion RFC
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[Bug] Qwen3-Omni on B300: first ~2 s of every spoken reply is noisy about 20 hours ago
bug help wanted
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[Bug]: MiniCPM-o 4.5 early stop without answers during 2nd round in 1q1a_math of Omniinteract about 21 hours ago
bug help wanted high priority
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[RFC]: trtllm diffusion attention — roadmap 2 days ago
help wanted RFC
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[RFC]: vLLM-Omni NPU 2026 Q2 Roadmap 2 days ago
help wanted good first issue NPU high priority Hardware Plugin
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[RFC]: Helios performance optimization — ultra-low-latency and high-throughput serving tracks 3 days ago
enhancement help wanted high priority diffusion RFC
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
help wanted good first issue RFC
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[New Model]: Audio8/Audio8-TTS-Preview-0.1b (FalconH1 hybrid slow AR + DualAR fast branch) 4 days ago
help wanted new model tts
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
enhancement help wanted high priority diffusion RFC
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
bug help wanted
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
bug help wanted low priority
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[Bug]: Omni KV cache sizing still uses legacy accounting instead of upstream non_kv_cache_memory 8 days ago
bug help wanted low priority
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
enhancement help wanted high priority diffusion RFC
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
help wanted good first issue high priority
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
enhancement help wanted high priority
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
help wanted good first issue
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
help wanted
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
help wanted diffusion RFC Kernel optimization
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
help wanted good first issue
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
enhancement help wanted high priority
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
help wanted new model
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
good first issue tts
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
help wanted good first issue diffusion
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
bug help wanted medium priority
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[RFC]: vLLM-Omni XPU 2026 Q2 Roadmap 21 days ago
help wanted Hardware Plugin roadmap
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[Bug]: Shared-GPU stage initialization stalls for 300s on v0.28.0 due to spawn-lock/device-flock inversion 22 days ago
bug help wanted medium priority
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
bug help wanted ci-failure medium priority
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[RFC]: Finish the config refactor 23 days ago
help wanted medium priority RFC
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
help wanted high priority
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[RFC]: Continuous Quantization Support 24 days ago
help wanted good first issue high priority
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
help wanted RFC
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
enhancement help wanted diffusion CI/CD RFC
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
bug help wanted medium priority
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
help wanted good first issue tts RFC
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[RFC]: staged MiniMax-H3 SVDQuant support 30 days ago
help wanted RFC
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
help wanted omni
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[Roadmap] MAGI-2 Preview performance: DiT-MoE kernels, parallelism, quantization, and CI about 1 month ago
help wanted diffusion roadmap Kernel optimization
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
bug help wanted high priority ci-failure
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[Bug]: CUBLAS_STATUS_INVALID_VALUE when serving BAGEL-7B-MoT with --quantization fp8 in Docker about 1 month ago
bug help wanted high priority
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[RFC]: Shared Realtime Web UI for Omni Models (MiniCPM Shell, Honest Qwen3 Profile) about 1 month ago
help wanted RFC
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[Roadmap] MiniMax-H3 follow-up: accuracy/performance CI, quantization, and optimizations about 1 month ago
help wanted ROCm NPU Hardware Plugin diffusion xpu quantization CI/CD Kernel optimization
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[Bug]: Nightly / CI failed - MiniCPM-o 4.5 image-to-text-audio async_chunk content mismatch about 1 month ago
bug help wanted high priority ci-failure
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[New Model]: Re-enable support for [fun-audio-chat] with asynchronous audio chunk streaming about 1 month ago
help wanted good first issue new model
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
Align and expand LTX support about 1 month ago
help wanted
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[New Model]: Kimi-Audio-7B about 1 month ago
help wanted good first issue new model
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
documentation help wanted good first issue diffusion tts CI/CD refactor
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[Bug]: NPU: stopping torch profiler mid-RECORD causes Segfault and crashes Stage-0 EngineCore about 1 month ago
bug help wanted NPU low priority
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[New Model] F5-TTS (flow-matching DiT-based TTS) about 1 month ago
help wanted
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[RFC] Streaming Video Input for Omni-Modal Real-Time Interaction about 1 month ago
help wanted RFC
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[RFC]: Duplex Request Metrics about 1 month ago
help wanted RFC
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[RFC]: Slim L1 CPU coverage for diffusion comm primitives (test_comm.py) about 1 month ago
help wanted RFC
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[RFC]: Cut L3 H100 entrypoint cold starts (Qwen realtime, BAGEL llm_engine) and stop 60s 5% VRAM waits about 1 month ago
help wanted RFC
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[RFC]: Align vLLM-Omni error handling with vLLM about 1 month ago
help wanted RFC
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[New Model]: Add microsoft/Mage-VL with end-to-end full-duplex multimodal streaming inference about 1 month ago
help wanted new model
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[Bug][A100][H100]: minicpm 4.5, tests/e2e/online_serving/test_minicpmo_4_5_duplex_expansion.py:90: AssertionError True is Flase about 2 months ago
bug help wanted high priority ci-failure
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[RFC]: Support Scalable Frontend: Implementing --api-server-count for Multimodal Throughput about 2 months ago
help wanted
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
bug help wanted NPU low priority
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[Bug]: Nightly / CI failed - Nemotron VoiceChat native duplex times out waiting for model output about 2 months ago
bug help wanted high priority ci-failure
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[Bug]: Nightly CI, openbmb/VoxCPM2, performance metrics regressed by more than 10% compared to the baseline in some scenarios about 2 months ago
bug help wanted ci-failure low priority
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[RFC]: Dynamic Task-DiT Residency for Unified MiniMax-H3 Serving about 2 months ago
help wanted RFC
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[Bug]: Nightly / CI failed - Qwen3-Omni ModelOpt NVFP4 stage 1 EngineCore initialization failed about 2 months ago
bug help wanted high priority ci-failure
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[Bug]: Nightly CI, Qwen/Qwen3-Omni-30B-A3B-Instruct, performance metrics regressed by more than 10% compared to the baseline in some scenarios about 2 months ago
bug help wanted ci-failure medium priority
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
bug help wanted NPU medium priority
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[Bug]: MiniMax-H3 modulation Triton kernels crash on Ascend NPU due to coreDim exceeding 65535 limit about 2 months ago
bug help wanted NPU medium priority
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[Bug]: Nightly CI, MiniMaxAI/MiniMax-H3, performance metrics regressed by more than 10% compared to the baseline in some scenarios about 2 months ago
bug help wanted medium priority
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[New Model]: [Meta] Tuna series about 2 months ago
help wanted good first issue new model
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[RFC]: Model-declared readiness warmup for diffusion pipelines about 2 months ago
help wanted high priority RFC
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[RFC]: Omni-DuplexEval Benchmark Support in vLLM-Omni about 2 months ago
help wanted RFC
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[Bug]: Qwen3-Omni /v1/realtime response never finishes about 2 months ago
bug help wanted medium priority
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[Bug]: weekly CI, Diffusion · H100 · Multi-GPU over-reserves four H100s for mixed 2/4-GPU tests about 2 months ago
bug help wanted diffusion low priority CI/CD
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[Bug][ROCm]: AMD ready / merge CI, CPU-only Simple tests reserve MI300 GPUs about 2 months ago
help wanted ROCm CI/CD RFC
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[New Model]: Audio8/Audio8-TTS-Preview-0.6b about 2 months ago
help wanted good first issue new model tts
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[Bug]: PR nightly-test label reruns the full nightly pipeline on every push about 2 months ago
bug help wanted low priority CI/CD
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
help wanted NPU CI/CD RFC benchmark/profiler/metrics/logger
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[Bug][NPU]: Nightly MiniCPM-o 4.5 accuracy job occupies 2 A3 NPUs for 109 minutes about 2 months ago
help wanted NPU CI/CD RFC
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[Bug][NPU]: Nightly Wan2.2 I2V perf job occupies 4 A3 NPUs for 99 minutes about 2 months ago
help wanted NPU diffusion CI/CD RFC benchmark/profiler/metrics/logger
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[Bug]: weekly CI, TTS · L4 serializes all model files and times out at 90 minutes about 2 months ago
bug help wanted ci-failure tts CI/CD
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[Bug]: Nightly / CI failed - Krea-2 README example - 403 GatedRepoError for krea/Krea-2-Raw about 2 months ago
bug help wanted ci-failure diffusion CI/CD
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[Bug]: CUDA ready / merge CI, CPU-only Simple tests reserve L4 GPUs on every build about 2 months ago
bug help wanted CI/CD
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[RFC]: FP8 Quantization for Key and Value Tensors in Diffusion Model Attention Layers about 2 months ago
help wanted RFC
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[RFC]: NVFP4 Quantization Support for Diffusion Models about 2 months ago
help wanted RFC
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
enhancement help wanted
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
help wanted RFC
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[RFC]: Decouple vllm-omni GGUF quantization from upstream vllm#39583 about 2 months ago
help wanted good first issue
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
help wanted good first issue
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[RFC] Full-Duplex Session Architecture for vLLM-OMNI about 2 months ago
help wanted high priority
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
bug help wanted ci-failure diffusion CI/CD
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[Bug]: Qwen3-Omni seed-TTS — model speaks the task description / answers the prompt instead of reading it; ~2x worse on the vLLM 0.27 rebase about 2 months ago
bug help wanted high priority ci-failure
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[New Model]: SenseNova-U1.5-8B-MoT about 2 months ago
help wanted new model
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[RFC] Improve diffusion worker/engine control-plane reliability and output contracts about 2 months ago
help wanted high priority
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[RFC]: Production VAE optimization for diffusion pipelines with MiniMax-H3 about 2 months ago
help wanted RFC
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[RFC]: [Cosmos3 optimization] Feature Support, Quantilization, Hardware Recipes, and Scenario Optimization about 2 months ago
help wanted good first issue high priority Hardware Plugin diffusion critical
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
enhancement help wanted diffusion
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[RFC] Native MAGI-2 Preview architecture and distributed deployment about 2 months ago
help wanted new model
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
[New Model]: SenseNova-Vision-7B-MoT about 2 months ago
help wanted new model
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
bug help wanted low priority
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
bug help wanted high priority
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation
bug help wanted medium priority
vllm-project/vllm-omni vllm-project/vllm-omni A framework for efficient model inference with omni-modality models
Open project →
3.2K
A framework for efficient model inference with omni-modality models
Python
#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation