vllm-project/vllm-omni

[RFC]: MOSS-TTS-Local-v1.5 Serving Optimization 18 minutes ago

help wanted tts RFC

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[RFC]: Data Parallelism for Video Generation Models in vLLM-Omni about 1 hour ago

enhancement help wanted high priority RFC

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[RFC]: Unify example model usage — migrate all special-usage examples to standard task examples + declarative model_extras about 5 hours ago

help wanted good first issue high priority critical

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[New Model]: Boogu-Image about 15 hours ago

help wanted new model

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[RFC]: Benchmark Layout Reorganization about 24 hours ago

help wanted high priority diffusion tts

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[RFC]: [Cosmos3 optimization] Feature Support, Quantilization, Hardware Recipes, and Scenario Optimization 1 day ago

help wanted good first issue high priority Hardware Plugin diffusion critical

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[RFC]: vLLM-Omni NPU 2026 Q2 Roadmap 1 day ago

help wanted good first issue NPU high priority Hardware Plugin

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[Feature]: Support for InternVL-U model 2 days ago

help wanted good first issue new model

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[RFC]: Continuous Quantization Support 2 days ago

help wanted good first issue high priority

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[RFC]: Ref-Target KV Cache for Video Diffusion Models 2 days ago

help wanted high priority RFC

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[Good First Issue]: Add vendor-organized community recipes for “run model X on hardware Y for task Z” in vLLM-Omni 2 days ago

help wanted good first issue high priority

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[New Model]: LongCat-AudioDiT (Meituan) — Waveform Latent Space Diffusion TTS 5 days ago

help wanted good first issue new model tts

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[RFC]: Support NVIDIA Alpamayo 1.5 (Reasoning VLA for Autonomous Driving) in vLLM-Omni 6 days ago

help wanted world model

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[RFC]: TTS Development Roadmap - Q2 2026 7 days ago

help wanted good first issue high priority

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[New Model]: dots.tts (rednote-hilab) — continuous-AR 48kHz zero-shot voice cloning 7 days ago

help wanted good first issue new model tts

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[Aligned with vllm 0.24.0 now][RFC]: vLLM-Omni 2026 Q2 Roadmap 7 days ago

help wanted good first issue roadmap

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[RFC]: SenseNova-U1Optimization Roadmap 7 days ago

good first issue

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[New Model]: Baidu NAVA video 9 days ago

help wanted good first issue new model

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[RFC]: General TTS Model Implementation 11 days ago

enhancement help wanted good first issue new model high priority

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[New Model]: Omni-Diffusion 12 days ago

help wanted good first issue new model

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[New Model]: Skywork / SkyReels 12 days ago

help wanted new model

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[New Model]: Index-AniSora (Bilibili) 12 days ago

help wanted good first issue new model

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[New Model]: VibeVoice 12 days ago

help wanted good first issue new model

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[New Model] F5-TTS (flow-matching DiT-based TTS) 13 days ago

help wanted

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[Performance]: Per-request Python preprocess loop dominates decode step time at high concurrency (8.5 ms of a 10.9 ms step at 32 requests) — also a frame-cadence blocker for realtime/duplex 14 days ago

help wanted high priority

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[Feature]: Rename ar_stop_token_ids to a more descriptive name 15 days ago

help wanted good first issue

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[RFC]: Pipeline Parallelism & Stream Batch for Real-Time Video Generation 15 days ago

help wanted good first issue high priority

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[New Model]: HiDream-O1-Image 16 days ago

help wanted good first issue new model

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[New Model]: HiDream-O1-Image 16 days ago

help wanted new model

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[New Model]: OpenMOSS-Team/MOVA-720p 17 days ago

help wanted new model

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[New Model]: DreamX-World 18 days ago

help wanted new model high priority diffusion world model

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

Codebase cleanup audit: dead code, config drift, and packaging robustness 19 days ago

help wanted good first issue

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[RFC/Bug] Improve diffusion worker/engine control-plane reliability and output contracts 20 days ago

bug help wanted high priority

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[New Model] Add TADA (Hume AI) TTS model support 20 days ago

help wanted good first issue new model

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[RFC]: World Model Support 21 days ago

help wanted good first issue new model high priority

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[RFC]: Decouple vllm-omni GGUF quantization from upstream vllm#39583 24 days ago

help wanted good first issue

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[RFC] Full-Duplex Session Architecture for vLLM-OMNI 25 days ago

help wanted high priority

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[RFC]: NVIDIA ModelOpt Quantized Diffusion & Video Model Deployment in vLLM-OMNI 26 days ago

help wanted good first issue

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[New Model]: inclusionAI/Ming-omni-tts-16.8B-A3B 26 days ago

help wanted new model

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[New Model]: Add PersonaPlex (nvidia/personaplex-7b-v1) MVP support 26 days ago

help wanted new model

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[New Model]: jd-opensource/JoyAI-Image-Edit 27 days ago

help wanted new model

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[RFC]: Add JoyAI-Echo (LTX-2.3-derived multi-shot T2V+Audio) 27 days ago

help wanted good first issue new model

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[New Model]: Audio-Omni 28 days ago

help wanted good first issue new model diffusion tts

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[Feature]: Support Container Image Format -> ARM64 29 days ago

help wanted

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[Perf]: Voxcpm2 performance improvement 29 days ago

help wanted good first issue

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[RFC]: Support Model FLOPs Utilization (MFU) Metrics for Diffusion Models (DiTs) 30 days ago

help wanted high priority

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[CI/Test] Add Fish Speech TTS e2e test (no e2e coverage in any pipeline tier) about 1 month ago

good first issue tts

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[New Model]: Support Loading Original (Non-Diffusers) PAI/Wan2.2-VACE-Fun-A14B Checkpoint about 1 month ago

help wanted good first issue new model

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[Feature]: Can support the model wan2.2-fun-a14b-inp use the tool vllm-omni? about 1 month ago

good first issue new model

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[New Model]: Sana-WM about 1 month ago

help wanted new model

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[RFC]: Bagel deployment about 1 month ago

enhancement help wanted good first issue new model

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[RFC]: vLLM-Omni XPU 2026 Q2 Roadmap about 1 month ago

help wanted Hardware Plugin roadmap

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[New Model]: circlestone-labs/Anima about 1 month ago

help wanted new model

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[RFC][calling for help from the community]: Large-Scale Multi-Stage Serving Architecture for vLLM-Omni about 1 month ago

enhancement help wanted high priority roadmap

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[New Model]:Step Audio 2 about 1 month ago

help wanted good first issue new model

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[Feature]: Add word-level timestamps to TTS streaming output via shared forced aligner about 1 month ago

enhancement good first issue tts

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[New Model]: add HunyuanVideo-I2V about 1 month ago

help wanted good first issue new model

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[RFC]: Support Wan-AI/Wan2.2-S2V-14B in vllm-omni about 1 month ago

help wanted good first issue new model

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[help wanted][Feature]: Claude Code skills for model integration, benchmarking, and PR workflow about 1 month ago

enhancement help wanted good first issue

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

Consider using pre-built Flash Attention kernels via `kernels` about 1 month ago

help wanted

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[RFC]: Kernel Optimization for Diffusion DiT and MoE LLM about 1 month ago

help wanted good first issue

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[New Model]: deepseek-janus about 1 month ago

help wanted new model high priority

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[RFC]: Encoder Embedding Data Sharing for Disaggregated Omni-Modality Inference about 2 months ago

help wanted high priority

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[RFC]: Enable NPU CI Tests about 2 months ago

help wanted NPU

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[Bug] OmniVoice online-serving example fails with HTTP 400 from hardcoded voice "default" about 2 months ago

bug good first issue

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[New Model] PrismAudio (Video-to-Audio Generation) about 2 months ago

help wanted good first issue new model

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[New Model]: bitdance about 2 months ago

help wanted good first issue new model

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[New Model] Fun-CineForge (Zero-Shot Movie Dubbing) about 2 months ago

help wanted good first issue new model

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[New Model]: MiniMind-O (0.1B / 0.3B-A0.1B end-to-end Omni with Thinker-Talker + Mimi codec) about 2 months ago

help wanted good first issue

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[RFC]: HunyuanImage Model deployment optimization about 2 months ago

help wanted good first issue new model high priority

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[New Model]: SoulX-Singer — Open-Source Zero-Shot Singing Voice Synthesis (Soul AI Lab) about 2 months ago

help wanted good first issue tts

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[New Model]: stabilityai/stable-audio-3-medium (DiT text-to-audio for music and SFX) about 2 months ago

good first issue new model

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[RFC]: Plugin-based Sparse Attention Interface for DiT Modules about 2 months ago

help wanted good first issue high priority diffusion

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[New Model]: Lance from ByteDance about 2 months ago

help wanted new model

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[RFC]: Continuous Recipe Support for Diffusion Models about 2 months ago

help wanted good first issue diffusion

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[RFC]: vLLM-Omni Diffusion Module — Q2 2026 Roadmap about 2 months ago

enhancement good first issue high priority diffusion

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[RFC]: Qwen3-TTS high-throughput hardening about 2 months ago

help wanted high priority tts

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[RFC]: Diffusion Offline Examples Docs & Test about 2 months ago

documentation enhancement help wanted good first issue

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[New Model]: SongGeneration 2 / LeVo 2 (Tencent AI Lab) — Hybrid LLM-Diffusion Full-Song Generation about 2 months ago

help wanted good first issue tts

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

vLLM-Omni Model Support about 2 months ago

help wanted good first issue new model

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[RFC]: Mooncake and vLLM-Omni Collaboration Roadmap about 2 months ago

help wanted high priority

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[New Model]: Vevo2 — Unified Controllable AR + Flow-Matching for Speech and Singing Voice Generation 2 months ago

help wanted good first issue tts

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[New Model]: SongGen — Single-Stage Auto-Regressive Transformer for Text-to-Song 2 months ago

help wanted good first issue tts

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[RFC]: LingBot-World-Fast — Interactive video world model port 2 months ago

help wanted new model

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[Followup] Deploy YAML field ownership: stage-level defaults, user knobs, and model-owned config 2 months ago

good first issue frontend

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[New Model]: OpenMOSS-Team/MOSS-TTS 2 months ago

help wanted new model

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[New Model]: Step Audio EditX 2 months ago

help wanted good first issue new model

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[New Model]: [Meta] Tuna series 2 months ago

help wanted good first issue new model

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[RFC]: FLUX.2-dev Model Acceleration Support 2 months ago

help wanted good first issue new model

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[New Model]: Omni model openbmb/MiniCPM-o-4_5 2 months ago

help wanted new model

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[Bug]: The field `profiler_config` in deploy yaml can't be passed correctly 2 months ago

bug help wanted high priority

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[Feature]: Support VAE as a Separate Stage to Reduce GPU Memory Pressure in Diffusion Pipelines 2 months ago

enhancement help wanted

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[Performance] Qwen-Image双卡配置下单张图片生成时间未优化 - TP2/DP2/PP2性能问题 2 months ago

help wanted good first issue NPU

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[New Model]: VoxCPM2 2 months ago

help wanted good first issue new model

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[RFC]: diffusion engine clean up 2 months ago

help wanted high priority

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[Bug] CUDNN_ATTN crashes on LTX-2.0 audio attention under torch.compile (symbolic head_dim) 2 months ago

help wanted

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[New Model]: LTX-2.3 2 months ago

help wanted new model

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[RFC]: vLLM-Omni 2026 Q1 Roadmap 2 months ago

documentation help wanted

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[RFC]: [UX][Metrics] Improve vLLM-Omni Metrics UX 3 months ago

help wanted good first issue high priority

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

[RFC] Sentinel-default precedence for stage engine args 3 months ago

help wanted high priority

vllm-project/vllm-omni

3.2K

A framework for efficient model inference with omni-modality models

Python

#audio-generation#diffusion#image-generation#inference#model-serving#multimodal#pytorch#transformer#video-generation

Open Issues Need Help