ovg-project/kvcached - 9 Help Wanted Issues

Open Issues Need Help

good first issue

1.1K

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

Python

#elastic-kvcache#gpu-mutiplexing#gpu-sharing#inference-engine#kvcache#kvcache-optimization#kvcached#llm#llm-framework#llm-inference#llm-serving#ollama#online-offline-coserve#serverless#sglang#vllm

kvcached support matrix 5 days ago

help wanted

ovg-project/kvcached

1.1K

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

Python

#elastic-kvcache#gpu-mutiplexing#gpu-sharing#inference-engine#kvcache#kvcache-optimization#kvcached#llm#llm-framework#llm-inference#llm-serving#ollama#online-offline-coserve#serverless#sglang#vllm

Prefix caching makes gemma-4 generations diverge from vanilla vLLM (output stays coherent, not garbled) 8 days ago

bug help wanted

ovg-project/kvcached

1.1K

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

Python

#elastic-kvcache#gpu-mutiplexing#gpu-sharing#inference-engine#kvcache#kvcache-optimization#kvcached#llm#llm-framework#llm-inference#llm-serving#ollama#online-offline-coserve#serverless#sglang#vllm

Roadmap/Feature requested/TODOs---Start Here for New Contributors 20 days ago

help wanted

ovg-project/kvcached

1.1K

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

Python

#elastic-kvcache#gpu-mutiplexing#gpu-sharing#inference-engine#kvcache#kvcache-optimization#kvcached#llm#llm-framework#llm-inference#llm-serving#ollama#online-offline-coserve#serverless#sglang#vllm

CI runs no tests — add a GitHub Actions job for the CPU-only pytest suite 29 days ago

enhancement help wanted

ovg-project/kvcached

1.1K

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

Python

#elastic-kvcache#gpu-mutiplexing#gpu-sharing#inference-engine#kvcache#kvcache-optimization#kvcached#llm#llm-framework#llm-inference#llm-serving#ollama#online-offline-coserve#serverless#sglang#vllm

Error on gpt-oss with vLLM 9 months ago

good first issue

ovg-project/kvcached

1.1K

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

Python

#elastic-kvcache#gpu-mutiplexing#gpu-sharing#inference-engine#kvcache#kvcache-optimization#kvcached#llm#llm-framework#llm-inference#llm-serving#ollama#online-offline-coserve#serverless#sglang#vllm

Failed to patch kv_cache_coordinator 10 months ago

good first issue

ovg-project/kvcached

1.1K

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

Python

#elastic-kvcache#gpu-mutiplexing#gpu-sharing#inference-engine#kvcache#kvcache-optimization#kvcached#llm#llm-framework#llm-inference#llm-serving#ollama#online-offline-coserve#serverless#sglang#vllm

What is the difference between kvcached and Paged Attention ? 10 months ago

good first issue

ovg-project/kvcached

1.1K

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

Python

#elastic-kvcache#gpu-mutiplexing#gpu-sharing#inference-engine#kvcache#kvcache-optimization#kvcached#llm#llm-framework#llm-inference#llm-serving#ollama#online-offline-coserve#serverless#sglang#vllm

Question About kvcached Ability to Dynamically Recognize and Utilize Kubernetes Elastic Scaled GPU Memory Resources 12 months ago

good first issue

ovg-project/kvcached

1.1K

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

Python

#elastic-kvcache#gpu-mutiplexing#gpu-sharing#inference-engine#kvcache#kvcache-optimization#kvcached#llm#llm-framework#llm-inference#llm-serving#ollama#online-offline-coserve#serverless#sglang#vllm