nano-lmcache good first issues (Python)

good first issue task area: cache difficulty: easy

7

📚 An educational, step-by-step implementation of LLM KV cache reuse — learn prefix caching, chunk keys, storage & eviction, from pure Python to GPU tensors and vLLM integration. Inspired by LMCache.

Python

#educational#kv-cache#llm#llm-inference#lmcache#prefix-caching#python#vllm

M3: Byte-based capacity 5 days ago

good first issue task area: cache difficulty: medium

Kangwenqiao/nano-lmcache

7

📚 An educational, step-by-step implementation of LLM KV cache reuse — learn prefix caching, chunk keys, storage & eviction, from pure Python to GPU tensors and vLLM integration. Inspired by LMCache.

Python

#educational#kv-cache#llm#llm-inference#lmcache#prefix-caching#python#vllm

D11: Chinese translation of README and docs 5 days ago

documentation good first issue task area: docs difficulty: easy

Kangwenqiao/nano-lmcache

7

📚 An educational, step-by-step implementation of LLM KV cache reuse — learn prefix caching, chunk keys, storage & eviction, from pure Python to GPU tensors and vLLM integration. Inspired by LMCache.

Python

#educational#kv-cache#llm#llm-inference#lmcache#prefix-caching#python#vllm

D9: Glossary and FAQ 5 days ago

documentation good first issue task area: docs difficulty: easy

Kangwenqiao/nano-lmcache

7

📚 An educational, step-by-step implementation of LLM KV cache reuse — learn prefix caching, chunk keys, storage & eviction, from pure Python to GPU tensors and vLLM integration. Inspired by LMCache.

Python

#educational#kv-cache#llm#llm-inference#lmcache#prefix-caching#python#vllm

D2: Step-by-step tutorial 5 days ago

documentation good first issue task area: docs difficulty: medium

Kangwenqiao/nano-lmcache

7

📚 An educational, step-by-step implementation of LLM KV cache reuse — learn prefix caching, chunk keys, storage & eviction, from pure Python to GPU tensors and vLLM integration. Inspired by LMCache.

Python

#educational#kv-cache#llm#llm-inference#lmcache#prefix-caching#python#vllm

Kangwenqiao/nano-lmcache

Open Issues Need Help