Open Issues Need Help
View All on GitHub Preserve the prompt cache across a yield on llama.cpp backends about 2 months ago
enhancement help wanted
preston-bernstein/ollama-yield preston-bernstein/ollama-yield Stop your local LLM from holding the GPU when you start a game. Pauses and resumes Ollama around gaming and Plex transcodes. Works on any GPU, including AMD.
Open project →
0
Stop your local LLM from holding the GPU when you start a game. Pauses and resumes Ollama around gaming and Plex transcodes. Works on any GPU, including AMD.
Go
#amd-gpu#golang#gpu#homelab#linux-gaming#llm-inference#local-llm#ollama#plex#rocm#self-hosted#vram