docker/model-runner

Available unified memory in llama.cpp about 11 hours ago

good first issue

docker/model-runner

603

Docker Model Runner

Go

Add Pascal GPU (sm_61/sm_62) support to llama.cpp CUDA build about 1 month ago

good first issue

docker/model-runner

603

Docker Model Runner

Go

Docker model runner container does not sync changes to config.json; requires restart (engine only) about 1 month ago

good first issue

docker/model-runner

603

Docker Model Runner

Go

Docker Healthcheck failing about 1 month ago

good first issue

docker/model-runner

603

Docker Model Runner

Go

[Bug]vllm backend doesn't work for wsl2 ubuntu22.04 about 1 month ago

good first issue

docker/model-runner

603

Docker Model Runner

Go

Full support for v1/responses endpoint. about 1 month ago

good first issue

docker/model-runner

603

Docker Model Runner

Go

Unable to set vllm serve parameters using hf_overrides about 2 months ago

good first issue

docker/model-runner

603

Docker Model Runner

Go

NPU support about 2 months ago

good first issue

docker/model-runner

603

Docker Model Runner

Go

Bug Report: Docker Model Runner Does Not Use Intel Arc GPU via Vulkan on Windows about 2 months ago

good first issue

docker/model-runner

603

Docker Model Runner

Go

docker model launch llmfit about 2 months ago

good first issue

docker/model-runner

603

Docker Model Runner

Go

Docker Sandboxes and DMR integration about 2 months ago

good first issue

docker/model-runner

603

Docker Model Runner

Go

Add support for Modelfile 2 months ago

good first issue

docker/model-runner

603

Docker Model Runner

Go

Merge the functionality of the existing model-runner and model-cli into a single dmr executable 2 months ago

good first issue

docker/model-runner

603

Docker Model Runner

Go

alt (option) + b/f doesn't work on iTerm2 on macOS 3 months ago

good first issue

docker/model-runner

603

Docker Model Runner

Go

Suggest `unload` instead of help on `stop`, or add `stop` alias 3 months ago

good first issue

docker/model-runner

603

Docker Model Runner

Go

Centralize default deps versions in a single source-of-truth file 3 months ago

enhancement good first issue

docker/model-runner

603

Docker Model Runner

Go

Implement open prompt in system text editor 3 months ago

good first issue

docker/model-runner

603

Docker Model Runner

Go

The Rest of the OpenAI API support? 3 months ago

good first issue

docker/model-runner

603

Docker Model Runner

Go

e2e-test unreliable 3 months ago

good first issue

docker/model-runner

603

Docker Model Runner

Go

Feature Request: Make model timeouts for unloading from memory configurable 5 months ago

enhancement good first issue

docker/model-runner

603

Docker Model Runner

Go

AMD/ROCm implementation and testing (llama.cpp/vLLM) 5 months ago

good first issue

docker/model-runner

603

Docker Model Runner

Go

Support pushing to Hugging Face 5 months ago

good first issue

docker/model-runner

603

Docker Model Runner

Go

Hugging Face models produce non-deterministic OCI digests due to `time.Now()` in creation date 5 months ago

good first issue

docker/model-runner

603

Docker Model Runner

Go

Models appear in `docker model list`, but `docker model run` re-downloads 5 months ago

good first issue

docker/model-runner

603

Docker Model Runner

Go

Model ID naming issues 5 months ago

good first issue

docker/model-runner

603

Docker Model Runner

Go

Model unavailable after sending first message 5 months ago

good first issue

docker/model-runner

603

Docker Model Runner

Go

Qwen3-vl and Qwen2.5-vl Video Mode 5 months ago

good first issue

docker/model-runner

603

Docker Model Runner

Go

"docker model run" optimization 5 months ago

good first issue

docker/model-runner

603

Docker Model Runner

Go

vLLM ROCm 5 months ago

good first issue

docker/model-runner

603

Docker Model Runner

Go

docker model launch opencode/claude/codex/anythingllm/openwebui/moltbot 5 months ago

enhancement good first issue

docker/model-runner

603

Docker Model Runner

Go

Missing cache check for native HuggingFace pulls causes duplicate downloads 5 months ago

good first issue

docker/model-runner

603

Docker Model Runner

Go

docker model show 5 months ago

good first issue

docker/model-runner

603

Docker Model Runner

Go

Prevent pulling hf.co and huggingface.co as different models 5 months ago

good first issue

docker/model-runner

603

Docker Model Runner

Go

Ray, Docker Model Runner, docker-compose integration 5 months ago

good first issue

docker/model-runner

603

Docker Model Runner

Go

Ray, Docker Model Runner, docker-compose 5 months ago

good first issue

docker/model-runner

603

Docker Model Runner

Go

Introduce log levels with slog 5 months ago

good first issue

docker/model-runner

603

Docker Model Runner

Go

Consistent UX for pull and push 6 months ago

good first issue

docker/model-runner

603

Docker Model Runner

Go

Pull vllm-compatible models from HuggingFace 6 months ago

good first issue

docker/model-runner

603

Docker Model Runner

Go

Enhancement: Expose richer model metadata in /engines/v1/models (similar to OpenRouter) 7 months ago

good first issue

docker/model-runner

603

Docker Model Runner

Go

Create "docker model bench MODEL" 7 months ago

good first issue

docker/model-runner

603

Docker Model Runner

Go

Unfork llama.cpp 7 months ago

good first issue

docker/model-runner

603

Docker Model Runner

Go

Implement and test Anthropic Messages API 7 months ago

good first issue

docker/model-runner

603

Docker Model Runner

Go

Feature: SGLang backend 7 months ago

good first issue

docker/model-runner

603

Docker Model Runner

Go

Interactive chat in CLI through `run` doesn't send conversational context 8 months ago

bug good first issue

docker/model-runner

603

Docker Model Runner

Go

Inconsistent units ("M", " MiB", "M", " M") 8 months ago

good first issue

docker/model-runner

603

Docker Model Runner

Go

Feature: MLX backend 9 months ago

enhancement good first issue

docker/model-runner

603

Docker Model Runner

Go

Pulling models from behind firewall not possible even though pulling images works 9 months ago

good first issue

docker/model-runner

603

Docker Model Runner

Go

Nvidia NIM support 9 months ago

good first issue nvidia

docker/model-runner

603

Docker Model Runner

Go

On Ctrl-C, we should just stop the bot from chatting, rather than exit the application altogether 9 months ago

good first issue

docker/model-runner

603

Docker Model Runner

Go

"docker model run --detach" 9 months ago

good first issue

docker/model-runner

603

Docker Model Runner

Go

Bind to interface 0.0.0.0 9 months ago

enhancement good first issue

docker/model-runner

603

Docker Model Runner

Go

Open Issues Need Help