All-in-one GGUF model manager and runner

ai gguf inference llama-cpp llm llms open-webui openai self-hosted
1 Open Issue Need Help Last updated: Dec 5, 2025

Open Issues Need Help

View All on GitHub

AI Summary: The 'Direct URL' button in the Add Models panel is redundant and displays the incorrect 'Download from HuggingFace' form instead of a URL input. The proposed solution is to remove this button and enhance the existing HuggingFace Browser search bar to intelligently detect and handle various model references, effectively replacing the old direct URL functionality with a smarter search.

Complexity: 3/5
enhancement good first issue ui

All-in-one GGUF model manager and runner

Rust
#ai#gguf#inference#llama-cpp#llm#llms#open-webui#openai#self-hosted