Open-source, OpenAI-compatible LLM gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.

285 stars 17 forks 285 watchers Python Apache License 2.0
ai ai-gateway anthropic api-key-management budgets cost-tracking gateway litellm-alternative llm llm-gateway llm-proxy llm-routing llmops multi-provider open-source openai openai-compatible python self-hosted
3 Open Issues Need Help Last updated: Jul 15, 2026

Open Issues Need Help

View All on GitHub

Open-source, OpenAI-compatible LLM gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.

Python
#ai#ai-gateway#anthropic#api-key-management#budgets#cost-tracking#gateway#litellm-alternative#llm#llm-gateway#llm-proxy#llm-routing#llmops#multi-provider#open-source#openai#openai-compatible#python#self-hosted

Open-source, OpenAI-compatible LLM gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.

Python
#ai#ai-gateway#anthropic#api-key-management#budgets#cost-tracking#gateway#litellm-alternative#llm#llm-gateway#llm-proxy#llm-routing#llmops#multi-provider#open-source#openai#openai-compatible#python#self-hosted

Open-source, OpenAI-compatible LLM gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.

Python
#ai#ai-gateway#anthropic#api-key-management#budgets#cost-tracking#gateway#litellm-alternative#llm#llm-gateway#llm-proxy#llm-routing#llmops#multi-provider#open-source#openai#openai-compatible#python#self-hosted