Self-hosted, OpenAI-compatible AI gateway that splits your control plane (auth, guardrails, budgets, encrypted key vault, cost & observability) from the translation engine - swap Bifrost / LiteLLM / Portkey / Direct per provider at runtime. Own your keys; contain a compromised engine to one in-flight request.

ai-gateway ai-governance ai-security bifrost control-plane cost-tracking fastapi guardrails hexagonal-architecture litellm litellm-alternative llm llm-gateway llm-proxy llmops model-router observability openai-compatible portkey self-hosted
1 Open Issue Need Help Last updated: Aug 15, 2026

Open Issues Need Help

View All on GitHub
help wanted good first issue

Self-hosted, OpenAI-compatible AI gateway that splits your control plane (auth, guardrails, budgets, encrypted key vault, cost & observability) from the translation engine - swap Bifrost / LiteLLM / Portkey / Direct per provider at runtime. Own your keys; contain a compromised engine to one in-flight request.

Python
#ai-gateway#ai-governance#ai-security#bifrost#control-plane#cost-tracking#fastapi#guardrails#hexagonal-architecture#litellm#litellm-alternative#llm#llm-gateway#llm-proxy#llmops#model-router#observability#openai-compatible#portkey#self-hosted