Privacy-first LLM proxy and AI gateway — load balancing, multi-provider routing, API key management, usage tracking, rate limiting. Self-hosted. Zero knowledge of your prompts.

ai ai-gateway anthropic api-gateway docker golang helm kubernetes llm llm-gateway llm-proxy ollama openai openai-proxy privacy privacy-first rate-limiting rbac self-hosted vllm
1 Open Issue Need Help Last updated: Jul 21, 2026

Open Issues Need Help

View All on GitHub
enhancement help wanted area:proxy priority:low

Privacy-first LLM proxy and AI gateway — load balancing, multi-provider routing, API key management, usage tracking, rate limiting. Self-hosted. Zero knowledge of your prompts.

Go
#ai#ai-gateway#anthropic#api-gateway#docker#golang#helm#kubernetes#llm#llm-gateway#llm-proxy#ollama#openai#openai-proxy#privacy#privacy-first#rate-limiting#rbac#self-hosted#vllm