Self-hosted LLM serving via llm-d. Includes per-model OIDC access control, API key management, and Envoy AI Gateway token counting and rate limiting.

3 stars 1 forks 3 watchers Go Apache License 2.0
4 Open Issues Need Help Last updated: Aug 18, 2026

Open Issues Need Help

View All on GitHub
good first issue type: enhancement 💅🏼 priority: low 🌱 UI/UX/DX

Self-hosted LLM serving via llm-d. Includes per-model OIDC access control, API key management, and Envoy AI Gateway token counting and rate limiting.

Go
area: testing ✅ good first issue needs: follow-up 📥 type: maintenance 🛠 priority: low 🌱

Self-hosted LLM serving via llm-d. Includes per-model OIDC access control, API key management, and Envoy AI Gateway token counting and rate limiting.

Go
area: developer experience 👩🏻‍💻 good first issue needs: follow-up 📥 type: maintenance 🛠 priority: low 🌱

Self-hosted LLM serving via llm-d. Includes per-model OIDC access control, API key management, and Envoy AI Gateway token counting and rate limiting.

Go
area: developer experience 👩🏻‍💻 good first issue needs: follow-up 📥 type: maintenance 🛠 priority: medium ⚡

Self-hosted LLM serving via llm-d. Includes per-model OIDC access control, API key management, and Envoy AI Gateway token counting and rate limiting.

Go