nebari-dev

nebari-dev/llm-serving-pack

Self-hosted LLM serving via llm-d. Includes per-model OIDC access control, API key management, and Envoy AI Gateway token counting and rate limiting.

4 good first / help-wanted issues · Go · last activity Aug 18, 2026

3 stars 1 forks 3 watchers Go Apache License 2.0
4 Open Issues Need Help Last updated: Aug 18, 2026

Open Issues Need Help

View All on GitHub
good first issue type: enhancement 💅🏼 priority: low 🌱 UI/UX/DX
nebari-dev/llm-serving-pack
3

Self-hosted LLM serving via llm-d. Includes per-model OIDC access control, API key management, and Envoy AI Gateway token counting and rate limiting.

Go
area: testing ✅ good first issue needs: follow-up 📥 type: maintenance 🛠 priority: low 🌱
nebari-dev/llm-serving-pack
3

Self-hosted LLM serving via llm-d. Includes per-model OIDC access control, API key management, and Envoy AI Gateway token counting and rate limiting.

Go
area: developer experience 👩🏻‍💻 good first issue needs: follow-up 📥 type: maintenance 🛠 priority: low 🌱
nebari-dev/llm-serving-pack
3

Self-hosted LLM serving via llm-d. Includes per-model OIDC access control, API key management, and Envoy AI Gateway token counting and rate limiting.

Go
area: developer experience 👩🏻‍💻 good first issue needs: follow-up 📥 type: maintenance 🛠 priority: medium ⚡
nebari-dev/llm-serving-pack
3

Self-hosted LLM serving via llm-d. Includes per-model OIDC access control, API key management, and Envoy AI Gateway token counting and rate limiting.

Go