Durable, resumable OpenAI-compatible inference streams that survive disconnects, backend loss, and Kubernetes rolling updates.

2 stars 0 forks 2 watchers Go Apache License 2.0
ai-inference fault-tolerance golang kubernetes kubernetes-operator llm observability openai redis server-sent-events streaming typescript
1 Open Issue Need Help Last updated: Aug 23, 2026

Open Issues Need Help

View All on GitHub
help wanted good first issue area: sdk github_actions

Durable, resumable OpenAI-compatible inference streams that survive disconnects, backend loss, and Kubernetes rolling updates.

Go
#ai-inference#fault-tolerance#golang#kubernetes#kubernetes-operator#llm#observability#openai#redis#server-sent-events#streaming#typescript