mosafariuk

mosafariuk/TokenFlow-Gateway

A token-aware API gateway and load balancer for vLLM and open-source AI infrastructure.

4 good first / help-wanted issues · TypeScript · last activity Aug 10, 2026

0 stars 0 forks 0 watchers TypeScript MIT License
ai-gateway fastify llmops load-balancer typescript vllm
View on GitHub
4 Open Issues Need Help Last updated: Aug 10, 2026

Open Issues Need Help

View All on GitHub
Roadmap: adaptive output-token budgets (close the reservation vs. actual KV usage gap) 2 months ago
enhancement help wanted
mosafariuk/TokenFlow-Gateway
0

A token-aware API gateway and load balancer for vLLM and open-source AI infrastructure.

TypeScript
#ai-gateway#fastify#llmops#load-balancer#typescript#vllm
Roadmap: prefix/session-affinity routing (KV-cache reuse) 2 months ago
enhancement help wanted
mosafariuk/TokenFlow-Gateway
0

A token-aware API gateway and load balancer for vLLM and open-source AI infrastructure.

TypeScript
#ai-gateway#fastify#llmops#load-balancer#typescript#vllm
Docs/DX: Add Docker healthchecks for Redis and the mock backends in Quick Start 3 months ago
documentation help wanted good first issue
mosafariuk/TokenFlow-Gateway
0

A token-aware API gateway and load balancer for vLLM and open-source AI infrastructure.

TypeScript
#ai-gateway#fastify#llmops#load-balancer#typescript#vllm
Feature: Add Prometheus /metrics export for the gateway 3 months ago
enhancement help wanted good first issue
mosafariuk/TokenFlow-Gateway
0

A token-aware API gateway and load balancer for vLLM and open-source AI infrastructure.

TypeScript
#ai-gateway#fastify#llmops#load-balancer#typescript#vllm