Open Issues Need Help
View All on GitHub Implement Anonymizers and Guardrails Pipelines in `endpoint_i about 2 hours ago
documentation enhancement good first issue
LLM Router is a service that can be deployed on‑premises or in the cloud. It adds a layer between any application and the LLM provider. In real time it controls traffic, distributes a load among providers of a specific LLM, and enables analysis of outgoing requests from a security perspective (masking, anonymization, prohibited content).
Python
#automation#cloud#genai#llm-balancing#llm-gateway#llm-gateway-system#llm-router#load-balancing#model-management#on-prem#rest-api