Open Issues Need Help
View All on GitHub Router performance benchmark about 2 months ago
help wanted
LLM Semantic Router: Intelligent Mixture-of-Models (MoM) System with Privacy Preservation and Prompt Guard. The semantic router intelligently directs OpenAI compliant API requests to the most suitable backend models based on semantic understanding of request content.
Python
#bert-classification#bert-fine-tuning#envoy-proxy#golang#llm-inference#mixture-of-models#openai-api#pii-detection#prompt-guard#python#rust#semantic-router
OpenAI API conformance test about 2 months ago
help wanted
LLM Semantic Router: Intelligent Mixture-of-Models (MoM) System with Privacy Preservation and Prompt Guard. The semantic router intelligently directs OpenAI compliant API requests to the most suitable backend models based on semantic understanding of request content.
Python
#bert-classification#bert-fine-tuning#envoy-proxy#golang#llm-inference#mixture-of-models#openai-api#pii-detection#prompt-guard#python#rust#semantic-router