Open Issues Need Help
View All on GitHub Reject unknown fields from API requests 3 months ago
enhancement good first issue
predibase/lorax predibase/lorax Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
Open project →
3.8K
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
Python
#fine-tuning#gpt#llama#llm#llm-inference#llm-serving#llmops#lora#model-serving#pytorch#transformers
Return number of input tokens when `details=True` about 1 year ago
enhancement good first issue
predibase/lorax predibase/lorax Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
Open project →
3.8K
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
Python
#fine-tuning#gpt#llama#llm#llm-inference#llm-serving#llmops#lora#model-serving#pytorch#transformers
Include total time to generate tokens in final payload details about 1 year ago
enhancement good first issue
predibase/lorax predibase/lorax Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
Open project →
3.8K
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
Python
#fine-tuning#gpt#llama#llm#llm-inference#llm-serving#llmops#lora#model-serving#pytorch#transformers