neuralmagic/guidellm

Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs

1 Open Issue Need Help Last updated: Jun 26, 2025

Open Issues Need Help

Improve error handling around invalid tokenizer names 2 months ago

AI Summary: Improve the error handling in GuideLLM when an invalid tokenizer name (like `qwen3:4b`) is provided. The current error messages are inconsistent and unhelpful; the goal is to provide more informative and consistent error messages to the user, guiding them towards a correct tokenizer specification.

Complexity: 4/5

good first issue

neuralmagic/guidellm

368

Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs

Python