KushagraKanaujia

KushagraKanaujia/throttle

Safe, local benchmarking for OpenAI-compatible inference endpoints

2 good first / help-wanted issues · Python · last activity Sep 4, 2026

7 stars 6 forks 7 watchers Python MIT License

inference-benchmarking llm-inference python-cli vllm

2 Open Issues Need Help Last updated: Sep 4, 2026

Open Issues Need Help

View All on GitHub

Consistent terminal output across demo/watch/golden about 2 months ago

enhancement good first issue

KushagraKanaujia/throttle

7

Safe, local benchmarking for OpenAI-compatible inference endpoints

Python

#inference-benchmarking#llm-inference#python-cli#vllm

Design pass on golden HTML report about 2 months ago

enhancement good first issue

KushagraKanaujia/throttle

7

Safe, local benchmarking for OpenAI-compatible inference endpoints

Python

#inference-benchmarking#llm-inference#python-cli#vllm