casys-kaist

casys-kaist/LLMServingSim

LLMServingSim 2.0: A Unified Simulator for Heterogeneous and Disaggregated LLM Serving Infrastructure

1 good first / help-wanted issue · Python · last activity Aug 15, 2026

361 stars 96 forks 361 watchers Python MIT License
View on GitHub Website
1 Open Issue Need Help Last updated: Aug 15, 2026

Open Issues Need Help

View All on GitHub
Consumer-class GPU profile bundles (RTX 4090 / 3090 / A5000) 3 months ago
enhancement good first issue help wanted
casys-kaist/LLMServingSim
361

LLMServingSim 2.0: A Unified Simulator for Heterogeneous and Disaggregated LLM Serving Infrastructure

Python