Open Issues Need Help
View All on GitHub Measure time to first token (TTFT) 15 days ago
enhancement help wanted
michal-konik-human/local-llm-perf-bench michal-konik-human/local-llm-perf-bench Performance benchmark for local LLM inference: llama.cpp, any GGUF, one GPU or several (ROCm). Records the conditions, not just the numbers.
Open project →
0
Performance benchmark for local LLM inference: llama.cpp, any GGUF, one GPU or several (ROCm). Records the conditions, not just the numbers.
Python
#amd#benchmark#gguf#gpu#inference#llama-cpp#llm#local-llm#multi-gpu#radeon#rocm
enhancement help wanted
michal-konik-human/local-llm-perf-bench michal-konik-human/local-llm-perf-bench Performance benchmark for local LLM inference: llama.cpp, any GGUF, one GPU or several (ROCm). Records the conditions, not just the numbers.
Open project →
0
Performance benchmark for local LLM inference: llama.cpp, any GGUF, one GPU or several (ROCm). Records the conditions, not just the numbers.
Python
#amd#benchmark#gguf#gpu#inference#llama-cpp#llm#local-llm#multi-gpu#radeon#rocm