Open Issues Need Help
View All on GitHub Add: Serverless CPU vs GPU cost comparison for embeddings about 10 hours ago
help wanted missing-entry
Curated, evidence-backed list of runtimes, formats & tools for running AI inference on CPU — start with CPU, justify the GPU.
Python
#ai#arm#awesome#awesome-list#cpu#cpu-inference#edge-ai#efficient-inference#ggml#gguf#inference#llama-cpp#llm#local-llm#machine-learning#on-device#onnx#onnxruntime#openvino#quantization
Add: CPU inference on Kubernetes — deployment guide about 10 hours ago
documentation help wanted missing-entry
Curated, evidence-backed list of runtimes, formats & tools for running AI inference on CPU — start with CPU, justify the GPU.
Python
#ai#arm#awesome#awesome-list#cpu#cpu-inference#edge-ai#efficient-inference#ggml#gguf#inference#llama-cpp#llm#local-llm#machine-learning#on-device#onnx#onnxruntime#openvino#quantization
Missing: RISC-V inference section expansion about 10 hours ago
help wanted good first issue missing-entry
Curated, evidence-backed list of runtimes, formats & tools for running AI inference on CPU — start with CPU, justify the GPU.
Python
#ai#arm#awesome#awesome-list#cpu#cpu-inference#edge-ai#efficient-inference#ggml#gguf#inference#llama-cpp#llm#local-llm#machine-learning#on-device#onnx#onnxruntime#openvino#quantization
Missing: Apple Silicon M4 Ultra CPU inference benchmarks about 10 hours ago
help wanted good first issue missing-entry
Curated, evidence-backed list of runtimes, formats & tools for running AI inference on CPU — start with CPU, justify the GPU.
Python
#ai#arm#awesome#awesome-list#cpu#cpu-inference#edge-ai#efficient-inference#ggml#gguf#inference#llama-cpp#llm#local-llm#machine-learning#on-device#onnx#onnxruntime#openvino#quantization
Missing: AMD EPYC CPU inference benchmarks (Genoa/Turin) about 10 hours ago
help wanted good first issue missing-entry
Curated, evidence-backed list of runtimes, formats & tools for running AI inference on CPU — start with CPU, justify the GPU.
Python
#ai#arm#awesome#awesome-list#cpu#cpu-inference#edge-ai#efficient-inference#ggml#gguf#inference#llama-cpp#llm#local-llm#machine-learning#on-device#onnx#onnxruntime#openvino#quantization