ai-factory-ops-lab good first issues (Shell)

HAMi + NVIDIA GPU Operator coexistence (getting-to-production) 3 months ago

help wanted lesson hami priority: next upstream

5

Hands-on GPU/HPC infrastructure operations: K8s GPU scheduling, HAMi sharing, Slurm, observability & vLLM inference. Learn it free on a laptop; validate on one cheap GPU.

Shell

#ai-infrastructure#dcgm#devops#gpu#gpu-scheduling#gpu-sharing#grafana#hami#hpc#inference#k3s#kai-scheduler#kubernetes#learning-by-doing#mlops#nvidia#observability#prometheus#slurm#vllm

Lesson: Volcano (gang scheduling) 4 months ago

help wanted lesson priority: later

ld-singh/ai-factory-ops-lab

5

Hands-on GPU/HPC infrastructure operations: K8s GPU scheduling, HAMi sharing, Slurm, observability & vLLM inference. Learn it free on a laptop; validate on one cheap GPU.

Shell

#ai-infrastructure#dcgm#devops#gpu#gpu-scheduling#gpu-sharing#grafana#hami#hpc#inference#k3s#kai-scheduler#kubernetes#learning-by-doing#mlops#nvidia#observability#prometheus#slurm#vllm

Lesson: Kueue (Kubernetes-native batch queueing) 4 months ago

help wanted lesson priority: later

ld-singh/ai-factory-ops-lab

5

Hands-on GPU/HPC infrastructure operations: K8s GPU scheduling, HAMi sharing, Slurm, observability & vLLM inference. Learn it free on a laptop; validate on one cheap GPU.

Shell

#ai-infrastructure#dcgm#devops#gpu#gpu-scheduling#gpu-sharing#grafana#hami#hpc#inference#k3s#kai-scheduler#kubernetes#learning-by-doing#mlops#nvidia#observability#prometheus#slurm#vllm

Lesson: distributed training on 2 GPUs (NCCL all-reduce + PyTorch DDP) 4 months ago

help wanted lesson priority: later

ld-singh/ai-factory-ops-lab

5

Hands-on GPU/HPC infrastructure operations: K8s GPU scheduling, HAMi sharing, Slurm, observability & vLLM inference. Learn it free on a laptop; validate on one cheap GPU.

Shell

#ai-infrastructure#dcgm#devops#gpu#gpu-scheduling#gpu-sharing#grafana#hami#hpc#inference#k3s#kai-scheduler#kubernetes#learning-by-doing#mlops#nvidia#observability#prometheus#slurm#vllm

Concepts: the multi-node boundary (NCCL, NVLink, GPUDirect RDMA, InfiniBand) 4 months ago

help wanted concept priority: later

ld-singh/ai-factory-ops-lab

5

Hands-on GPU/HPC infrastructure operations: K8s GPU scheduling, HAMi sharing, Slurm, observability & vLLM inference. Learn it free on a laptop; validate on one cheap GPU.

Shell

#ai-infrastructure#dcgm#devops#gpu#gpu-scheduling#gpu-sharing#grafana#hami#hpc#inference#k3s#kai-scheduler#kubernetes#learning-by-doing#mlops#nvidia#observability#prometheus#slurm#vllm

Lesson 8: Cost & autoscaling for GPU platforms 4 months ago

enhancement help wanted lesson priority: later

ld-singh/ai-factory-ops-lab

5

Hands-on GPU/HPC infrastructure operations: K8s GPU scheduling, HAMi sharing, Slurm, observability & vLLM inference. Learn it free on a laptop; validate on one cheap GPU.

Shell

#ai-infrastructure#dcgm#devops#gpu#gpu-scheduling#gpu-sharing#grafana#hami#hpc#inference#k3s#kai-scheduler#kubernetes#learning-by-doing#mlops#nvidia#observability#prometheus#slurm#vllm

HAMi: compute (gpucores) throttling lab 4 months ago

help wanted lesson hami priority: next

ld-singh/ai-factory-ops-lab

5

Hands-on GPU/HPC infrastructure operations: K8s GPU scheduling, HAMi sharing, Slurm, observability & vLLM inference. Learn it free on a laptop; validate on one cheap GPU.

Shell

#ai-infrastructure#dcgm#devops#gpu#gpu-scheduling#gpu-sharing#grafana#hami#hpc#inference#k3s#kai-scheduler#kubernetes#learning-by-doing#mlops#nvidia#observability#prometheus#slurm#vllm

Lesson: GPU fault handling & resilience 4 months ago

help wanted lesson priority: next

ld-singh/ai-factory-ops-lab

5

Hands-on GPU/HPC infrastructure operations: K8s GPU scheduling, HAMi sharing, Slurm, observability & vLLM inference. Learn it free on a laptop; validate on one cheap GPU.

Shell

#ai-infrastructure#dcgm#devops#gpu#gpu-scheduling#gpu-sharing#grafana#hami#hpc#inference#k3s#kai-scheduler#kubernetes#learning-by-doing#mlops#nvidia#observability#prometheus#slurm#vllm

Add an asciinema / GIF of a lab running to the README 4 months ago

documentation good first issue priority: next

ld-singh/ai-factory-ops-lab

5

Hands-on GPU/HPC infrastructure operations: K8s GPU scheduling, HAMi sharing, Slurm, observability & vLLM inference. Learn it free on a laptop; validate on one cheap GPU.

Shell

#ai-infrastructure#dcgm#devops#gpu#gpu-scheduling#gpu-sharing#grafana#hami#hpc#inference#k3s#kai-scheduler#kubernetes#learning-by-doing#mlops#nvidia#observability#prometheus#slurm#vllm

Lesson 6 Part D: Slurm real GRES enforcement on hardware 4 months ago

help wanted lesson priority: next

ld-singh/ai-factory-ops-lab

5

Hands-on GPU/HPC infrastructure operations: K8s GPU scheduling, HAMi sharing, Slurm, observability & vLLM inference. Learn it free on a laptop; validate on one cheap GPU.

Shell

#ai-infrastructure#dcgm#devops#gpu#gpu-scheduling#gpu-sharing#grafana#hami#hpc#inference#k3s#kai-scheduler#kubernetes#learning-by-doing#mlops#nvidia#observability#prometheus#slurm#vllm

Lesson 7: Security for GPU/AI infrastructure 4 months ago

help wanted lesson security priority: next

ld-singh/ai-factory-ops-lab

5

Hands-on GPU/HPC infrastructure operations: K8s GPU scheduling, HAMi sharing, Slurm, observability & vLLM inference. Learn it free on a laptop; validate on one cheap GPU.

Shell

#ai-infrastructure#dcgm#devops#gpu#gpu-scheduling#gpu-sharing#grafana#hami#hpc#inference#k3s#kai-scheduler#kubernetes#learning-by-doing#mlops#nvidia#observability#prometheus#slurm#vllm

ld-singh/ai-factory-ops-lab

Open Issues Need Help