domains / families / devops / gpu-kubernetes-operations

gpu-kubernetes-operations

authentic

Operate GPU-backed Kubernetes clusters for AI inference and training with scheduling, autoscaling, node health, MIG partitioning, and cost controls.

When to use

• Setting up GPU node pools in Kubernetes for AI inference or training
• Configuring NVIDIA device plugin and GPU operator
• Implementing MIG partitioning to share GPUs across workloads
• Building GPU-aware autoscaling policies
• Monitoring GPU health with DCGM and Prometheus
• Troubleshooting GPU scheduling, driver, or OOM issues

Skill page

Source