domains / families / devops / tao-setup-nvidia-gpu-host

tao-setup-nvidia-gpu-host

separate

Host setup for TAO GPU backends. Checks and, after user approval, installs minimum-compatible NVIDIA driver, CUDA Toolkit, and NVIDIA Container Toolkit versions for Docker/local-Docker and Kubernetes GPU worker hosts. TAO-wide defaults can be overridden by the selected model's runtime profile. The `--check-only` path works on any Linux distribution; `--install` automates debian-family (Ubuntu/Debian/Pop!_OS/Mint/Zorin/Raspbian), rhel-family (Fedora/RHEL/Rocky/AlmaLinux), and suse-family (openSUSE/SLES) hosts, and prints actionable manual-install steps for everything else. Use when the user asks to "set up an NVIDIA GPU host", "check TAO Docker GPU runtime", or prepare a Kubernetes GPU worker for TAO.

When to use

• set up an NVIDIA GPU host
• check TAO Docker GPU runtime
• prepare a Kubernetes GPU worker for TAO
• install NVIDIA driver
• install CUDA Toolkit
• install NVIDIA Container Toolkit
• install Docker engine for GPU backends

When not to use

• installing on Arch, Alpine, Gentoo, NixOS, or FreeBSD
• running without user approval for installation
• rewriting platform defaults for other models

Skill page

Source