domains / families / science / launch-nemo-rl

launch-nemo-rl

separate

Playbook for launching, monitoring, stopping, and debugging NeMo-RL recipes on a Kubernetes cluster via the nrl-k8s CLI. Covers ephemeral vs long-lived RayCluster modes, iterating on runs, and debugging hung or failed training jobs.

When to use

• run this recipe on k8s
• launch on the cluster
• submit a training job
• tear down the cluster
• resubmit as rayjob
• why is the run stuck
• how do I get logs for job X
• bring the cluster back up

Skill page

Source