domains / families / data / nemo-mbridge-perf-tp-dp-comm-overlap

nemo-mbridge-perf-tp-dp-comm-overlap

separate

Operational guide for enabling TP, DP, and PP communication overlap in Megatron-Bridge, including config knobs, code anchors, pitfalls, and verification.

When to use

• Enabling TP/DP/PP comm overlap
• tracing a throughput regression to a comm overlap config change
• overlap_param_gather
• overlap_grad_reduce
• sequence-parallel overlap
• TP overlap
• DP overlap
• comm overlap

Skill page

Source