domains / families / science / nemo-mbridge-perf-moe-comm-overlap

nemo-mbridge-perf-moe-comm-overlap

separate

MoE expert-parallel communication overlap in Megatron Bridge. Covers dispatch/combine overlap, flex dispatcher backends, and expert wgrad scheduling.

When to use

• Tuning MoE communication overlap
• tracing a MoE throughput regression to a comm-overlap config change
• overlap_moe_expert_parallel_comm
• MoE dispatch overlap
• flex dispatcher
• DeepEP overlap
• expert wgrad scheduling

When not to use

• early bring-up step

Skill page

Source