domains / families / data / accelerate

accelerate

separate

Simplest distributed training API. 4 lines to add distributed support to any PyTorch script. Unified API for DeepSpeed/FSDP/Megatron/DDP. Automatic device placement, mixed precision (FP16/BF16/FP8). Interactive config, single launch command. HuggingFace ecosystem standard.

When to use

• Want simplest distributed training
• Need single script for any hardware
• Use HuggingFace ecosystem
• Want flexibility (DDP/DeepSpeed/FSDP/Megatron)
• Need quick prototyping
• **4 lines**: Minimal code changes
• **Unified API**: Same code for DDP, DeepSpeed, FSDP, Megatron
• **Automatic**: Device placement, mixed precision, sharding

Skill page

Source