Pipeline Parallelism

AI and Machine Learning · Distributed Training · 2018 · pipeline-parallelism.yaml

Assigns consecutive layers to different devices and streams micro- batches through them. Communication is only at stage boundaries, at the cost of bubbles while the pipeline fills and drains.

Colour is the family; a dashed line is the second member of it.

Drag to pan · scroll to zoom · click a node to open it
G pipeline-parallelism Pipeline Parallelism tensor-parallelism Tensor Parallelism pipeline-parallelism->tensor-parallelism splits between layers rather than inside one

This node

References