A library that enables Distributed Data Parallel and optimizes node-to-node communication.1

Footnotes

  1. Not sure if this also applies for non-deep learning model