| github_url: | https://github.com/nvidia/apex |
|---|
This site contains the API documentation for Apex (https://github.com/nvidia/apex), a Pytorch extension with NVIDIA-maintained utilities to streamline mixed precision and distributed training. Some of the code here will be included in upstream Pytorch eventually. The intention of Apex is to make up-to-date utilities available to users as quickly as possible.
Installation instructions can be found here: https://github.com/NVIDIA/apex#quick-start.
Some other useful material, including GTC 2019 and Pytorch DevCon 2019 Slides, can be found here: https://github.com/mcarilli/mixed_precision_references.
.. toctree:: :maxdepth: 1 :caption: AMP: Automatic Mixed Precision amp
.. toctree:: :maxdepth: 1 :caption: Distributed Training parallel
.. toctree:: :maxdepth: 1 :caption: Fused Optimizers optimizers
.. toctree:: :maxdepth: 1 :caption: Fused Layer Norm layernorm