composer.algorithms.swa

Modules

composer.algorithms.swa.swa

Core code for Stochastic Weight Averaging.

Stochastic Weight Averaging (SWA; Izmailov et al, 2018) averages model weights sampled at different times near the end of training.

This leads to better generalization than just using the final trained weights. See the Method Card for more details.

Classes

SWA	Applies Stochastic Weight Averaging (Izmailov et al, 2018).