composer.algorithms.agc

Modules

composer.algorithms.agc.agc

Core adaptive gradient clipping classes and functions.

Adaptive gradient Clipping Clips all gradients in model based on ratio of gradient norms to parameter norms.

See the Method Card for more details.

Functions

apply_agc

Clips all gradients in model based on ratio of gradient norms to parameter norms.

Classes

AGC	Clips all gradients in model based on ratio of gradient norms to parameter norms.