composer.optim#

Modules

`composer.optim.decoupled_weight_decay`	composer.optim.decoupled_weight_decay
`composer.optim.optimizer_hparams`	composer.optim.optimizer_hparams
`composer.optim.scheduler`	composer.optim.scheduler

composer.optim

Classes

`DecoupledAdamW`	Adam optimizer with the weight decay term decoupled from the learning rate.
`DecoupledSGDW`	SGD optimizer with the weight decay term decoupled from the learning rate.

Hparams

These classes are used with yahp for YAML-based configuration.

`AdamHparams`	Hyperparameters for the `Adam` optimizer.
`AdamWHparams`	Hyperparameters for the `torch.optim.AdamW` optimizer.
`ConstantLRHparams`	Hyperparameters for the `constant_scheduler()` scheduler.
`CosineAnnealingLRHparams`	Hyperparameters for the `cosine_annealing_scheduler()` scheduler.
`CosineAnnealingWarmRestartsHparams`	Hyperparameters for the `cosine_annealing_warm_restarts_scheduler()` scheduler.
`CosineAnnealingWithWarmupLRHparams`	Hyperparameters for the `cosine_annealing_with_warmup_scheduler()` scheduler.
`DecoupledAdamWHparams`	Hyperparameters for the `DecoupledAdamW` optimizer.
`DecoupledSGDWHparams`	Hyperparameters for the `DecoupledSGDW` optimizer.
`ExponentialLRHparams`	Hyperparameters for the `exponential_scheduler()` scheduler.
`LinearLRHparams`	Hyperparameters for the `linear_scheduler()` scheduler.
`LinearWithWarmupLRHparams`	Hyperparameters for the `linear_with_warmup_scheduler()` scheduler.
`MultiStepLRHparams`	Hyperparameters for the `multi_step_scheduler()` scheduler.
`MultiStepWithWarmupLRHparams`	Hyperparameters for the `multi_step_with_warmup_scheduler()` scheduler.
`OptimizerHparams`	Abstract base class for optimizer hyperparameter classes.
`PolynomialLRHparams`	Hyperparameters for the `polynomial_scheduler()` scheduler.
`RAdamHparams`	Hyperparameters for the `RAdam` optimizer.
`RMSPropHparams`	Hyperparameters for the [RMSProp optimizer](https://pytorch.org/docs/stable/generated/torch.optim.RMSprop.html#torch.optim.RMSprop).
`SGDHparams`	Hyperparameters for the SGD optimizer.
`SchedulerHparams`	composer.optim.scheduler.SchedulerHparams
`StepLRHparams`	Hyperparameters for the `step_scheduler()` scheduler.