composer.utils

Modules

composer.utils.checkpoint	Utilities for working with training checkpoints.
composer.utils.dist	Helper methods for torch.distributed.
composer.utils.file_retriever	Utility for retrieving files.
composer.utils.iter_helpers	Utilities for iterating over collections.
composer.utils.module_surgery	Modify model architectures.
composer.utils.object_store	Utility for uploading to and downloading from cloud object stores.
composer.utils.reproducibility	Helper utilities for configuring deterministic training to ensure reproducibility.
composer.utils.run_directory	The run directory stores artifacts created during training.
composer.utils.string_enum	Base class for Enums containing string values.

Helper utilities.

Functions

ensure_tuple	Converts x into a tuple.
get_file	Get a file from a local folder, URL, or object store.
iterate_with_pbar	Iterate over a batch iterator and update a tqdm.tqdm progress bar by the batch size on each step.
load_checkpoint	Load a checkpoint from a local file, URI, or cloud object store into state.
map_collection	Apply map_fn on each element in collection.
save_checkpoint	Checkpoint the training state.

Classes

ObjectStoreProvider	Utility for uploading to and downloading from object (blob) stores, such as Amazon S3.
StringEnum	Base class for Enums containing string values.

Hparams

These classes are used with yahp for YAML-based configuration.

ObjectStoreProviderHparams

ObjectStoreProvider hyperparameters.