Precision

class composer.core.Precision(value)

Enum class for the numerical precision to be used by the model.

AMP

Use torch.cuda.amp. Only compatible with GPUs.

FP16

Use 16-bit floating-point precision. Currently only compatible with GPUs on DeepSpeed.

FP32

Use 32-bit floating-point precision. Compatible with CPUs and GPUs.

BF16

Use 16-bit BFloat mixed precision. Compatible with CPUs and GPUs.