composer.models.transformer_hparams#

composer.models.transformer_hparams

Functions

dataclass

Returns the same class as was passed in, with dunder methods added based on the fields defined in the class.

Classes

ABC

Helper class that provides a standard way to create an ABC using inheritance.

Hparams

These classes are used with yahp for YAML-based configuration.

ModelHparams

Model Hparams.

TransformerHparams

Defines the necessary hyparameters for a Transformer base module.

Attributes

  • Dict

  • JSON

  • Optional

class composer.models.transformer_hparams.TransformerHparams(initializers=<factory>, num_classes=None, tokenizer_name=None, pretrained_model_name=None, model_config=<factory>, use_pretrained=False, gradient_checkpointing=False)[source]#

Bases: composer.models.model_hparams.ModelHparams, abc.ABC

Defines the necessary hyparameters for a Transformer base module.