composer.models.transformer_hparams#
composer.models.transformer_hparams
Functions
Returns the same class as was passed in, with dunder methods added based on the fields defined in the class. |
Classes
Helper class that provides a standard way to create an ABC using inheritance. |
Hparams
These classes are used with yahp
for YAML
-based configuration.
Model Hparams. |
|
Defines the necessary hyparameters for a Transformer base module. |
Attributes
Dict
JSON
Optional
- class composer.models.transformer_hparams.TransformerHparams(initializers=<factory>, num_classes=None, tokenizer_name=None, pretrained_model_name=None, model_config=<factory>, use_pretrained=False, gradient_checkpointing=False)[source]#
Bases:
composer.models.model_hparams.ModelHparams
,abc.ABC
Defines the necessary hyparameters for a Transformer base module.