composer.models.gpt2

Modules

composer.models.gpt2.gpt2_hparams	composer.models.gpt2.gpt2_hparams
composer.models.gpt2.model	composer.models.gpt2.model

composer.models.gpt2

Classes

GPT2Model

Implements a GPT-2 wrapper around a ComposerTransformer.

Hparams

These classes are used with yahp for YAML-based configuration.

GPT2Hparams

Overrides TransformerHparams to create GPT-2 specific models and configs.