bert

Modules

composer.models.bert.bert_hparams	YAHP general and classification interfaces for BERTModel.
composer.models.bert.model	Implements a BERT wrapper around a ComposerTransformer.

The BERT model family using Hugging Face Transformers.

Functions

create_bert_classification	BERT classification model based on 🤗 Transformers.
create_bert_mlm	BERT model based on 🤗 Transformers.

Hparams

These classes are used with yahp for YAML-based configuration.

BERTForClassificationHparams	YAHP interface for BERTModel.
BERTHparams	YAHP interface for BERTModel.