composer.metrics#

A collection of common torchmetrics.

Classes

BinaryF1Score

Implements F1 Scores for binary classification tasks via sklearn.

CrossEntropy

Torchmetrics cross entropy loss implementation.

Dice

The Dice Coefficient for evaluating image segmentation.

HFCrossEntropy

Hugging Face compatible cross entropy loss.

LanguageCrossEntropy

Torchmetric that computes cross entropy on language modeling outputs.

LossMetric

Turns a torch.nn Loss Module into distributed torchmetrics Metric.

MIoU

Torchmetrics mean Intersection-over-Union (mIoU) implementation.

MaskedAccuracy

Computes accuracy with support for masked indicies.

Perplexity

Subclasses HFLanguageCrossEntropyLoss to implement perplexity.