composer.core.evaluator

composer.core.evaluator

Classes

DataSpec	Specifications for operating and training on data.
Evaluator	Wrapper for a dataloader to include metrics that apply to a specific dataset.
Metric	Base class for all metrics present in the Metrics API.
MetricCollection	MetricCollection class can be used to chain metrics that have the same call pattern into one single class.

Attributes

• TYPE_CHECKING

• Union

• annotations

class composer.core.evaluator.Evaluator(*, label, dataloader, metrics)

Bases: object

Wrapper for a dataloader to include metrics that apply to a specific dataset.

label

Name of the Evaluator

Type

str

dataloader

Dataloader/DataSpec for evaluation data

Type

Union[DataSpec, DataLoader]

metrics

Metrics to log. The metrics will be deep-copied to ensure that each evaluator updates only its metrics.

Type

Metrics