StreamingADE20k

class composer.datasets.StreamingADE20k(remote, local, split, shuffle, base_size=512, min_resize_scale=0.5, max_resize_scale=2.0, final_size=512, batch_size=None)

Implementation of the ADE20k dataset using StreamingDataset.

Parameters

• remote (str) – Remote directory (S3 or local filesystem) where dataset is stored.

• local (str) – Local filesystem directory where dataset is cached during operation.

• split (str) – The dataset split to use, either ‘train’ or ‘val’.

• shuffle (bool) – Whether to shuffle the samples in this dataset.

• base_size (int) – initial size of the image and target before other augmentations. Default: 512.

• min_resize_scale (float) – the minimum value the samples can be rescaled. Default: 0.5.

• max_resize_scale (float) – the maximum value the samples can be rescaled. Default: 2.0.

• final_size (int) – the final size of the image and target. Default: 512.

• batch_size (Optional[int]) – Hint the batch_size that will be used on each device’s DataLoader. Default: None.