StreamingCIFAR10#
- class composer.datasets.StreamingCIFAR10(remote, local, split, shuffle, batch_size=None)[source]#
Implementation of the CIFAR10 dataset using StreamingDataset.
- Parameters
remote (str) โ Remote directory (S3 or local filesystem) where dataset is stored.
local (str) โ Local filesystem directory where dataset is cached during operation.
split (str) โ The dataset split to use, either โtrainโ or โvalโ.
shuffle (bool) โ Whether to shuffle the samples in this dataset.
batch_size (Optional[int]) โ Hint batch_size that will be used on each deviceโs DataLoader. Default:
None
.