StreamingImageNet1k#
- class composer.datasets.StreamingImageNet1k(remote, local, split, shuffle, resize_size=- 1, crop_size=224, batch_size=None)[source]#
Implementation of the ImageNet1k dataset using StreamingDataset.
- Parameters
remote (str) โ Remote directory (S3 or local filesystem) where dataset is stored.
local (str) โ Local filesystem directory where dataset is cached during operation.
split (str) โ The dataset split to use, either โtrainโ or โvalโ.
shuffle (bool) โ Whether to shuffle the samples in this dataset.
resize_size (int, optional) โ The resize size to use. Use -1 to not resize. Default:
-1
.size (crop) โ The crop size to use. Default:
224
.batch_size (Optional[int]) โ Hint batch_size that will be used on each deviceโs DataLoader. Default:
None
.