composer.datasets.streaming.world#
The World
class is used for easily querying distributed training info, used by StreamingDataset.
Functions
Returns a |
Classes
A |
- class composer.datasets.streaming.world.World(global_node, global_num_nodes, global_device, global_num_devices, node_device, node_num_devices, global_worker, global_num_workers, node_worker, node_num_workers, device_worker, device_num_workers)[source]#
Bases:
tuple
A
NamedTuple
that provides context about workers, devices, and nodes.
- composer.datasets.streaming.world.get_world()[source]#
Returns a
World
object, initialized usingcomposer.utils.dist
andtorch.utils.data.get_worker_info()