all_gather_object#

composer.utils.dist.all_gather_object(obj)[source]#

Collect a pickleable object from each rank and return a list of these objects indexed by rank.

Parameters

obj (TObj) โ€“ Object to be gathered.

Returns

List[TObj] โ€“ A list of objects indexed by rank.