Skip to main content
Not every worker answered before the deadline. A subclass of TimeoutError raised by DistributedRunner.
Development preview. See availability.
Startup uses start_timeout. Generation and reset use call_timeout. Check the expected execution time and whether all ranks enter the same collectives. The runner refuses further calls. Call shutdown() before constructing a replacement. A longer timeout does not fix a rank waiting for a peer that cannot participate.