DistributedWorker

Extend DistributedWorker and implement load(), generate(), and reset(). Pass your worker class to DistributedRunner. The runner creates the workers and coordinates their calls. The base class declares typed rank, world_size, and device attributes for editor completion. It also provides is_leader for rank-0 checks.

Development preview. See availability.

from reactor_runtime.distributed import DistributedWorker


class MyWorker(DistributedWorker):
    def load(self, **kwargs):
        ...  # Load weights on self.device.

    def generate(self, input):
        ...  # Run inference and return the complete result on rank 0.

    def reset(self):
        ...  # Clear session state.

Attributes

The runner sets rank, world_size, and device before load(). The base class computes is_leader from rank:

Attribute	Type	Meaning
`rank`	`int`	This worker’s index, from `0` to `world_size - 1`.
`world_size`	`int`	The number of workers.
`device`	`str`	`cuda:<rank>` when CUDA is available, otherwise `cpu`.
`is_leader`	`bool`	A property that is true on rank 0. Provided by this base class.

Use is_leader for work that only rank 0 performs. Do not use it to skip collectives that require all ranks to participate. All ranks must enter matching collectives in the same order.

Required worker methods

Implement all three methods in your subclass:

Method	Responsibility
`load(**kwargs)`	Load weights and perform warmup in this worker. Receives the runner’s `load_kwargs`.
`generate(input)`	Compute one step from the input. All ranks run it. Return the complete result on rank 0.
`reset()`	Clear per-session state while retaining weights. Takes no arguments.

If ranks produce separate parts of the output, gather them onto rank 0 inside generate() before returning. The runner returns only rank 0’s result and does not assemble outputs from other ranks. The base implementations raise NotImplementedError. The worker needs a no-argument constructor. Keep client commands, tracks, and sessions in the application.

Get Started

CLI & Platform

Build a Model

Media & Transport

Releases

DistributedWorker

Attributes

Required worker methods

​Attributes

​Required worker methods

Attributes

Required worker methods