Class WorkStealing

Declaration

Methods

• ▷ def __init__(self, scheduler)

  source link
• ▶ def add_worker(self, scheduler=None, worker=None) override

  inherited doc Run when a new worker enters the cluster

  source link

  This method overrides distributed.diagnostics.plugin.SchedulerPlugin.add_worker.

• ▷ def balance(self)

  source link
• ▷ def log(self) @property

  @property
  def log(self)

  source link
• ▷ def move_task_request(self, ts, victim, thief)

  source link
• ▷ def put_key_in_stealable(self, ts)

  source link
• ▷ def remove_key_from_stealable(self, ts)

  source link
• ▶ def remove_worker(self, scheduler=None, worker=None) override

  inherited doc Run when a worker leaves the cluster

  source link

  This method overrides distributed.diagnostics.plugin.SchedulerPlugin.remove_worker.

• ▶ def restart(self, scheduler) override

  inherited doc Run when the scheduler restarts itself

  source link

  This method overrides distributed.diagnostics.plugin.SchedulerPlugin.restart.

• ▶ def steal_time_ratio(self, ts)

  The compute to communication time ratio of a key

  source link

  Returns

  • The increased cost from moving this task as a factor.
• ▷ def story(self, *keys)

  source link
• ▷ def teardown(self)

  source link
• ▶ def transition(self, key, start, finish, compute_start=None, compute_stop=None, *args, **kwargs) override

  inherited doc Run whenever a task changes state

  source link

  This method overrides distributed.diagnostics.plugin.SchedulerPlugin.transition.

  Parameters

  • key : string
  • start : string
    

    Start state of the transition.
    One of released, waiting, processing, memory, error.

  • finish : string
    

    Final state of the transition.

  • *args, **kwargs : More options passed when transitioning
    

    This may include worker ID, compute time, etc.

Inherited methods

• Methods inherited from distributed.diagnostics.plugin.SchedulerPlugin:
  add_client, remove_client, update_graph

Reexports

• Imported in distributed.scheduler.

Generated by nedoc v0.9 at 2020-12-29 14:05