Dask Executor

class orion.executor.dask_backend.Dask(n_workers=-1, client=None, **config)

Wrapper around the dask client.

Warning

The Dask executor can be pickled and used inside a subprocess, the pickled client will use the main client that was spawned in the main process, but you cannot spawn clients inside a subprocess.

Attributes

in_worker

Methods

async_get(futures[, timeout])	Retrieve futures that completed, removes them from the list of pending futures and return their results
submit(function, *args, **kwargs)	Submit work to the executor for asynchronous execution
wait(futures)	Wait for all futures to complete execution.

async_get(futures, timeout=0.01)

Retrieve futures that completed, removes them from the list of pending futures and return their results

Parameters

futures: `concurrent.futures.Futures` or equivalent interface

The objects returned by submit() of the executor.

timeout: int

time to wait before checking the other future

Returns

returns a list of results

submit(function, *args, **kwargs)

Submit work to the executor for asynchronous execution

Parameters

function: a callable object

A function to be executed by the executor. The function must be serializable.

*args, **kwargs:

Arguments for the function. The arguments must be serializable.

wait(futures)

Wait for all futures to complete execution.

Parameters

futures: `concurrent.futures.Futures` or equivalent interface

The objects returned by submit() of the executor.