Dask Executor

class orion.executor.dask_backend.Dask(n_workers=-1, client=None, **config)[source]

Wrapper around the dask client.

Warning

The Dask executor can be pickled and used inside a subprocess, the pickled client will use the main client that was spawned in the main process, but you cannot spawn clients inside a subprocess.

Attributes
in_worker

Methods

async_get(futures[, timeout])

Retrieve futures that completed, removes them from the list of pending futures and return their results

submit(function, *args, **kwargs)

Submit work to the executor for asynchronous execution

wait(futures)

Wait for all futures to complete execution.

async_get(futures, timeout=0.01)[source]

Retrieve futures that completed, removes them from the list of pending futures and return their results

Parameters
futures: `concurrent.futures.Futures` or equivalent interface

The objects returned by submit() of the executor.

timeout: int

time to wait before checking the other future

Returns
returns a list of results
submit(function, *args, **kwargs)[source]

Submit work to the executor for asynchronous execution

Parameters
function: a callable object

A function to be executed by the executor. The function must be serializable.

*args, **kwargs:

Arguments for the function. The arguments must be serializable.

wait(futures)[source]

Wait for all futures to complete execution.

Parameters
futures: `concurrent.futures.Futures` or equivalent interface

The objects returned by submit() of the executor.