Average Rank

Average Rank Assessment

class orion.benchmark.assessment.averagerank.AverageRank(repetitions=1)[source]

Evaluate the average performance (objective value) between different search algorithms from the rank perspective at different time steps (trial number). The performance (objective value) used for a trial will the best result until the trial.

Methods

analysis(task, experiments)

Generate a plotly.graph_objects.Figure to display average rankings between different search algorithms.

analysis(task, experiments)[source]

Generate a plotly.graph_objects.Figure to display average rankings between different search algorithms.

task: str

Name of the task

experiments: list

A list of (task_index, experiment), where task_index is the index of task to run for this assessment, and experiment is an instance of orion.core.worker.experiment.