Average Rank¶
Average Rank Assessment¶
- class orion.benchmark.assessment.averagerank.AverageRank(repetitions=1)[source]¶
Evaluate the average performance (objective value) between different search algorithms from the rank perspective at different time steps (trial number). The performance (objective value) used for a trial will the best result until the trial.
Methods
analysis
(task, experiments)Generate a
plotly.graph_objects.Figure
to display average rankings between different search algorithms.- analysis(task, experiments)[source]¶
Generate a
plotly.graph_objects.Figure
to display average rankings between different search algorithms.- task: str
Name of the task
- experiments: list
A list of (task_index, experiment), where task_index is the index of task to run for this assessment, and experiment is an instance of
orion.core.worker.experiment
.