Base definition of assessments¶
Base definition of Assessment¶
-
class
orion.benchmark.assessment.base.
BaseAssess
(task_num, **kwargs)[source]¶ Base class describing what an assessment can do.
Parameters: - task_num : int
Number of experiment the assessment ask to run the corresponding task
- kwargs : dict
Configurable parameters of the assessment, a particular assessment implementation can have its own parameters.
Attributes: configuration
Return the configuration of the assessment.
task_num
Return the task number to run for this assessment
Methods
analysis
(task, experiments)Generate a plotly.graph_objects.Figure
to display the performance analysis based on the assessment purpose.-
analysis
(task, experiments)[source]¶ Generate a
plotly.graph_objects.Figure
to display the performance analysis based on the assessment purpose.- task: str
- Name of the task
- experiments: list
- A list of (task_index, experiment), where task_index is the index of task to run for
this assessment, and experiment is an instance of
orion.core.worker.experiment
.
-
configuration
¶ Return the configuration of the assessment.
-
task_num
¶ Return the task number to run for this assessment