Oríon's benchmark makes it easy to execute multiple hyperparameter optimization algorithms on several tasks. You can assess the average result over multiple runs of the algorithms or automatically benchmark how well they parallelize to large pools of workers. It quickly becomes difficult however to analyse all the data generated by these benchmarks, as large number of tasks and assessments can lead to hundreds of potential plots. It can also be challenging to track the progress of hundreds of experiments, each consisting of hundreds of trials. This dashboard serves as a centralized interface to visualize the results of the benchmarks and to monitor their progress.
This dashboard uses React and Carbon. You will need to install npm first, and then yarn.
npm insall --global yarnInstall all dependencies including Carbon.
yarnYou can start the server with
yarn startThe first time will take a few minutes while everything gets compiled. Next time will be faster.