… you are organizing challenge/competition/benchmark:

Rankings Reloaded can help you analyze your challenge in depth. It provides comparisons of different ranking methods and visualizes ranking stability by using bootstrapping or statistical testing. It enables you to take comprehensive snapshots of your challenge results, rankings, and outcomes. You can use these in your publications and/or to improve your next challenge.

… you are running hyperparameter optimization:

Rankings Reloaded provides descriptive statistics and their visualization over all cases (images), for instance as dot- and box plots. Ranking heatmaps demonstrate the ranking stability across all cases in the dataset. These analyses can help you decide whether a new approach truly creates a positive impact compared to others.

… you want to compare different algorithms:

Rankings Reloaded robustly ranks your algorithm of interest with previously published ones (if their data can be provided individually) and provides visualizations in the form of dot- and box along with podium plots. In addition, you can compare all algorithms regarding different tasks if the dataset offers multiple tasks or modalities.