You may refer to the article below:

Maier-Hein, L., Eisenmann, M., Reinke, A. et al. Why rankings of biomedical image analysis competitions should be interpreted with care. Nat Commun 9, 5217 (2018). https://doi.org/10.1038/s41467-018-07619-7

You may get details of the challengeR from its published article:

Wiesenfarth, M., Reinke, A., Landman, B.A., Eisenmann, M., Aguilera Saiz, L., Cardoso, M.J., Maier-Hein, L. and Kopp-Schneider, A. Methods and open-source toolkit for analyzing and visualizing challenge results. Sci Rep 11, 2369 (2021). https://doi.org/10.1038/s41598-021-82017-6

The processing time for report generation can be longer depending on the size of the data (e.g., size of cases or algorithms). If selected, bootstrapping may also increase the time burden. Please do not close the window while waiting for your report to be generated.

Yes, you may download challengeR from its source: https://github.com/wiesenfa/challengeR. Please keep in mind that you need to install R with necessary libraries before using it. You may follow the README-page of challengeR.

Yes, you can! You may access the source code of challengeR from: https://github.com/wiesenfa/challengeR challengeR is available under license GPLv2 or any later version.

All users must accept the terms of use and data consent in order to meet The General Data Protection Regulation (EU) 2016/679 (GDPR) law.