The following terms and conditions outline the rules and regulations for the use of Rankings Reloaded. By accessing this website, we assume that you accept the terms and conditions. Do not continue to use the website if you do not accept all of the terms and conditions.
The purpose of the web version is to perform an analysis on the given challenge and / or benchmarking assessment data. Specified ranking schemes will be applied, uncertainty analysis can optionally be performed and several plots will be computed as described in Wiesenfarth et al. 2021. The analysis and plots will be integrated in a report(pdf, html or docx file) that can be downloaded from the web toolkit as well as optionally the plots as single files(pdf, png or jpeg files). The output files can either be downloaded directly or can be sent to an optionally given email address.
The assessment data will be uploaded to the web toolkit in form of a CSV file including performance measure values for participating algorithms of a challenge for different test cases and optionally for different challenge tasks. Values in the different columns of the assessment data will be included in the final report and figures as appearing in the CSV file.
In order to create the outputs as described above, the assessment data in the format of a CSV file will be uploaded to a DKFZ server in order to be processed by the original challengeR toolkit. Before continuing, please read and accept the Data Protection Policy.
After completing the process of the toolkit, all data will be deleted from the server.
Developers of the challengeR toolkit as described in the ‘Developers’ Section of the web toolkit(staff of the Division of Computer Assisted Medical Interventions(CAMI) and the Division of Biostatistics of the German Cancer Research Center(DKFZ)) and members of the DKFZ IT core facility will be able to view and process the uploaded challenge assessment data as described above. The generation of reports and figures will happen automatically, unless staff input is required.
If you do not agree to the privacy policy and the data protection policy, the use of the web version of challengeR is not possible.
For the usage of Rankings Reloaded (web version of the challengeR) toolkit, we need the following data:
1. The results of a validation study in the form of a CSV file including participating algorithm identifiers, performance measure values for given cases and optionally different tasks. We refer to this data as assessment data.
2. A PDF title that may include the name of the validation study.
3. Optionally, an email address can be provided that can be used to receive the output files as described in Privacy Policy, section 1.
All data as described in section 1 will be deleted in 24 hours after completing the process of the challengeR toolkit. Furthermore, a withdrawal of consent is possible at any time and implicates the immediate termination of the process, including the deletion of all data as described in section 1.
Any transfer of your data to third parties as described in the Privacy Policy, section 2 (with the exception of the persons described in the Privacy Policy, section 2) may only be carried out with your express consent.
If you do not agree to the privacy policy and the data protection policy, the use of Rankings Reloaded is not possible.
I agree to the collection of my data as described in section 1. The consent is voluntary, and I was informed that the use of Rankings Reloaded is not possible without consent. The data described in section 1 are processed exclusively by the persons as described in Privacy Policy, section 2. The storing, readout, request and similar processing of data is organized by the DKFZ IT infrastructure hosting the server. In case of a challenge, I ensure that the participating algorithms have been informed that their team identifiers will appear in the assessment data and uploaded to Rankings Reloaded.
I am aware that the developers can view and process my data in case of assistance and potential implementation errors (Privacy Policy, section 2). The data are accessed in order to create the analysis and visualization techniques in form of a report and optionally single figures that can be downloaded at the end. The data may also be processed for scientific analyses and publications as described in Privacy Policy, sections 1 and 2.