Challenges
Every year, hundreds of new algorithms are published in the field of biomedical image analysis. For a long time, validation and evaluation of new methods was based on the authors’ personal data sets, rendering fair and direct comparison of solutions impossible. In the meantime, common research practice has changed and involves organization of international competitions (‘challenges’) that allow for benchmarking algorithms on publicly released data sets. While this was a great step forward, “advancement of science requires continuous examination of the principles and practices by which the research community operates” [1]. After 10 years of grand biomedical challenges at MICCAI, we have carefully analyzed and critically questioned common practice related to the design and organization of biomedical challenges [2,3]. Given this analysis, the mission of the MICCAI challenge working group is to bring MICCAI challenges to the next level of quality.
Working group composition
The MICCAI challenge working group was founded in summer 2018 and has the following active members:
Lena Maier-Hein (Chair)
Division of Computer Assisted Medical Interventions (CAMI), German Cancer Research Center (DKFZ), Heidelberg, Germany Read more
Anne Martel
Department of Medical Biophysics, University of Toronto, Ontario, Canada, Physical Sciences, Sunnybrook Research Institute, Toronto, Ontario, Canada Read more
Michal Kozubek
Centre for Biomedical Image Analysis, Masaryk University, Brno, Czech Republic Read more
Spyridon (Spyros) Bakas
Center for Biomedical Image Computing & Analytics (CBICA), Perelman School of Medicine, University of Pennsylvania, Philadelphia, US Read more
Bennett Landman
Electrical Engineering, Vanderbilt University, Nashville, Tennessee, USA Read more
Annette Kopp-Schneider
Division of Biostatistics, German Cancer Research Center (DKFZ), Heidelberg, Germany Read more
Annika Reinke
Division of Computer Assisted Medical Interventions (CAMI), German Cancer Research Center (DKFZ), Heidelberg, Germany Read more