Frequently Asked Questions

How are the methods evaluated?
The evaluation framework (data, reference standard, measures, scores and ranking) is described in this document.

I have downloaded the data. How do I read it?
Read the data format section on the about page.

What's the submission format
Read the submssion format section on the about page.

Why can't I download the reference segmentation for the test data and perform the evaluation myself?
From our previous experiences with making data sets publicly available we have learned that if we would release the 'truth' for the test data, groups would perform slightly or vastly different types of evaluations. This may lead to incomparable results between papers that have used the same data. To avoid this, we decided on the current procedure, which makes sure that each system is evaluated in exactly the same way.

I have lost the password of my registered team. What should I do?
Send an e-mail to Coert Metz ( or Michiel Schaap ( A password reminder will be mailed to the e-mail address provided with the registered team.

What to do if I have further questions?
Send an e-mail to one of the organizers.