MitoEM Challenge: Large-scale 3D Mitochondria Instance Segmentation

This challenge is part of ISBI 2021taking place on April 13-16th, 2021.  The top teams will be invited for writing an overview paper after the challenge. More information about the MitoEM dataset can be found in our MICCAI 2020 paper.  We keep the online evaluation open for new submissions, but only results submitted before March 1, 2021, are considered for the ISBI challenge workshop.

[Important Note!] For online evaluations after March 2, 2022, we will use "MitoEM-v2" where we corrected some data annotation errors after the ISBI challenge (MitoEM-v1). The screenshot of the MitoEM-v1 leaderboard is kept only for reference.


Explore it in your browser! [MitoEM-H], [MitoEM-R]

(navigation tips: [manual] [youtube video])


Task

The task is the 3D mitochondria instance segmentation on two 30x30x30 um datasets, 1000x4096x4096 in voxels at 30x8x8 nm resolution. The image volumes are acquired from a rat (Mito-R) and a human (Mito-H) tissue, respectively. The mitochondria can display a complex morphology, e.g., (a) mitochondria-on-a-string (MOAS) instances are connected by thin microtubules, and (b) multiple instances can entangle with each other.


Dataset

All the mitochondria instances in the ground-truth annotation are at least 2,000 voxels. The annotation is not perfect. Please email linzudi@g.harvard.edu the (x,y,z) location of erroneous segmentation to refine it together. The subject of the email: "[MitoEM Error]"


Starter code

  • Deep learning baseline method: [link]
  • Submission utility functions: [link]


Important Changes

We changed the evaluation metric from AP-75 to F1 after a complete analysis of the submissions (more detail is the evaluation page). We are finishing the MitoEM competition review paper explaining the motivation behind the change, a deep study of errors and challenges of this dataset that remain open to the community.


Important Dates

  • 01 Nov 2020: Challenge Website Launch
  • 08 Nov 2020: Registration open
  • 26 Nov 2020: Training/Val/Test Data Release (Images + Training/Val Ground truth)
  • 28 Feb 2021: Test set results submission deadline.
  • 10 Mar 2021: 4-page Paper submission deadline for top-performing teams.
  • 15 Mar 2021: Off-site leaderboard update and call for participation of top-performing teams (subjected to ISBI registration)
  • 18 Mar 2021: ISBI registration deadline
  • 20 Mar 2021: Final Off-site leaderboard update and the display of top teams upon participation confirmation.
  • 13 April 2021: On-site challenge at ISBI 2021.



Number of participants: 253



Citation

@inproceedings{wei2020mitoem,
  title={MitoEM Dataset: Large-scale 3D Mitochondria Instance Segmentation from EM Images},
  author={D. Wei, Z. Lin, D. Barranco, N. Wendt, X. Liu, W. Yin, X. Huang, A. Gupta,
W. Jang, X. Wang, I. Arganda-Carreras, J. Lichtman, H. Pfister}, booktitle={International Conference on Medical Image Computing and Computer Assisted Intervention}, year={2020} }

Organizing committee