MitoEM Dataset: Large-Scale 3D Mitochondria Instance Segmentation from EM Images
Open accessAbstract
Electron microscopy (EM) allows the identification of intracellular organelles such as mitochondria, providing insights for clinical and scientific studies. However, public mitochondria segmentation datasets only contain hundreds of instances with simple shapes. It is unclear if existing methods achieving human-level accuracy on these small datasets are robust in practice. To this end, we introduce the MitoEM dataset, a 3D mitochondria instance segmentation dataset with two (30 μ m)3 volumes from human and rat cortices respectively, 3, 600× larger than previous benchmarks. With around 40K instances, we find a great diversity of mitochondria in terms of shape and density. For evaluation, we tailor the implementation of the average precision (AP) metric for 3D data with a 45× speedup. On MitoEM, we find existing instance segmentation methods often fail to correctly segment mitochondria with complex shapes or close contacts with other instances. Thus, our MitoEM dataset poses new challenges to the field. We release our code and data: https://donglaiw.github.io/page/mitoEM/index.html.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
SynapseMNIST3D is a new 3D volume dataset to classify whether a synapse is excitatory or inhibitory, using a 3D image volume of an adult rat acquired by a multi-beam scanning electron microscope.
“The SynapseMNIST3D is a new 3D volume dataset to classify whether a synapse is excitatory or inhibitory. It uses a 3D image volume of an adult rat acquired by a multi-beam scanning electron microscope.”
From MedMNIST v2 - A large-scale lightweight benchmark for 2D and 3D biomedical image classification (2023) · cites this paper as [37]
The Dataset Acquisition section (page unavailable) says the adult-rat tissue used for MitoEM-R was imaged with a multi-beam scanning electron microscope. But the Introduction identifies MitoEM as a 3D mitochondria instance-segmentation dataset; our copy does not identify SynapseMNIST3D or describe excitatory-versus-inhibitory synapse classification. (LLM, conf=0.88)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404 · see citing works
Dense connectomic reconstruction in layer 4 of the somatosensory cortex
Motta, A., Berning, M., Boergens, K. M., Staffler, B., Beining, M., Loomba, S., Hennig, P., Wissler, H., & Helmstaedter, M. (2019) · Science · doi:10.1126/science.aay3134 · Cited by 333 · see citing works
Automated synaptic connectivity inference for volume electron microscopy
Dorkenwald, S., Schubert, P. J., Killinger, M. F., Urban, G., Mikula, S., Svara, F., & Kornfeld, J. (2017) · Nature Methods · doi:10.1038/nmeth.4206 · Cited by 132 · see citing works
Flagged first, then by citations
Research works printed but not linked: 32
- [2]Beier T, Pape C, Rahaman N, Prange T, Berg S, Bock DD, Cardona A, Knott GW, Plaza SM, Scheffer LK,: Multicut brings automated neurite segmentation closer to human performance. Nature methods 14(2) (2017) 28139671
- [3]Chen H, Qi X, Yu L, Heng PA: DCAN: deep contour-aware networks for accurate gland segmentation In: CVPR. pp. 2487– 2496. IEEE (2016)
- [4]Cheng HC, Varshney A: Volume segmentation using convolutional neural networks with limited training data In: ICIP. pp. 590– 594. IEEE (2017)
- [5]Çiçek Ö, Abdulkadir A, Lienkamp SS, Brox T, Ronneberger O: 3d u-net: learning dense volumetric segmentation from sparse annotation In: MICCAI. pp. 424– 432. Springer (2016)
- [6]Ciresan D, Giusti A, Gambardella LM, Schmidhuber J: Deep neural networks segment neuronal membranes in electron microscopy images. In: NeurIPS. pp. 2843– 2851 (2012)
- [7]Cousty J, Bertrand G, Najman L, Couprie M: Watershed cuts: Minimum spanning forests and the drop of water principle. TPAMI 31, 1362– 1374 (2008) 19542572
- [9]Funke J, Tschopp F, Grisaitis W, Sheridan A, Singh C, Saalfeld S, Turaga SC: Large scale image segmentation with structured loss based deep learning for connectome reconstruction. TPAMI 41(7), 1669– 1680 (2018) 29993708
- [10]He K, Gkioxari G, Dollár P, Girshick R: Mask r-cnn In: ICCV. pp. 2961– 2969. IEEE (2017) 29994331
- [11]Jain V, Turaga SC, Briggman K, Helmstaedter MN, Denk W, Seung HS: Learning to agglomerate superpixel hierarchies In: NeurIPS. pp. 648– 656 (2011)
- [12]Januszewski M, Kornfeld J, Li PH, Pope A, Blakely T, Lindsey L, Maitin-Shepard J, Tyka M, Denk W, Jain V: High-precision automated reconstruction of neurons with flood-filling networks. Nature Methods (2018) 30013046
- [13]Kasahara T, Takata A, Kato T, Kubota-Sakashita M, Sawada T, Kakita A, Mizukami H, Kaneda D, Ozawa K, Kato T: Depression-like episodes in mice harboring mtdna deletions in paraventricular thalamus. Molecular psychiatry (2016) PMC5414076 26481320
- [14]Krasowski N, Beier T, Knott G, Köthe U, Hamprecht FA, Kreshuk A: Neuron segmentation with high-level biological priors. TMI 37(4) (2017) 28600240
- [15]Lee K, Zung J, Li P, Jain V, Seung HS: Superhuman accuracy on the snemi3d connectomics challenge. arXiv:1706.00120 (2017) · arXiv
- [16]Lin TY, Maire M, Belongie S, Hays J, Perona P, Ramanan D, Dollár P, Zitnick CL: Microsoft coco: Common objects in context In: ECCV. pp. 740– 755. Springer (2014)
- [17]Liu J, Li W, Xiao C, Hong B, Xie Q, Han H: Automatic detection and segmentation of mitochondria from sem images using deep neural network In: EMBC. IEEE (2018) 30440475
- [18]Lucchi A, Li Y, Smith K, Fua P: Structured image segmentation using kernelized features In: ECCV. Springer (2012)
- [19]Lucchi A, Márquez-Neila P, Becker C, Li Y, Smith K, Knott G, Fua P: Learning structured models for segmentation of 2-d and 3-d imagery. TMI 34(5), 1096– 1110 (2014) 25438309
- [20]Lucchi A, Smith K, Achanta R, Knott G, Fua P: Supervoxel-based segmentation of mitochondria in em image stacks with learned shape features. TMI 31(2), 474– 486 (2011) 21997252
- [21]Meirovitch Y, Mi L, Saribekyan H, Matveev A, Rolnick D, Shavit N: Cross-classification clustering: An efficient multi-object tracking technique for 3-d instance segmentation in connectomics In: CVPR. IEEE (2019)
- [23]Nunez-Iglesias J, Kennedy R, Parag T, Shi J, Chklovskii DB: Machine learning of hierarchical clustering to segment 2d and 3d images. PloS one (2013) PMC3748125 23977123
- [26]Schubert PJ, Dorkenwald S, Januszewski M, Jain V, Kornfeld J: Learning cellular morphology with neural networks. Nature communications (2019) PMC6588634 31227718
- [27]Smith K, Carleton A, Lepetit V: Fast ray features for learning irregular shapes In: ICCV. IEEE (2009)
- [28]Turaga SC, Briggman KL, Helmstaedter M, Denk W, Seung HS: Maximin affinity learning of image segmentation. In: NeurIPS. pp. 1865– 1873 (2009)
- [29]Vazquez-Reina A, Gelbart M, Huang D, Lichtman J, Miller E, Pfister H: Segmentation fusion for connectomics In: ICCV. IEEE (2011)
- [30]Xiao C, Chen X, Li W, Li L, Wang L, Xie Q, Han H: Automatic mitochondria segmentation for em data using a 3d supervised convolutional network. Frontiers in neuroanatomy 12, 92 (2018) 30450040 PMC6224513
- [31]Xu N, Yang L, Fan Y, Yue D, Liang Y, Yang J, Huang T: Youtube-vos: A large-scale video object segmentation benchmark In: ECCV. Springer (2018)
- [32]Xu Y, Li Y, Wang Y, Liu M, Fan Y, Lai M, Eric I, Chang C: Gland instance segmentation using deep multichannel neural networks. Transactions on Biomedical Engineering 64(12), 2901– 2912 (2017) 28358671
- [33]Yan Z, Yang X, Cheng KTT: A deep model with shape-preserving loss for gland instance segmentation In: MICCAI. pp. 138– 146. Springer (2018)
- [34]Zeng T, Wu B, Ji S: Deepem3d: approaching human-level performance on 3d anisotropic em image segmentation. Bioinformatics 33(16), 2555– 2562 (2017) 28379412 PMC6248556
- [35]Zeviani M, Di Donato S: Mitochondrial disorders. Brain 127(10) (2004) 15358637
- [36]Zhang L, Trushin S, Christensen TA, Bachmeier BV, Gateno B, Schroeder A, Yao J, Itoh K, Sesaki H, Poon WW, Gylys K: Altered brain energetics induces mitochondrial fission arrest in alzheimer’s disease. Scientific reports 6, 18725 (2016) 26729583 PMC4700525
- [37]Zlateski A, Seung HS: Image segmentation by size-dependent single linkage clustering of a watershed basin graph. arXiv:1505.00249 (2015) · arXiv
Cited by
Sorted by citations
MedMNIST v2 - A large-scale lightweight benchmark for 2D and 3D biomedical image classification
Yang, J., Shi, R., Wei, D., Liu, Z., Zhao, L., Ke, B., Pfister, H., & Ni, B. (2023) · Scientific Data · doi:10.1038/s41597-022-01721-8 · Cited by 1,043 · see citing works
“The original data is of the size 100 × 100 × 100 um 3 and the resolution 8 × 8 × 30 nm 3 , where a ( 30 um ) 3 sub-volume was used in the MitoEM dataset 37 with dense 3D mitochondria instance segmentation labels.”
MethodSelf-citationCAVE: Connectome Annotation Versioning Engine
Dorkenwald, S., Schneider-Mizell, C. M., Brittain, D., Halageri, A., Jordan, C., Kemnitz, N., Castro, M. A., Silversmith, W., Maitin-Shephard, J., Troidl, J., et al. (2023) · doi:10.1101/2023.07.26.550598 · Cited by 79 · see citing works
Self-citation
- Authors
- Wei, D., Lin, Z., Franco-Barranco, D., Wendt, N., Liu, X., Yin, W., Huang, X., Gupta, A., Jang, W.-D., Wang, X., Arganda-Carreras, I., Lichtman, J. W., & Pfister, H.
- Affiliations
- Harvard University (US)
- University of the Basque Country (ES)
- Technical University of Munich (DE)
- Shanghai Jiao Tong University (CN)
- Northeastern University (US)
- Indian Institute of Technology Roorkee (IN)
- Corresponding author
- Wei, Donglai
- ORCID
- Venue
- Lecture Notes in Computer Science
- Publisher
- Springer International Publishing
- Published
- 2020
- Volume
- 12265
- Pages
- 66-76
- ISSN
- 0302-9743 (ISSN-L)
- 1611-3349
- PMC
- PMC7713709
- OpenAlex
- W3089720110
- Cited by
- 105
- References
- 3
- Citations by year
- 2026: 9 · 2025: 20 · 2024: 18 · 2023: 23 · 2022: 20 · 2021: 13 · 2020: 1
- FWCI
- 36.16
- Type
- conference paper
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Lecture notes in computer science (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Cancer Institute (U54CA225088)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Biophysics › Cell Image Analysis Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Medical Image Segmentation Techniques
- Keywords
- mitochondria, instance segmentation, 3D segmentation, electron microscopy images, cortical tissue, intracellular organelles, benchmark dataset
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review