Cross-Classification Clustering: An Efficient Multi-Object Tracking Technique for 3-D Instance Segmentation in Connectomics
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Pixel-accurate tracking of objects is a key element in many computer vision applications, often solved by iterated individual object tracking or instance segmentation followed by object matching. Here we introduce cross-classification clustering (3C), a technique that simultaneously tracks complex, interrelated objects in an image stack. The key idea in cross-classification is to efficiently turn a clustering problem into a classification problem by running a logarithmic number of independent classifications per image, letting the cross-labeling of these classifications uniquely classify each pixel to the object labels. We apply the 3C mechanism to achieve state-of-the-art accuracy in connectomics - the nanoscale mapping of neural tissue from electron microscopy volumes. Our reconstruction system increases scalability by an order of magnitude over existing single-object tracking methods (such as flood-filling networks). This scalability is important for the deployment of connectomics pipelines, since currently the best performing techniques require computing infrastructures that are beyond the reach of most laboratories. Our algorithm may offer benefits in other domains that require pixel-accurate tracking of multiple objects, such as segmentation of videos and medical imagery.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Connectomic reconstruction of the inner plexiform layer in the mouse retina
Helmstaedter, M., Briggman, K. L., Turaga, S. C., Jain, V., Seung, H. S., & Denk, W. (2013) · Nature · doi:10.1038/nature12346 · Cited by 997
Space–time wiring specificity supports direction selectivity in the retina
EyeWirers, T., Kim, J. S., Greene, M. J., Zlateski, A., Lee, K., Richardson, M., Turaga, S. C., Purcaro, M., Balkam, M., Robinson, A., et al. (2014) · Nature · doi:10.1038/nature13240 · Cited by 450
Object Detection from Video Tubelets with Convolutional Neural Networks
Kang, K., Ouyang, W., Li, H., & Wang, X. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.95 · Cited by 386 · cited 1×
“Object tracking is an important and extensively studied component in many computer vision applications [1, 13, 14, 16, 23, 54, 57, 59].”
BackgroundHigh-precision automated reconstruction of neurons with flood-filling networks
Januszewski, M., Kornfeld, J., Li, P. H., Pope, A., Blakely, T., Lindsey, L., Maitin-Shepard, J., Tyka, M., Denk, W., & Jain, V. (2018) · Nature Methods · doi:10.1038/s41592-018-0049-4 · Cited by 380
Convolutional Networks Can Learn to Generate Affinity Graphs for Image Segmentation
Turaga, S. C., Murray, J. F., Jain, V., Roth, F., Helmstaedter, M., Briggman, K., Denk, W., & Seung, H. S. (2010) · Neural Computation · doi:10.1162/neco.2009.10-08-881 · Cited by 376 · cited 1×
“D and then gradually agglomerating information to form the final objects [6, 9, 20, 27, 31, 34, 35, 52].”
BackgroundSynaptic circuits and their variations within different columns in the visual system of Drosophila
Takemura, S.-Y., Xu, C. S., Lu, Z., Rivlin, P. K., Parag, T., Olbris, D. J., Plaza, S., Zhao, T., Katz, W. T., Umayam, L., et al. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1509820112 · Cited by 264 · cited 3×
“Although 3C and FFN invoke FCNs a logarithmic versus a linear number of times, respectively, FFN runs on We computed the number of times a pixel is participating in object detection (red) for two public datasets (SNEMI3D, FlyEM), and compared to the number of classification calls in 3C. smaller inputs, centered around…”
MethodInfluential
Cited by
Connectomes across development reveal principles of brain maturation
Witvliet, D., Mulcahy, B., Mitchell, J. K., Meirovitch, Y., Berger, D. R., Wu, Y., Liu, Y., Koh, W. X., Parvathala, R., Holmyard, D., et al. (2021) · Nature · doi:10.1038/s41586-021-03778-8 · Cited by 393
Self-citationMitoEM Dataset: Large-Scale 3D Mitochondria Instance Segmentation from EM Images
Wei, D., Lin, Z., Franco-Barranco, D., Wendt, N., Liu, X., Yin, W., Huang, X., Gupta, A., Jang, W.-D., Wang, X., et al. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-59722-1_7 · Cited by 105
“In the other methodology, CNNs are trained recursively to grow the current estimate of a single segmentation mask [12], which is extended to handle multiple objects [21].”
MethodMulti-layered maps of neuropil with segmentation-guided contrastive learning
Dorkenwald, S., Li, P. H., Januszewski, M., Berger, D. R., Maitin-Shepard, J., Bodor, A. L., Collman, F., Schneider-Mizell, C. M., da Costa, N. M., Lichtman, J. W., et al. (2023) · Nature Methods · doi:10.1038/s41592-023-02059-8 · Cited by 30
Metadata
- Authors
- Meirovitch, Y., Mi, L., Saribekyan, H., Matveev, A., Rolnick, D., & Shavit, N.
- Venue
- 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2019-06
- Pages
- 8417-8427
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2903162698
- Cited by
- 39
- References
- 7
- FWCI
- 14.61
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Cross-Classification Clustering: An Efficient Multi-Object Tracking Technique for 3-D Instance Segmentation in Connectomics. https://app.cochat.ai/papers/10.1109/cvpr.2019.00862
- The paper
- Meirovitch, Y., Mi, L., Saribekyan, H., Matveev, A., Rolnick, D., & Shavit, N. (2019). Cross-Classification Clustering: An Efficient Multi-Object Tracking Technique for 3-D Instance Segmentation in Connectomics. 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). https://doi.org/10.1109/cvpr.2019.00862
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.