Local shape descriptors for neuron segmentation
Open accessPublished version of a preprint
The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
We present an auxiliary learning task for the problem of neuron segmentation in electron microscopy volumes. The auxiliary task consists of the prediction of local shape descriptors (LSDs), which we combine with conventional voxel-wise direct neighbor affinities for neuron boundary detection. The shape descriptors capture local statistics about the neuron to be segmented, such as diameter, elongation, and direction. On a study comparing several existing methods across various specimen, imaging techniques, and resolutions, auxiliary learning of LSDs consistently increases segmentation accuracy of affinity-based methods over a range of metrics. Furthermore, the addition of LSDs promotes affinity-based segmentation methods to be on par with the current state of the art for neuron segmentation (flood-filling networks), while being two orders of magnitudes more efficient—a critical requirement for the processing of future petabyte-sized datasets.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation
Çiçek, Ö., Abdulkadir, A., Lienkamp, S. S., Brox, T., & Ronneberger, O. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46723-8_49 · Cited by 7,945 · cited 9×
“VoI measures the disagreement between two segmentations in terms of the average number of bits needed to guess the segment ID of a randomly chosen voxel in one segmentation, given only its label in the other segmentation.”
InfluentialThe structure of the nervous system of the nematode Caenorhabditis elegans
White, J. G., Southgate, E., Thomson, J. N., & Brenner, S. (1986) · Philosophical Transactions of the Royal Society of London. B, Biological Sciences · doi:10.1098/rstb.1986.0056 · Cited by 5,589
A connectome and analysis of the adult Drosophila central brain
Scheffer, L. K., Xu, C. S., Januszewski, M., Lu, Z., Takemura, S.-Y., Hayworth, K. J., Huang, G. B., Shinomiya, K., Maitlin-Shepard, J., Berg, S., et al. (2020) · eLife · doi:10.7554/elife.57443 · Cited by 1,128 · cited 3×
“LSDs are 10-dimensional vectors, computed for each voxel, which encode local object properties.”
Self-citationA Complete Electron Microscopy Volume of the Brain of Adult Drosophila melanogaster
Zheng, Z., Lauritzen, J. S., Perlman, E., Robinson, C. G., Nichols, M., Milkie, D., Torrens, O., Price, J., Fisher, C. B., Sharifi, N., et al. (2018) · Cell · doi:10.1016/j.cell.2018.06.019 · Cited by 1,050 · cited 2×
“Larval tissue averages ∼ 13.7 hours per millimeter (Schneider-Mizell et al., 2016), which is comparable to tracing speeds in the Drosophila dataset, (Zheng et al., 2018) due to the challenging nature of invertebrate neuropil.”
InfluentialSelf-citationHulse, B. K., Haberkern, H., Franconville, R., Turner-Evans, D. B., Takemura, S., Wolff, T., Noorman, M., Dreher, M., Dan, C., Parekh, R., et al. (2020) · doi:10.1101/2020.12.08.413955 · Cited by 392 · cited 1×
“However, this method is slower than serial section approaches.”
Hulse, B. K., Haberkern, H., Franconville, R., Turner-Evans, D., Takemura, S.-Y., Wolff, T., Noorman, M., Dreher, M., Dan, C., Parekh, R., et al. (2021) · eLife · doi:10.7554/elife.66039 · Cited by 392
Convolutional Networks Can Learn to Generate Affinity Graphs for Image Segmentation
Turaga, S. C., Murray, J. F., Jain, V., Roth, F., Helmstaedter, M., Briggman, K., Denk, W., & Seung, H. S. (2010) · Neural Computation · doi:10.1162/neco.2009.10-08-881 · Cited by 376
Self-citationDense connectomic reconstruction in layer 4 of the somatosensory cortex
Motta, A., Berning, M., Boergens, K. M., Staffler, B., Beining, M., Loomba, S., Hennig, P., Wissler, H., & Helmstaedter, M. (2019) · Science · doi:10.1126/science.aay3134 · Cited by 333 · cited 3×
“These wiring diagrams provide insight into the inner mechanisms underlying behavior and help drive future theoretical experiments (Schneider-Mizell et al., 2016; Motta et al., 2019; Bates et al., 2020; Hulse et al., 2020).”
Quantitative neuroanatomy for connectomics in Drosophila
Schneider-Mizell, C. M., Gerhard, S., Longair, M., Kazimiers, T., Li, F., Zwart, M. F., Champion, A., Midgley, F. M., Fetter, R. D., Saalfeld, S., et al. (2016) · eLife · doi:10.7554/elife.12059 · Cited by 332
Self-citationFlyWire: online community for whole-brain connectomics
Dorkenwald, S., McKellar, C. E., Macrina, T., Kemnitz, N., Lee, K., Lu, R., Wu, J., Popovych, S., Mitchell, E., Nehoran, B., et al. (2022) · Nature Methods · doi:10.1038/s41592-021-01330-0 · Cited by 289 · cited 3×
“We further investigated how VOI and ERL relate to proof-reading effort given the capabilities of contemporary proof-reading tools (Zhao et al., 2018; Dorkenwald et al., 2022) and found that VOI is a considerably more reliable proxy for proof-reading effort than ERL (see Figure 3B, 3D, Figure 18, and…”
Research works printed but not linked: 23
- Bates, A. S. et al. Complete connectomic reconstruction of olfactory projection neurons in the fly brain. Current Biology 30, 3183–3199 (2020). · DOI · Paper page
- Schlegel, P. et al. Synaptic transmission parallels neuromodulation in a central food-intake circuit. eLife 5, e16799 (2016). · DOI · Paper page
- Briggman, K. L. & Bock, D. D. Volume electron microscopy for neuronal circuit reconstruction. Curr. Opin. Neurobiol. 22, 154–161 (2012). · DOI · Paper page
- Lee, W.-C. A. et al. Anatomy and function of an excitatory network in the visual cortex. Nature 532, 370–374 (2016). · DOI · Paper page
- Schneider-Mizell, C. M. et al. Structure and function of axo-axonic inhibition. eLife 10, e73783 (2021). · DOI · Paper page
- Turner, N. L. et al. Multiscale and multimodal reconstruction of cortical structure and function. Preprint at bioRxiv https://doi.org/10.1101/2020.10.14.338681 (2020). · DOI · Paper page
- Kornfeld, J. et al. EM connectomics reveals axonal target variation in a sequence-generating network. eLife 6, e24364 (2017). · DOI · Paper page
- Yin, W. et al. A petascale automated imaging pipeline for mapping neuronal circuits with high-throughput transmission electron microscopy. Nat. Commun. 11, 4949 (2020). · DOI · Paper page
- Shapson-Coe, A. et al. A connectomic study of a petascale fragment of human cerebral cortex. Preprint at bioRxiv https://doi.org/10.1101/2021.05.29.446289 (2021). · DOI · Paper page
- Boergens, K. M. et al. webKnossos: efficient online 3D data annotation for connectomics. Nat. Methods 14, 691–694 (2017). · DOI · Paper page
- Lee, K., Zung, J., Li, P., Jain, V. and Seung, H. S. Superhuman accuracy on the SNEMI3d Connectomics Challenge. Preprint at arXiv https://doi.org/10.48550/arXiv.1706.00120 (2017). · arXiv · doi:10.48550/arxiv.1706.00120 · Paper page
- Kreshuk, A., Funke, J., Cardona, A. and Hamprecht, F. A. Who is talking to whom: synaptic partner detection in anisotropic volumes of insect brain. In Medical Image Computing and Computer-Assisted Intervention—MICCAI 2015 (eds Navab, N., Hornegger, J., Wells, W. M., & Frangi, A.) 661–668 (Springer, 2015). · DOI · Paper page
- Buhmann, J. et al. Synaptic partner prediction from point annotations in insect brains. In Medical Image Computing and Computer Assisted Intervention—MICCAI 2018 (eds Frangi, A. F., Schnabel, J. A., Davatzikos, C., Alberola-López, C. & Fichtinger, G.) 309–316 (Springer, 2018). · DOI · Paper page
- Januszewski, M. et al. High-precision automated reconstruction of neurons with flood-filling networks. Nature Methods 15, 605 (2018). · DOI · Paper page
- Funke, J. et al. Large scale image segmentation with structured loss based deep learning for connectome reconstruction. IEEE Trans. Pattern Anal. Mach. Intel. 41, 1669–1680 (2019). · DOI · Paper page
- Li, P. H. et al. Automated reconstruction of a serial-section EM Drosophila brain with flood-filling networks and local realignment. Microsc. Microanal. 25, 1364–1365 (2019). · DOI
- Maitin-Shepard, J. B., Jain, V., Januszewski, M., Li, P. and Abbeel, P. Combinatorial energy learning for image segmentation. In Advances in Neural Information Processing Systems (eds Lee, D. D., Sugiyama, M., Luxburg, U. V., Guyon, I. & Garnett, R.) (Curran Associates, 2016).
- Bai, M. and Urtasun, R. Deep watershed transform for instance segmentation. In 2017 IEEE Conference on Computer Vision and Pattern Recognition 5221–5229 (IEEE, 2017). · DOI · Paper page
- Plaza, S. M. and Funke, J. Analyzing image segmentation for connectomics. Front. Neural Circuits https://doi.org/10.3389/fncir.2018.00102 (2018). · DOI
- Zhao, T., Olbris, D. J., Yu, Y., and Plaza, S. M. NeuTu: software for collaborative, large-scale, segmentation-based connectome reconstruction. Front. Neural Circuits https://doi.org/10.3389/fncir.2018.00101 (2018). · DOI · Paper page
- Tu, Z. & Bai, X. Auto-context and its application to high-level vision tasks and 3D brain image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 32, 1744–1757 (2010). · DOI · Paper page
- Funke, J. et al. Large scale image segmentation with structured loss based deep learning for connectome reconstruction. IEEE Trans. Pattern Anal. Mach. Intell. 41, 1669–1680 (2019). · DOI · Paper page
- Januszewski, M. et al. High-precision automated reconstruction of neurons with flood-filling networks. Nat. Methods 15, 605 (2018). · DOI · Paper page
Cited by
Segment Anything for Microscopy
Archit, A., Freckmann, L., Nair, S., Khalid, N., Hilt, P., Rajashekar, V., Freitag, M., Teuber, C., Spitzner, M., Tapia Contreras, C., et al. (2025) · Nature Methods · doi:10.1038/s41592-024-02580-4 · Cited by 307
Eckstein, N., Bates, A. S., Champion, A., Du, M., Yin, Y., Schlegel, P., Lu, A. K.-Y., Rymer, T., Finley-May, S., Paterson, T., et al. (2024) · Cell · doi:10.1016/j.cell.2024.03.016 · Cited by 277
“In addition, recent advances in automated methods for segmenting neurons (Funke et al., 2018; Januszewski et al., 2018; Lee et al., 2019; Sheridan et al., 2022), detecting synapses (Kreshuk et al., 2015; Staffler et al., 2017; Buhmann et al., 2019; Huang et al., 2018) and proofreading (Dorkenwald…”
Self-citationEckstein, N., Bates, A. S., Champion, A., Du, M., Yin, Y., Schlegel, P., Lu, A. K.-Y., Rymer, T., Finley-May, S., Paterson, T., et al. (2020) · doi:10.1101/2020.06.12.148775 · Cited by 115
Self-citationNested neural circuits generate distinct acoustic signals during Drosophila courtship
Lillvis, J. L., Wang, K., Shiozaki, H. M., Xu, M., Stern, D. L., & Dickson, B. J. (2024) · Current Biology · doi:10.1016/j.cub.2024.01.015 · Cited by 59
Towards foundation models of biological image segmentation
Ma, J., & Wang, B. (2023) · Nature Methods · doi:10.1038/s41592-023-01885-0 · Cited by 57
Metadata
- Authors
- Sheridan, A., Nguyen, T. M., Deb, D., Lee, W.-C. A., Saalfeld, S., Turaga, S. C., Manor, U., & Funke, J.
- Venue
- Nature Methods
- Published
- 2022-12-30
- Volume
- 20
- Issue
- 2
- Pages
- 295-303
- ISSN
- 1548-7091 (ISSN-L)
- 1548-7105
- OpenAlex
- W4313339627
- Cited by
- 71
- References
- 20
- FWCI
- 5.46
- Type
- journal article
- Language
- en
- Open access
- hybrid
- Licence
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Funders
- Waitt Foundation (NCI CCSG (CA014195))
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Local shape descriptors for neuron segmentation. https://app.cochat.ai/papers/10.1038/s41592-022-01711-z
- The paper
- Sheridan, A., Nguyen, T. M., Deb, D., Lee, W.-C. A., Saalfeld, S., Turaga, S. C., Manor, U., & Funke, J. (2023). Local shape descriptors for neuron segmentation. Nature Methods. https://doi.org/10.1038/s41592-022-01711-z
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.