The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
FusionNet: A Deep Fully Residual Convolutional Neural Network for Image Segmentation in Connectomics
Open accessAbstract
Cellular-resolution connectomics is an ambitious research direction with the goal of generating comprehensive brain connectivity maps using high-throughput, nano-scale electron microscopy. One of the main challenges in connectomics research is developing scalable image analysis algorithms that require minimal user intervention. Deep learning has provided exceptional performance in image classification tasks in computer vision, leading to a recent explosion in popularity. Similarly, its application to connectomic analyses holds great promise. Here, we introduce a deep neural network architecture, FusionNet, with a focus on its application to accomplish automatic segmentation of neuronal structures in connectomics data. FusionNet combines recent advances in machine learning, such as semantic segmentation and residual neural networks, with summation-based skip connections. This results in a much deeper network architecture and improves segmentation accuracy. We demonstrate the performance of the proposed method by comparing it with several other popular electron microscopy segmentation methods. We further illustrate its flexibility through segmentation results for two different tasks: cell membrane segmentation and cell nucleus segmentation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Fiji: an open-source platform for biological-image analysis
Schindelin, J., Arganda-Carreras, I., Frise, E., Kaynig, V., Longair, M., Pietzsch, T., Preibisch, S., Rueden, C., Saalfeld, S., Schmid, B., et al. (2012) · Nature Methods · doi:10.1038/nmeth.2019 · Cited by 66,890
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
Fully convolutional networks for semantic segmentation
Shelhamer, E., Long, J., & Darrell, T. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2572683 · Cited by 11,898
3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation
Çiçek, Ö., Abdulkadir, A., Lienkamp, S. S., Brox, T., & Ronneberger, O. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46723-8_49 · Cited by 7,945
Image Style Transfer Using Convolutional Neural Networks
Gatys, L. A., Ecker, A. S., & Bethge, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.265 · Cited by 6,025
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1512.03385 · Cited by 4,196
Fully Convolutional Networks for Semantic Segmentation
Long, J., Shelhamer, E., & Darrell, T. J. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1411.4038 · Cited by 2,489
Going Deeper with Convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2014) · arXiv · doi:10.48550/arxiv.1409.4842 · Cited by 1,461
(2012) · neural information processing systems · Cited by 1,291
Ilastik: Interactive learning and segmentation toolkit
Sommer, C., Straehle, C., Kothe, U., & Hamprecht, F. A. (2011) · 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro · doi:10.1109/isbi.2011.5872394 · Cited by 1,125
A Complete Electron Microscopy Volume of the Brain of Adult Drosophila melanogaster
Zheng, Z., Lauritzen, J. S., Perlman, E., Robinson, C. G., Nichols, M., Milkie, D., Torrens, O., Price, J., Fisher, C. B., Sharifi, N., et al. (2018) · Cell · doi:10.1016/j.cell.2018.06.019 · Cited by 1,050
Saturated Reconstruction of a Volume of Neocortex
Kasthuri, N., Hayworth, K. J., Berger, D. R., Schalek, R. L., Conchello, J. A., Knowles-Barley, S., Lee, D., Vázquez-Reina, A., Kaynig, V., Jones, T. R., et al. (2015) · Cell · doi:10.1016/j.cell.2015.06.054 · Cited by 1,044
TrakEM2 Software for Neural Circuit Reconstruction
Cardona, A., Saalfeld, S., Schindelin, J., Arganda-Carreras, I., Preibisch, S., Longair, M., Tomancak, P., Hartenstein, V., & Douglas, R. J. (2012) · PLoS ONE · doi:10.1371/journal.pone.0038011 · Cited by 1,013
The Importance of Skip Connections in Biomedical Image Segmentation
Drozdzal, M., Vorontsov, E., Chartrand, G., Kadoury, S., & Pal, C. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46976-8_19 · Cited by 984
(2014) · arXiv (Cornell University) · Cited by 942
Wiring specificity in the direction-selectivity circuit of the retina
Briggman, K. L., Helmstaedter, M., & Denk, W. (2011) · Nature · doi:10.1038/nature09818 · Cited by 883
Network anatomy and in vivo physiology of visual cortical neurons
Bock, D. D., Lee, W.-C. A., Kerlin, A. M., Andermann, M. L., Hood, G., Wetzel, A. W., Yurgenson, S., Soucy, E. R., Kim, H. S., & Reid, R. C. (2011) · Nature · doi:10.1038/nature09802 · Cited by 870
Review of MRI-based brain tumor image segmentation using deep learning methods
Işın, A., Direkoğlu, C., & Şah, M. (2016) · Procedia Computer Science · doi:10.1016/j.procs.2016.09.407 · Cited by 766
Compressed Sensing MRI Reconstruction Using a Generative Adversarial Network With a Cyclic Loss
Quan, T. M., Nguyen-Duc, T., & Jeong, W.-K. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2820120 · Cited by 609
Self-citationConvolutional Networks Can Learn to Generate Affinity Graphs for Image Segmentation
Turaga, S. C., Murray, J. F., Jain, V., Roth, F., Helmstaedter, M., Briggman, K., Denk, W., & Seung, H. S. (2010) · Neural Computation · doi:10.1162/neco.2009.10-08-881 · Cited by 376
Whole-brain serial-section electron microscopy in larval zebrafish
Hildebrand, D. G. C., Cicconet, M., Torres, R. M., Choi, W., Quan, T. M., Moon, J., Wetzel, A. W., Scott Champion, A., Graham, B. J., Randlett, O., et al. (2017) · Nature · doi:10.1038/nature22356 · Cited by 375
Self-citationCardona, A., Saalfeld, S., Preibisch, S., Schmid, B., Cheng, A., Pulokas, J., Tomancak, P., & Hartenstein, V. (2010) · PLoS Biology · doi:10.1371/journal.pbio.1000502 · Cited by 372
The Big and the Small: Challenges of Imaging the Brain’s Circuits
Lichtman, J. W., & Denk, W. (2011) · Science · doi:10.1126/science.1209168 · Cited by 370
Crowdsourcing the creation of image segmentation algorithms for connectomics
Arganda-Carreras, I., Turaga, S. C., Berger, D. R., Cireşan, D., Giusti, A., Gambardella, L. M., Schmidhuber, J., Laptev, D., Dwivedi, S., Buhmann, J. M., et al. (2015) · Frontiers in Neuroanatomy · doi:10.3389/fnana.2015.00142 · Cited by 341
Volume electron microscopy for neuronal circuit reconstruction
Briggman, K. L., & Bock, D. D. (2012) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2011.10.022 · Cited by 335
Cellular-resolution connectomics: challenges of dense neural circuit reconstruction
Helmstaedter, M. (2013) · Nature Methods · doi:10.1038/nmeth.2476 · Cited by 313
Learning Steerable Filters for Rotation Equivariant CNNs
Weiler, M., Hamprecht, F. A., & Storath, M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00095 · Cited by 298
Hayworth, K. J., Morgan, J. L., Schalek, R., Berger, D. R., Hildebrand, D. G. C., & Lichtman, J. W. (2014) · Frontiers in Neural Circuits · doi:10.3389/fncir.2014.00068 · Cited by 282
Self-citationParallel Multi-Dimensional LSTM, With Application to Fast Biomedical Volumetric Image Segmentation
Stollenga, M. F., Byeon, W., Liwicki, M., & Schmidhuber, J. (2015) · arXiv · doi:10.48550/arxiv.1506.07452 · Cited by 244
Combining Fully Convolutional and Recurrent Neural Networks for 3D Biomedical Image Segmentation
Chen, J., Yang, L., Zhang, Y., Alber, M., & Chen, D. Z. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1609.01006 · Cited by 212
3D Deep Learning for Efficient and Robust Landmark Detection in Volumetric Data
Zheng, Y., Liu, D., Georgescu, B., Nguyen, H. V., & Comaniciu, D. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24553-9_69 · Cited by 159
Multicut brings automated neurite segmentation closer to human performance
Beier, T., Pape, C., Rahaman, N., Prange, T., Berg, S., Bock, D. D., Cardona, A., Knott, G. W., Plaza, S. M., Scheffer, L. K., et al. (2017) · Nature Methods · doi:10.1038/nmeth.4151 · Cited by 159
Deep Contextual Networks for Neuronal Structure Segmentation
Chen, H., Qi, X., Cheng, J., & Heng, P. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10141 · Cited by 152
Residual Deconvolutional Networks for Brain Electron Microscopy Image Segmentation
Fakhry, A., Zeng, T., & Ji, S. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2613019 · Cited by 123
Large-scale automatic reconstruction of neuronal processes from electron microscopy images
Kaynig, V., Vázquez-Reina, A., Knowles-Barley, S., Roberts, M., Jones, T. R., Kasthuri, N., Miller, E. L., Lichtman, J. W., & Pfister, H. (2015) · Medical Image Analysis · doi:10.1016/j.media.2015.02.001 · Cited by 118
Jeong, W., Beyer, J., Hadwiger, M., Blue, R., Law, C., Vázquez-Reina, A., Reid, R. C., Lichtman, J. W., & Pfister, H. (2010) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.2010.56 · Cited by 70
Self-citationMulti-Beam Scanning Electron Microscopy for High-Throughput Imaging in Connectomics Research
Eberle, A. L., & Zeidler, D. (2018) · Frontiers in Neuroanatomy · doi:10.3389/fnana.2018.00112 · Cited by 64
Multi-stage Multi-recursive-input Fully Convolutional Networks for Neuronal Boundary Detection
Shen, W., Wang, B., Jiang, Y., Wang, Y., & Yuille, A. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.262 · Cited by 62
Deep models for brain EM image segmentation: novel insights and improved performance
Fakhry, A., Peng, H., & Ji, S. (2016) · Bioinformatics · doi:10.1093/bioinformatics/btw165 · Cited by 52
The Mutex Watershed and its Objective: Efficient, Parameter-Free Graph Partitioning
Wolf, S., Bailoni, A., Pape, C., et al. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2980827 · Cited by 52
PatchPerPix for Instance Segmentation
Mais, L., Hirsch, P., & Kainmueller, D. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58595-2_18 · Cited by 39
Wetzel, A. W., Bakal, J., Dittrich, M., Hildebrand, D. G. C., Morgan, J., & Lichtman, J. W. (2016) · IEEE Applied Imagery Pattern Recognition Workshop · doi:10.1109/aipr.2016.8010595 · Cited by 35
Self-citationAn Efficient Fusion Move Algorithm for the Minimum Cost Lifted Multicut Problem
Beier, T., Andres, B., Köthe, U., & Hamprecht, F. A. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46475-6_44 · Cited by 34
Deep contextual residual network for electron microscopy image segmentation in connectomics
Xiao, C., Liu, J., Chen, X., Han, H., Shu, C., & Xie, Q. (2018) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2018.8363597 · Cited by 25
Leveraging Domain Knowledge to Improve Microscopy Image Segmentation With Lifted Multicuts
Pape, C., Matskevych, A., Wolny, A., Hennies, J., Mizzon, G., Louveaux, M., Musser, J. M., Maizel, A., Arendt, D., & Kreshuk, A. (2019) · Frontiers in Computer Science · doi:10.3389/fcomp.2019.00006 · Cited by 20
ACE-Net: Biomedical Image Segmentation with Augmented Contracting and Expansive Paths
Zhu, Y., Chen, Z., Zhao, S., et al. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-32239-7_79 · Cited by 18
Semantic segmentation of bioimages using convolutional neural networks
Wiehman, S., & de Villiers, H. (2016) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2016.7727258 · Cited by 13
An Iterative Convolutional Neural Network Algorithm Improves Electron Microscopy Image SegmentationPreprint
Wu, X. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.05849 · Cited by 12
Efficient Classifier Training to Minimize False Merges in Electron Microscopy Segmentation
Parag, T., Ciresan, D. C., & Giusti, A. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.82 · Cited by 9
Lee, G., Oh, J.-W., Kang, M.-S., et al. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00934-2_38 · Cited by 8
3D reconstruction of neurons in electron microscopy images
Ensafi, S., Lu, S., Kassim, A. A., & Tan, C. L. (2014) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2014.6945173 · Cited by 5
Whole-brain functional and structural examination in larval zebrafish
Hildebrand, D. G. C. (2015) · Digital Access to Scholarship at Harvard (DASH) (Harvard University) · Cited by 2
Self-citation
Cited by
A Brief Survey on Semantic Segmentation with Deep Learning
Hao, S., Zhou, Y., & Guo, Y. (2020) · Neurocomputing · doi:10.1016/j.neucom.2019.11.118 · Cited by 596
Pose Guided Person Image Generation
Ma, L., Jia, X., Sun, Q., Schiele, B., Tuytelaars, T., & Gool, L. V. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.09368 · Cited by 590
Synthesizing Images of Humans in Unseen Poses
Balakrishnan, G., Zhao, A., Dalca, A. V., Durand, F., & Guttag, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00870 · Cited by 317
Learning Steerable Filters for Rotation Equivariant CNNs
Weiler, M., Hamprecht, F. A., & Storath, M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00095 · Cited by 298
Machine learning in materials science: From explainable predictions to autonomous design
Pilania, G. (2021) · Computational Materials Science · doi:10.1016/j.commatsci.2021.110360 · Cited by 281
Metadata
- Authors
- Quan, T. M., Hildebrand, D. G. C., & Jeong, W.-K.
- Venue
- Frontiers in Computer Science
- Publisher
- Frontiers Media SA
- Published
- 2021-05-13
- Volume
- 3
- ISSN
- 2624-9898 (ISSN-L)
- OpenAlex
- W2582996697
- Cited by
- 279
- References
- 59
- FWCI
- 12.25
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.