The DOI matches its Crossref record; 66 of the 66 references it cites were found in a registry or an index.
3D fully convolutional networks for subcortical segmentation in MRI: A large-scale study
Open accessAbstract
This study investigates a 3D and fully convolutional neural network (CNN) for subcortical brain structure segmentation in MRI. 3D CNN architectures have been generally avoided due to their computational and memory requirements during inference. We address the problem via small kernels, allowing deeper architectures. We further model both local and global context by embedding intermediate‐layer outputs in the final prediction, which encourages consistency between features extracted at different scales and embeds fine‐grained information directly in the segmentation process. Our model is efficiently trained end‐to‐end on a graphics processing unit (GPU), in a single stage, exploiting the dense inference capabilities of fully CNNs. We performed comprehensive experiments over two publicly available datasets. First, we demonstrate a state‐of‐the‐art performance on the ISBR dataset. Then, we report a large‐scale multi‐site evaluation over 1112 unregistered subject datasets acquired from 17 different sites (ABIDE dataset), with ages ranging from 7 to 64 years, showing that our method is robust to various acquisition protocols, demographics and clinical factors. Our method yielded segmentations that are highly consistent with a standard atlas‐based approach, while running in a fraction of the time needed by atlas‐based methods and avoiding registration/normalization steps. This makes it convenient for massive multi‐site neuroanatomical imaging studies. To the best of our knowledge, our work is the first to study subcortical structure segmentation on such large‐scale and heterogeneous data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
Lafferty, J., McCallum, A., & Pereira, F. C. N. (2001) · ScholarlyCommons (University of Pennsylvania) · Cited by 12,935
Measures of the Amount of Ecologic Association Between Species
Dice, L. R. (1945) · Ecology · doi:10.2307/1932409 · Cited by 11,874
Fast robust automated brain extraction
Smith, S. M. (2002) · Human Brain Mapping · doi:10.1002/hbm.10062 · Cited by 10,496
Fischl, B. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.01.021 · Cited by 9,526
Multi-scale context aggregation by dilated convolutions
Yu, F., & Koltun, V. (2015) · arXiv · doi:10.48550/arxiv.1511.07122 · Cited by 7,738
Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2014) · arXiv · doi:10.48550/arxiv.1412.7062 · Cited by 4,213
Efficient multi-scale 3D CNN with fully connected CRF for accurate brain lesion segmentation
Kamnitsas, K., Ledig, C., Newcombe, V. F. J., Simpson, J. P., Kane, A. D., Menon, D. K., Rueckert, D., & Glocker, B. (2017) · Medical Image Analysis · doi:10.1016/j.media.2016.10.004 · Cited by 3,498 · cited 10×
“In [31], Kamnitsas et al. found that increasing the size of input segments in training leads to a higher performance, but this performance increase stops beyond segment sizes of 25 3 .”
BackgroundMethodInfluentialBrain tumor segmentation with Deep Neural Networks
Havaei, M., Davy, A., Warde-Farley, D., Biard, A., Courville, A., Bengio, Y., Pal, C., Jodoin, P.-M., & Larochelle, H. (2017) · Medical Image Analysis · doi:10.1016/j.media.2016.05.004 · Cited by 3,278
Di Martino, A., Yan, C.-G., Li, Q., Denio, E., Castellanos, F. X., Alaerts, K., Anderson, J. S., Assaf, M., Bookheimer, S. Y., Dapretto, M., et al. (2014) · Molecular Psychiatry · doi:10.1038/mp.2013.78 · Cited by 2,780
Brain Tumor Segmentation Using Convolutional Neural Networks in MRI Images
Pereira, S., Pinto, A., Alves, V., & Silva, C. A. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2538465 · Cited by 2,735
Learning Hierarchical Features for Scene Labeling
Farabet, C., Couprie, C., Najman, L., & LeCun, Y. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.231 · Cited by 2,620
High Accuracy Optical Flow Estimation Based on a Theory for Warping
Brox, T., Bruhn, A., Papenberg, N., & Weickert, J. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24673-2_3 · Cited by 2,570
Fully Convolutional Networks for Semantic Segmentation
Long, J., Shelhamer, E., & Darrell, T. J. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1411.4038 · Cited by 2,489
A Bayesian model of shape and appearance for subcortical brain segmentation
Patenaude, B., Smith, S. M., Kennedy, D. N., & Jenkinson, M. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.02.046 · Cited by 2,287
Hypercolumns for object segmentation and fine-grained localization
Hariharan, B., Arbelaez, P., Girshick, R., & Malik, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298642 · Cited by 1,511
Evaluation of Pooling Operations in Convolutional Architectures for Object Recognition
Scherer, D., Müller, A., & Behnke, S. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15825-4_10 · Cited by 1,503
(2012) · neural information processing systems · Cited by 1,291
for the ENIGMA Schizophrenia Working Group, van Erp, T. G. M., Hibar, D. P., Rasmussen, J. M., Glahn, D. C., Pearlson, G. D., Andreassen, O. A., Agartz, I., Westlye, L. T., Haukvik, U. K., et al. (2016) · Molecular Psychiatry · doi:10.1038/mp.2015.63 · Cited by 1,135
Theano: A CPU and GPU Math Compiler in Python
Bergstra, J., Breuleux, O., Bastien, F., Lamblin, P., Pascanu, R., Desjardins, G., Turian, J., Warde-Farley, D., & Bengio, Y. (2010) · Proceedings of the Python in Science Conference · doi:10.25080/majora-92bf1922-003 · Cited by 1,052
Koolschijn, P. C. M. P., van Haren, N. E. M., Lensvelt‐Mulders, G. J. L. M., Hulshoff Pol, H. E., & Kahn, R. S. (2009) · Human Brain Mapping · doi:10.1002/hbm.20801 · Cited by 902
Automatic anatomical brain MRI segmentation combining label propagation and decision fusion
Heckemann, R. A., Hajnal, J. V., Aljabar, P., Rueckert, D., & Hammers, A. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.05.061 · Cited by 866
Automatic Segmentation of MR Brain Images With a Convolutional Neural Network
Moeskops, P., Viergever, M. A., Mendrik, A. M., de Vries, L. S., Benders, M. J. N. L., & Isgum, I. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2548501 · Cited by 861
Schumann, C. M., Hamstra, J., Goodlin-Jones, B. L., Lotspeich, L. J., Kwon, H., Buonocore, M. H., Lammers, C. R., Reiss, A. L., & Amaral, D. G. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.1297-04.2004 · Cited by 840
Deep convolutional neural networks for multi-modality isointense infant brain image segmentation
Zhang, W., Li, R., Deng, H., Wang, L., Lin, W., Ji, S., & Shen, D. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2014.12.061 · Cited by 817 · cited 2×
“In biomedical imaging, CNNs have been recently investigated for several neuroimaging applications [20, 21, 22, 23].”
BackgroundMethodMulti-Atlas Segmentation with Joint Label Fusion
Wang, H., Suh, J. W., Das, S. R., Pluta, J. B., Craige, C., & Yushkevich, P. A. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.143 · Cited by 796
Combination Strategies in Multi-Atlas Image Segmentation: Application to Brain MR Data
Artaechevarria, X., Munoz-Barrutia, A., & Ortiz-de-Solorzano, C. (2009) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2009.2014372 · Cited by 507
Effects of age on brain volume and head circumference in autism
Aylward, E. H., Minshew, N. J., Field, K., Sparks, B. F., & Singh, N. (2002) · Neurology · doi:10.1212/wnl.59.2.175 · Cited by 497
A Generative Model for Image Segmentation Based on Label Fusion
Sabuncu, M. R., Yeo, B. T. T., Van Leemput, K., Fischl, B., & Golland, P. (2010) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2010.2050897 · Cited by 479
The Medical Imaging Interaction Toolkit
Wolf, I., Vetter, M., Wegner, I., Böttger, T., Nolden, M., Schöbinger, M., Hastenteufel, M., Kunert, T., & Meinzer, H.-P. (2005) · Medical Image Analysis · doi:10.1016/j.media.2005.04.005 · Cited by 421
Fast and robust multi-atlas segmentation of brain magnetic resonance images
Lötjönen, J. M., Wolz, R., Koikkalainen, J. R., Thurfjell, L., Waldemar, G., Soininen, H., & Rueckert, D. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.10.026 · Cited by 391
Hough-CNN: Deep learning for segmentation of deep brain regions in MRI and ultrasound
Milletari, F., Ahmadi, S.-A., Kroll, C., Plate, A., Rozanski, V., Maiostre, J., Levin, J., Dietrich, O., Ertl-Wagner, B., Bötzel, K., et al. (2017) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2017.04.002 · Cited by 391
Chen, L.-C., Barron, J. T., Papandreou, G., Murphy, K., & Yuille, A. L. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.492 · Cited by 364
García-Lorenzo, D., Francis, S., Narayanan, S., Arnold, D. L., & Collins, D. L. (2013) · Medical Image Analysis · doi:10.1016/j.media.2012.09.004 · Cited by 355
Deep neural networks for anatomical brain segmentation
de Brebisson, A., & Montana, G. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2015.7301312 · Cited by 330
Ghosh, S. S., Kakunoori, S., Augustinack, J., Nieto-Castanon, A., Kovelman, I., Gaab, N., Christodoulou, J. A., Triantafyllou, C., Gabrieli, J. D. E., & Fischl, B. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.05.075 · Cited by 281
A Supervised Patch-Based Approach for Human Brain Labeling
Rousseau, F., Habas, P. A., & Studholme, C. (2011) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2011.2156806 · Cited by 271
Changes in the Developmental Trajectories of Striatum in Autism
Langen, M., Schnack, H. G., Nederveen, H., Bos, D., Lahuis, B. E., de Jonge, M. V., van Engeland, H., & Durston, S. (2009) · Biological Psychiatry · doi:10.1016/j.biopsych.2009.03.017 · Cited by 260
Corpus callosum size in autism
Hardan, A. Y., Minshew, N. J., & Keshavan, M. S. (2000) · Neurology · doi:10.1212/wnl.55.7.1033 · Cited by 243
Segmentation of multiple sclerosis lesions in brain MRI: A review of automated approaches
Lladó, X., Oliver, A., Cabezas, M., Freixenet, J., Vilanova, J. C., Quiles, A., Valls, L., Ramió-Torrentà, L., & Rovira, À. (2012) · Information Sciences · doi:10.1016/j.ins.2011.10.011 · Cited by 240
Atlas Renormalization for Improved Brain MR Image Segmentation Across Scanner Platforms
Han, X., & Fischl, B. (2007) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2007.893282 · Cited by 215
Khan, A. R., Wang, L., & Beg, M. F. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.03.024 · Cited by 182
Powell, S., Magnotta, V. A., Johnson, H., Jammalamadaka, V. K., Pierson, R., & Andreasen, N. C. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2007.05.063 · Cited by 170
Deeley, M. A., Chen, A., Datteri, R. D., Noble, J. H., Cmelak, A. J., Donnelly, E. F., Malcolm, A. W., Moretti, L., Jaboin, J. J., Niermann, K. J., et al. (2011) · Physics in Medicine and Biology · doi:10.1088/0031-9155/56/14/021 · Cited by 149
Detection and mapping of hippocampal abnormalities in autism
Nicolson, R., DeVito, T. J., Vidal, C. N., Sui, Y., Hayashi, K. M., Drost, D. J., Williamson, P., Rajakumar, N., Toga, A. W., & Thompson, P. M. (2006) · Psychiatry Research Neuroimaging · doi:10.1016/j.pscychresns.2006.02.005 · Cited by 132
Multi-atlas segmentation of subcortical brain structures via the AutoSeg software pipeline
Wang, J., Vachet, C., Rumple, A., Gouttard, S., Ouziel, C., Perrot, E., Du, G., Huang, X., Gerig, G., & Styner, M. A. (2014) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2014.00007 · Cited by 127
Deep Convolutional Encoder Networks for Multiple Sclerosis Lesion Segmentation
Brosch, T., Yoo, Y., Tang, L. Y. W., Li, D. K. B., Traboulsee, A. L., & Tam, R. C. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_1 · Cited by 127
Consistent cortical reconstruction and multi-atlas brain segmentation
Huo, Y., Plassard, A. J., Carass, A., Resnick, S. M., Pham, D. L., Prince, J. L., & Landman, B. A. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.05.030 · Cited by 124
3D image segmentation of deformable objects with joint shape-intensity prior models using level sets
Yang, J., & Duncan, J. S. (2004) · Medical Image Analysis · doi:10.1016/j.media.2004.06.008 · Cited by 123
Homeomorphic brain image segmentation with topological and statistical atlases
Bazin, P., & Pham, D. L. (2008) · Medical Image Analysis · doi:10.1016/j.media.2008.06.008 · Cited by 118
Sub-cortical brain structure segmentation using F-CNN'S
Shakeri, M., Tsogkas, S., Ferrante, E., Lippé, S., Kadoury, S., Nikos Paragios, A., & Kokkinos, I. (2016) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2016.7493261 · Cited by 109
Multi-scale structured CNN with label consistency for brain MR image segmentation
Bao, S., & Chung, A. C. S. (2018) · Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization · doi:10.1080/21681163.2016.1182072 · Cited by 101
Deep Neural Networks for Anatomical Brain SegmentationPreprint
de Brébisson, A., & Montana, G. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1502.02445 · Cited by 74
Increased Putamen Volume in Adults with Autism Spectrum Disorder
Sato, W., Kubota, Y., Kochiyama, T., Uono, S., Yoshimura, S., Sawada, R., Sakihama, M., & Toichi, M. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00957 · Cited by 68
KHAN, A. R., Cherbuin, N., Wen, W. X., Anstey, K. J., Sachdev, P. S., & Beg, M. F. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.01.078 · Cited by 67
Groupwise multi-atlas segmentation of the spinal cord’s internal structure
Asman, A. J., Bryan, F. W., Smith, S. A., Reich, D. S., & Landman, B. A. (2014) · Medical Image Analysis · doi:10.1016/j.media.2014.01.003 · Cited by 65
Hierarchical statistical shape analysis and prediction of sub-cortical brain structures
Rao, A. W., Aljabar, P., & Rueckert, D. (2007) · Medical Image Analysis · doi:10.1016/j.media.2007.06.006 · Cited by 57
Dolz, J., Massoptier, L., & Vermandel, M. (2015) · IRBM · doi:10.1016/j.irbm.2015.06.001 · Cited by 53
Self-citationMotor stereotypies and volumetric brain alterations in children with Autistic Disorder
Goldman, S., O’Brien, L. M., Filipek, P. A., Rapin, I., & Herbert, M. R. (2012) · Research in Autism · doi:10.1016/j.rasd.2012.07.005 · Cited by 39
3D Brain Segmentation Using Active Appearance Models and Local Regressors
Babalola, K., Cootes, T. F., Twining, C., Petrovic, V. S., & Taylor, C. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-85988-8_48 · Cited by 37
Towards a deep learning approach to brain parcellation
Lee, N., Laine, A. F., & Klein, A. (2011) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2011.5872414 · Cited by 23
Cited by
Zhou, S. K., Greenspan, H., Davatzikos, C., Duncan, J. S., Van Ginneken, B., Madabhushi, A., Prince, J. L., Rueckert, D., & Summers, R. M. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3054390 · Cited by 1,118
Deep learning in medical imaging and radiation therapy
Sahiner, B., Pezeshk, A., Hadjiiski, L. M., Wang, X., Drukker, K., Cha, K. H., Summers, R. M., & Giger, M. L. (2019) · Medical Physics · doi:10.1002/mp.13264 · Cited by 740
FastSurfer - A fast and accurate deep learning based neuroimaging pipeline
Henschel, L., Conjeti, S., Estrada, S., Diers, K., Fischl, B., & Reuter, M. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.117012 · Cited by 660
Ranjbarzadeh, R., Bagherian Kasgari, A., Jafarzadeh Ghoushchi, S., Anari, S., Naseri, M., & Bendechache, M. (2021) · Scientific Reports · doi:10.1038/s41598-021-90428-8 · Cited by 634
HyperDense-Net: A Hyper-Densely Connected CNN for Multi-Modal Image Segmentation
Dolz, J., Gopinath, K., Yuan, J., Lombaert, H., Desrosiers, C., & Ben Ayed, I. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2878669 · Cited by 580
Self-citation
Metadata
- Authors
- Dolz, J., Desrosiers, C., & Ben Ayed, I.
- Venue
- NeuroImage
- Publisher
- Elsevier BV
- Published
- 2018-04
- Volume
- 170
- Pages
- 456-470
- ISSN
- 1053-8119 (ISSN-L)
- OpenAlex
- W2567599812
- Cited by
- 414
- References
- 66
- FWCI
- 21.79
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.