3D fully convolutional networks for subcortical segmentation in MRI: A large-scale study
Open accessThe DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index.
Abstract
This study investigates a 3D and fully convolutional neural network (CNN) for subcortical brain structure segmentation in MRI. 3D CNN architectures have been generally avoided due to their computational and memory requirements during inference. We address the problem via small kernels, allowing deeper architectures. We further model both local and global context by embedding intermediate‐layer outputs in the final prediction, which encourages consistency between features extracted at different scales and embeds fine‐grained information directly in the segmentation process. Our model is efficiently trained end‐to‐end on a graphics processing unit (GPU), in a single stage, exploiting the dense inference capabilities of fully CNNs. We performed comprehensive experiments over two publicly available datasets. First, we demonstrate a state‐of‐the‐art performance on the ISBR dataset. Then, we report a large‐scale multi‐site evaluation over 1112 unregistered subject datasets acquired from 17 different sites (ABIDE dataset), with ages ranging from 7 to 64 years, showing that our method is robust to various acquisition protocols, demographics and clinical factors. Our method yielded segmentations that are highly consistent with a standard atlas‐based approach, while running in a fraction of the time needed by atlas‐based methods and avoiding registration/normalization steps. This makes it convenient for massive multi‐site neuroanatomical imaging studies. To the best of our knowledge, our work is the first to study subcortical structure segmentation on such large‐scale and heterogeneous data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
Lafferty, J., McCallum, A., & Pereira, F. C. N. (2001) · ScholarlyCommons (University of Pennsylvania) · Cited by 12,935
Measures of the Amount of Ecologic Association Between Species
Dice, L. R. (1945) · Ecology · doi:10.2307/1932409 · Cited by 11,874
Fast robust automated brain extraction
Smith, S. M. (2002) · Human Brain Mapping · doi:10.1002/hbm.10062 · Cited by 10,496
Fischl, B. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.01.021 · Cited by 9,526
Cited by
Zhou, S. K., Greenspan, H., Davatzikos, C., Duncan, J. S., Van Ginneken, B., Madabhushi, A., Prince, J. L., Rueckert, D., & Summers, R. M. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3054390 · Cited by 1,118
Deep learning in medical imaging and radiation therapy
Sahiner, B., Pezeshk, A., Hadjiiski, L. M., Wang, X., Drukker, K., Cha, K. H., Summers, R. M., & Giger, M. L. (2019) · Medical Physics · doi:10.1002/mp.13264 · Cited by 740
FastSurfer - A fast and accurate deep learning based neuroimaging pipeline
Henschel, L., Conjeti, S., Estrada, S., Diers, K., Fischl, B., & Reuter, M. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.117012 · Cited by 660
Ranjbarzadeh, R., Bagherian Kasgari, A., Jafarzadeh Ghoushchi, S., Anari, S., Naseri, M., & Bendechache, M. (2021) · Scientific Reports · doi:10.1038/s41598-021-90428-8 · Cited by 634
HyperDense-Net: A Hyper-Densely Connected CNN for Multi-Modal Image Segmentation
Dolz, J., Gopinath, K., Yuan, J., Lombaert, H., Desrosiers, C., & Ben Ayed, I. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2878669 · Cited by 580
Self-citationConvolutional Neural Networks for Radiologic Images: A Radiologist’s Guide
Soffer, S., Ben-Cohen, A., Shimon, O., Amitai, M. M., Greenspan, H., & Klang, E. (2019) · Radiology · doi:10.1148/radiol.2018180547 · Cited by 577
Multi-Scale Self-Guided Attention for Medical Image Segmentation
Sinha, A., & Dolz, J. (2021) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.2986926 · Cited by 570
Self-citationBoundary loss for highly unbalanced segmentation
Kervadec, H., Bouchtiba, J., Desrosiers, C., Granger, E., Dolz, J., & Ben Ayed, I. (2021) · Medical Image Analysis · doi:10.1016/j.media.2020.101851 · Cited by 532
Self-citationRA-UNet: A Hybrid Deep Attention-Aware Network to Extract Liver and Tumor in CT Scans
Jin, Q., Meng, Z., Sun, C., Cui, H., & Su, R. (2020) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2020.605132 · Cited by 468
3D conditional generative adversarial networks for high-quality PET image estimation at low dose
Wang, Y., Yu, B., Wang, L., Zu, C., Lalush, D. S., Lin, W., Wu, X., Zhou, J., Shen, D., & Zhou, L. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.03.045 · Cited by 449
Deep convolutional neural networks for brain image analysis on magnetic resonance imaging: a review
Bernal, J., Kushibar, K., Asfaw, D. S., Valverde, S., Oliver, A., Martí, R., & Lladó, X. (2019) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2018.08.008 · Cited by 368
IterNet: Retinal Image Segmentation Utilizing Structural Redundancy in Vessel Networks
Li, L., Verma, M., Nakashima, Y., Nagahara, H., & Kawasaki, R. (2020) · 2020 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv45572.2020.9093621 · Cited by 357
Survey on deep learning for radiotherapy
Meyer, P., Noblet, V., Mazzara, C., & Lallement, A. (2018) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2018.05.018 · Cited by 302
A systematic survey of computer-aided diagnosis in medicine: Past and present developments
Yanase, J., & Triantaphyllou, E. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.112821 · Cited by 303
“…in CT [Li, et al., 2015] Fully Convolutional Networks (FCN) Segmentation [Long, et al., 2015], [Milletari, el al., 2016] 3D Segmentation in MRI [Dolz, et al., 2018] 3D Segmentation in CT [Christ, et al., 2016] Recently, Yager introduced another extension of intuitionistic fuzzy sets known as…”
BackgroundA survey on U-shaped networks in medical image segmentations
Liu, L., Cheng, J., Quan, Q., Wu, F.-X., Wang, Y.-P., & Wang, J. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.05.070 · Cited by 286
Deep learning based diagnosis of Parkinson’s disease using convolutional neural network
Sivaranjini, S., & Sujatha, C. M. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-019-7469-8 · Cited by 281
Constrained-CNN losses for weakly supervised segmentation
Kervadec, H., Dolz, J., Tang, M., Granger, E., Boykov, Y., & Ben Ayed, I. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.02.009 · Cited by 278
Self-citationKhodatars, M., Shoeibi, A., Sadeghi, D., Ghaasemi, N., Jafari, M., Moridian, P., Khadem, A., Alizadehsani, R., Zare, A., Kong, Y., et al. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.104949 · Cited by 270
QuickNAT: A fully convolutional network for quick and accurate segmentation of neuroanatomy
Guha Roy, A., Conjeti, S., Navab, N., & Wachinger, C. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2018.11.042 · Cited by 267
Deep Learning for Smart Healthcare—A Survey on Brain Tumor Detection from Medical Imaging
Arabahmadi, M., Farahbakhsh, R., & Rezazadeh, J. (2022) · Sensors · doi:10.3390/s22051960 · Cited by 253
Gabr, R. E., Coronado, I., Robinson, M., Sujit, S. J., Datta, S., Sun, X., Allen, W. J., Lublin, F. D., Wolinsky, J. S., & Narayana, P. A. (2020) · Multiple Sclerosis Journal · doi:10.1177/1352458519856843 · Cited by 92
Bayesian convolutional neural network based MRI brain extraction on nonhuman primates
Zhao, G., Liu, F., Oler, J. A., Meyerand, M. E., Kalin, N. H., & Birn, R. M. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.03.065 · Cited by 68
“2; https://github.com/jms290/NMT) (Seidlitz et al., 2017), SegNet (https://github.com/alexgkendall/caffe-segnet) (Badrinarayanan et al., 2015c), LiviaNet (https://github.com/josedolz/LiviaNET) (Dolz et al., 2017) and VNet (https://github.com/ faustomilletari/VNet) (Milletari et al., 2016).”
MethodUsing 3D Convolutional Neural Networks for Tactile Object Recognition with Robotic Palpation
Pastor, F., Gandarias, J. M., García-Cerezo, A. J., & Gómez-de-Gabriel, J. M. (2019) · Sensors · doi:10.3390/s19245356 · Cited by 49
“Although the type of information contained in MRIs and 3D tactile tensors is different, methods such as 3D CNNs used to process MRI information [33,34] might be used for tactile data with good results in this application as we explored in our previous work [35].”
MethodSubcortical segmentation of the fetal brain in 3D ultrasound using deep learning
Hesse, L. S., Aliasi, M., Moser, F., Haak, M. C., Xie, W., Jenkinson, M., & Namburete, A. I. L. (2022) · NeuroImage · doi:10.1016/j.neuroimage.2022.119117 · Cited by 44
Privacy-Net: An Adversarial Approach for Identity-Obfuscated Segmentation of Medical Images
Kim, B. N., Dolz, J., Jodoin, P.-M., & Desrosiers, C. (2021) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2021.3065727 · Cited by 43
Self-citationLee, W.-K., Wu, C.-C., Lee, C.-C., Lu, C.-F., Yang, H.-C., Huang, T.-H., Lin, C.-Y., Chung, W.-Y., Wang, P.-S., Wu, H.-M., et al. (2020) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2020.101911 · Cited by 35
A Bayesian Hierarchical Network for Combining Heterogeneous Data Sources in Medical Diagnoses
Donnat, C., Miolane, N., Bunbury, F., & Kreindler, J. (2020) · arXiv · doi:10.48550/arxiv.2007.13847 · Cited by 7
Metadata
- Authors
- Dolz, J., Desrosiers, C., & Ben Ayed, I.
- Venue
- NeuroImage
- Publisher
- Elsevier BV
- Published
- 2018-04
- Volume
- 170
- Pages
- 456-470
- ISSN
- 1053-8119 (ISSN-L)
- OpenAlex
- W2567599812
- Cited by
- 414
- References
- 67
- FWCI
- 21.79
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.