The DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.
DeepNAT: Deep convolutional neural network for segmenting neuroanatomy
Open accessAbstract
We introduce DeepNAT, a 3D Deep convolutional neural network for the automatic segmentation of NeuroAnaTomy in T1‐weighted magnetic resonance images. DeepNAT is an end‐to‐end learning‐based approach to brain segmentation that jointly learns an abstract feature representation and a multi‐class classification. We propose a 3D patch‐based approach, where we do not only predict the center voxel of the patch but also neighbors, which is formulated as multi‐task learning. To address a class imbalance problem, we arrange two networks hierarchically, where the first one separates foreground from background, and the second one identifies 25 brain structures on the foreground. Since patches lack spatial context, we augment them with coordinates. To this end, we introduce a novel intrinsic parameterization of the brain volume, formed by eigenfunctions of the Laplace‐Beltrami operator. As network architecture, we use three convolutional layers with pooling, batch normalization, and non‐linearities, followed by fully connected layers with dropout. The final segmentation is inferred from the probabilistic output of the network with a 3D fully connected conditional random field, which ensures label agreement between close voxels. The roughly 2.7 million parameters in the network are learned with stochastic gradient descent. Our results show that DeepNAT compares favorably to state‐of‐the‐art methods. Finally, the purely learning‐based method may have a high potential for the adaptation to young, old, or diseased brains by fine‐tuning the pre‐trained network with a small training sample on the target application, where the availability of larger datasets with manual annotations may boost the overall segmentation accuracy in the future. HIGHLIGHTSBrain segmentation with deep convolutional neural network.Jointly learned feature representation and classification.Multi‐task learning for brain segmentation.Hierarchal segmentation to address class imbalance.Spectral coordinates for intrinsic brain parameterization.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2016) · arXiv · doi:10.48550/arxiv.1606.00915 · Cited by 22,392
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2699184 · Cited by 22,392
Normalized cuts and image segmentation
Shi, J., & Malik, J. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.868688 · Cited by 15,502
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 14,214
(2010) · Cited by 14,134
Backpropagation Applied to Handwritten Zip Code Recognition
LeCun, Y., Boser, B., Denker, J. S., Henderson, D., Howard, R. E., Hubbard, W., & Jackel, L. D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.4.541 · Cited by 11,891
Measures of the Amount of Ecologic Association Between Species
Dice, L. R. (1945) · Ecology · doi:10.2307/1932409 · Cited by 11,874
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Cortical Surface-Based Analysis
Dale, A. M., Fischl, B., & Sereno, M. I. (1999) · NeuroImage · doi:10.1006/nimg.1998.0395 · Cited by 10,910
Fischl, B., Salat, D. H., Busa, E., Albert, M., Dieterich, M., Haselgrove, C., van der Kouwe, A., Killiany, R., Kennedy, D., Klaveness, S., et al. (2002) · Neuron · doi:10.1016/s0896-6273(02)00569-x · Cited by 8,610
(2010) · Cited by 8,261
Ashburner, J., & Friston, K. J. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.02.018 · Cited by 7,507 · cited 9×
“For 15 training and 15 test images, DeepNATcrf yields significantly higher Dice scores in comparison to DeepNAT (p 0.001), FreeSurfer (p 0.001), and STAPLE (p 0.001), whereas the difference to PICSL (p = 0.06) is not significant.”
Influential(2011) · Cited by 6,993
3D Convolutional Neural Networks for Human Action Recognition
Ji, S., Xu, W., Yang, M., & Yu, K. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.59 · Cited by 6,235
Cortical Surface-Based Analysis
Fischl, B., Sereno, M. I., & Dale, A. M. (1999) · NeuroImage · doi:10.1006/nimg.1998.0396 · Cited by 6,147
How transferable are features in deep neural networks?
Yosinski, J., Clune, J., Bengio, Y., & Lipson, H. (2014) · arXiv · doi:10.48550/arxiv.1411.1792 · Cited by 6,061
Chung, F. (1996) · CBMS Regional Conference Series in Mathematics · doi:10.1090/cbms/092 · Cited by 5,524
Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2014) · arXiv · doi:10.48550/arxiv.1412.7062 · Cited by 4,213
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. J. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1408.5093 · Cited by 3,752
Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials
Krähenbühl, P., & Koltun, V. (2012) · arXiv · doi:10.48550/arxiv.1210.5644 · Cited by 2,908
Marcus, D. S., Wang, T. H., Parker, J., Csernansky, J. G., Morris, J. C., & Buckner, R. L. (2007) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2007.19.9.1498 · Cited by 2,163
Warfield, S. K., Zou, K. H., & Wells, W. M. (2004) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2004.828354 · Cited by 2,072
Dale, A. M., & Sereno, M. I. (1993) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1993.5.2.162 · Cited by 2,003
Mitosis Detection in Breast Cancer Histology Images with Deep Neural Networks
Cireşan, D. C., Giusti, A., Gambardella, L. M., & Schmidhuber, J. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-40763-5_51 · Cited by 1,536
Automatic anatomical brain MRI segmentation combining label propagation and decision fusion
Heckemann, R. A., Hajnal, J. V., Aljabar, P., Rueckert, D., & Hammers, A. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.05.061 · Cited by 866
Deep convolutional neural networks for multi-modality isointense infant brain image segmentation
Zhang, W., Li, R., Deng, H., Wang, L., Lin, W., Ji, S., & Shen, D. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2014.12.061 · Cited by 817 · cited 2×
“, 2012) and increasingly in medical imaging (Brosch et al., 2014; Cireşan et al., 2013; Prasoon et al., 2013; Roth et al., 2014; Zheng et al., 2015; Brosch et al., 2015; Zhang et al., 2015; Pereira et al., 2015).”
BackgroundMulti-Atlas Segmentation with Joint Label Fusion
Wang, H., Suh, J. W., Das, S. R., Pluta, J. B., Craige, C., & Yushkevich, P. A. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.143 · Cited by 796
Patch-based segmentation using expert priors: Application to hippocampus and ventricle segmentation
Coupé, P., Manjón, J. V., Fonov, V., Pruessner, J., Robles, M., & Collins, D. L. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.09.018 · Cited by 692
Deep Feature Learning for Knee Cartilage Segmentation Using a Triplanar Convolutional Neural Network
Prasoon, A., Petersen, K., Igel, C., Lauze, F., Dam, E., & Nielsen, M. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-40763-5_31 · Cited by 582
Rohlfing, T., Brandt, R., Menzel, R., & Maurer, C. R. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2003.11.010 · Cited by 573
A Generative Model for Image Segmentation Based on Label Fusion
Sabuncu, M. R., Yeo, B. T. T., Van Leemput, K., Fischl, B., & Golland, P. (2010) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2010.2050897 · Cited by 479
Deep Learning Based Imaging Data Completion for Improved Brain Disease Diagnosis
Li, R., Zhang, W., Suk, H.-I., Wang, L., Li, J., Shen, D., & Ji, S. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10443-0_39 · Cited by 469
Fast High‐Dimensional Filtering Using the Permutohedral Lattice
Adams, A., Baek, J., & Davis, M. A. (2010) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2009.01645.x · Cited by 394
Svarer, C., Madsen, K., Hasselbalch, S. G., Pinborg, L. H., Haugbøl, S., Frøkjær, V. G., Holm, S., Paulson, O. B., & Knudsen, G. M. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2004.10.017 · Cited by 386
Roth, H. R., Lu, L., Seff, A., Cherry, K. M., Hoffman, J., Wang, S., Liu, J., Turkbey, E., & Summers, R. M. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10404-1_65 · Cited by 340
Deep neural networks for anatomical brain segmentation
de Brebisson, A., & Montana, G. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2015.7301312 · Cited by 330
Rotating your face using multi-task deep neural network
Yim, J., Jung, H., Yoo, B., Choi, C., Park, D., & Kim, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298667 · Cited by 275
Retinal vessel segmentation via deep learning network and fully-connected conditional random fields
Fu, H., Xu, Y., Wong, D. W. K., & Liu, J. (2016) · 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2016.7493362 · Cited by 274
A Bayesian model for joint segmentation and registration
Pohl, K. M., Fisher, J., Grimson, W. E. L., Kikinis, R., & Wells, W. M. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2005.11.044 · Cited by 273
A Supervised Patch-Based Approach for Human Brain Labeling
Rousseau, F., Habas, P. A., & Studholme, C. (2011) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2011.2156806 · Cited by 271
Wang, C., Komodakis, N., & Paragios, N. (2013) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2013.07.004 · Cited by 208
Permitted and Forbidden Sets in Symmetric Threshold-Linear Networks
Hahnloser, R. H. R., Seung, H. S., & Slotine, J.-J. (2003) · Neural Computation · doi:10.1162/089976603321192103 · Cited by 202
3D Deep Learning for Efficient and Robust Landmark Detection in Volumetric Data
Zheng, Y., Liu, D., Georgescu, B., Nguyen, H. V., & Comaniciu, D. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24553-9_69 · Cited by 190
Quo Vadis, Atlas-Based Segmentation?
Rohlfing, T., Brandt, R., Menzel, R., Russakoff, D. B., & Maurer, C. R. (2005) · Handbook of Biomedical Image Analysis · doi:10.1007/0-306-48608-3_11 · Cited by 183
BrainPrint: A discriminative characterization of brain morphology
Wachinger, C., Golland, P., Kremen, W., Fischl, B., & Reuter, M. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2015.01.032 · Cited by 164
Self-citationFowlkes, C. C., Martin, D., & Malik, J. (2003) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2003.1211452 · Cited by 138
Deep Convolutional Neural Networks for the Segmentation of Gliomas in Multi-sequence MRI
Pereira, S., Pinto, A., Alves, V., & Silva, C. A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-30858-6_12 · Cited by 135
Deep Convolutional Encoder Networks for Multiple Sclerosis Lesion Segmentation
Brosch, T., Yoo, Y., Tang, L. Y. W., Li, D. K. B., Traboulsee, A. L., & Tam, R. C. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_1 · Cited by 127
Formulating Spatially Varying Performance in the Statistical Fusion Framework
Asman, A. J., & Landman, B. A. (2012) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2012.2190992 · Cited by 114
Object Categorization: Computer and Human Vision Perspectives
(2009) · doi:10.1017/cbo9780511635465 · Cited by 110
Lombaert, H., Grady, L. J., Polimeni, J. R., & Farida Cheriet, A. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.276 · Cited by 83
Diffeomorphic Spectral Matching of Cortical Surfaces
Lombaert, H., Jon Sporring, A., & Kaleem Siddiqi, A. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-38868-2_32 · Cited by 74
Atlas Encoding by Randomized Forests for Efficient Label Propagation
Zikic, D., Glocker, B., & Criminisi, A. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-40760-4_9 · Cited by 63
Brosch, T., Yoo, Y., Li, D. K. B., Traboulsee, A. L., & Tam, R. C. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10470-6_58 · Cited by 59
Book Review: Object Categorization, Computer and Human Vision Perspectives
Yu, J., & Joshi, D. (2007) · Journal of Electronic Imaging · doi:10.1117/1.3487487 · Cited by 55
Gao, M., Xu, Z., Lu, L., Wu, A., Nogues, I., Summers, R. M., & Mollura, D. J. (2016) · 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2016.7493497 · Cited by 48
Non-local STAPLE: An Intensity-Driven Multi-atlas Rater Model
Asman, A. J., & Landman, B. A. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33454-2_53 · Cited by 42
Contour-Driven Atlas-Based Segmentation
Wachinger, C., Fritscher, K. D., Sharp, G. C., & Golland, P. (2015) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2015.2442753 · Cited by 40
Self-citationAtlas-Based Under-Segmentation
Wachinger, C., & Golland, P. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10404-1_40 · Cited by 24
Self-citationEfficient Descriptor-Based Segmentation of Parotid Glands With Nonlocal Means
Wachinger, C., Brennan, M., Sharp, G. C., & Golland, P. (2016) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2016.2603119 · Cited by 19
Self-citationOn the Importance of Location and Features for the Patch-Based Segmentation of Parotid Glands
Wachinger, C., Brennan, M., Sharp, G., et al. (2014) · doi:10.54294/vkfz56 · Cited by 6
Self-citationHigh-resolution intersubject averaging and a coordinate system for the cortical surface
Fischl, B., Sereno, M. I., Tootell, R. B. H., & Dale, A. M. (1999) · Human Brain Mapping · doi:10.1002/(sici)1097-0193(1999)8:4<272::aid-hbm10>3.0.co;2-4
Cited by
Zhou, S. K., Greenspan, H., Davatzikos, C., Duncan, J. S., Van Ginneken, B., Madabhushi, A., Prince, J. L., Rueckert, D., & Summers, R. M. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3054390 · Cited by 1,118
Tversky Loss Function for Image Segmentation Using 3D Fully Convolutional Deep Networks
Salehi, S. S. M., Erdogmus, D., & Gholipour, A. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-67389-9_44 · Cited by 1,086
Embracing imperfect datasets: A review of deep learning solutions for medical image segmentation
Tajbakhsh, N., Jeyaseelan, L., Li, Q., Chiang, J. N., Wu, Z., & Ding, X. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101693 · Cited by 1,095
“spectral coordinates characterization by Wachinger et al. (2018) for neuroanatomy segmentation in MR Images.”
BackgroundMethodInfluentialDeep learning in medical imaging and radiation therapy
Sahiner, B., Pezeshk, A., Hadjiiski, L. M., Wang, X., Drukker, K., Cha, K. H., Summers, R. M., & Giger, M. L. (2019) · Medical Physics · doi:10.1002/mp.13264 · Cited by 740
FastSurfer - A fast and accurate deep learning based neuroimaging pipeline
Henschel, L., Conjeti, S., Estrada, S., Diers, K., Fischl, B., & Reuter, M. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.117012 · Cited by 660
Self-citation
Metadata
- Authors
- Wachinger, C., Reuter, M., & Klein, T.
- Venue
- NeuroImage
- Publisher
- Elsevier BV
- Published
- 2018-04
- Volume
- 170
- Pages
- 434-445
- ISSN
- 1053-8119 (ISSN-L)
- OpenAlex
- W2589647984
- Cited by
- 346
- References
- 64
- FWCI
- 20.33
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.