The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Integrating spatial configuration into heatmap regression based CNNs for landmark localization
Open accessAbstract
In many medical image analysis applications, only a limited amount of training data is available due to the costs of image acquisition and the large manual annotation effort required from experts. Training recent state-of-the-art machine learning methods like convolutional neural networks (CNNs) from small datasets is a challenging task. In this work on anatomical landmark localization, we propose a CNN architecture that learns to split the localization task into two simpler sub-problems, reducing the overall need for large training datasets. Our fully convolutional SpatialConfiguration-Net (SCN) learns this simplification due to multiplying the heatmap predictions of its two components and by training the network in an end-to-end manner. Thus, the SCN dedicates one component to locally accurate but ambiguous candidate predictions, while the other component improves robustness to ambiguities by incorporating the spatial configuration of landmarks. In our extensive experimental evaluation, we show that the proposed SCN outperforms related methods in terms of landmark localization error on a variety of size-limited 2D and 3D landmark localization datasets, i.e., hand radiographs, lateral cephalograms, hand MRIs, and spine CTs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
(2014) · Cited by 33,419
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
Fully convolutional networks for semantic segmentation
Shelhamer, E., Long, J., & Darrell, T. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2572683 · Cited by 11,898
Active Shape Models-Their Training and Application
Cootes, T. F., Taylor, C. J., Cooper, D. H., & Graham, J. (1995) · Computer Vision and Image Understanding · doi:10.1006/cviu.1995.1004 · Cited by 7,190
Attention U-Net: Learning Where to Look for the Pancreas
Oktay, O., Schlemper, J., Folgoc, L. L., Lee, M., Heinrich, M., Misawa, K., Mori, K., McDonagh, S., Hammerla, N. Y., Kainz, B., et al. (2018) · arXiv · doi:10.48550/arxiv.1804.03999 · Cited by 5,458
DeepPose: Human Pose Estimation via Deep Neural Networks
Toshev, A., & Szegedy, C. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.214 · Cited by 3,185
Conditional Random Fields as Recurrent Neural Networks
Zheng, S., Jayasumana, S., Romera-Paredes, B., Vineet, V., Su, Z., Du, D., Huang, C., & Torr, P. H. S. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.179 · Cited by 2,386
Pictorial Structures for Object Recognition
Felzenszwalb, P. F., & Huttenlocher, D. P. (2005) · International Journal of Computer Vision · doi:10.1023/b:visi.0000042934.15159.49 · Cited by 2,180
Mitosis Detection in Breast Cancer Histology Images with Deep Neural Networks
Cireşan, D. C., Giusti, A., Gambardella, L. M., & Schmidhuber, J. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-40763-5_51 · Cited by 1,536
Statistical shape models for 3D medical image segmentation: A review
Heimann, T., & Meinzer, H.-P. (2009) · Medical Image Analysis · doi:10.1016/j.media.2009.05.004 · Cited by 1,417
Gland segmentation in colon histology images: The glas challenge contest
Sirinukunwattana, K., Pluim, J. P. W., Chen, H., Qi, X., Heng, P.-A., Guo, Y. B., Wang, L. Y., Matuszewski, B. J., Bruni, E., Sanchez, U., et al. (2017) · Medical Image Analysis · doi:10.1016/j.media.2016.08.008 · Cited by 979
Self-citationJoint Training of a Convolutional Network and a Graphical Model for Human Pose Estimation
Tompson, J., Jain, A., LeCun, Y., & Bregler, C. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1406.2984 · Cited by 915
(2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-24574-4 · Cited by 526
Flowing ConvNets for Human Pose Estimation in Videos
Pfister, T., Charles, J., & Zisserman, A. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.222 · Cited by 500
A benchmark for comparison of dental radiography analysis algorithms
Wang, C.-W., Huang, C.-T., Lee, J.-H., Li, C.-H., Chang, S.-W., Siao, M.-J., Lai, T.-M., Ibragimov, B., Vrtovec, T., Ronneberger, O., et al. (2016) · Medical Image Analysis · doi:10.1016/j.media.2016.02.004 · Cited by 401
Consistent landmark and intensity-based image registration
Johnson, H. J., & Christensen, G. E. (2002) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2002.1009381 · Cited by 399
Multi-Scale Deep Reinforcement Learning for Real-Time 3D-Landmark Detection in CT Scans
Ghesu, F.-C., Georgescu, B., Zheng, Y., Grbic, S., Maier, A., Hornegger, J., & Comaniciu, D. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2782687 · Cited by 310
Robust and Accurate Shape Model Matching Using Random Forest Regression-Voting
Lindner, C., Bromiley, P. A., Ionita, M. C., & Cootes, T. F. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2382106 · Cited by 267
Regression forests for efficient anatomy detection and localization in computed tomography scans
Criminisi, A., Robertson, D., Konukoglu, E., Shotton, J., Pathak, S., White, S., & Siddiqui, K. (2013) · Medical Image Analysis · doi:10.1016/j.media.2013.01.001 · Cited by 235
Regressing Heatmaps for Multiple Landmark Localization Using CNNs
Payer, C., Štern, D., Bischof, H., & Urschler, M. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46723-8_27 · Cited by 232
Self-citationLindner, C., Wang, C.-W., Huang, C.-T., Li, C.-H., Chang, S.-W., & Cootes, T. F. (2016) · Scientific Reports · doi:10.1038/srep33581 · Cited by 225
Multi-label Whole Heart Segmentation Using CNNs and Anatomical Label Configurations
Payer, C., Štern, D., Bischof, H., & Urschler, M. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-75541-0_20 · Cited by 213
Self-citationZhang, J., Liu, M., & Shen, D. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2721106 · Cited by 192
Vertebrae Localization in Pathological Spine CT via Dense Classification from Sparse Annotations
Glocker, B., Zikic, D., Konukoglu, E., Haynor, D. R., & Criminisi, A. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-40763-5_33 · Cited by 190
Automatic Localization and Identification of Vertebrae in Arbitrary Field-of-View CT Scans
Glocker, B., Feulner, J., Criminisi, A., Haynor, D. R., & Konukoglu, E. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33454-2_73 · Cited by 190
Wells, W. M., Ünal, G., Sabuncu, M. R., Joskowicz, L., & Sebastien Ourselin, A. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46723-8 · Cited by 162
Chen, H., Shen, C., Qin, J., Ni, D., Shi, L., Cheng, J. C. Y., & Heng, P. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24553-9_63 · Cited by 143
Shape Representation for Efficient Landmark-Based Segmentation in 3-D
Ibragimov, B., Likar, B., Pernuš, F., & Vrtovec, T. (2014) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2013.2296976 · Cited by 123
Liao, H., Mesfin, A., & Luo, J. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2798293 · Cited by 113
Robust active appearance models and their application to medical image analysis
Beichel, R., Bischof, H., Leberl, F. W., & Milan Sonka, A. (2005) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2005.853237 · Cited by 106
Self-citationDonner, R., Menze, B. H., Bischof, H., & Langs, G. (2013) · Medical Image Analysis · doi:10.1016/j.media.2013.02.004 · Cited by 102
Self-citationYang, D., Xiong, T., Xu, D., Huang, Q., Liu, D., Zhou, S. K., Xu, Z., Park, J., Chen, M., Tran, T. D., et al. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-59050-9_50 · Cited by 101
Statistical Atlases and Computational Models of the Heart. ACDC and MMWHS Challenges
Isensee, F., Jaeger, P. F., Full, P. M., Ivo Wolf, A., Engelhardt, S., & Maier-Hein, K. H. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-75541-0 · Cited by 99
Parametric modelling and segmentation of vertebral bodies in 3D CT and MR spine images
Štern, D., Likar, B., Pernuš, F., & Vrtovec, T. (2011) · Physics in Medicine and Biology · doi:10.1088/0031-9155/56/23/011 · Cited by 97
Self-citationUrschler, M., Ebner, T., & Štern, D. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.09.003 · Cited by 97
Self-citationBtrfly Net: Vertebrae Labelling with Energy-based Adversarial Learning of Local Spine Prior
Sekuboyina, A., Rempfler, M., Kukačka, J., Tetteh, G., Valentinitsch, A., Kirschke, J., & Menze, B. H. (2018) · International Conference on Medical Image Computing and Computer-Assisted Intervention · doi:10.1007/978-3-030-00937-3_74 · Cited by 80
Search strategies for multiple landmark detection by submodular maximization
Liu, D., Zhou, K. S., Bernhardt, D., & Comaniciu, D. (2010) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2010.5540016 · Cited by 63
A Game-Theoretic Framework for Landmark-Based Image Segmentation
Ibragimov, B., Likar, B., Pernuš, F., & Vrtovec, T. (2012) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2012.2202915 · Cited by 61
From Local to Global Random Regression Forests: Exploring Anatomical Landmark Localization
Štern, D., Ebner, T., & Urschler, M. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46723-8_26 · Cited by 53
Self-citationAutomated Age Estimation from Hand MRI Volumes Using Deep Learning
Štern, D., Payer, C., Lepetit, V., & Urschler, M. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46723-8_23 · Cited by 48
Self-citationTowards intelligent robust detection of anatomical structures in incomplete volumetric data
Ghesu, F. C., Georgescu, B., Grbić, S., Maier, A., Joachim Hornegger, A., & Comaniciu, D. (2018) · Medical Image Analysis · doi:10.1016/j.media.2018.06.007 · Cited by 46
A Statistical Parts-Based Model of Anatomical Variability
Toews, M., & Arbel, T. (2007) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2007.892510 · Cited by 41
Urschler, M., Zach, C., Ditt, H., et al. (2006) · Lecture notes in computer science · doi:10.1007/11866763_87 · Cited by 23
Self-citationPersonalized Graphical Models for Anatomical Landmark Localization in Whole-Body Medical Images
Potěšil, V., Kadir, T., Platsch, G., & Brady, M. (2014) · International Journal of Computer Vision · doi:10.1007/s11263-014-0731-7 · Cited by 21
Medical Image Computing and Computer-Assisted Intervention – MICCAI 2014
Golland, P., Hata, N., Barillot, C., Joachim Hornegger, A., & Howe, R. D. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10470-6 · Cited by 9
Cited by
Explainable artificial intelligence: a comprehensive review
Minh, D., Wang, H. X., Li, Y. F., & Nguyen, T. N. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-10088-y · Cited by 983
A review of medical image data augmentation techniques for deep learning applications
Chlap, P., Min, H., Vandenberg, N., Dowling, J., Holloway, L., & Haworth, A. (2021) · Journal of Medical Imaging and Radiation Oncology · doi:10.1111/1754-9485.13261 · Cited by 956
Li, J., Chen, J., Tang, Y., Wang, C., Landman, B. A., & Zhou, S. K. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.102762 · Cited by 389
VerSe: A Vertebrae labelling and segmentation benchmark for multi-detector CT images
Sekuboyina, A., Husseini, M. E., Bayat, A., Löffler, M., Liebl, H., Li, H., Tetteh, G., Kukačka, J., Payer, C., Štern, D., et al. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.102166 · Cited by 372
Self-citationToraman, S., Alakus, T. B., & Turkoglu, I. (2020) · Chaos, Solitons & Fractals · doi:10.1016/j.chaos.2020.110122 · Cited by 327
Metadata
- Authors
- Payer, C., Štern, D., Bischof, H., & Urschler, M.
- Venue
- Medical Image Analysis
- Publisher
- Elsevier BV
- Published
- 2019-05
- Volume
- 54
- Pages
- 207-219
- ISSN
- 1361-8415 (ISSN-L)
- OpenAlex
- W2925288829
- Cited by
- 365
- References
- 52
- FWCI
- 11.78
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.