The DOI matches its Crossref record; 40 of the 41 references it cites were found in a registry or an index.
Detecting Anatomical Landmarks From Limited Medical Imaging Data Using Two-Stage Task-Oriented Deep Neural Networks
Open accessAbstract
One of the major challenges in anatomical landmark detection, based on deep neural networks, is the limited availability of medical imaging data for network learning. To address this problem, we present a two-stage task-oriented deep learning method to detect large-scale anatomical landmarks simultaneously in real time, using limited training data. Specifically, our method consists of two deep convolutional neural networks (CNN), with each focusing on one specific task. Specifically, to alleviate the problem of limited training data, in the first stage, we propose a CNN based regression model using millions of image patches as input, aiming to learn inherent associations between local image patches and target anatomical landmarks. To further model the correlations among image patches, in the second stage, we develop another CNN model, which includes a) a fully convolutional network that shares the same architecture and network weights as the CNN used in the first stage and also b) several extra layers to jointly predict coordinates of multiple anatomical landmarks. Importantly, our method can jointly detect large-scale (e.g., thousands of) landmarks in real time. We have conducted various experiments for detecting 1200 brain landmarks from the 3D T1-weighted magnetic resonance images of 700 subjects, and also 7 prostate landmarks from the 3D computed tomography images of 73 subjects. The experimental results show the effectiveness of our method regarding both accuracy and efficiency in the anatomical landmark detection.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
TensorFlow: A system for large-scale machine learningPreprint
Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., et al. (2016) · arXiv (Cornell University) · doi:10.5555/3026877.3026899 · Cited by 16,548
R-FCN: Object Detection via Region-based Fully Convolutional NetworksPreprint
Dai, J., Li, Y., He, K., & Sun, J. Z. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.06409 · Cited by 5,135
OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks
Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., & LeCun, Y. (2013) · arXiv · doi:10.48550/arxiv.1312.6229 · Cited by 2,680
Facial Landmark Detection by Deep Multi-task Learning
Zhang, Z., Luo, P., Loy, C. C., & Tang, X. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10599-4_7 · Cited by 1,410
Deep Convolutional Network Cascade for Facial Point Detection
Sun, Y. J., Wang, X., & Tang, X. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.446 · Cited by 1,405
Efficient object localization using Convolutional Networks
Tompson, J., Goroshin, R., Jain, A., LeCun, Y., & Bregler, C. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298664 · Cited by 1,365
Multi-atlas segmentation of biomedical images: A survey
Iglesias, J. E., & Sabuncu, M. R. (2015) · Medical Image Analysis · doi:10.1016/j.media.2015.06.012 · Cited by 667
From Facial Parts Responses to Face Detection: A Deep Learning Approach
Yang, S., Luo, P., Loy, C. C., & Tang, X. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.419 · Cited by 574
Robust and Accurate Shape Model Fitting Using Random Forest Regression Voting
Cootes, T. F., Ionita, M. C., Lindner, C., & Sauer, P. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33786-4_21 · Cited by 304
Regressing Heatmaps for Multiple Landmark Localization Using CNNs
Payer, C., Štern, D., Bischof, H., & Urschler, M. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46723-8_27 · Cited by 256
Detecting Anatomical Landmarks for Fast Alzheimer’s Disease Diagnosis
Zhang, J., Gao, Y., Gao, Y., Munsell, B. C., & Shen, D. G. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2582386 · Cited by 225
Self-citationZhu, X., Suk, H.-I., & Shen, D. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.05.078 · Cited by 202
Self-citationFully Automatic Segmentation of the Proximal Femur Using Random Forest Regression Voting
Lindner, C., Thiagarajah, S., Wilkinson, J. M., The Consortium, Wallis, G. A., & Cootes, T. F. (2013) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2013.2258030 · Cited by 198
Alzheimer's Disease Diagnosis Using Landmark-Based Features From Longitudinal Structural MR Images
Zhang, J., Liu, M., An, L., Gao, Y., & Shen, D. G. (2017) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2017.2704614 · Cited by 181
Self-citationAn Artificial Agent for Anatomical Landmark Detection in Medical Images
Ghesu, F. C., Georgescu, B., Mansi, T., Neumann, D., Joachim Hornegger, A., & Comaniciu, D. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46726-9_27 · Cited by 161
Liu, M., Zhang, J., Yap, P., & Shen, D. G. (2016) · Medical Image Analysis · doi:10.1016/j.media.2016.11.002 · Cited by 159
Self-citationLocal Energy Pattern for Texture Classification Using Self-Adaptive Quantization Thresholds
Zhang, J., Liang, J., & Zhao, H. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2214045 · Cited by 151
Self-citation3D Deep Learning for Efficient and Robust Landmark Detection in Volumetric Data
Zheng, Y., Liu, D., Georgescu, B., Nguyen, H. V., & Comaniciu, D. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24553-9_69 · Cited by 151
Decision Forests with Long-Range Spatial Context for Organ Localization in CT Volumes
Criminisi, A., & Bucciarelli, S. (2009) · Cited by 140
Joint Binary Classifier Learning for ECOC-Based Multi-Class Classification
Liu, M., Zhang, D., Chen, S., & Xue, H. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2430325 · Cited by 91
Self-citationFeng, Z., Hu, G., Kittler, J., Christmas, W. J., & Wu, X. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2446944 · Cited by 89
Automatic localization of the left ventricle in cardiac MRI images using deep learning
Emad, O., Yassine, I. A., & Fahmy, A. S. (2015) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2015.7318454 · Cited by 85
Stratified Decision Forests for Accurate Anatomical Landmark Localization in Cardiac Images
Oktay, O., Bai, W., Guerrero, R., Rajchl, M., de Marvao, A., O’Regan, D. P., Cook, S. A., Heinrich, M. P., Glocker, B., & Rueckert, D. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2597270 · Cited by 74
An evidential classifier based on feature selection and two-step classification strategy
Lian, C., Ruan, S., & Denœux, T. (2015) · Pattern Recognition · doi:10.1016/j.patcog.2015.01.019 · Cited by 68
Suzani, A., Rasoulian, A., Seitel, A., Fels, S., Rohling, R. N., & Abolmaesumi, P. (2015) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.2081542 · Cited by 65
Continuous rotation invariant local descriptors for texton dictionary-based texture classification
Zhang, J., Zhao, H., & Liang, J. (2012) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2012.10.004 · Cited by 64
Self-citationChen, C., Xie, W., Franke, J., Grützner, P.-A., Nolte, L.-P., & Guoyan Zheng, A. (2014) · Medical Image Analysis · doi:10.1016/j.media.2014.01.002 · Cited by 61
Zhang, J., Gao, Y.-Z., Wang, L., Tang, Z., Xia, J., & Shen, D. (2015) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2015.2503421 · Cited by 54
Self-citationRobust Automatic Knee MR Slice Positioning Through Redundant and Hierarchical Anatomy Detection
Zhan, Y., Dewan, M., Harder, M., Krishnan, A., & Zhou, X. (2011) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2011.2162634 · Cited by 50
Dual Sparse Constrained Cascade Regression for Robust Face Alignment
Liu, Q., Deng, J., & Tao, D. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2502485 · Cited by 37
Automatic Labeling of Anatomical Structures in MR FastView Images Using a Statistical Atlas
Fenchel, M., Thesen, S., & Schilling, A. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-85988-8_69 · Cited by 34
Unconstrained Facial Landmark Localization with Backbone-Branches Fully-Convolutional NetworksPreprint
Liang, Z., Ding, S., & Lin, L. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1507.03409 · Cited by 31
Learning-Based Multimodal Image Registration for Prostate Cancer Radiation Therapy
Cao, X., Gao, Y., Yang, J., Guorong Wu, A., & Shen, D. G. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46726-9_1 · Cited by 28
Self-citationAubert, B., Vázquez, C., Cresson, T., Stefan Parent, D., & de Guise, J. A. (2016) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2016.7493535 · Cited by 24
Generalized sparse MRF appearance models
Donner, R., Langs, G., Mičušík, B., & Bischof, H. (2009) · Image and Vision Computing · doi:10.1016/j.imavis.2009.07.010 · Cited by 22
Anatomical Landmark Detection in Medical Applications Driven by Synthetic Data
Riegler, G., Urschler, M., Rüther, M., Bischof, H., & Štern, D. (2015) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2015.21 · Cited by 18
Cited by
Sorted by citations
Deep learning in medical imaging and radiation therapy
Sahiner, B., Pezeshk, A. X., Hadjiiski, L. M., Wang, X., Drukker, K., Cha, K. H., Summers, R. M., & Giger, M. L. (2018) · Medical Physics · doi:10.1002/mp.13264 · Cited by 763
Lian, C., Liu, M., Zhang, J., & Shen, D. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2889096 · Cited by 544
Self-citationConvolutional Neural Networks for Radiologic Images: A Radiologist’s Guide
Soffer, S., Ben-Cohen, A., Shimon, O., Amitai, M. M., Greenspan, H. K., & Klang, E. (2019) · Radiology · doi:10.1148/radiol.2018180547 · Cited by 528
Landmark-based deep multi-instance learning for brain disease diagnosis
Liu, M., Zhang, J., Adeli, E., & Shen, D. G. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.10.005 · Cited by 434
Self-citationLiang, S., Wu, H., Zhen, L., Hua, Q., Garg, S., Kaddoum, G., Hassan, M. M., & Yu, K. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3158253 · Cited by 367
Metadata
- Authors
- Zhang, J., Liu, M., & Shen, D.
- Affiliations
- University of North Carolina at Chapel Hill (US)
- Venue
- IEEE Transactions on Image Processing
- Published
- 2017-10
- Volume
- 26
- Issue
- 10
- Pages
- 4753-4764
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- PMC
- PMC5729285
- OpenAlex
- W2724710774
- Cited by
- 192
- References
- 41
- Citations by year
- 2026: 10 · 2025: 14 · 2024: 11 · 2023: 16 · 2022: 31 · 2021: 29 · 2020: 29 · 2019: 20 · 2018: 26 · 2017: 6
- FWCI
- 9.98
- Type
- journal article
- Language
- en
- Open access
- green
- europepmc.org
- Locations
- IEEE Transactions on Image Processing (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Carolina Digital Repository (University of North Carolina at Chapel Hill) (submittedVersion)
- Figshare (submittedVersion, cc-by)
- UNC Libraries
- Funders
- NIH (EB006733, EB008374, EB009634, MH100217, AG041721, AG049371, AG042599)
- Topics
- Physical Sciences › Engineering › Biomedical Engineering › Medical Imaging and Analysis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Medical Image Segmentation Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- anatomical landmark detection, limited training data, convolutional neural networks, fully convolutional network, 3D medical images, T1-weighted imaging, CT images
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
