Real-Time Deep Pose Estimation With Geodesic Loss for Image-to-Template Rigid Registration
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
With an aim to increase the capture range and accelerate the performance of state-of-the-art inter-subject and subject-to-template 3-D rigid registration, we propose deep learning-based methods that are trained to find the 3-D position of arbitrarily-oriented subjects or anatomy in a canonical space based on slices or volumes of medical images. For this, we propose regression convolutional neural networks (CNNs) that learn to predict the angle-axis representation of 3-D rotations and translations using image features. We use and compare mean square error and geodesic loss to train regression CNNs for 3-D pose estimation used in two different scenarios: slice-to-volume registration and volume-to-volume registration. As an exemplary application, we applied the proposed methods to register arbitrarily oriented reconstructed images of fetuses scanned in-utero at a wide gestational age range to a standard atlas space. Our results show that in such registration applications that are amendable to learning, the proposed deep learning methods with geodesic loss minimization achieved 3-D pose estimation with a wide capture range in real-time (<100ms). We also tested the generalization capability of the trained CNNs on an expanded age range and on images of newborn subjects with similar and different MR image contrasts. We trained our models on T2-weighted fetal brain MRI scans and used them to predict the 3-D pose of newborn brains based on T1-weighted MRI scans. We showed that the trained models generalized well for the new domain when we performed image contrast transfer through a conditional generative adversarial network. This indicates that the domain of application of the trained deep regression CNNs can be further expanded to image modalities and contrasts other than those used in training. A combination of our proposed methods with accelerated optimization-based registration algorithms can dramatically enhance the performance of automatic imaging devices and image processing methods of the future.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A survey on deep learning in medical image analysis
Litjens, G., Kooi, T., Bejnordi, B. E., Setio, A. A. A., Ciompi, F., Ghafoorian, M., van der Laak, J. A. W. M., van Ginneken, B., & Sánchez, C. I. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.07.005 · Cited by 15,332
Identity mappings in deep residual networks
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_38 · Cited by 10,741
Identity Mappings in Deep Residual Networks
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · arXiv · doi:10.48550/arxiv.1603.05027 · Cited by 10,665 · cited 1×
“For slice 3D pose estimation we used an 18-layer residual CNN [36] for feature extraction, and two regression heads1: one for regression over 3 rotation parameters and the other”
MethodYushkevich, P. A., Piven, J., Hazlett, H. C., Smith, R. G., Ho, S., Gee, J. C., & Gerig, G. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.01.015 · Cited by 8,868
PoseNet: A Convolutional Network for Real-Time 6-DOF Camera Relocalization
Kendall, A., Grimes, M., & Cipolla, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.336 · Cited by 2,489
Deformable medical image registration: a survey
Sotiras, A., Davatzikos, C., & Paragios, N. (2013) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2013.2265603 · Cited by 1,587 · cited 1×
“The most widely used transformations in biomedical image registration range from rigid and affine to high-dimensional small or large deformations based on biophysical/biomechanical, elastic, or viscous fluid models [6].”
BackgroundA Review of 3d/2d Registration Methods for Image-Guided Interventions
Markelj, P., Tomaževič, D., Likar, B., & Pernuš, F. (2012) · Medical Image Analysis · doi:10.1016/j.media.2010.03.005 · Cited by 746 · cited 1×
“com/SadeghMSalehi/DeepRegistration range from image-based navigation in imaging and imageguided interventions to longitudinal and group analyses [1], [2], [3], [4], [5], [6], [7].”
BackgroundQuicksilver: Fast predictive image registration – A deep learning approach
Yang, X., Kwitt, R., Styner, M., & Niethammer, M. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.07.008 · Cited by 630 · cited 1×
“[13] developed a deep autoencoder-decoder convolutional neural network (CNN) that learned to predict the Large Deformation Diffeomorphic Metric Mapping (LDDMM) model, and achieved state-of-the-art performance with an order of magnitude faster optimization in inter-subject and subject-to-atlas deformable registration.”
MethodA CNN Regression Approach for Real-Time 2D/3D Registration
Miao, S., Wang, Z. J., & Liao, R. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2521800 · Cited by 514 · cited 2×
“Similar to [15], [16], and [21], we propose deep CNN”
MethodResult3D Pose Regression Using Convolutional Neural Networks
Mahendran, S., Ali, H., & Vidal, R. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.73 · Cited by 210 · cited 2×
“[21] have recently modeled the 3D camera/object pose estimation as a regression problem.”
MethodResult
Research works printed but not linked: 30
- 10.1088/0031-9155/46/3/201 · DOI · Paper page
- 10.1109/TMI.2003.815867 · DOI · Paper page
- 10.1109/TMI.2007.892508 · DOI · Paper page
- 10.1016/j.media.2017.04.010 · DOI · Paper page
- 10.1109/CVPR.2015.7298965 · DOI · Paper page
- 10.1109/TMI.2016.2553401 · DOI · Paper page
- 10.1007/978-3-319-46726-9_2 · DOI · Paper page
- 10.1109/TBME.2015.2496253 · DOI · Paper page
- 10.1007/978-3-319-46466-4_22 · DOI
- 10.1109/ICRA.2017.7989233 · DOI · Paper page
- 10.1109/CVPR.2015.7298758 · DOI · Paper page
- 10.1109/ICCV.2015.308 · DOI · Paper page
- 10.1109/ICCVW.2017.254 · doi:10.1109/iccvw.2017.254 · Paper page
- 10.1007/s10851-009-0161-2 · DOI · Paper page
- 10.1109/TMI.2010.2051680 · DOI · Paper page
- 10.1016/j.neuroimage.2017.04.033 · DOI · Paper page
- 10.1109/TMI.2018.2798801 · DOI · Paper page
- 10.1016/j.media.2018.02.006 · DOI · Paper page
- 10.1002/cmr.a.21321 · DOI · Paper page
- 10.1002/1522-2594(200009)44:3<457::AID-MRM17>3.0.CO;2-R · DOI · Paper page
- 10.1002/mrm.22176 · DOI · Paper page
- 10.1109/IEMBS.2011.6091385 · DOI
- 10.1109/TMI.2016.2555244 · DOI
- 10.1007/978-3-319-67564-0_8 · DOI
- 10.1109/ISBI.2018.8363675 · DOI
- 10.1109/TMI.2017.2721362 · DOI · Paper page
- 10.1038/s41598-017-00525-w · DOI · Paper page
- Arvo, 2013, Graphics Gems II
- 10.1109/CVPR.2017.632 · DOI · Paper page
- 10.1109/ICCV.2017.244 · DOI · Paper page
Cited by
Deep learning in medical image registration: a review
Fu, Y., Lei, Y., Wang, T., Curran, W. J., Liu, T., & Yang, X. (2020) · Physics in Medicine & Biology · doi:10.1088/1361-6560/ab843e · Cited by 661
Deep Learning in Medical Image Registration
Chen, X., Diaz-Pinto, A., Ravikumar, N., & Frangi, A. (2020) · Progress in Biomedical Engineering · doi:10.1088/2516-1091/abd37c · Cited by 106
Dhombres, F., Bonnard, J., Bailly, K., Maurice, P., Papageorghiou, A. T., & Jouannic, J.-M. (2022) · Journal of Medical Internet Research · doi:10.2196/35465 · Cited by 93
A Fully Differentiable Framework for 2D/3D Registration and the Projective Spatial Transformers
Gao, C., Feng, A., Liu, X., Taylor, R. H., Armand, M., & Unberath, M. (2024) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2023.3299588 · Cited by 55
“Geodesic loss, L geo , which is the square of the geodesic distance in SE ( 3 ) , has been studied for registration problems due to its convexity with respect to pose transformations [32], [33].”
BackgroundA Patient-Specific Self-supervised Model for Automatic X-Ray/CT Registration
Zhang, B., Faghihroohi, S., Azampour, M. F., Liu, S., Ghotbi, R., Schunkert, H., & Navab, N. (2023) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-43996-4_49 · Cited by 27
Metadata
- Authors
- Mohseni Salehi, S. S., Khan, S., Erdogmus, D., & Gholipour, A.
- Venue
- IEEE Transactions on Medical Imaging
- Published
- 2019-02
- Volume
- 38
- Issue
- 2
- Pages
- 470-481
- ISSN
- 0278-0062 (ISSN-L)
- 1558-254X
- OpenAlex
- W2805701966
- Cited by
- 115
- References
- 16
- FWCI
- 3.99
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- Funders
- McKnight Foundation
- National Institute of Biomedical Imaging and Bioengineering (R01 EB018988)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Real-Time Deep Pose Estimation With Geodesic Loss for Image-to-Template Rigid Registration. https://app.cochat.ai/papers/10.1109/tmi.2018.2866442
- The paper
- Mohseni Salehi, S. S., Khan, S., Erdogmus, D., & Gholipour, A. (2019). Real-Time Deep Pose Estimation With Geodesic Loss for Image-to-Template Rigid Registration. IEEE Transactions on Medical Imaging. https://doi.org/10.1109/tmi.2018.2866442
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.