The DOI matches its DataCite record; 44 of the 44 references it cites were found in a registry or an index.
Real-time Deep Pose Estimation with Geodesic Loss for Image-to-Template Rigid Registration
Open accessAbstract
With an aim to increase the capture range and accelerate the performance of state-of-the-art inter-subject and subject-to-template 3D registration, we propose deep learning-based methods that are trained to find the 3D position of arbitrarily oriented subjects or anatomy based on slices or volumes of medical images. For this, we propose regression CNNs that learn to predict the angle-axis representation of 3D rotations and translations using image features. We use and compare mean square error and geodesic loss to train regression CNNs for 3D pose estimation used in two different scenarios: slice-to-volume registration and volume-to-volume registration. Our results show that in such registration applications that are amendable to learning, the proposed deep learning methods with geodesic loss minimization can achieve accurate results with a wide capture range in real-time (<100ms). We also tested the generalization capability of the trained CNNs on an expanded age range and on images of newborn subjects with similar and different MR image contrasts. We trained our models on T2-weighted fetal brain MRI scans and used them to predict the 3D pose of newborn brains based on T1-weighted MRI scans. We showed that the trained models generalized well for the new domain when we performed image contrast transfer through a conditional generative adversarial network. This indicates that the domain of application of the trained deep regression CNNs can be further expanded to image modalities and contrasts other than those used in training. A combination of our proposed methods with accelerated optimization-based registration algorithms can dramatically enhance the performance of automatic imaging devices and image processing methods of the future.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Geodesic loss, L geo , which is the square of the geodesic distance in SE(3), has been studied for registration problems due to its convexity with respect to pose transformations [32] [33].”
From A Fully Differentiable Framework for 2D/3D Registration and the Projective Spatial Transformers (2024) · cites this paper as [32]
Citations
Cites
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
A survey on deep learning in medical image analysis
Litjens, G., Kooi, T., Bejnordi, B. E., Setio, A. A. A., Ciompi, F., Ghafoorian, M., van der Laak, J. A. W. M., van Ginneken, B., & Sánchez, C. I. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.07.005 · Cited by 15,332
Fully convolutional networks for semantic segmentation
Shelhamer, E., Long, J., & Darrell, T. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2572683 · Cited by 11,898
Identity mappings in deep residual networks
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_38 · Cited by 10,741
Yushkevich, P. A., Piven, J., Hazlett, H. C., Smith, R. G., Ho, S., Gee, J. C., & Gerig, G. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.01.015 · Cited by 8,868
Mutual-information-based registration of medical images: a survey
Pluim, J. P. W., Maintz, J. B. A., & Viergever, M. A. (2003) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2003.815867 · Cited by 2,882
PoseNet: A Convolutional Network for Real-Time 6-DOF Camera Relocalization
Kendall, A., Grimes, M., & Cipolla, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.336 · Cited by 2,489
Hill, D. L. G., Batchelor, P. G., Holden, M., & Hawkes, D. J. (2001) · Physics in Medicine and Biology · doi:10.1088/0031-9155/46/3/201 · Cited by 2,093
Cited by
Sorted by citations
Items 101–119 of 119
(2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2893085
Reverse-Net: Few-Shot Learning with Reverse Teaching for Deformable Medical Image Registration
Zhang, X., Yang, T., Zhao, X., & Yang, A. (2023) · Applied Sciences · doi:10.3390/app13021040
Ultrasound 2d Fetal Developing Brain Image Classification and Disease PredictionPreprint
Sridha, K., Gokul, N., Giridharan, L., & Akashdeep, V. (2023) · Research Square · doi:10.21203/rs.3.rs-2748807/v1
ITR-Net: A Hybrid Deep Learning Architecture for Precise and Efficient Medical Image Registration
Yan, Y., Su, L., Zhou, C., Huang, Y., Li, J., Li, R., Hassan, H., & Huang, B. (2023) · IEEE Joint International Information Technology and Artificial Intelligence Conference (ITAIC) · doi:10.1109/itaic58329.2023.10409014
Pose Estimation for Non-Cooperative Spacecraft Based on Deep LearningPreprint
GAO, X., Liu, C., Liu, J., & Hu, W. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4887267
SpaER: Learning Spatio-temporal Equivariant Representations for Fetal Brain Motion Tracking
Wang, J., Faghihpirayesh, R., Golland, P., & Gholipour, A. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73260-7_1
Self-citationMultispectral Registration Algorithm Based on Fusion of Infrared and Color Images
Wan, T., Du, S., Zhang, Q., Qi, Y., & Li, C. (2024) · International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery (CyberC) · doi:10.1109/cyberc62439.2024.00012
Boosting 2D brain image registration via priors from large model
Lin, H., & Song, Y. (2025) · Medical Physics · doi:10.1002/mp.17696
A Rigid Registration Pipeline for TMJ CBCT Time-Series Images with Removal of Remodel Structures
Chen, Z., Li, J., Feng, J., Ma, R., & Li, G. (2024) · International Congress on Image and Signal Processing (CISP) · doi:10.1109/cisp-bmei64163.2024.10906293
2D Ultrasound to 3D CT Image Registration for Liver Ablation Surgery
Vathanakumar, M., Jegakumaran, P., Nasvi, N., Sivakumar, L., Nanayakkara, N. D., Appuhamy, C., Siriwardena, R., & Liyanaarachchi, M. R. (2024) · IEEE Region 10 Conference (TENCON) · doi:10.1109/tencon61640.2024.10902885
Unsupervised Keypoint-Based 2D/3D Registration in Minimally Invasive Pelvic Surgery
Ju, F., Yuan, L., & Zhao, J. (2025) · International Seminar on Artificial Intelligence, Networking and Information Technology (AINIT) · doi:10.1109/ainit65432.2025.11035310
Spatial Regularisation for Improved Accuracy and Interpretability in Keypoint-Based Registration
Billot, B., Muthukrishnan, R., Türk, E. A., Grant, P. E., Ayache, N., Delingette, H., & Golland, P. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-05185-1_56
SAACT: Semiautomated Annotation of Computerized Tomography Data
Gabbar, H. A., Khan, M. J. A., Chahid, A., & Jing Ren, A. (2025) · Canadian Journal of Electrical and Computer Engineering · doi:10.1109/icjece.2025.3607372
Zhang, Z., Zhang, L., Cheng, Y., Wang, Z., Wang, F., Zhang, H., Yang, Y., Wu, Y., Huang, J., Avilés-Rivero, A. I., et al. (2026) · IEEE Transactions on Image Processing · doi:10.1109/tip.2026.3678052
Chen, M., & Kong, Y. (2026) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61042.2026.00699
Geometry-Aware Enhanced 6DRepNet for Single-RGB Head Pose Estimation
Yang, H., Li, Y., Mu, M., & Zhao, M. (2026) · Sensors · doi:10.3390/s26103266
Dupuis, C., Meyer, E., Masum, A. K. M., & Aygün, S. (2026) · Design, Automation, and Test in Europe · doi:10.23919/date69613.2026.11539628
Roles and applications of artificial intelligence in fetal and placental MRI: a literature review
Ding, D., Zhu, F., Tang, X., & Ding, Z. (2026) · BMC Pregnancy and Childbirth · doi:10.1186/s12884-026-09494-3
PICO: Projection-Informed Consistency Optimisation for 6DoF surgical tool pose estimation
Fothergill, L., Valdastri, P., Jones, D., & Sarıkaya, D. (2026) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-026-03802-0
Metadata
- Authors
- Salehi, S. S. M., Khan, S., Erdogmus, D., & Gholipour, A.
- Affiliations
- Boston Children's Hospital (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- Volume
- 38
- Issue
- 2
- Pages
- 470-481
- ISSN
- 0278-0062 (ISSN-L)
- arXiv
- 1803.05982
- PMC
- PMC6438698
- OpenAlex
- W2805701966
- Cited by
- 118
- References
- 44
- Citations by year
- 2026: 9 · 2025: 17 · 2024: 19 · 2023: 18 · 2022: 21 · 2021: 15 · 2020: 15 · 2019: 2 · 2018: 2
- FWCI
- 4.25
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- IEEE Transactions on Medical Imaging (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- McKnight Foundation
- National Institute of Neurological Disorders and Stroke (R01NS106030)
- National Institute of Biomedical Imaging and Bioengineering (R01EB018988)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Medical Image Segmentation Techniques
- Physical Sciences › Engineering › Biomedical Engineering › Medical Imaging and Analysis
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Keywords
- fetal brain MRI, slice-to-volume registration, domain generalization, conditional generative adversarial networks, real-time registration
- MeSH terms
- Deep Learning, Algorithms, Brain, Female, Fetus, Humans, Image Processing, Computer-Assisted, Infant, Newborn, Magnetic Resonance Imaging, Pregnancy, Databases, Factual
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review