Real-time Deep Pose Estimation with Geodesic Loss for Image-to-Template Rigid Registration
Open accessAbstract
With an aim to increase the capture range and accelerate the performance of state-of-the-art inter-subject and subject-to-template 3D registration, we propose deep learning-based methods that are trained to find the 3D position of arbitrarily oriented subjects or anatomy based on slices or volumes of medical images. For this, we propose regression CNNs that learn to predict the angle-axis representation of 3D rotations and translations using image features. We use and compare mean square error and geodesic loss to train regression CNNs for 3D pose estimation used in two different scenarios: slice-to-volume registration and volume-to-volume registration. Our results show that in such registration applications that are amendable to learning, the proposed deep learning methods with geodesic loss minimization can achieve accurate results with a wide capture range in real-time (<100ms). We also tested the generalization capability of the trained CNNs on an expanded age range and on images of newborn subjects with similar and different MR image contrasts. We trained our models on T2-weighted fetal brain MRI scans and used them to predict the 3D pose of newborn brains based on T1-weighted MRI scans. We showed that the trained models generalized well for the new domain when we performed image contrast transfer through a conditional generative adversarial network. This indicates that the domain of application of the trained deep regression CNNs can be further expanded to image modalities and contrasts other than those used in training. A combination of our proposed methods with accelerated optimization-based registration algorithms can dramatically enhance the performance of automatic imaging devices and image processing methods of the future.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Geodesic loss L_geo is convex with respect to pose transformations.
“Geodesic loss, L geo , which is the square of the geodesic distance in SE(3), has been studied for registration problems due to its convexity with respect to pose transformations [32] [33].”
From A Fully Differentiable Framework for 2D/3D Registration and the Projective Spatial Transformers (2024) · cites this paper as [32]
Cites
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834 · see citing works
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602 · see citing works
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930 · see citing works
A survey on deep learning in medical image analysis
Litjens, G., Kooi, T., Bejnordi, B. E., Setio, A. A. A., Ciompi, F., Ghafoorian, M., van der Laak, J. A. W. M., van Ginneken, B., & Sánchez, C. I. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.07.005 · Cited by 15,332 · see citing works
Fully convolutional networks for semantic segmentation
Shelhamer, E., Long, J., & Darrell, T. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2572683 · Cited by 11,898 · see citing works
Identity mappings in deep residual networks
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_38 · Cited by 10,741 · see citing works
Yushkevich, P. A., Piven, J., Hazlett, H. C., Smith, R. G., Ho, S., Gee, J. C., & Gerig, G. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.01.015 · Cited by 8,868 · see citing works
Mutual-information-based registration of medical images: a survey
Pluim, J. P. W., Maintz, J. B. A., & Viergever, M. A. (2003) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2003.815867 · Cited by 2,882 · see citing works
PoseNet: A Convolutional Network for Real-Time 6-DOF Camera Relocalization
Kendall, A., Grimes, M., & Cipolla, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.336 · Cited by 2,489 · see citing works
Hill, D. L. G., Batchelor, P. G., Holden, M., & Hawkes, D. J. (2001) · Physics in Medicine and Biology · doi:10.1088/0031-9155/46/3/201 · Cited by 2,093 · see citing works
Greenspan, H. K., van Ginneken, B., & Summers, R. M. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2553401 · Cited by 1,704 · see citing works
Deformable medical image registration: a survey
Sotiras, A., Davatzikos, C., & Paragios, N. (2013) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2013.2265603 · Cited by 1,587 · see citing works
A Review of 3d/2d Registration Methods for Image-Guided Interventions
Markelj, P., Tomaževič, D., Likar, B., & Pernuš, F. (2012) · Medical Image Analysis · doi:10.1016/j.media.2010.03.005 · Cited by 746 · see citing works
Metrics for 3D Rotations: Comparison and Analysis
Huynh, D. Q. (2009) · Journal of Mathematical Imaging and Vision · doi:10.1007/s10851-009-0161-2 · Cited by 718 · see citing works
Render for CNN: Viewpoint Estimation in Images Using CNNs Trained with Rendered 3D Model Views
Su, H., Qi, C. R., Li, Y., & Guibas, L. J. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.308 · Cited by 680 · see citing works
Quicksilver: Fast predictive image registration – A deep learning approach
Yang, X., Kwitt, R., Styner, M., & Niethammer, M. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.07.008 · Cited by 630 · see citing works
A CNN Regression Approach for Real-Time 2D/3D Registration
Miao, S., Wang, Z. J., & Liao, R. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2521800 · Cited by 514 · see citing works
PROMO: Real‐time prospective motion correction in MRI using image‐based tracking
White, N. S., Roddey, J. C., Shankaranarayanan, A., Han, E. T., Rettmann, D. W., Santos, J. M., Kuperman, J., & Dale, A. M. (2009) · Magnetic Resonance in Medicine · doi:10.1002/mrm.22176 · Cited by 377 · see citing works
6-DoF object pose from semantic keypoints
Pavlakos, G., Zhou, X., Chan, A., Derpanis, K. G., & Daniilidis, K. (2017) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2017.7989233 · Cited by 367 · see citing works
Gholipour, A., Rollins, C. K., Velasco‐Annis, C., Ouaalam, A., Akhondi‐Asl, A., Afacan, O., Ortinau, C. M., Clancy, S., Limperopoulos, C., Yang, E., et al. (2017) · Scientific Reports · doi:10.1038/s41598-017-00525-w · Cited by 357 · see citing works
Self-citationGholipour, A., Estroff, J. A., & Warfield, S. K. (2010) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2010.2051680 · Cited by 351 · see citing works
Self-citationTulsiani, S., & Malik, J. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298758 · Cited by 348 · see citing works
Guorong Wu, A., Kim, M., Wang, Q., Munsell, B. C., & Shen, D. G. (2015) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2015.2496253 · Cited by 277 · see citing works
Brain Functional Localization: A Survey of Image Registration Techniques
Gholipour, A., Kehtarnavaz, N., Briggs, R. W., Devous, M. D., & Gopinath, K. (2007) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2007.892508 · Cited by 270 · see citing works
Self-citationSingle Image 3D Interpreter Network
Wu, J., Xue, T., Lim, J. J., Tian, Y., Tenenbaum, J. B., Torralba, A. B., & Freeman, W. T. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46466-4_22 · Cited by 248 · see citing works
Single Image 3D Interpreter Network
Tian, Y., Wu, J., Xue, T., Lim, J. J., Tenenbaum, J. B., Torralba, A. B., & Freeman, W. T. (2016) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 241 · see citing works
Salehi, S. S. M., Deniz Erdogmus, B., & Gholipour, A. (2017) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2017.2721362 · Cited by 232 · see citing works
Self-citationA Deep Metric for Multimodal Registration
Simonovsky, M., Gutiérrez-Becker, B., Mateus, D., Navab, N., & Nikos Komodakis, A. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46726-9_2 · Cited by 224 · see citing works
3D Pose Regression Using Convolutional Neural Networks
Mahendran, S., Ali, H., & Vidal, R. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.73 · Cited by 210 · see citing works
Fast Volume Reconstruction From Motion Corrupted Stacks of 2D Slices
Kainz, B., Steinberger, M., Wein, W., Kuklisova-Murgasova, M., Malamateniou, C., Keraudren, K., Torsney-Weir, T., Rutherford, M., Aljabar, P., Hajnal, J. V., et al. (2015) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2015.2415453 · Cited by 200 · see citing works
An artificial agent for robust image registration
Liao, R., Miao, S., De Tournemire, P., Grbic, S., Kamen, A., Mansi, T., & Comaniciu, D. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11230 · Cited by 199 · see citing works
A Survey of Medical Image Registration on Multicore and the GPU
Shams, R., Sadeghi, P., Kennedy, R., & Hartley, R. (2010) · IEEE Signal Processing Magazine · doi:10.1109/msp.2009.935387 · Cited by 198 · see citing works
Slice-to-volume medical image registration: A survey
Ferrante, E., & Nikos Paragios, A. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.04.010 · Cited by 177 · see citing works
Fetal MRI: A technical update with educational aspirations
Gholipour, A., Estroff, J. A., Barnewolt, C. E., Robertson, R. L., Grant, P. E., Gagoski, B. A., Warfield, S. K., Afacan, O., Connolly, S. A., Neil, J. J., et al. (2014) · Concepts in Magnetic Resonance Part A · doi:10.1002/cmr.a.21321 · Cited by 121 · see citing works
Self-citationReal-time automatic fetal brain extraction in fetal MRI by deep learning
Salehi, S. S. M., Hashemi, S. R., Velasco‐Annis, C., Ouaalam, A., Estroff, J. A., Deniz Erdogmus, B., Warfield, S. K., & Gholipour, A. (2018) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2018.8363675 · Cited by 102 · see citing works
Self-citationReal-time 2D/3D registration via CNN regression
Miao, S., Wang, Z. J., Zheng, Y., & Liao, R. (2016) · 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2016.7493536 · Cited by 101 · see citing works
Namburete, A. I. L., Xie, W., Yaqub, M., Zisserman, A., & Noble, J. A. (2018) · Medical Image Analysis · doi:10.1016/j.media.2018.02.006 · Cited by 95 · see citing works
3-D Reconstruction in Canonical Co-Ordinate Space From Arbitrarily Oriented 2-D Images
Hou, B., Khanal, B., Alansary, A., McDonagh, S., Davidson, A., Rutherford, M., Hajnal, J. V., Rueckert, D., Glocker, B., & Kainz, B. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2798801 · Cited by 90 · see citing works
Marami, B., Salehi, S. S. M., Afacan, O., Scherrer, B., Rollins, C. K., Yang, E., Estroff, J. A., Warfield, S. K., & Gholipour, A. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.04.033 · Cited by 78 · see citing works
Self-citationPredicting Slice-to-Volume Transformation in Presence of Arbitrary Subject Motion
Hou, B., Alansary, A., McDonagh, S., Davidson, A., Rutherford, M., Hajnal, J. V., Rueckert, D., Glocker, B., & Kainz, B. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-66185-8_34 · Cited by 68 · see citing works
Marami, B., Scherrer, B., Afacan, O., Erem, B., Warfield, S. K., & Gholipour, A. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2555244 · Cited by 40 · see citing works
Self-citationGholipour, A., Polak, M., van der Kouwe, A. J. W., Nevo, E., & Warfield, S. K. (2011) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/iembs.2011.6091385 · Cited by 23 · see citing works
Self-citationKurugol, S., Marami, B., Afacan, O., Warfield, S. K., & Gholipour, A. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-67564-0_8 · Cited by 6 · see citing works
Self-citationSlow vasomotor fluctuation in fMRI of anesthetized child brain
Kiviniemi, V., Jauhiainen, J., Tervonen, O., P��kk�, E., Oikarinen, J., Vainionp��, V., Rantala, H., & Biswal, B. (2000) · Magnetic Resonance in Medicine · doi:10.1002/1522-2594(200009)44:3
Flagged first, then by citations
Cited by
Sorted by citations
An overview of deep learning in medical imaging focusing on MRI
Lundervold, A. S., & Lundervold, A. (2019) · Zeitschrift für Medizinische Physik · doi:10.1016/j.zemedi.2018.11.002 · Cited by 2,058 · see citing works
An overview of deep learning in medical imaging focusing on MRI
Lundervold, A. S., & Lundervold, A. (2018) · NORA - Norwegian Open Research Archives · Cited by 1,012 · see citing works
Deep learning in medical image registration: a review
Fu, Y., Lei, Y., Wang, T., Curran, W. J., Liu, T., & Yang, X. (2020) · Physics in Medicine & Biology · doi:10.1088/1361-6560/ab843e · Cited by 661 · see citing works
Deep learning in medical image registration: a survey
Haskins, G., Kruger, U., & Yan, P. (2020) · Machine Vision and Applications · doi:10.1007/s00138-020-01060-x · Cited by 704 · see citing works
MSU-Net: Multi-Scale U-Net for 2D Medical Image Segmentation
Su, R. Z., Zhang, D., Liu, J., & Cheng, C. (2021) · Frontiers in Genetics · doi:10.3389/fgene.2021.639930 · Cited by 171 · see citing works
Deformable Slice-to-Volume Registration for Motion Correction of Fetal Body and Placenta MRI
Uus, A., Zhang, T., Jackson, L. H., Roberts, T. A., Rutherford, M., Hajnal, J. V., & Deprez, M. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.2974844 · Cited by 141 · see citing works
Mahmood, T., Rehman, A. U., Saba, T., Nadeem, L., & Bahaj, S. A. (2023) · IEEE Access · doi:10.1109/access.2023.3313977 · Cited by 155 · see citing works
Davidson, L., & Boland, M. R. (2020) · Briefings in Bioinformatics · doi:10.1093/bib/bbaa369 · Cited by 127 · see citing works
Deep Learning in Medical Image Registration
Chen, X., Diaz-Pinto, A., Ravikumar, N., & Frangi, A. (2020) · Progress in Biomedical Engineering · doi:10.1088/2516-1091/abd37c · Cited by 106 · see citing works
Dhombres, F., Bonnard, J., Bailly, K., Maurice, P., Papageorghiou, A. T., & Jouannic, J.-M. (2022) · Journal of Medical Internet Research · doi:10.2196/35465 · Cited by 93 · see citing works
Machine learning based liver disease diagnosis: A systematic review
Khan, R. A., Luo, Y., & Wu, F. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.08.138 · Cited by 92 · see citing works
Phisannupawong, T., Kamsing, P., Torteeka, P., Channumsin, S., Sawangwit, U., Hematulin, W., Jarawan, T., Somjit, T., Yooyen, S., Delahaye, D., et al. (2020) · Aerospace · doi:10.3390/aerospace7090126 · Cited by 84 · see citing works
Artificial intelligence with deep learning in nuclear medicine and radiology
Decuyper, M., Maebe, J., Holen, R. V., & Vandenberghe, S. (2021) · EJNMMI Physics · doi:10.1186/s40658-021-00426-y · Cited by 60 · see citing works
Singh, D., Monga, A., de Moura, H. L., Zhang, X., Zibetti, M. V. W., & Regatte, R. R. (2023) · Bioengineering · doi:10.3390/bioengineering10091012 · Cited by 53 · see citing works
RGB-D Point Cloud Registration Based on Salient Object Detection
Wan, T., Du, S., Cui, W., Yao, R., Ge, Y., Li, C., Gao, Y., & Zheng, N. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3053274 · Cited by 51 · see citing works
Sensing and Artificial Intelligent Maternal-Infant Health Care Systems: A Review
Ahmad, S. G., Iqbal, T., Javaid, A., Munir, E. U., Kirn, N., Jan, S. U., & Ramzan, N. (2022) · Sensors · doi:10.3390/s22124362 · Cited by 57 · see citing works
SVoRT: Iterative Transformer for Slice-to-Volume Registration in Fetal Brain MRI
Xu, J., Moyer, D., Grant, P. E., Golland, P., Iglesias, J. E., & Elfar Adalsteinsson, A. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-16446-0_1 · Cited by 51 · see citing works
Uus, A. U., Egloff, A. M., Roberts, T. A., Hajnal, J. V., Rutherford, M., & Deprez, M. (2022) · British Journal of Radiology · doi:10.1259/bjr.20220071 · Cited by 51 · see citing works
Uus, A. U., Grigorescu, I., van Poppel, M. P. M., Steinweg, J. K., Roberts, T. A., Rutherford, M., Hajnal, J. V., Lloyd, D. F. A., Pushparajah, K., & Deprez, M. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102484 · Cited by 49 · see citing works
Deep Predictive Motion Tracking in Magnetic Resonance Imaging: Application to Fetal Imaging
Singh, A., Salehi, S. S. M., & Gholipour, A. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.2998600 · Cited by 47 · see citing works
Self-citationAutomatic Inter-Frame Patient Motion Correction for Dynamic Cardiac PET Using Deep Learning
Shi, L., Lu, Y., Dvornek, N. C., Weyman, C. A., Miller, E. J., Sinusas, A. J., & Liu, C. (2021) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2021.3082578 · Cited by 43 · see citing works
A Fully Differentiable Framework for 2D/3D Registration and the Projective Spatial Transformers
Gao, C., Feng, A., Liu, X., Taylor, R. H., Armand, M., & Unberath, M. (2024) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2023.3299588 · Cited by 36 · see citing works
Spin Detection in Robotic Table Tennis
Tebbe, J., Klamt, L., Gao, Y., & Zell, A. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9196536 · Cited by 34 · see citing works
A review on AI-based medical image computing in head and neck surgery
Xu, J., Zeng, B., Egger, J., Wang, C., Smedby, Ö., Jiang, X., & Chen, X. (2022) · Physics in Medicine and Biology · doi:10.1088/1361-6560/ac840f · Cited by 35 · see citing works
Clinical Application of AI-based PET Images in Oncological Patients.
Dai, J.-N., Wang, H., Xu, Y.-C., Chen, X.-Y., & Tian, R. (2023) · Seminars in Cancer Biology · doi:10.1016/j.semcancer.2023.03.005 · Cited by 28 · see citing works
A Systematic Literature Review on Applications of GAN-Synthesized Images for Brain MRI
Tavse, S., Vijayakumar, V., Bachute, M., Gite, S., & Kotecha, K. (2022) · Future Internet · doi:10.3390/fi14120351 · Cited by 28 · see citing works
An Unordered Image Stitching Method Based on Binary Tree and Estimated Overlapping Area
Qu, Z., Li, J., Bao, K.-H., & Si, Z. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2993134 · Cited by 32 · see citing works
Artificial intelligence applied to fetal MRI: A scoping review of current research
Meshaka, R., Gaunt, T., & Shelmerdine, S. C. (2022) · British Journal of Radiology · doi:10.1259/bjr.20211205 · Cited by 33 · see citing works
Deep learning solution for medical image localization and orientation detection
Zhao, Y., Zeng, K., Zhao, Y., Bhatia, P., Ranganath, M., Kozhikkavil, M. L., Li, C., & Hermosillo, G. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102529 · Cited by 30 · see citing works
3D Deep Learning on Medical Images: A Review
SINGH, S. P., Wang, L., Gupta, S., Goli, H., Padmanabhan, P., & Gulyás, B. Z. (2020) · Sensors · doi:10.3390/s20185097 · Cited by 60 · see citing works
A Patient-Specific Self-supervised Model for Automatic X-Ray/CT Registration
Zhang, B., Faghihroohi, S., Azampour, M. F., Liu, S., Ghotbi, R., Schunkert, H., & Navab, N. (2023) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-43996-4_49 · Cited by 27 · see citing works
Shi, W., Xu, H., Sun, C., Sun, J., Li, Y., Xu, X., Zheng, T., Zhang, Y., Wang, G., & Wu, D. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2022.3208277 · Cited by 26 · see citing works
Artificial Intelligence for Image Registration in Radiation Oncology
Teuwen, J., Gouw, Z. A. R., & Sonke, J. (2022) · Seminars in Radiation Oncology · doi:10.1016/j.semradonc.2022.06.003 · Cited by 23 · see citing works
Real‐time fetal brain tracking for functional fetal MRI
Silva, S. N., Verdera, J. A., Tomi‐Tricot, R., Neji, R., Uus, A. U., Grigorescu, I., Wilkinson, T., Ozenne, V., Lewin, A., Story, L., et al. (2023) · Magnetic Resonance in Medicine · doi:10.1002/mrm.29803 · Cited by 21 · see citing works
Fully automated planning for anatomical fetal brain MRI on 0.55T
Silva, S. N., McElroy, S., Verdera, J. A., Colford, K., Clair, K. S., Tomi‐Tricot, R., Uus, A. U., Ozenne, V., Hall, M., Story, L., et al. (2024) · Magnetic Resonance in Medicine · doi:10.1002/mrm.30122 · Cited by 19 · see citing works
A Transformer-Based Network for Deformable Medical Image Registration
Wang, Y., Qian, W., Li, M., & Zhang, X. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20497-5_41 · Cited by 19 · see citing works
Automatic Fetal Middle Sagittal Plane Detection in Ultrasound Using Generative Adversarial Network
Tsai, P.-Y., Hung, C.-H., Chen, C.-Y., & Sun, Y.-N. (2020) · Diagnostics · doi:10.3390/diagnostics11010021 · Cited by 18 · see citing works
A critical assessment of artificial intelligence in magnetic resonance imaging of cancer
Wu, C., Andaloussi, M. A., Hormuth, D. A., Lima, E. A. B. F., Lorenzo, G., Stowers, C. E., Ravula, S., Levac, B., Dimakis, A. G., Tamir, J. I., et al. (2025) · npj Imaging · doi:10.1038/s44303-025-00076-0 · Cited by 17 · see citing works
Deep learning-based plane pose regression in obstetric ultrasound
Di Vece, C., Dromey, B., Vasconcelos, F., David, A. L., Peebles, D., & Stoyanov, D. (2022) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-022-02609-z · Cited by 17 · see citing works
Rapid head‐pose detection for automated slice prescription of fetal‐brain MRI
Hoffmann, M., Türk, E. A., Gagoski, B. A., Morgan, L., Wighton, P., Tisdall, M. D., Reuter, M., Elfar Adalsteinsson, A., Grant, P. E., Wald, L. L., et al. (2021) · International Journal of Imaging Systems and Technology · doi:10.1002/ima.22563 · Cited by 17 · see citing works
Fetal MRI by Robust Deep Generative Prior Reconstruction and Diffeomorphic Registration
Cordero‐Grande, L., Ortuño, J. E., del Hoyo, A. A., Uus, A. U., Deprez, M., Santos, A., Hajnal, J. V., & Ledesma‐Carbayo, M. J. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2022.3217725 · Cited by 16 · see citing works
Uus, A. U., Silva, S. N., Verdera, J. A., Payette, K., Hall, M., Colford, K., Luis, A., Sousa, H., Ning, Z., Roberts, T. A., et al. (2025) · Pediatric Radiology · doi:10.1007/s00247-025-06165-x · Cited by 16 · see citing works
Fast fetal head compounding from multi-view 3D ultrasound
Wright, R., Gómez, A., Zimmer, V. A., Toussaint, N., Khanal, B., Matthew, J., Skelton, E., Kainz, B., Rueckert, D., Hajnal, J. V., et al. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.102793 · Cited by 15 · see citing works
Vision-based attitude estimation for spacecraft docking operation through deep learning algorithm
Phisannupawong, T., Kamsing, P., Tortceka, P., & Yooyen, S. (2020) · International Conference on Advanced Communication Technology · doi:10.23919/icact48636.2020.9061445 · Cited by 14 · see citing works
TSVR-Net: An End-to-End Ground-Penetrating Radar Images Registration and Location Network
Bi, B., Shen, L., Zhang, P., Huang, X., Xin, Q., & Jin, T. (2023) · Remote Sensing · doi:10.3390/rs15133428 · Cited by 13 · see citing works
Empowering brain cancer diagnosis: harnessing artificial intelligence for advanced imaging insights
Al-Kadi, O. S., Al-Emaryeen, R., Al-Nahhas, S., Almallahi, I., Braik, R., & Mahafza, W. S. (2024) · Reviews in the Neurosciences · doi:10.1515/revneuro-2023-0115 · Cited by 13 · see citing works
A CNN-Based Approach for Lung 3D-CT Registration
Hu, X., Yang, J., & Yang, J. (2020) · IEEE Access · doi:10.1109/access.2020.3032612 · Cited by 13 · see citing works
Fully Convolutional Slice-to-Volume Reconstruction for Single-Stack MRI
Young, S. I., Balbastre, Y., Fischl, B. R., Golland, P., & Iglesias, J. E. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01096 · Cited by 12 · see citing works
SE(3)-Equivariant and Noise-Invariant 3D Rigid Motion Tracking in Brain MRI
Billot, B., Dey, N., Moyer, D., Hoffmann, M., Türk, E. A., Gagoski, B. A., Grant, P. E., & Golland, P. (2024) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2024.3411989 · Cited by 11 · see citing works
Deep Learning Framework for Real-Time Fetal Brain Segmentation in MRI
Faghihpirayesh, R., Karimi, D., Deniz Erdogmus, B., & Gholipour, A. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-17117-8_6 · Cited by 12 · see citing works
Self-citationDupuy, T., Beitone, C., Troccaz, J., & Voros, S. (2023) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2023.3243436 · Cited by 11 · see citing works
A two-step deep learning method for 3DCT-2DUS kidney registration during breathing
Chi, Y., Xu, Y., Liu, H., Wu, X., Liu, Z., Mao, J., Xu, G., & Huang, W. (2023) · Scientific Reports · doi:10.1038/s41598-023-40133-5 · Cited by 12 · see citing works
UTR: A UNet-like transformer for efficient unsupervised medical image registration
Qiu, W., Xiong, L., Li, N., Wang, Y., & Zhang, Y. (2024) · Image and Vision Computing · doi:10.1016/j.imavis.2024.105209 · Cited by 10 · see citing works
SMPL-IK: Learned Morphology-Aware Inverse Kinematics for AI Driven Artistic Workflows
Voleti, V., Oreshkin, B. N., Bocquelet, F., Harvey, F. G., Ménard, L.-S., & Pal, C. (2022) · SIGGRAPH Asia Technical Communications · doi:10.1145/3550340.3564227 · Cited by 10 · see citing works
Anatomy-Guided Convolutional Neural Network for Motion Correction in Fetal Brain MRI
Pei, Y., Wang, L., Zhao, F., Zhong, T., Liao, L., Shen, D. G., & Li, G. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-59861-7_39 · Cited by 10 · see citing works
Equivariant Filters for Efficient Tracking in 3D Imaging
Moyer, D., Türk, E. A., Grant, P. E., Wells, W. M., & Golland, P. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87202-1_19 · Cited by 9 · see citing works
Pei, Y., Zhao, F., Zhong, T., Ma, L., Liao, L., Wu, Z., Wang, L., Zhang, H., Wang, L., & Li, G. (2023) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2023.3327295 · Cited by 8 · see citing works
You, Y., & Zhao, Y. (2019) · Personal and Ubiquitous Computing · doi:10.1007/s00779-019-01255-8 · Cited by 8 · see citing works
Uus, A. U., Grigorescu, I., van Poppel, M. P. M., Hughes, E., Steinweg, J. K., Roberts, T. A., Lloyd, D. F. A., Pushparajah, K., & Deprez, M. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.06.23.449574 · Cited by 8 · see citing works
Deep rigid registration for slice-to-volume in real time
Zheng, S., Wang, Y., Yang, X. N., Deng, X., Ding, M., & Hou, W. W. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121132 · Cited by 7 · see citing works
Deep learning-based medical image registration
Cao, X., Xue, P., Fan, J., Liu, D., Sun, K., Xue, Z., & Shen, D. G. (2024) · Elsevier eBooks · doi:10.1016/b978-0-32-385124-4.00023-4 · Cited by 7 · see citing works
2D/3D deep registration for real-time prostate biopsy navigation
Dupuy, T., Beitone, C., Troccaz, J., & Voros, S. (2021) · SPIE Medical Imaging: Image-Guided Procedures, Robotic Interventions, and Modeling · doi:10.1117/12.2579874 · Cited by 6 · see citing works
Affine medical image registration with fusion feature mapping in local and global
Ji, W., & Feng, Y. (2024) · Physics in Medicine and Biology · doi:10.1088/1361-6560/ad2717 · Cited by 7 · see citing works
Li, J., Wang, Y., Wang, S., Zhang, K., & Li, G. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87589-3_54 · Cited by 6 · see citing works
A component method to delineate surgical spine implants for proton Monte Carlo dose calculation
Chang, C., Charyyev, S., Harms, J. M., Slopsema, R. L., Wolf, J., Refai, D., Yoon, T., McDonald, M. W., Bradley, J. D., Leng, S., et al. (2022) · Journal of Applied Clinical Medical Physics · doi:10.1002/acm2.13800 · Cited by 4 · see citing works
Uus, A. U., Silva, S. N., Verdera, J. A., Payette, K., Hall, M., Colford, K., Luis, A., Sousa, H. S., Ning, Z., Roberts, T. A., et al. (2024) · medRxiv · doi:10.1101/2024.04.22.24306177 · Cited by 6 · see citing works
Quantum blockchain for a greener tomorrow: A survey of emerging applications
Rani, P., Rani, P., & Sachan, R. K. (2025) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2025.110322 · Cited by 5 · see citing works
Deep Regression Neural Networks for Proportion Judgment
Miličević, M., Batoš, V., Lipovac, A., & Car, Ž. (2022) · Future Internet · doi:10.3390/fi14040100 · Cited by 5 · see citing works
Applications of Deep Learning to Magnetic Resonance Imaging (MRI)
Meça, A. (2023) · International Conference on Computing, Electronics & Communications Engineering (iCCECE) · doi:10.1109/iccece59400.2023.10238598 · Cited by 5 · see citing works
Custom 3D fMRI Registration Template Construction Method Based on Time-Series Fusion
Wang, Z., Xin, J., Shen, H., Chen, Q., Wang, Z., & Wang, X. (2022) · Diagnostics · doi:10.3390/diagnostics12082013 · Cited by 5 · see citing works
A method of image stitching with partition matching and direct detection for rotated image
Qu, Z., Li, J., & Gao, L.-Y. (2022) · Displays · doi:10.1016/j.displa.2022.102316 · Cited by 5 · see citing works
Peng, K., Zhou, D., Sun, K., Wang, J., Deng, J., & Gong, S. (2024) · Sensors · doi:10.3390/s24165447 · Cited by 4 · see citing works
GMmorph: dynamic spatial matching registration model for 3D medical image based on gated Mamba
Lin, H., Song, Y., & Zhang, Q. (2025) · Physics in Medicine and Biology · doi:10.1088/1361-6560/adaacd · Cited by 4 · see citing works
Wu, J., Chen, L., Li, Z., Li, X., Sun, T., Wang, L., Wang, R., Wei, H., & Zhang, Y. (2025) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2025.3586049 · Cited by 4 · see citing works
Lajili, M., Belhachmi, Z., Moakher, M., & Theljani, A. (2024) · Applied Intelligence · doi:10.1007/s10489-024-05585-w · Cited by 4 · see citing works
2D/3D fast fine registration in minimally invasive pelvic surgery
Ju, F., Li, Y., Zhao, J., & Dong, M. (2024) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2024.107145 · Cited by 4 · see citing works
Zheng, J.-Q., Lim, N. H., & Papież, B. W. (2023) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2023.102204 · Cited by 4 · see citing works
D-net: Siamese Based Network for Arbitrarily Oriented Volume Alignment
Zheng, J.-Q., Lim, N. H., & Papież, B. W. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-61056-2_6 · Cited by 4 · see citing works
Silic, M., Tam, F., & Graham, S. J. (2024) · Sensors · doi:10.3390/s24123737 · Cited by 3 · see citing works
Real-World Visual Navigation for Cardiac Ultrasound View Planning
Bao, M., Wang, Y., Wei, X., Jia, B., Fan, X., Lu, D., Gu, Y., Cheng, J., Zhang, Y., Wang, C., et al. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72378-0_30 · Cited by 3 · see citing works
Hou, P., Zhang, Y., Zhou, W., Ye, B., & Wu, Y. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.110890 · Cited by 3 · see citing works
AVP-AP: Self-Supervised Automatic View Positioning in 3D Cardiac CT via Atlas Prompting
Fan, X., Wang, Y., Zhang, Y., Bao, M., Jia, B., Dong, L., Gu, Y., Cheng, J., & Zhu, H. (2025) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2025.3554785 · Cited by 2 · see citing works
Towards Symmetry-sensitive Pose Estimation: A Rotation Representation for Symmetric Object Classes
Kriegler, A., Beleznai, C., & Gelautz, M. (2026) · International Journal of Computer Vision · doi:10.1007/s11263-026-02770-x · Cited by 3 · see citing works
Ramesh, J., Dinsdale, N. K., Yeung, P.-H., & Namburete, A. I. L. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72378-0_39 · Cited by 2 · see citing works
Application-driven validation of posteriors in inverse problems
Adler, T. J., Nölke, J.-H., Reinke, A., Tizabi, M. D., Gruber, S., Trofimova, D., Ardizzone, L., Jäger, P. F., Buettner, F., Koethe, U., et al. (2025) · Medical Image Analysis · doi:10.1016/j.media.2025.103474 · Cited by 2 · see citing works
Towards automatic US-MR fetal brain image registration with learning-based methods
Zeng, Q., Liu, W., Li, B., Didier, R. A., Grant, P. E., & Karimi, D. (2025) · NeuroImage · doi:10.1016/j.neuroimage.2025.121104 · Cited by 2 · see citing works
Variable Flip Angle Optimization for Fetal Brain Imaging With Reduced Specific Absorption Rate
Franson, D. N., Calixto, C. A., Fan, H., Jaimes, C. E., Velasco‐Annis, C., Ferraciolli, S. F., Alves, C., Yang, E., Cauley, S., & Gholipour, A. (2025) · NMR in Biomedicine · doi:10.1002/nbm.70075 · Cited by 2 · see citing works
Self-citationSchmidt, C., & Overhoff, H. M. (2022) · Computer Science Research Notes · doi:10.24132/csrn.3201.23 · Cited by 2 · see citing works
Cordero‐Grande, L., Ortuño, J. E., Uus, A. U., Deprez, M., Santos, A., Hajnal, J. V., & Ledesma‐Carbayo, M. J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.00102 · Cited by 2 · see citing works
Shen, A., Fu, X., Jiang, J., Zeng, Q., Tang, Y., Chen, Z., Nong, L., Wang, F., & Zhou, S. K. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-05114-1_44 · Cited by 1 · see citing works
CardioMorphNet: Cardiac motion prediction using a shape-guided Bayesian recurrent deep network
Movahed, R. A., Rezaee, A., Zakeri, A., Berry, C., Ho, E. S. L., & Gooya, A. (2026) · Medical Image Analysis · doi:10.1016/j.media.2026.104149 · Cited by 1 · see citing works
DGS-Net: Learning Dexterous Grasps From Single-View Point Clouds via a Multi-Object Scene Dataset
Geng, T., Yang, D., Liu, Z., Zhang, L., Qi, L., Li, W., Ren, Y., Luo, S., & Ni, F. (2026) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2026.3739901 · Cited by 1 · see citing works
A Hybrid Supervised Fusion Deep Learning Framework for Microscope Multi-Focus Images
Yang, Q., Chen, H., Jiang, M., Wang, M., Zhang, J., Sun, Y., & Tan, T. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-50078-7_17 · Cited by 1 · see citing works
A self-attention model for robust rigid slice-to-volume registration of functional MRI
Khawaled, S., Afacan, O., Warfield, S. K., & Freiman, M. (2025) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2025.102643 · Cited by 1 · see citing works
Xu, Y., Chen, Y., Xu, H., Wang, T., Li, Y., & Nie, Z. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3635480 · Cited by 1 · see citing works
Self-Supervised Rigid Registration for Small Images
Ma, R., Zhao, S., & Cheng, S. S. M. (2021) · KSII Transactions on Internet and Information Systems · doi:10.3837/tiis.2021.01.011 · Cited by 1 · see citing works
A Novel Iterative Rigid Image Registration Algorithm Based on the Newton Method
Khosravi, J., Abadi, M. S. E., & Ebrahimpour, R. (2020) · International Journal of Image and Graphics · doi:10.1142/s0219467821500133
D-Net: Siamese based Network with Mutual Attention for Volume AlignmentPreprint
Zheng, J.-Q., Lim, N. H., & Papież, B. W. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.10248
ProtoRes: Proto-Residual Architecture for Deep Modeling of Human Pose.Preprint
Oreshkin, B. N., Bocquelet, F., Harvey, F. G., Raitt, B., & Laflamme, D. (2021) · arXiv (Cornell University)
Rapid Transformation Estimation Using Deep Learning for Defect Detection
Jing Ren, A., & Huang, X. (2021) · International Conference on Artificial Intelligence and Information Systems (ICAIIS) · doi:10.1145/3469213.3469219
- Authors
- Salehi, S. S. M., Khan, S., Erdogmus, D., & Gholipour, A.
- Affiliations
- Boston Children's Hospital (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- Volume
- 38
- Issue
- 2
- Pages
- 470-481
- ISSN
- 0278-0062 (ISSN-L)
- arXiv
- 1803.05982
- PMC
- PMC6438698
- OpenAlex
- W2805701966
- Cited by
- 118
- References
- 44
- Citations by year
- 2026: 9 · 2025: 17 · 2024: 19 · 2023: 18 · 2022: 21 · 2021: 15 · 2020: 15 · 2019: 2 · 2018: 2
- FWCI
- 4.25
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- IEEE Transactions on Medical Imaging (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- McKnight Foundation
- National Institute of Neurological Disorders and Stroke (R01NS106030)
- National Institute of Biomedical Imaging and Bioengineering (R01EB018988)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Medical Image Segmentation Techniques
- Physical Sciences › Engineering › Biomedical Engineering › Medical Imaging and Analysis
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Keywords
- fetal brain MRI, slice-to-volume registration, domain generalization, conditional generative adversarial networks, real-time registration
- MeSH terms
- Deep Learning, Algorithms, Brain, Female, Fetus, Humans, Image Processing, Computer-Assisted, Infant, Newborn, Magnetic Resonance Imaging, Pregnancy, Databases, Factual
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
