Machine learning for automated and real-time two-dimensional to three-dimensional registration of the spine using a single radiograph
Open accessAbstract
OBJECTIVE: The goal of this work was to methodically evaluate, optimize, and validate a self-supervised machine learning algorithm capable of real-time automatic registration and fluoroscopic localization of the spine using a single radiograph or fluoroscopic frame. METHODS: The authors propose a two-dimensional to three-dimensional (2D-3D) registration algorithm that maximizes an image similarity metric between radiographic images to identify the position of a C-arm relative to a 3D volume. This work utilizes digitally reconstructed radiographs (DRRs), which are synthetic radiographic images generated by simulating the x-ray projections as they would pass through a CT volume. To evaluate the algorithm, the authors used cone-beam CT data for 127 patients obtained from an open-source de-identified registry of cervical, thoracic, and lumbar scans. They systematically evaluated and tuned the algorithm, then quantified the convergence rate of the model by simulating C-arm registrations with 80 randomly simulated DRRs for each CT volume. The endpoints of this study were time to convergence, accuracy of convergence for each of the C-arm’s degrees of freedom, and overall registration accuracy based on a voxel-by-voxel measurement. RESULTS: A total of 10,160 unique radiographic images were simulated from 127 CT scans. The algorithm successfully converged to the correct solution 82% of the time with an average of 1.96 seconds of computation. The radiographic images for which the algorithm converged to the solution demonstrated 99.9% registration accuracy despite utilizing only single-precision computation for speed. The algorithm was found to be optimized for convergence when the search space was limited to a ± 45° offset in the right anterior oblique/left anterior oblique, cranial/caudal, and receiver rotation angles with the radiographic isocenter contained within 8000 cm 3 of the volumetric center of the CT volume. CONCLUSIONS: The investigated machine learning algorithm has the potential to aid surgeons in level localization, surgical planning, and intraoperative navigation through a completely automated 2D-3D registration process. Future work will focus on algorithmic optimizations to improve the convergence rate and speed profile.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Gradient-based optimization with DiffDRR recovers the true pose faster and more robustly than gradient-free methods on synthetic data.
“On synthetic data, gradient-based optimization with DiffDRR, a differentiable renderer, has been shown to recover the true pose faster and more robustly than gradient-free methods [1, 22].”
From Intraoperative 2D/3D Image Registration via Differentiable X-Ray Rendering (2024) · cites this paper as [1]
The Experimental Design and Results sections describe using DiffDRR with gradient descent to recover the target pose from simulated radiographs. The Limitations and Future Directions section says this was not a systematic comparison with other methods, so the claimed speed and robustness advantage over gradient-free methods is unsupported. Page numbers were not supplied in our copy. (LLM, conf=0.88)
Experimental — accuracy not yet measuredRegistration of intraoperative 2D X-rays to 3D preoperative scans is a prerequisite for numerous advanced image guidance techniques, including vertebral level localization, surgical plan reprojection, instrument tracking, motion correction, and surgical robotics.
“The registration of intraoperative 2D X-rays to 3D preoperative scans is a prerequisite for numerous advanced image guidance techniques, including vertebral level localization [11], surgical plan reprojection [12,13], instrument tracking [14], motion correction [15], and surgical robotics [16].”
From Rapid patient-specific neural networks for intraoperative X-ray to volume registration (2025) · cites this paper as [11]
Citation [16] is attached to the surgical-robotics portion of the sentence. The Discussion says 2D–3D registration is used for surgical planning and navigation, but the passages found do not establish that registering intraoperative X-rays to preoperative scans is a prerequisite for surgical robotics. A reference title mentions guiding a surgical robot, but that alone does not establish the prerequisite claim. (LLM, conf=0.70)
Experimental — accuracy not yet measuredGradient normalized cross correlation (gradNCC) is an image similarity metric that computes the correlation between Sobel-filtered versions of the two images.
“gradient normalized cross correlation (gradNCC) [11], an image similarity metric that computes the correlation between Sobel-filtered versions of the two images.”
From Rapid patient-specific neural networks for intraoperative X-ray to volume registration (2025) · cites this paper as [11]
The Experimental Design section describes zero-normalized cross-correlation (ZNCC) as an image-similarity loss function, not gradNCC. Searches for gradNCC and Sobel filtering found no passage in our copy defining the claimed metric or describing correlation between Sobel-filtered images; the section labels provide no page numbers. (LLM, conf=0.73)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Large-Scale Machine Learning with Stochastic Gradient Descent
Bottou, L. (2010) · Proceedings of COMPSTAT'2010 · doi:10.1007/978-3-7908-2604-3_16 · Cited by 5,795 · see citing works
Elastix: a toolbox for intensity-based medical image registration
Klein, S., Staring, M., Murphy, K., Viergever, M. A., & Pluim, J. (2010) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2009.2035616 · Cited by 4,311 · see citing works
Fast calculation of the exact radiological path for a three‐dimensional CT array
Siddon, R. L. (1985) · Medical Physics · doi:10.1118/1.595715 · Cited by 1,535 · see citing works
A Review of 3d/2d Registration Methods for Image-Guided Interventions
Markelj, P., Tomaževič, D., Likar, B., & Pernuš, F. (2012) · Medical Image Analysis · doi:10.1016/j.media.2010.03.005 · Cited by 746 · see citing works
Grid Search, Random Search, Genetic Algorithm: A Big Comparison for NASPreprint
Liashchynskyi, P. B., & Liashchynskyi, P. B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.06059 · Cited by 585 · see citing works
Large-Scale Machine Learning with Stochastic Gradient Descent
Bottou, L. (2011) · Chapman & Hall/CRC series in computer science & data analysis/Series in computer science and data analysis · doi:10.1201/b11429-4 · Cited by 540 · see citing works
A CNN Regression Approach for Real-Time 2D/3D Registration
Miao, S., Wang, Z. J., & Liao, R. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2521800 · Cited by 514 · see citing works
Consistent landmark and intensity-based image registration
Johnson, H. J., & Christensen, G. E. (2002) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2002.1009381 · Cited by 400 · see citing works
VerSe: A Vertebrae labelling and segmentation benchmark for multi-detector CT images
Sekuboyina, A., Husseini, M. E., Bayat, A., Löffler, M. T., Liebl, H., Li, H., Tetteh, G., Kukačka, J., Payer, C., Štern, D., et al. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.102166 · Cited by 391 · see citing works
The Prevalence of Wrong Level Surgery Among Spine Surgeons
Mody, M. G., Nourbakhsh, A., Stahl, D. L., Gibbs, M., Alfawareh, M. D., & Garges, K. J. (2008) · Spine · doi:10.1097/brs.0b013e31816043d1 · Cited by 221 · see citing works
Handbook of Medical Image Computing and Computer Assisted Intervention
(2019) · Elsevier eBooks · doi:10.1016/c2017-0-04608-6 · Cited by 198 · see citing works
A Vertebral Segmentation Dataset with Fracture Grading
Löffler, M. T., Sekuboyina, A., Jacob, A., Grau, A.-L., Scharr, A., El Husseini, M., Kallweit, M., Zimmer, C., Baum, T., & Kirschke, J. S. (2020) · Radiology: Artificial Intelligence · doi:10.1148/ryai.2020190138 · Cited by 181 · see citing works
Anatomy-based registration of CT-scan and intraoperative X-ray images for guiding a surgical robot
Gueziec, A. P., Kazanzides, P., Williamson, B., & Taylor, R. H. (1998) · IEEE Transactions on Medical Imaging · doi:10.1109/42.736023 · Cited by 148 · see citing works
Techniques and accuracy of thoracolumbar pedicle screw placement
Puvanesarajah, V. (2014) · World Journal of Orthopedics · doi:10.5312/wjo.v5.i2.112 · Cited by 133 · see citing works
Wrong-sided and wrong-level neurosurgery: a national survey
Jhawar, B. S., Mitsis, D., & Duggal, N. (2007) · Journal of Neurosurgery: Spine · doi:10.3171/spi-07/11/467 · Cited by 120 · see citing works
Unberath, M., Gao, C., Hu, Y., Judish, M., Taylor, R. H., Armand, M., & Grupp, R. (2021) · Frontiers in Robotics and AI · doi:10.3389/frobt.2021.716007 · Cited by 102 · see citing works
Robotic Spine Surgery: Current State in Minimally Invasive Surgery
Vo, C. D., Jiang, B., Azad, T. D., Crawford, N. R., Bydon, A., & Theodore, N. (2020) · Global Spine Journal · doi:10.1177/2192568219878131 · Cited by 102 · see citing works
What is new in the diagnosis and prevention of spine surgical site infections
Radcliff, K. E., Neusner, A. D., Millhouse, P. W., Harrop, J. D., Kepler, C. K., Rasouli, M. R., Albert, T. J., & Vaccaro, A. R. (2014) · The Spine Journal · doi:10.1016/j.spinee.2014.09.022 · Cited by 101 · see citing works
Otake, Y., Schafer, S., Stayman, J. W., Zbijewski, W., Kleinszig, G., Graumann, R., Khanna, A. J., & Siewerdsen, J. H. (2012) · Physics in Medicine and Biology · doi:10.1088/0031-9155/57/17/5485 · Cited by 79 · see citing works
Technologic Evolution of Navigation and Robotics in Spine Surgery: A Historical Perspective
Mao, J. Z., Agyei, J. O., Khan, A., Hess, R. M., Jowdy, P. K., Mullin, J. P., & Pollina, J. (2020) · World Neurosurgery · doi:10.1016/j.wneu.2020.08.224 · Cited by 66 · see citing works
Wrong-level surgery: A unique problem in spine surgery.
Hsiang, J. (2011) · Europe PMC (PubMed Central) · doi:10.4103/2152-7806.79769 · Cited by 60 · see citing works
3D-2D Registration for Surgical Guidance: Effect of Projection View Angles on Registration Accuracy
Uneri, A., Otake, Y., Wang, A. S., Kleinszig, G., Vogt, S., Khanna, A. J., & Siewerdsen, J. H. (2014) · Physics in Medicine and Biology · doi:10.1088/0031-9155/59/2/271 · Cited by 53 · see citing works
Ling, J. M., Dinesh, S. K., Pang, B. C., Chen, M. W., Lim, H. L., Louange, D. T., Yu, C. S., & Wang, C. M. E. (2014) · Journal of Clinical Neuroscience · doi:10.1016/j.jocn.2013.02.034 · Cited by 52 · see citing works
Fully automated 2D–3D registration and verification
Varnavas, A., Carrell, T., & Penney, G. (2015) · Medical Image Analysis · doi:10.1016/j.media.2015.08.005 · Cited by 50 · see citing works
Gopalakrishnan, V., & Golland, P. (2023) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-23179-7_1 · Cited by 50 · see citing works
Self-citationRisk Factors and Prevention of Surgical Site Infections Following Spinal Procedures
Nasser, R., Kosty, J. A., Shah, S., Wang, J., & Cheng, J. (2018) · Global Spine Journal · doi:10.1177/2192568218806275 · Cited by 45 · see citing works
Galvin, J. M., Sims, C., Dominiak, G. S., & Cooper, J. S. (1995) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/0360-3016(94)00503-6 · Cited by 45 · see citing works
Guha, D., Jakubovic, R. Y., Gupta, S., Alotaibi, N. M., Cadotte, D. W., da Costa, L., George, R., Heyn, C., Howard, P., Kapadia, A. N., et al. (2016) · The Spine Journal · doi:10.1016/j.spinee.2016.10.020 · Cited by 42 · see citing works
Moore, C. S., Liney, G. P., Beavis, A. W., & Saunderson, J. (2011) · British Journal of Radiology · doi:10.1259/bjr/30125639 · Cited by 41 · see citing works
Prospects and limitations of different registration modalities in electromagnetic ENT navigation
Soteriou, E., Grauvogel, J., Laszig, R., & Grauvogel, T. D. (2016) · European Archives of Oto-Rhino-Laryngology · doi:10.1007/s00405-016-4063-9 · Cited by 38 · see citing works
Dhont, J., Verellen, D., Mollaert, I., Vanreusel, V., & Vandemeulebroucke, J. (2020) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2020.10.004 · Cited by 29 · see citing works
Malham, G. M., & Munday, N. R. (2021) · The Spine Journal · doi:10.1016/j.spinee.2021.10.002 · Cited by 29 · see citing works
GPU-accelerated digitally reconstructed radiographs
Ruijters, D., Romeny, B. M. T. H., Suetens, P., & Hierlemann, A. (2008) · TU/e Research Portal · Cited by 26 · see citing works
Digitally reconstructed radiograph generation by an adaptive Monte Carlo method
Li, X., Yang, J., & Zhu, Y. (2006) · Physics in Medicine and Biology · doi:10.1088/0031-9155/51/11/004 · Cited by 24 · see citing works
Eck, J. C., Lange, J. K., Street, J., Lapinsky, A. S., & DiPaola, C. P. (2013) · Global Spine Journal · doi:10.1055/s-0033-1345037 · Cited by 20 · see citing works
A Novel Parallel Architecture for Template Matching based on Zero-Mean Normalized Cross-Correlation
Wang, X., Wang, X., & Han, L. (2019) · IEEE Access · doi:10.1109/access.2019.2961334 · Cited by 18 · see citing works
Pre- and intraoperative thoracic spine localization techniques: a systematic review
Strong, M. J., Santarosa, J., Sullivan, T. P., Kazemi, N. J., Joseph, J. R., Kashlan, O. N., Oppenlander, M. E., Szerlip, N. J., Park, P., & Elswick, C. M. (2021) · Journal of Neurosurgery Spine · doi:10.3171/2021.8.spine21480 · Cited by 17 · see citing works
A portable software tool for computing digitally reconstructed radiographs
Chaney, E. L., Thorn, J. S., Tracton, G. S., Cullip, T., Rosenman, J. G., & Tepper, J. E. (1995) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/0360-3016(94)00470-6 · Cited by 14 · see citing works
Hidden Error in Optical Stereotactic Navigation Systems and Strategy to Maximize Accuracy
Holland, M. T., Mansfield, K., Mitchell, A., & Burchiel, K. J. (2021) · Stereotactic and Functional Neurosurgery · doi:10.1159/000514053 · Cited by 5 · see citing works
Brecevich, A. T., DOWE, C., Lebl, D. R., Sama, A. A., Abjornson, C., & Cammisa, F. P. (2019) · The Spine Journal · doi:10.1016/j.spinee.2019.05.135 · Cited by 5 · see citing works
Liebl, H., Schinz, D., Sekuboyina, A., Malagutti, L., Löffler, M. T., Bayat, A., Husseini, M. E., Tetteh, G., Grau, K., Niederreiter, E., et al. (2021) · Scientific Data · doi:10.1038/s41597-021-01060-0 · Cited by 5 · see citing works
Clinical Image-Based Procedures
Drechsler, K., Laura, C. O., Freiman, M., Chen, Y., Wesarg, S., & Erdt, M. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73083-2 · Cited by 2 · see citing works
Flagged first, then by citations
2 of the 44 references couldn’t be matched to a known paper.
Research works printed but not linked: 3
- Longo UG, Loppini M, Romeo G, Maffulli N, Denaro V. Er- rors of level in spinal surgery: an evidence-based systematic review. J Bone Joint Surg Br. 2012;94(11):1546-1550.
- Munbodh R, Jaffray DA, Moseley DJ, et al. Automated 2D- 3D registration of a radiograph and a cone beam CT using line-segment enhancement. Med Phys. 2006;33(5):1398-1411.
- Briechle K, Hanebeck UD. Template matching using fast normalized cross correlation. In: Casasent DP, Chao TH, eds. SPIE Proceedings Volume 4387. Optical Pattern Recognition XII. SPIE; 2001: 95-102.
Cited by
Sorted by citations
Intraoperative 2D/3D Image Registration via Differentiable X-Ray Rendering
Gopalakrishnan, V., Dey, N., & Golland, P. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.01108 · Cited by 48 · see citing works
“On synthetic data, gradient-based optimization with DiffDRR, a differentiable renderer, has been shown to recover the true pose faster and more robustly than gradient-free methods [1, 22].”
MethodSelf-citationA review: artificial intelligence in image-guided spinal surgery
Zeng, J., & Fu, Q. (2024) · Expert Review of Medical Devices · doi:10.1080/17434440.2024.2384541 · Cited by 17 · see citing works
Chen, M., & Zhang, Z. (2025) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi60581.2025.10981220 · Cited by 3 · see citing works
Burton, W. S., Myers, C. A., Stefanovic, M., Shelburne, K. B., & Rullkoetter, P. J. (2024) · Annals of Biomedical Engineering · doi:10.1007/s10439-024-03473-5 · Cited by 3 · see citing works
Humphreys, S. C., Block, J. E., Sivaganesan, A., Nel, L. J., Peterman, M., & Hodges, S. D. (2025) · Expert Review of Medical Devices · doi:10.1080/17434440.2025.2484252 · Cited by 3 · see citing works
Rapid patient-specific neural networks for intraoperative X-ray to volume registration
Gopalakrishnan, V., Chlorogiannis, D.-D., Abumoussa, A., Larson, A. M., Haouchine, N., Orbach, D. B., Frisken, S., Dey, N., & Golland, P. (2025) · arXiv · doi:10.48550/arxiv.2503.16309 · Cited by 2 · see citing works
Self-citationGunness, V. R. N., Chakir, S., Aljeeran, O., & Taha, S. (2025) · Indian Journal of Neurosurgery · doi:10.1055/s-0045-1811667
Yang, E., Howell, H. J., Schonfeld, E., Fuller, J., Khan, F., Ayloo, B., Izima, C., Sampath, S. G., Tang, A. J., Rolfe, N. W., et al. (2026) · Artificial Intelligence Surgery · doi:10.20517/ais.2025.98
Rapid patient-specific neural networks for X-ray to volume registration
Gopalakrishnan, V., Chlorogiannis, D., Abumoussa, A. L., Larson, A. M., Haouchine, N., Orbach, D. B., Frisken, S., Dey, N., & Golland, P. (2026) · Nature · doi:10.1038/s41586-026-11045-x · Cited by 7 · see citing works
Self-citationDai, L., Cheng, L., Wu, C., Hou, Z., Yang, J., & Wei, W. (2026) · European Journal of Radiology · doi:10.1016/j.ejrad.2026.113295
- Authors
- Abumoussa, A., Gopalakrishnan, V., Succop, B., Galgano, M., Jaikumar, S., Lee, Y. Z., & Bhowmick, D. A.
- Affiliations
- Departments of Neurosurgery and
- Massachusetts Institute of Technology (US)
- University of North Carolina at Chapel Hill (US)
- Duke University Hospital (US)
- Venue
- Neurosurgical Focus
- Published
- 2023-06
- Volume
- 54
- Issue
- 6
- Pages
- E16
- ISSN
- 1092-0684 (ISSN-L)
- OpenAlex
- W4379056406
- Cited by
- 9
- References
- 44
- Citations by year
- 2026: 3 · 2025: 3 · 2024: 3
- FWCI
- 0.71
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Locations
- Neurosurgical FOCUS (publishedVersion)
- PubMed (publishedVersion)
- Carolina Digital Repository (University of North Carolina at Chapel Hill) (submittedVersion)
- UNC Libraries
- Topics
- Physical Sciences › Engineering › Biomedical Engineering › Medical Imaging and Analysis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Medical Image Segmentation Techniques
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiation Dose and Imaging
- Keywords
- 2D-3D registration, spine, C-arm, digitally reconstructed radiographs, cone-beam computed tomography, self-supervised learning, real-time registration, surgical navigation, surgical planning, image similarity measures
- MeSH terms
- Machine Learning, Algorithms, Humans, Radiography, Spine, Tomography, X-Ray Computed, Imaging, Three-Dimensional
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review