Fiducial-Free 2D/3D Registration for Robot-Assisted Femoroplasty
Open accessAbstract
Femoroplasty is a proposed alternative therapeutic method for preventing osteoporotic hip fractures in the elderly. Previously developed navigation system for femoroplasty required the attachment of an external X-ray fiducial to the femur. We propose a fiducial-free 2D/3D registration pipeline using fluoroscopic images for robot-assisted femoroplasty. Intraoperative fluoroscopic images are taken from multiple views to perform registration of the femur and drilling/injection device. The proposed method was tested through comprehensive simulation and cadaveric studies. Performance was evaluated on the registration error of the femur and the drilling/injection device. In simulations, the proposed approach achieved a mean accuracy of 1.26±0.74 mm for the relative planned injection entry point; 0.63±0.21° and 0.17±0.19° for the femur injection path direction and device guide direction, respectively. In the cadaver studies, a mean error of 2.64 ± 1.10 mm was achieved between the planned entry point and the device guide tip. The biomechanical analysis showed that even with a 4 mm translational deviation from the optimal injection path, the yield load prior to fracture increased by 40.7%. This result suggests that the fiducial-less 2D/3D registration is sufficiently accurate to guide robot assisted femoroplasty.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Due to the lack of distinct features of the proximal femur in DRRs, Gao et al. proposed a two-step registration where the pelvis is first registered for better femoral pose initialization because the pelvis has a rich collection of distinct features leading to accurate registration.
“Due to the lack of distinct features of the proximal femur in the DRRs, Gao et al. have proposed a two-step registration where the pelvis is first registered for a better femoral pose initialization since the pelvis has a rich collection of distinct features that leads to accurate registration accuracy (Gao et al. 2020).”
From Towards 2D/3D Registration of the Preoperative MRI to Intraoperative Fluoroscopic Images for Visualisation of Bone Defects (2023) · cites this paper as Gao et al. 2020
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Completely Derandomized Self-Adaptation in Evolution Strategies
Hansen, N., & Ostermeier, A. (2001) · Evolutionary Computation · doi:10.1162/106365601750190398 · Cited by 4,397 · see citing works
Dilated FCN for Multi-Agent 2D/3D Medical Image Registration
Miao, S., Piat, S., Fischer, P., Tuysuzoglu, A., Mewes, P., Mansi, T., & Liao, R. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11576 · Cited by 113 · see citing works
Automatic Annotation of Hip Anatomy in Fluoroscopy for Robust and Efficient 2D/3D Registration
Grupp, R. B., Unberath, M., Gao, C., Hegeman, R. A., Murphy, R. J., Alexander, C. P., Otake, Y., McArthur, B. A., Armand, M., & Taylor, R. H. (2020) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-020-02162-7 · Cited by 81 · cited 1× · see citing works
“during fluoroscopic navigation of the hip [25].”
Self-citationTowards Fully Automatic X-Ray to CT Registration
Esteban, J., Grimm, M., Unberath, M., Zahnd, G., & Navab, N. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-32226-7_70 · Cited by 38 · see citing works
Self-citationSIFT algorithm-based 3D pose estimation of femur
Zhang, X., Zhu, Y., Li, C., Zhao, J., & Li, G. (2014) · Bio-Medical Materials and Engineering · doi:10.3233/bme-141103 · Cited by 8 · see citing works
Flagged first, then by citations
Research works printed but not linked: 31
- [1]Goldacre MJ, Roberts SE, and Yeates D, “ Mortality after admission to hospital with fractured neck of femur: database study,” Bmj, vol. 325, no. 7369, pp. 868– 869, 2002. 12386038 PMC129634
- [2]Teng GG, “ Mortality and osteoporotic fractures: is the link causal, and is it modifiable?” Clinical and experimental rheumatology, vol. 26, no. 5 0 51, p. S125, 2008. PMC4124750 19026155
- [3]Dinah A, “ Sequential hip fractures in elderly patients,” Injury, vol. 33, no. 5, pp. 393– 394, 2002. 12095717
- [4]Land J, Russell L, and Khan S, “ Osteoporosis,” Clinical Orthopaedics and Related Research, vol. 372, pp. 139– 150, 2000. 10738423
- [5]Basafa E and Armand M, “ Subject-specific planning of femoroplasty: a combined evolutionary optimization and particle diffusion model approach,” Journal of biomechanics, vol. 47, no. 10, pp. 2237– 2243, 2014. 24856887 PMC4096901
- [6]Basafa E, Murphy RJ, Otake Y, Kutzer MD, Belkoff SM, Mears SC, and Armand M, “ Subject-specific planning of femoroplasty: an experimental verification study,” Journal of biomechanics, vol. 48, no. 1, pp. 59– 64, 2015. 25468663 PMC4274194
- [7]Otake Y, Armand M, Sadowsky O, Armiger RS, Kutzer MD, Mears SC, Kazanzides P, and Taylor RH, “ An image-guided femoroplasty system: development and initial cadaver studies,” in Medical Imaging 2010: Visualization, Image-Guided Procedures, and Modeling, vol. 7625. International Society for Optics and Photonics, 2010, p. 76250P.
- [8]Farvardin A, Basafa E, Bakhtiarinejad M, and Armand M, “ Significance of preoperative planning for prophylactic augmentation of osteoporotic hip: A computational modeling study,” Journal of biomechanics, 2019. PMC6736717 31371101
- [9]Kuo N, Lee J, Deguet A, Song D, Burdette EC, and Prince J, “ Automatic segmentation of seeds and fluoroscope tracking (ftrac) fiducial in prostate brachytherapy x-ray images,” in Medical Imaging 2010: Visualization, Image-Guided Procedures, and Modeling, vol. 7625. International Society for Optics and Photonics, 2010, p. 76252T. PMC3438694 22977294
- [10]Guéziec A, Kazanzides P, Williamson B, and Taylor RH, “ Anatomy-based registration of ct-scan and intraoperative x-ray images for guiding a surgical robot,” IEEE Transactions on Medical Imaging, vol. 17, no. 5, pp. 715– 728, 1998. 9874295
- [11]Yu W and Zheng G, “ 2d-3d regularized deformable b-spline registration: Application to the proximal femur,” in 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI). IEEE, 2015, pp. 829– 832.
- [13]Zaman A and Ko SY, “ Improving the accuracy of 2d-3d registration of femur bone for bone fracture reduction robot using particle swarm optimization,” in Proceedings of the Genetic and Evolutionary Computation Conference Companion. ACM, 2018, pp. 101– 102.
- [15]Gao C, Grupp RB, Unberath M, Taylor RH, and Armand M, “ Fiducial-free 2d/3d registration of the proximal femur for robot-assisted femoroplasty,” in Medical Imaging 2020: Image-Guided Procedures, Robotic Interventions, and Modeling, vol. 11315. International Society for Optics and Photonics, 2020, p. 113151C.
- [16]Markelj P, Tomaževič D, Likar B, and Pernuš F, “ A review of 3d/2d registration methods for image-guided interventions,” Medical image analysis, vol. 16, no. 3, pp. 642– 661, 2012. 20452269
- [17]Johnson HJ and Christensen GE, “ Consistent landmark and intensity-based image registration,” IEEE transactions on medical imaging, vol. 21, no. 5, pp. 450– 461, 2002. 12071616
- [18]Unberath M, Zaech J-N, Gao C, Bier B, Goldmann F, Lee SC, Fotouhi J, Taylor R, Armand M, and Navab N, “ Enabling machine learning in x-ray-based procedures via realistic simulation of image formation,” International journal of computer assisted radiology and surgery, vol. 14, no. 9, pp. 1517– 1528, 2019. 31187399 PMC7297499
- [19]Payer C, Štern D, Bischof H, and Urschler M, “ Regressing heatmaps for multiple landmark localization using cnns,” in International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, 2016, pp. 230– 238.
- [20]Bier B, Unberath M, Zaech J-N, Fotouhi J, Armand M, Osgood G, Navab N, and Maier A, “ X-ray-transform invariant anatomical landmark detection for pelvic trauma surgery,” in International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, 2018, pp. 55– 63.
- [22]Kordon F, Fischer P, Privalov M, Swartman B, Schnetzke M, Franke J, Lasowski R, Maier A, and Kunze H, “ Multi-task localization and segmentation for x-ray guided planning in knee surgery,” in International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, 2019, pp. 622– 630.
- [23]Laina I, Rieke N, Rupprecht C, Vizcaíno JP, Eslami A, Tombari F, and Navab N, “ Concurrent segmentation and localization for tracking of surgical instruments,” in International conference on medical image computing and computer-assisted intervention. Springer, 2017, pp. 664– 672.
- [24]Gao C, Unberath M, Taylor R, and Armand M, “ Localizing dexterous surgical tools in x-ray for image-based navigation,” arXiv preprint arXiv:1901.06672, 2019. · arXiv
- [26]Gong RH, Stewart J, and Abolmaesumi P, “ Multiple-object 2-d–3-d registration for noninvasive pose identification of fracture fragments,” IEEE transactions on biomedical engineering, vol. 58, no. 6, pp. 1592– 1601, 2011. 21233043
- [27]Otake Y, Armand M, Armiger RS, Kutzer MD, Basafa E, Kazanzides P, and Taylor RH, “ Intraoperative image-based multiview 2d/3d registration for image-guided orthopaedic surgery: incorporation of fiducial-based c-arm tracking and gpu-acceleration,” IEEE transactions on medical imaging, vol. 31, no. 4, pp. 948– 962, 2011. 22113773 PMC4451116
- [28]Yao J, Taylor RH, Goldberg RP, Kumar R, Bzostek A, Van Vorhis R, Kazanzides P, Gueziec A, and Funda J, “ A progressive cut refinement scheme for revision total hip replacement surgery using c-arm fluoroscopy,” in International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, 1999, pp. 1010– 1019.
- [29]Yao J, Taylor RH, Goldberg RP, Kumar R, Bzostek A, Van Vorhis R, Kazanzides P, and Gueziec A, “ A c-arm fluoroscopy-guided progressive cut refinement strategy using a surgical robot,” Computer Aided Surgery, vol. 5, no. 6, pp. 373– 390, 2000. 11295851
- [30]Yi T, Ramchandran V, Siewerdsen JH, and Uneri A, “ Robotic drill guide positioning using known-component 3d–2d image registration,” Journal of Medical Imaging, vol. 5, no. 2, p. 021212, 2018. 29430481 PMC5800483
- [31]Grupp RB, Hegeman R, Murphy R, Alexander C, Otake Y, McArthur B, Armand M, and Taylor RH, “ Pose estimation of periacetabular osteotomy fragments with intraoperative x-ray navigation,” IEEE Transactions on Biomedical Engineering, 2019. PMC7297497 31059424
- [32]Krčah M, Székely G, and Blanc R, “ Fully automatic and fast segmentation of the femur bone from 3d-ct images with no shape prior,” in 2011 IEEE international symposium on biomedical imaging: from nano to macro. IEEE, 2011, pp. 2087– 2090.
- [33]Hartley R and Zisserman A, Multiple view geometry in computer vision. Cambridge university press, 2003.
- [34]Grupp RB, Armand M, and Taylor RH, “ Patch-based image similarity for intraoperative 2d/3d pelvis registration during periacetabular osteotomy,” in OR 2.0 Context-Aware Operating Theaters, Computer Assisted Robotic Endoscopy, Clinical Image-Based Procedures, and Skin Image Analysis. Springer, 2018, pp. 153– 163.
- [36]Powell MJ, “ The bobyqa algorithm for bound constrained optimization without derivatives,” Cambridge NA Report NA2009/06, University of Cambridge, Cambridge, pp. 26– 46, 2009.
Cited by
Sorted by citations
Unberath, M., Gao, C., Hu, Y., Judish, M., Taylor, R. H., Armand, M., & Grupp, R. (2021) · Frontiers in Robotics and AI · doi:10.3389/frobt.2021.716007 · Cited by 102 · see citing works
“Right: Image-based navigation for robot-assisted femoropalsty by [21].”
BackgroundSelf-citationAutomatic Annotation of Hip Anatomy in Fluoroscopy for Robust and Efficient 2D/3D Registration
Grupp, R. B., Unberath, M., Gao, C., Hegeman, R. A., Murphy, R. J., Alexander, C. P., Otake, Y., McArthur, B. A., Armand, M., & Taylor, R. H. (2020) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-020-02162-7 · Cited by 81 · see citing works
Self-citationIntraoperative 2D/3D Image Registration via Differentiable X-Ray Rendering
Gopalakrishnan, V., Dey, N., & Golland, P. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.01108 · Cited by 48 · see citing works
“Beyond localization of instruments relative to patient anatomy, accurate 2D/3D rigid registration is critical to cutting-edge surgical innovations incorporating robotic assistance and augmented reality [2, 3, 20].”
BackgroundA Fully Differentiable Framework for 2D/3D Registration and the Projective Spatial Transformers
Gao, C., Feng, A., Liu, X., Taylor, R. H., Armand, M., & Unberath, M. (2024) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2023.3299588 · Cited by 36 · see citing works
“The surgical tool was chosen an integrated drilling and injection device, which was custom-designed for the application of femoroplasty [4].”
BackgroundMethodSelf-citationKu, P.-C., Martin-Gomez, A., Gao, C., Grupp, R., Mears, S. C., & Armand, M. (2023) · Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization · doi:10.1080/21681163.2022.2152375 · Cited by 8 · see citing works
“Registration pipelines between CT and 2D radiographs have been proposed for surgical treatments around the hip region such as periacetabular osteotomy (Grupp et al. 2020) and femoroplasty (Gao et al. 2020).”
BackgroundSelf-citation
- Authors
- Gao, C., Farvardin, A., Grupp, R. B., Bakhtiarinejad, M., Ma, L., Thies, M., Unberath, M., Taylor, R. H., & Armand, M.
- Affiliations
- Johns Hopkins University (US)
- Chinese Academy of Medical Sciences & Peking Union Medical College (CN)
- Friedrich-Alexander-Universität Erlangen-Nürnberg (DE)
- ORCID
- Venue
- IEEE Transactions on Medical Robotics and Bionics
- Published
- 2020-08
- Volume
- 2
- Issue
- 3
- Pages
- 437-446
- ISSN
- 2576-3202 (ISSN-L)
- PMC
- PMC7982989
- OpenAlex
- W3046011767
- Cited by
- 36
- References
- 5
- Citations by year
- 2026: 2 · 2025: 6 · 2024: 9 · 2023: 11 · 2022: 5 · 2021: 2 · 2020: 1
- FWCI
- 1.85
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Licence
- Locations
- IEEE Transactions on Medical Robotics and Bionics (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- NIH (R01EB023939, R21EB020113)
- Johns Hopkins University Applied Physics Laboratory internal funds
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Medical Image Segmentation Techniques
- Health Sciences › Medicine › Surgery › Spinal Fractures and Fixation Techniques
- Health Sciences › Medicine › Epidemiology › Bone fractures and treatments
- Keywords
- 2D-3D registration, fluoroscopy, surgical navigation, femur, yield load, cadaveric study, biomechanical analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review