2D/3D image registration using regression learning
Open accessThe DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
In computer vision and image analysis, image registration between 2D projections and a 3D image that achieves high accuracy and near real-time computation is challenging. In this paper, we propose a novel method that can rapidly detect an object’s 3D rigid motion or deformation from a 2D projection image or a small set thereof. The method is called CLARET (Correction via Limited-Angle Residues in External Beam Therapy) and consists of two stages: registration preceded by shape space and regression learning. In the registration stage, linear operators are used to iteratively estimate the motion/deformation parameters based on the current intensity residue between the target projec-tion(s) and the digitally reconstructed radiograph(s) (DRRs) of the estimated 3D image. The method determines the linear operators via a two-step learning process. First, it builds a low-order parametric model of the image region’s motion/deformation shape space from its prior 3D images. Second, using learning-time samples produced from the 3D images, it formulates the relationships between the model parameters and the co-varying 2D projection intensity residues by multi-scale linear regressions. The calculated multi-scale regression matrices yield the coarse-to-fine linear operators used in estimating the model parameters from the 2D projection intensity residues in the registration. The method’s application to Image-guided Radiation Therapy (IGRT) requires only a few seconds and yields good results in localizing a tumor under rigid motion in the head and neck and under respiratory deformation in the lung, using one treatment-time imaging 2D projection or a small set thereof.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Yushkevich, P. A., Piven, J., Hazlett, H. C., Smith, R. G., Ho, S., Gee, J. C., & Gerig, G. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.01.015 · Cited by 8,868
Cootes, T. F., Edwards, G. J., & Taylor, C. J. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.927467 · Cited by 5,409
A Review of 3d/2d Registration Methods for Image-Guided Interventions
Markelj, P., Tomaževič, D., Likar, B., & Pernuš, F. (2012) · Medical Image Analysis · doi:10.1016/j.media.2010.03.005 · Cited by 746
Russakoff, D. B., Rohlfing, T., Mori, K., Rueckert, D., Ho, A., Adler, J. R., & Maurer, C. R. (2005) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2005.856749 · Cited by 142
Research works printed but not linked: 23
- D. Russakoff, T. Rohlfing, C. Maurer, Fast intensity-based 2D–3D image registration of clinical data using light fields, in: Proceedings. Ninth IEEE International Conference on Computer Vision, 2003, vol. 1, 2003, pp. 416–422. · DOI
- Khamene, 2006, Automatic registration of portal images and volumetric CT for patient positioning in radiation therapy, Med. Image Anal., 10, 96, 10.1016/j.media.2005.06.002 · DOI
- Munbodh, 2006, Automated 2D–3D registration of a radiograph and a cone beam CT using line-segment enhancement, Med. Phys., 33, 1398, 10.1118/1.2192621 · DOI
- H. Furtado, C. Gendrin, C. Bloch, J. Spoerk, S.A. Pawiro, C. Weber, M. Figl, M. Stock, D. Georg, H. Bergmann, W. Birkfellner, Real-time 2D/3D registration for tumor motion tracking during radiotherapy, in: Proc. SPIE 8314, Medical Imaging 2012: Image Processing, vol. 8314, 2012, pp. 831407. doi: 10.1117/12.910117. · doi:10.1117/12.910117
- Gendrin, 2012, Monitoring tumor motion by real time 2D/3D registration during radiotherapy, Radiother. Oncol., 102, 274, 10.1016/j.radonc.2011.07.031 · DOI · Paper page
- Li, 2010, Real-time volumetric image reconstruction and 3D tumor localization based on a single X-ray projection image for lung cancer radiotherapy, Med. Phys., 37, 2822, 10.1118/1.3426002 · DOI
- Li, 2011, 3D tumor localization through real-time volumetric X-ray imaging for lung cancer radiotherapy, Med. Phys., 38, 2783, 10.1118/1.3582693 · DOI
- Banks, 1996, Accurate measurement of three-dimensional knee replacement kinematics using single-plane fluoroscopy, IEEE Trans. Biomed. Eng., 43, 638, 10.1109/10.495283 · DOI · Paper page
- L. Freire, A. Gouveia, F. Godinho, FMRI 3D registration based on Fourier space subsets using neural networks, in: 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 2010, pp. 5624–5627. doi: 10.1109/IEMBS.2010.5628038, ISSN: 1557-170X. · doi:10.1109/iembs.2010.5628038
- Zhang, 2008, Rapid surface registration of 3D volumes using a neural network approach, Image Vision Comput., 26, 201, 10.1016/j.imavis.2007.04.003 · DOI
- M. Wachowiak, R. Smolikova, J. Zurada, A. Elmaghraby, A supervised learning approach to landmark-based elastic biomedical image registration and interpolation, in: Proceedings of the 2002 International Joint Conference on Neural Networks, 2002. IJCNN ’02, vol. 2, 2002, pp. 1625–1630. doi: 10.1109/IJCNN.2002.1007761. · DOI
- Chou, 2010, A learning-based patient repositioning method from limited-angle projections, vol. 83, 83
- C.-R. Chou, B. Frederick, X. Liu, G. Mageras, S. Chang, S. Pizer, CLARET: a fast deformable registration method applied to lung radiation therapy, in: Fourth International (MICCAI) Workshop on Pulmonary Image Analysis, 2011, pp. 113–124.
- P. Steininger, M. Neuner, K. Fritscher, F. Sedlmayer, H. Deutschmann, A novel class of machine-learning-driven real-time 2D/3D tracking methods: texture model registration (TMR), in: Proc. SPIE 7964, Medical Imaging 2011: Visualization, Image-Guided Procedures, and Modeling, vol. 7964, 2011, pp. 79640G. doi: 10.1117/12.878147. · DOI
- Jurie, 2002, Hyperplane approximation for template matching, IEEE Trans. Pattern Anal. Mach. Intell., 24, 996, 10.1109/TPAMI.2002.1017625 · DOI · Paper page
- X. Liu, B. Davis, M. Niethammer, S. Pizer, G. Mageras, Prediction-driven respiratory motion atlas formation for 4D image-guided radiation therapy in lung, in: MICCAI’10 Pulmonary Image Analysis Workshop, 2010.
- Beg, 2005, Computing large deformation metric mappings via geodesic flows of diffeomorphisms, Int. J. Comput. Vision, 61, 139, 10.1023/B:VISI.0000043755.93987.aa · DOI · Paper page
- Lorenzen, 2006, Multi-modal image set registration and atlas formation, Med. Image Anal., 10, 440, 10.1016/j.media.2005.03.002 · DOI
- Maltz, 2009, Fixed gantry tomosynthesis system for radiation therapy image guidance based on a multiple source X-ray tube with carbon nanotube cathodes, Med. Phys., 36, 1624, 10.1118/1.3110067 · doi:10.1118/1.3110067
- Nocedal, 1980, Updating quasi-newton matrices with limited storage, Math. Comput., 35, 773, 10.1090/S0025-5718-1980-0572855-7 · DOI · Paper page
- Frederick, 2010, TH-C-201C-10: registration using nanotube stationary tomosynthesis: comparison of 3D/3D to 3D/2D methods, Med. Phys., 37, 3460, 10.1118/1.3469515 · doi:10.1118/1.3469515
- Mageras, 2004, Measurement of lung tumor motion using respiration-correlated CT, Int. J. Radiat. Oncol. Biol. Phys., 60, 933, 10.1016/j.ijrobp.2004.06.021 · doi:10.1016/j.ijrobp.2004.06.021
- Rosu, 2005, Dose reconstruction in deforming lung anatomy: dose grid size effects and clinical implications, Med. Phys., 32, 2487, 10.1118/1.1949749 · DOI
Cited by
Quicksilver: Fast predictive image registration – A deep learning approach
Yang, X., Kwitt, R., Styner, M., & Niethammer, M. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.07.008 · Cited by 630
“An alternative approach to improve registration speed is to predict deformation parameters, or deformation parameter update steps in the optimization via a regression model, instead of directly minimizing a registration energy [7, 8].”
BackgroundMethodA CNN Regression Approach for Real-Time 2D/3D Registration
Miao, S., Wang, Z. J., & Liao, R. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2521800 · Cited by 514
“[17] computed the residual between the DRR and X-ray images as a feature and trained linear regressors to estimate the transformation parameters to reduce the residual.”
BackgroundMethodA Comprehensive Analysis of Deep Regression
Lathuiliere, S., Mesejo, P., Alameda-Pineda, X., & Horaud, R. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2910523 · Cited by 326
Fast Predictive Image Registration
Yang, X., Kwitt, R., & Niethammer, M. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46976-8_6 · Cited by 127
Dilated FCN for Multi-Agent 2D/3D Medical Image Registration
Miao, S., Piat, S., Fischer, P., Tuysuzoglu, A., Mewes, P., Mansi, T., & Liao, R. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11576 · Cited by 113
Metadata
- Authors
- Chou, C.-R., Frederick, B., Mageras, G., Chang, S., & Pizer, S.
- Venue
- Computer Vision and Image Understanding
- Publisher
- Elsevier BV
- Published
- 2013-09
- Volume
- 117
- Issue
- 9
- Pages
- 1095-1106
- ISSN
- 1077-3142 (ISSN-L)
- OpenAlex
- W2000529452
- Cited by
- 64
- References
- 4
- FWCI
- 3.24
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: 2D/3D image registration using regression learning. https://app.cochat.ai/papers/10.1016/j.cviu.2013.02.009
- The paper
- Chou, C.-R., Frederick, B., Mageras, G., Chang, S., & Pizer, S. (2013). 2D/3D image registration using regression learning. Computer Vision and Image Understanding. https://doi.org/10.1016/j.cviu.2013.02.009
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.