Standardized evaluation methodology for 2-D-3-D registration
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
In the past few years, a number of two-dimensional (2-D) to three-dimensional (3-D) (2-D-3-D) registration algorithms have been introduced. However, these methods have been developed and evaluated for specific applications, and have not been directly compared. Understanding and evaluating their performance is therefore an open and important issue. To address this challenge we introduce a standardized evaluation methodology, which can be used for all types of 2-D-3-D registration methods and for different applications and anatomies. Our evaluation methodology uses the calibrated geometry of a 3-D rotational X-ray (3DRX) imaging system (Philips Medical Systems, Best, The Netherlands) in combination with image-based 3-D-3-D registration for attaining a highly accurate gold standard for 2-D X-ray to 3-D MR/CT/3DRX registration. Furthermore, we propose standardized starting positions and failure criteria to allow future researchers to directly compare their methods. As an illustration, the proposed methodology has been used to evaluate the performance of two 2-D-3-D registration techniques, viz. a gradient-based and an intensity-based method, for images of the spine. The data and gold standard transformations are available on the internet (http://www.isi.uu.nl/Research/Databases/).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Multimodality image registration by maximization of mutual information
Maes, F., Collignon, A., Vandermeulen, D., Marchal, G., & Suetens, P. (1997) · IEEE Transactions on Medical Imaging · doi:10.1109/42.563664 · Cited by 4,547 · cited 4×
“An application based on the Multi-Modality Image Registration using Information Theory (MIRIT) software by the Laboratory for Medical Imaging Research, Leuven, Belgium [26] was used for 3-D–3-D registration.”
MethodInfluential“Gold Standard” 2D/3D Registration of X-Ray to CT and MR Images
Tomaevič, D., Likar, B., & Pernuš, F. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-45787-9_58 · Cited by 9 · cited 1×
“Previously, gold standards for 2-D–3-D registration were either obtained manually [9], [22], by controlled motion [7], [8], [24], by independent measuring devices [3], [7], [11], by back-projection of images features (mainly implanted fiducials) [4], [9], [12], [15], [17]–[19], [21], [24], [25] or by using simulated d…”
Self-citation
Cited by
A Review of 3d/2d Registration Methods for Image-Guided Interventions
Markelj, P., Tomaževič, D., Likar, B., & Pernuš, F. (2012) · Medical Image Analysis · doi:10.1016/j.media.2010.03.005 · Cited by 746
“To increase the accuracy and reliability of MR to X-ray registrations, a mapping function was proposed by van de Kraats et al. (2005b) to generate CT-like data from the MR data.”
BackgroundMethodInfluentialSelf-citationA CNN Regression Approach for Real-Time 2D/3D Registration
Miao, S., Wang, Z. J., & Liao, R. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2521800 · Cited by 514
“Registration Error in the projection direction (mTREproj) [29],”
BackgroundReal-time 2D/3D registration via CNN regression
Miao, S., Wang, Z. J., Zheng, Y., & Liao, R. (2016) · 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2016.7493536 · Cited by 101
Otake, Y., Wang, A. S., Webster Stayman, J., Uneri, A., Kleinszig, G., Vogt, S., Khanna, A. J., Gokaslan, Z. L., & Siewerdsen, J. H. (2013) · Physics in Medicine and Biology · doi:10.1088/0031-9155/58/23/8535 · Cited by 89
Otake, Y., Schafer, S., Stayman, J. W., Zbijewski, W., Kleinszig, G., Graumann, R., Khanna, A. J., & Siewerdsen, J. H. (2012) · Physics in Medicine and Biology · doi:10.1088/0031-9155/57/17/5485 · Cited by 79
3D-2D Registration of Cerebral Angiograms: A Method and Evaluation on Clinical Images
Mitrovic, U., Spiclin, Z., Likar, B., & Pernus, F. (2013) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2013.2259844 · Cited by 67
“The clinical context associated with the publicly available image datasets is spine surgery [31], [32], [34], and radiotherapy of the head [33].”
InfluentialMultiview 2D/3D Rigid Registration via a Point-Of-Interest Network for Tracking and Triangulation
Liao, H., Lin, W.-A., Zhang, J., Zhang, J., Luo, J., & Zhou, S. K. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01292 · Cited by 66
van der Bom, I. M. J., Klein, S., Staring, M., Homan, R., Bartels, L. W., & Pluim, J. P. W. (2011) · SPIE Proceedings · doi:10.1117/12.877655 · Cited by 55
3D-2D Registration for Surgical Guidance: Effect of Projection View Angles on Registration Accuracy
Uneri, A., Otake, Y., Wang, A. S., Kleinszig, G., Vogt, S., Khanna, A. J., & Siewerdsen, J. H. (2014) · Physics in Medicine and Biology · doi:10.1088/0031-9155/59/2/271 · Cited by 53
Birkfellner, W., Stock, M., Figl, M., Gendrin, C., Hummel, J., Dong, S., Kettenbach, J., Georg, D., & Bergmann, H. (2009) · Medical Physics · doi:10.1118/1.3157111 · Cited by 44
3D–2D registration in mobile radiographs: algorithm development and preliminary clinical evaluation
Otake, Y., Wang, A. S., Uneri, A., Kleinszig, G., Vogt, S., Aygun, N., Lo, S.-F. L., Wolinsky, J.-P., Gokaslan, Z. L., & Siewerdsen, J. H. (2015) · Physics in Medicine & Biology · doi:10.1088/0031-9155/60/5/2075 · Cited by 41
“Registration accuracy was evaluated in terms of projection distance error (PDE) (van de Kraats et al 2005) defined as: (5) where is the projection of the ith target point computed by a projection matrix (equation (1)) estimated by the registration and is the projection computed by the true…”
MethodGendrin, C., Markelj, P., Pawiro, S. A., Spoerk, J., Bloch, C., Weber, C., Figl, M., Bergmann, H., Birkfellner, W., Likar, B., et al. (2011) · Medical Physics · doi:10.1118/1.3553403 · Cited by 38
Accurate and precise 2D–3D registration based on X-ray intensity
Aouadi, S., & Sarry, L. (2008) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2007.05.006 · Cited by 30
A Patient-Specific Self-supervised Model for Automatic X-Ray/CT Registration
Zhang, B., Faghihroohi, S., Azampour, M. F., Liu, S., Ghotbi, R., Schunkert, H., & Navab, N. (2023) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-43996-4_49 · Cited by 27
Iterative Closest Graph Matching for Non-rigid 3d/2d Coronary Arteries Registration
Zhu, J., Li, H., Ai, D., Yang, Q., Fan, J., Huang, Y., Song, H., Han, Y., & Yang, J. (2021) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2020.105901 · Cited by 22
Registration of 2D x-ray images to 3D MRI by generating pseudo-CT data
van der Bom, M. J., Pluim, J. P. W., Gounis, M. J., van de Kraats, E. B., Sprinkhuizen, S. M., Timmer, J., Homan, R., & Bartels, L. W. (2011) · Physics in Medicine and Biology · doi:10.1088/0031-9155/56/4/010 · Cited by 21
Self-citationMetric-Driven Learning of Correspondence Weighting for 2-D/3-D Image Registration
Schaffert, R., Wang, J., Fischer, P., Borsdorf, A., & Maier, A. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-12939-2_11 · Cited by 19
Wang, C., Xie, S., Li, K., Wang, C., Liu, X., Zhao, L., & Tsai, T.-Y. (2021) · Engineering · doi:10.1016/j.eng.2020.03.016 · Cited by 19
Naik, R. R., Hoblidar, A., Bhat, S. N., Ampar, N., & Kundangar, R. (2022) · Journal of Imaging · doi:10.3390/jimaging8070185 · Cited by 16
Comparative Evaluation of Regression Methods for 3D-2D Image Registration
Gouveia, A. I. R., Metz, C., Freire, L., & Klein, S. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33266-1_30 · Cited by 5
Single shot 2D3D image regisraton
Xie, Y., Meng, C., Guan, S., & Wang, Q. (2017) · 2017 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI) · doi:10.1109/cisp-bmei.2017.8302202 · Cited by 2
Metadata
- Authors
- van de Kraats, E. B., Penney, G. P., Tomazevic, D., van Walsum, T., & Niessen, W. J.
- Venue
- IEEE Transactions on Medical Imaging
- Published
- 2005-09
- Volume
- 24
- Issue
- 9
- Pages
- 1177-1189
- ISSN
- 0278-0062 (ISSN-L)
- OpenAlex
- W2126440019
- Cited by
- 211
- References
- 2
- FWCI
- 11.97
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.