Fully automated 2D–3D registration and verification
Abstract
Clinical application of 2D-3D registration technology often requires a significant amount of human interaction during initialisation and result verification. This is one of the main barriers to more widespread clinical use of this technology. We propose novel techniques for automated initial pose estimation of the 3D data and verification of the registration result, and show how these techniques can be combined to enable fully automated 2D-3D registration, particularly in the case of a vertebra based system. The initialisation method is based on preoperative computation of 2D templates over a wide range of 3D poses. These templates are used to apply the Generalised Hough Transform to the intraoperative 2D image and the sought 3D pose is selected with the combined use of the generated accumulator arrays and a Gradient Difference Similarity Measure. On the verification side, two algorithms are proposed: one using normalised features based on the similarity value and the other based on the pose agreement between multiple vertebra based registrations. The proposed methods are employed here for CT to fluoroscopy registration and are trained and tested with data from 31 clinical procedures with 417 low dose, i.e. low quality, high noise interventional fluoroscopy images. When similarity value based verification is used, the fully automated system achieves a 95.73% correct registration rate, whereas a no registration result is produced for the remaining 4.27% of cases (i.e. incorrec…
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Feature-based 2D/3D registration methods require features or anatomical landmarks that are specific to every object and must be selected with domain knowledge and be clearly visible in target images.
“However, these features and anatomical landmarks are specific to every object and must be selected with domain knowledge and such that they are clearly visible in the target images.”
From A Fully Differentiable Framework for 2D/3D Registration and the Projective Spatial Transformers (2024) · cites this paper as [10]
Cites
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421 · see citing works
Kittler, J., Hatef, M., Duin, R. P. W., & Matas, J. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.667881 · Cited by 5,312 · see citing works
Generalizing the Hough transform to detect arbitrary shapes
Ballard, D. H. (1981) · Pattern Recognition · doi:10.1016/0031-3203(81)90009-1 · Cited by 4,366 · see citing works
A Review of 3d/2d Registration Methods for Image-Guided Interventions
Markelj, P., Tomaževič, D., Likar, B., & Pernuš, F. (2012) · Medical Image Analysis · doi:10.1016/j.media.2010.03.005 · Cited by 746 · see citing works
Phase Congruency Detects Corners and Edges
Kovesi, P. D. (2003) · UWA Profiles and Research Repository (UWA) · Cited by 431 · see citing works
Gradient-based 2-D/3-D rigid registration of fluoroscopic X-ray to CT
Livyatan, H., Yaniv, Z. R., & Joskowicz, L. (2003) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2003.819288 · Cited by 176 · see citing works
3-D/2-D registration of CT and MR to X-ray images
Tomaževič, D., Likar, B., Slivnik, T., & Pernuš, F. (2003) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2003.819277 · Cited by 168 · see citing works
Voxel-based 2-D/3-D registration of fluoroscopy images and CT scans for image-guided surgery
Weese, J., Penney, G., Desmedt, P., Buzug, T. M., Hill, D., & Hawkes, D. J. (1997) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/4233.681173 · Cited by 164 · see citing works
Self-citationOtake, Y., Armand, M., Armiger, R. S., Kutzer, M. D. M., Basafa, E., Kazanzides, P., & Taylor, R. H. (2011) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2011.2176555 · Cited by 140 · see citing works
Penney, G., Batchelor, P. G., Hill, D., Hawkes, D. J., & Weese, J. (2001) · Medical Physics · doi:10.1118/1.1373400 · Cited by 112 · see citing works
Self-citationInformation Processing in Computer-Assisted Interventions
Taylor, R. H., & Yang, G.-Z. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-21504-9 · Cited by 88 · see citing works
Monitoring tumor motion by real time 2D/3D registration during radiotherapy
Gendrin, C., Furtado, H., Weber, C., Bloch, C., Figl, M., Pawiro, S. A., Bergmann, H., Stock, M., Gabor Fichtinger, A., Georg, D., et al. (2011) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2011.07.031 · Cited by 87 · see citing works
Otake, Y., Wang, A. S., Webster Stayman, J., Uneri, A., Kleinszig, G., Vogt, S., Khanna, A. J., Gokaslan, Z. L., & Siewerdsen, J. H. (2013) · Physics in Medicine and Biology · doi:10.1088/0031-9155/58/23/8535 · Cited by 85 · see citing works
Otake, Y., Schafer, S., Stayman, J. W., Zbijewski, W., Kleinszig, G., Graumann, R., Khanna, A. J., & Siewerdsen, J. H. (2012) · Physics in Medicine and Biology · doi:10.1088/0031-9155/57/17/5485 · Cited by 79 · see citing works
Virtual Reality: Preparation and Execution of Sinus Surgery
Ecke, U., Klimek, L., M�ller, W., Ziegler, R., & Mann, W. J. (1998) · Computer Aided Surgery · doi:10.1002/(sici)1097-0150(1998)3:1 · Cited by 55 · see citing works
Validation of 3D multimodality roadmapping in interventional neuroradiology
Ruijters, D., Homan, R., Mielekamp, P., van de Haar, P., & Babić, D. (2011) · Physics in Medicine and Biology · doi:10.1088/0031-9155/56/16/017 · Cited by 48 · see citing works
Gendrin, C., Markelj, P., Pawiro, S. A., Spoerk, J., Bloch, C., Weber, C., Figl, M., Bergmann, H., Birkfellner, W., Likar, B., et al. (2011) · Medical Physics · doi:10.1118/1.3553403 · Cited by 38 · see citing works
3D Road-Mapping in the Endovascular Treatment of Cerebral Aneurysms and Arteriovenous Malformations
Rossitti, S., & Pfister, M. (2009) · Interventional Neuroradiology · doi:10.1177/159101990901500305 · Cited by 35 · see citing works
Registration of tomographic images to X-ray projections for use in image guided interventions
Penney, G. (2000) · Europe PMC (PubMed Central) · Cited by 35 · see citing works
Self-citationIncreasing the Automation of a 2D-3D Registration System
Varnavas, A., Carrell, T. W. G., & Penney, G. (2013) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2012.2227337 · Cited by 34 · see citing works
Self-citationvan der Bom, M. J., Bartels, L. W., Gounis, M. J., Homan, R., Timmer, J., Viergever, M. A., & Pluim, J. P. W. (2010) · Medical Physics · doi:10.1118/1.3366252 · Cited by 30 · see citing works
Penney, G., Varnavas, A., Dastur, N., & Carrell, T. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-21504-9_2 · Cited by 22 · see citing works
Self-citationInteractive initialization of 2D/3D rigid registration
Gong, R. H., Güler, Ö., Kürklüoğlu, M., Lovejoy, J. F., & Yaniv, Z. R. (2013) · Medical Physics · doi:10.1118/1.4830428 · Cited by 15 · see citing works
Wang, J., Borsdorf, A., Heigl, B., Köhler, T., & Joachim Hornegger, A. (2014) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2014.45 · Cited by 13 · see citing works
“Gold Standard” 2D/3D Registration of X-Ray to CT and MR Images
Tomaevič, D., Likar, B., & Pernuš, F. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-45787-9_58 · Cited by 9 · see citing works
Flagged first, then by citations
1 of the 26 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
A CNN Regression Approach for Real-Time 2D/3D Registration
Miao, S., Wang, Z. J., & Liao, R. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2521800 · Cited by 514 · see citing works
Unberath, M., Gao, C., Hu, Y., Judish, M., Taylor, R. H., Armand, M., & Grupp, R. (2021) · Frontiers in Robotics and AI · doi:10.3389/frobt.2021.716007 · Cited by 102 · see citing works
“While there are three methods that do, in fact, describe the 2D/3D registration of multiple objects, i. e., vertebral bodies [36, 37] and knee anatomy [38], the individual registrations are solved independently which inhibits information sharing to ease the optimization problem.”
BackgroundMethodInfluentialEsfandiari, H., Newell, R. S., Anglin, C., Street, J., & Hodgson, A. J. (2018) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-018-1776-9 · Cited by 60 · see citing works
Reyneke, C., Lüthi, M., Burdin, V., Douglas, T. S., Vetter, T. R., & Mutsvangwa, T. (2018) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2018.2876450 · Cited by 61 · see citing works
A prospective observational trial of fusion imaging in infrarenal aneurysms
Maurel, B., Martin-Gonzalez, T., Chong, D., Irwin, A. G., Guimbretière, G., Davis, M., & Mastracci, T. M. (2018) · Journal of Vascular Surgery · doi:10.1016/j.jvs.2018.04.015 · Cited by 46 · see citing works
Doelare, S. A. N., Smorenburg, S. P. M., van Schaik, T. G., Blankensteijn, J. D., Wisselink, W., Nederhoed, J. H., Lely, R. J., Hoksbergen, A. W. J., & Yeung, K. K. (2020) · Journal of Endovascular Therapy · doi:10.1177/1526602820960444 · Cited by 43 · see citing works
Ketcha, M. D., Silva, T. D., Uneri, A., Jacobson, M. W., Goerres, J., Kleinszig, G., Vogt, S. K., Wolinsky, J.-P., & Siewerdsen, J. H. (2017) · Physics in Medicine and Biology · doi:10.1088/1361-6560/aa6b3e · Cited by 37 · see citing works
A Fully Differentiable Framework for 2D/3D Registration and the Projective Spatial Transformers
Gao, C., Feng, A., Liu, X., Taylor, R. H., Armand, M., & Unberath, M. (2024) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2023.3299588 · Cited by 36 · see citing works
“Such examples include SIFT features for femur [9], Generalized Hough Transform (GHT) for spine vertebrae [10], learning-based shape encodings for metal implants [11], etc.”
MethodX23D—Intraoperative 3D Lumbar Spine Shape Reconstruction Based on Sparse Multi-View X-ray Data
Jecklin, S., Jancik, C., Farshad, M., Fürnstahl, P., & Esfandiari, H. (2022) · Journal of Imaging · doi:10.3390/jimaging8100271 · Cited by 30 · see citing works
Image Registration in Medical Robotics and Intelligent Systems: Fundamentals and Applications
Liu, J., Singh, G., Alaref, S. J., Lee, B., Oleru, O. O., Min, J. K., Dunham, S. N., Sabuncu, M. R., & Mosadegh, B. (2019) · Advanced Intelligent Systems · doi:10.1002/aisy.201900048 · Cited by 29 · see citing works
Esfandiari, H., Anglin, C., Guy, P., Street, J., Weidert, S., & Hodgson, A. J. (2019) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-019-02024-x · Cited by 27 · see citing works
Current Trends in Artificial Intelligence-Assisted Spine Surgery: A Systematic Review
Liawrungrueang, W., Cho, S. T., Sarasombath, P., Kim, I., & Kim, J. H. (2023) · Asian Spine Journal · doi:10.31616/asj.2023.0410 · Cited by 28 · see citing works
Intraoperative application of hand-held structured light scanning: a feasibility study
Chan, B. W., Au-Yeung, J., Rudan, J. F., Ellis, R. E., & Kunz, M. (2016) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-016-1381-8 · Cited by 23 · see citing works
Patel, R. J., Lee, A. M., Hallsten, J., Lane, J. S., Barleben, A. R., & Malas, M. B. (2022) · Journal of Vascular Surgery · doi:10.1016/j.jvs.2022.12.033 · Cited by 22 · see citing works
Pose-aware C-arm for automatic re-initialization of interventional 2D/3D image registration
Fotouhi, J., Fuerst, B., Johnson, A., Lee, S. C., Taylor, R., Osgood, G., Navab, N., & Armand, M. (2017) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-017-1611-8 · Cited by 24 · see citing works
Iterative Closest Graph Matching for Non-rigid 3d/2d Coronary Arteries Registration
Zhu, J., Li, H., Ai, D., Yang, Q., Fan, J., Huang, Y., Song, H., Han, Y., & Yang, J. (2021) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2020.105901 · Cited by 22 · see citing works
Automatic landmark detection and mapping for 2D/3D registration with BoneNet
Nguyen, V., Pereira, L. F. A., Liang, Z., Mielke, F., Houtte, J. V., Sijbers, J., & Beenhouwer, J. D. (2022) · Frontiers in Veterinary Science · doi:10.3389/fvets.2022.923449 · Cited by 16 · see citing works
Willey, M., Kern, A., Goetz, J. E., Marsh, J. L., & Anderson, D. D. (2022) · Journal of Orthopaedic Research® · doi:10.1002/jor.25393 · Cited by 15 · see citing works
Heuristic tree searching for pose-independent 3D/2D rigid registration of vessel structures
Zhu, J., Fan, J., Guo, S., Ai, D., Song, H., Wang, C., Zhou, S., & Yang, J. (2020) · Physics in Medicine and Biology · doi:10.1088/1361-6560/ab6b43 · Cited by 14 · see citing works
Realistic C-arm to pCT registration for vertebral localization in spine surgery
Naik, R. R., Anitha, H., Bhat, S. N., Ampar, N., & Kundangar, R. S. (2022) · Medical & Biological Engineering & Computing · doi:10.1007/s11517-022-02600-5 · Cited by 14 · see citing works
Banerjee, J., Sun, Y., Klink, C., Gahrmann, R., Niessen, W. J., Moelker, A. D., & van Walsum, T. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.02.003 · Cited by 12 · see citing works
3D/2D Vessel Registration Based on Monte Carlo Tree Search and Manifold Regularization
Zhu, J., Wang, C., Zhang, Y., Zhan, M., Zhao, W. G., Teng, S., Lu, L., & Teng, G. (2023) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2023.3347896 · Cited by 11 · see citing works
Automated image fusion during endovascular aneurysm repair: a feasibility and accuracy study
Smorenburg, S. P. M., Lely, R. J., Smit-Ockeloen, I., Yeung, K. K., & Hoksbergen, A. W. J. (2023) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-023-02832-2 · Cited by 10 · see citing works
Abumoussa, A., Gopalakrishnan, V., Succop, B., Galgano, M., Jaikumar, S., Lee, Y. Z., & Bhowmick, D. A. (2023) · Neurosurgical Focus · doi:10.3171/2023.3.focus2345 · Cited by 9 · see citing works
Budge, J., Carrell, T. W. G., Yaqub, M., Wafa, H. A., Waltham, M., Pilecka, I., Kelly, J., Murphy, C., Palmer, S., Wang, Y., et al. (2024) · Trials · doi:10.1186/s13063-023-07710-5 · Cited by 9 · see citing works
Self-citationBurton, W. S., Myers, C. A., Stefanovic, M., Shelburne, K. B., & Rullkoetter, P. J. (2024) · Journal of Biomechanics · doi:10.1016/j.jbiomech.2024.112066 · Cited by 9 · see citing works
Huang, Y., Zhang, X., Hu, Y., Johnston, A., Jones, C. K., Zbijewski, W. B., Siewerdsen, J. H., Helm, P. A., Witham, T. F., & Uneri, A. (2024) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2024.102365 · Cited by 8 · see citing works
Finite-Element Based Image Registration for Endovascular Aortic Aneurysm Repair
Pionteck, A., Pierrat, B., Gorges, S., Albertini, J., & Avril, S. (2020) · Modelling—International Open Access Journal of Modelling in Engineering Science · doi:10.3390/modelling1010002 · Cited by 8 · see citing works
Jian, 杨. Y., Yuanyuan, 王. W., Ai, D., Hong, 宋. S., Jingfan, 范. F., Tianyu, 付. F., 肖德强, Long, 邵. 龙. S., Ying, 顾. G., & Yongtian, 王. W. (2023) · Acta Optica Sinica · doi:10.3788/aos230742 · Cited by 7 · see citing works
Zhang, S., Lichti, D. D., Küpper, J., & Ronsky, J. L. (2020) · The international archives of the photogrammetry, remote sensing and spatial information sciences/International archives of the photogrammetry, remote sensing and spatial information sciences · doi:10.5194/isprs-archives-xliii-b2-2020-805-2020 · Cited by 6 · see citing works
2-D/3-D Medical Image Registration Based on Feature-Point Matching
Si, S., Li, Z., Lin, Z., Xu, X., Zhang, Y., & Xie, S. (2024) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2024.3481556 · Cited by 5 · see citing works
Yang, K., Luo, Y., Zhao, Y., Su, S., Qu, D., Zhao, X., & Song, G. (2021) · Physics in Medicine and Biology · doi:10.1088/1361-6560/abe9f5 · Cited by 5 · see citing works
Intraoperative Imaging and Image Fusion for Venous Interventions
Chinnadurai, P., & Bismuth, J. X. (2018) · Methodist DeBakey Cardiovascular Journal · doi:10.14797/mdcj-14-3-200 · Cited by 5 · see citing works
Mini-review on human-centered assurance in robot-assisted orthopedics and neurosurgery
Cho, S. M., Zou, X., Fleig, L., & Unberath, M. (2026) · Frontiers in Robotics and AI · doi:10.3389/frobt.2026.1755883 · Cited by 3 · see citing works
Yang, S., Xiao, D., Geng, H., Ai, D., Fan, J., Fu, T., Song, H., Duan, F., & Yang, J. (2024) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2024.3508840 · Cited by 4 · see citing works
Thomas, S., Isensee, F., Köhl, S., Privalov, M., Beisemann, N., Swartman, B. J., Keil, H., Vetter, S. Y., Franke, J., Grützner, P. A., et al. (2019) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-019-02043-8 · Cited by 3 · see citing works
Burton, W. S., Myers, C. A., Stefanovic, M., Shelburne, K. B., & Rullkoetter, P. J. (2024) · Annals of Biomedical Engineering · doi:10.1007/s10439-024-03473-5 · Cited by 3 · see citing works
Ragte, A. S., Almeida, P. D., Rao, B. H. C., Anitha, H., & Muralikrishna, H. (2016) · IEEE International Conference on Recent Trends in Electronics, Information & Communication Technology · doi:10.1109/rteict.2016.7808159 · Cited by 3 · see citing works
Kurniawan, A., Alias, A., Yusof, M. Y. P. M., & Marya, A. (2024) · Imaging Science in Dentistry · doi:10.5624/isd.20230218 · Cited by 2 · see citing works
A novel system for markerless intra-operative bone and bone fragment tracking
Tatum, M., Kern, A., Goetz, J. E., Thomas, G. W., & Anderson, D. D. (2025) · Computer Methods in Biomechanics and Biomedical Engineering Imaging & Visualization · doi:10.1080/21681163.2025.2463327 · Cited by 2 · see citing works
Towards Automated Spine Mobility Quantification: A Locally Rigid CT to X-ray Registration Framework
Drobny, D., Ranzini, M. B. M., Isaac, A., Vercauteren, T. K., Sebastien Ourselin, A., Choi, D., & Marc Modat, A. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-50120-4_7 · Cited by 2 · see citing works
Bai, X., Fang, G., Wang, H., Qin, Y., Han, J., & Yu, N. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.132547 · Cited by 1 · see citing works
Learning-Based Misalignment Detection for 2-D/3-D Overlays
Schaffert, R., Wang, J., Fischer, P., Borsdorf, A., & Maier, A. (2020) · Informatik aktuell · doi:10.1007/978-3-658-29267-6_52 · Cited by 1 · see citing works
Novel diagnostic and imaging techniques in endovascular iliac artery procedures
Boer, S. W. D., Heinen, S. G. H., Goudeketting, S. R., de Haan, M. W., Mees, B., van den Heuvel, D. A. F., & de Vries, J. P. P. M. (2020) · Expert Review of Cardiovascular Therapy · doi:10.1080/14779072.2020.1780916 · Cited by 1 · see citing works
Peripheral Arterial Occlusive Disease
Boer, S. W. D. (2022) · doi:10.33612/diss.222069724
Reliable 2D–3D Registration in Dynamic Stereo-Radiography With Energy Barrier Constraints
Burton, W. S., Myers, C. A., Clary, C. W., & Rullkoetter, P. J. (2024) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2024.3522200
Zhang, Z., Song, H., Fan, J., Shao, L., Fu, T., Ai, D., Xiao, D., Wang, Y., Lin, Y., & Yang, J. (2026) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2026.3714447
Meta-reg: A meta-learning framework for generalizable intraoperative 2D/3D image registration
Xu, L., Kong, Q., Wang, X., Zhang, Y., & Xu, L. (2026) · Applied Soft Computing · doi:10.1016/j.asoc.2026.116093
Neri, J. C. S., Batista, F. C., Estevam, R. V. A., Heredia, B., Tinoco, J., Azevedo, G. V. M. M., & Riguetti-Pinto, C. R. (2026) · Annals of Vascular Surgery · doi:10.1016/j.avsg.2026.09.039
- Authors
- Varnavas, A., Carrell, T., & Penney, G.
- Affiliations
- St Thomas' Hospital (GB)
- Corresponding author
- Varnavas, Andreas
- Venue
- Medical Image Analysis
- Publisher
- Elsevier BV
- Published
- 2015-12
- Volume
- 26
- Issue
- 1
- Pages
- 108-119
- ISSN
- 1361-8415 (ISSN-L)
- OpenAlex
- W2166490563
- Cited by
- 50
- References
- 26
- Citations by year
- 2026: 5 · 2025: 1 · 2024: 8 · 2023: 6 · 2022: 6 · 2021: 2 · 2020: 9 · 2019: 4 · 2018: 4 · 2017: 2 · 2016: 3
- FWCI
- 2.60
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Medical Image Analysis (publishedVersion)
- PubMed (publishedVersion)
- Research Portal (King's College London) (submittedVersion)
- Funders
- National Institute for Health Research
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Medical Image Segmentation Techniques
- Physical Sciences › Engineering › Biomedical Engineering › Medical Imaging and Analysis
- Physical Sciences › Physics and Astronomy › Radiation › Advanced Radiotherapy Techniques
- Keywords
- 2D-3D registration, automatic registration, initial pose estimation, low-dose fluoroscopy, interventional fluoroscopy
- MeSH terms
- Algorithms, Pattern Recognition, Automated, Radiographic Image Enhancement, Radiographic Image Interpretation, Computer-Assisted, Sensitivity and Specificity, Signal Processing, Computer-Assisted, Subtraction Technique, Tomography, X-Ray Computed, Reproducibility of Results, Imaging, Three-Dimensional, Multimodal Imaging
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review