The DOI matches its Crossref record; 101 of the 101 references it cites were found in a registry or an index.
Indirect comparisons of competing interventions
Open accessAbstract
OBJECTIVES: To survey the frequency of use of indirect comparisons in systematic reviews and evaluate the methods used in their analysis and interpretation. Also to identify alternative statistical approaches for the analysis of indirect comparisons, to assess the properties of different statistical methods used for performing indirect comparisons and to compare direct and indirect estimates of the same effects within reviews. DATA SOURCES: Electronic databases. REVIEW METHODS: The Database of Abstracts of Reviews of Effects (DARE) was searched for systematic reviews involving meta-analysis of randomised controlled trials (RCTs) that reported both direct and indirect comparisons, or indirect comparisons alone. A systematic review of MEDLINE and other databases was carried out to identify published methods for analysing indirect comparisons. Study designs were created using data from the International Stroke Trial. Random samples of patients receiving aspirin, heparin or placebo in 16 centres were used to create meta-analyses, with half of the trials comparing aspirin and placebo and half heparin and placebo. Methods for indirect comparisons were used to estimate the contrast between aspirin and heparin. The whole process was repeated 1000 times and the results were compared with direct comparisons and also theoretical results. Further detailed case studies comparing the results from both direct and indirect comparisons of the same effects were undertaken. RESULTS: Of the reviews identified through DARE, 31/327 (9.5%) included indirect comparisons. A further five reviews including indirect comparisons were identified through electronic searching. Few reviews carried out a formal analysis and some based analysis on the naive addition of data from the treatment arms of interest. Few methodological papers were identified. Some valid approaches for aggregate data that could be applied using standard software were found: the adjusted indirect comparison, meta-regression and, for binary data only, multiple logistic regression (fixed effect models only). Simulation studies showed that the naive method is liable to bias and also produces over-precise answers. Several methods provide correct answers if strong but unverifiable assumptions are fulfilled. Four times as many similarly sized trials are needed for the indirect approach to have the same power as directly randomised comparisons. Detailed case studies comparing direct and indirect comparisons of the same effect show considerable statistical discrepancies, but the direction of such discrepancy is unpredictable. CONCLUSIONS: Direct evidence from good-quality RCTs should be used wherever possible. Without this evidence, it may be necessary to look for indirect comparisons from RCTs. However, the results may be susceptible to bias. When making indirect comparisons within a systematic review, an adjusted indirect comparison method should ideally be used employing the random effects model. If both direct and indirect comparisons are possible within a review, it is recommended that these be done separately before considering whether to pool data. There is a need to evaluate methods for the analysis of indirect comparisons for continuous data and for empirical research into how different methods of indirect comparison perform in cases where there is a large treatment effect. Further study is needed into when it is appropriate to look at indirect comparisons and when to combine both direct and indirect comparisons. Research into how evidence from indirect comparisons compares to that from non-randomised studies may also be warranted. Investigations using individual patient data from a meta-analysis of several RCTs using different protocols and an evaluation of the impact of choosing different binary effect measures for the inverse variance method would also be useful.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Schulz (1995) · doi:10.1001/jama.1995.03520290060030 · Cited by 5,634
How should meta‐regression analyses be undertaken and interpreted?
Thompson, S. G., & Higgins, J. P. T. (2002) · Statistics in Medicine · doi:10.1002/sim.1187 · Cited by 3,026
Clinical Trials: A Practical Approach.
Hill, I. D., & Pocock, S. J. (1984) · Biometrics · doi:10.2307/2531186 · Cited by 2,930
Evaluating non-randomised intervention studies
Deeks, J., Dinnes, J., D'Amico, R., Sowden, A., Sakarovitch, C., Song, F., Petticrew, M., & Altman, D. (2003) · Health Technology Assessment · doi:10.3310/hta7270 · Cited by 2,907
Self-citationFibrinolytic Therapy Trialists' (FTT) Collaborative Group (1994) · The Lancet · doi:10.1016/s0140-6736(94)91161-4 · Cited by 2,744
Deeks, J. J., Altman, D. G., & Bradburn, M. J. (2001) · Systematic Reviews in Health Care · doi:10.1002/9780470693926.ch15 · Cited by 2,163
Self-citationBucher, H. C., Guyatt, G. H., Griffith, L. E., & Walter, S. D. (1997) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(97)00049-8 · Cited by 2,052
(2000) · Queen Mary Research Online (Queen Mary University of London) · Cited by 1,795
Garg, R. (1995) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1995.03520420066040 · Cited by 1,771
Why we need observational studies to evaluate the effectiveness of health care
Black, N. (1996) · BMJ · doi:10.1136/bmj.312.7040.1215 · Cited by 1,598
Systematic Reviews in Health Care. Meta-analysis in Context.
Kleijnen, J., & Antes, G. (2002) · International Journal of Epidemiology · doi:10.1093/ije/31.3.697 · Cited by 1,363
A Meta-Analysis of Thoracic Radiotherapy for Small-Cell Lung Cancer
Pignon, J.-P., Arriagada, R., Ihde, D. C., Johnson, D. H., Perry, M. C., Souhami, R. L., Brodin, O., Joss, R. A., Kies, M. S., Lebeau, B., et al. (1992) · New England Journal of Medicine · doi:10.1056/nejm199212033272302 · Cited by 1,331
Early thrombolytic treatment in acute myocardial infarction: reappraisal of the golden hour
Boersma, E., Maas, A. C., Deckers, J. W., & Simoons, M. L. (1996) · The Lancet · doi:10.1016/s0140-6736(96)02514-7 · Cited by 1,299
Network meta‐analysis for indirect treatment comparisons
Lumley, T. (2002) · Statistics in Medicine · doi:10.1002/sim.1201 · Cited by 1,206
Discrepancies between Meta-Analyses and Subsequent Large Randomized, Controlled Trials
LeLorier, J., Grégoire, G., Benhaddad, A., Lapierre, J., & Derderian, F. (1997) · New England Journal of Medicine · doi:10.1056/nejm199708213370806 · Cited by 1,171
Lowering blood homocysteine with folic acid based supplements: meta-analysis of randomised trials
Collaboration, H. L. T. (1998) · BMJ · doi:10.1136/bmj.316.7135.894 · Cited by 1,084
St John's wort for depression—an overview and meta-analysis of randomised clinical trials
Linde, K., Ramirez, G., Mulrow, C. D., Pauls, A., Weidenhammer, W., & Melchart, D. (1996) · BMJ · doi:10.1136/bmj.313.7052.253 · Cited by 989
Song, F., Altman, D. G., Glenny, A.-M., & Deeks, J. J. (2003) · BMJ · doi:10.1136/bmj.326.7387.472 · Cited by 943
Self-citationA systematic review of antidepressants in neuropathic pain
McQuay, H. J., Tramér, M., Nye, B. A., Carroll, D., Wiffen, P. J., & Moore, R. A. (1996) · Pain · doi:10.1016/s0304-3959(96)03140-5 · Cited by 930
Chiba, N., De Gara, C., Wilkinson, J., & Hunt, R. (1997) · Gastroenterology · doi:10.1053/gast.1997.v112.pm9178669 · Cited by 857
Anticonvulsant drugs for management of pain: a systematic review
McQuay, H., Carroll, D., Jadad, A. R., Wiffen, P., & Moore, A. (1995) · BMJ · doi:10.1136/bmj.311.7012.1047 · Cited by 713
Deeks, J. J. (2002) · Statistics in Medicine · doi:10.1002/sim.1188 · Cited by 660
Self-citationBORROWING STRENGTH FROM EXTERNAL TRIALS IN A META-ANALYSIS
HIGGINS, J. P. T., & WHITEHEAD, A. (1996) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19961230)15:24<2733::aid-sim562>3.0.co;2-0 · Cited by 557
A Meta-analysis of the Effects of Nonsteroidal Anti-inflammatory Drugs on Blood Pressure
Pope, J. E. (1993) · Archives of Internal Medicine · doi:10.1001/archinte.1993.00410040045007 · Cited by 527
Randomisation and baseline comparisons in clinical trials
Altman, D. G., & Doré, C. J. (1990) · The Lancet · doi:10.1016/0140-6736(90)90014-v · Cited by 508
Self-citationStochastically dependent effect sizes.
Gleser, L. J., & Olkin, I. (1994) · Cited by 485
Epidemiology and reporting of randomised trials published in PubMed journals
Chan, A.-W., & Altman, D. G. (2005) · The Lancet · doi:10.1016/s0140-6736(05)71879-1 · Cited by 474
Self-citationFelson, D. T., Anderson, J. J., & Meenan, R. F. (1990) · Arthritis & Rheumatism · doi:10.1002/art.1780331001 · Cited by 470
Publication and Related Biases
Song, F., Eastwood, A., Gilbody, S., Duley, L., & Sutton, A. (2001) · The Advanced Handbook of Methods in Evidence Based Healthcare · doi:10.4135/9781848608344.n21 · Cited by 455
Self-citationApplied Mixed Models in Medicine
Ziegel, E. R., Brown, H., & Prescott, R. (2000) · Technometrics · doi:10.2307/1270978 · Cited by 447
Some Surprising Results about Covariate Adjustment in Logistic Regression Models
Robinson, L. D., & Jewell, N. P. (1991) · International Statistical Review / Revue Internationale de Statistique · doi:10.2307/1403444 · Cited by 410
Lambert, P. C., Sutton, A. J., Abrams, K. R., & Jones, D. R. (2002) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(01)00414-0 · Cited by 394
Large trials vs meta-analysis of smaller trials: how do their results compare?
Cappelleri, J. C., Ioannidis, J., Schmid, C., de Ferranti, S., Aubert, M., Chalmers, T. C., & Lau, J. (1996) · Journal of the American Medical Association (JAMA) · doi:10.1001/jama.276.16.1332 · Cited by 340
Rectal corticosteroids versus alternative treatments in ulcerative colitis: a meta-analysis.
Marshall, J. K., & Irvine, E. J. (1997) · Gut · doi:10.1136/gut.40.6.775 · Cited by 314
Bayesian Approaches to Clinical Trials and Health-Care Evaluation
Best, M. A. (2005) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2004.00347_17.x · Cited by 303
de Craen, A. J. M., Tijssen, J. G. P., de Gans, J., & Kleijnen, J. (2000) · Journal of Neurology · doi:10.1007/s004150050560 · Cited by 292
Wade, C. E., Kramer, G. C., Grady, J. J., Fabian, T. C., & Younes, R. N. (1997) · Surgery · doi:10.1016/s0039-6060(97)90135-5 · Cited by 286
Efficacy of Drug Treatment in Obsessive–Compulsive Disorder: a Meta-Analytic Review
Piccinelli, M., Pini, S., Bellantuono, C., & Wilkinson, G. (1995) · British Journal of Psychiatry · doi:10.1192/bjp.166.4.424 · Cited by 282
Meta‐analysis of continuous outcome data from individual patients
Higgins, J. P. T., Whitehead, A., Turner, R. M., Omar, R. Z., & Thompson, S. G. (2001) · Statistics in Medicine · doi:10.1002/sim.918 · Cited by 265
A Meta-analysis of Methods to Prevent Venous Thromboembolism Following Total Hip Replacement
Imperiale, T. F. (1994) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1994.03510460072036 · Cited by 245
Assessing the Quality of Randomised Controlled Trials
Jüni, P., Altman, D. G., & Egger, M. (2001) · Systematic Reviews in Health Care · doi:10.1002/9780470693926.ch5 · Cited by 238
Self-citationMoore, A. R., & McQuay, J. H. (1997) · Pain · doi:10.1016/s0304-3959(96)03291-5 · Cited by 236
A quality assessment of randomized control trials of primary treatment of breast cancer.
Liberati, A., Himel, H. N., & Chalmers, T. C. (1986) · Journal of Clinical Oncology · doi:10.1200/jco.1986.4.6.942 · Cited by 195
Rectal aminosalicylate therapy for distal ulcerative colitis: a meta‐analysis
MARSHALL, J. K., & IRVINE, E. J. (1995) · Alimentary Pharmacology & Therapeutics · doi:10.1111/j.1365-2036.1995.tb00384.x · Cited by 194
Paracetamol with and without codeine in acute pain: a quantitative systematic review
Moore, A., Collins, S., Carroll, D., & McQuay, H. (1997) · Pain · doi:10.1016/s0304-3959(96)03319-2 · Cited by 192
Packer, M., Antonopoulos, G. V., Berlin, J. A., Chittams, J., Konstam, M. A., & Udelson, J. E. (2001) · American Heart Journal · doi:10.1067/mhj.2001.115584 · Cited by 184
Investigating heterogeneity in an individual patient data meta-analysis of time to event outcomes
Smith, C. T., Williamson, P. R., & Marson, A. G. (2005) · Statistics in Medicine · doi:10.1002/sim.2050 · Cited by 173
The Treatment of Chronic Constipation in Adults A Systematic Review
Tramonte, S. M., Brand, M. B., Mulrow, C. D., Amato, M. G., O'Keefe, M. E., & Ramirez, G. (1997) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.1997.12103.x · Cited by 170
Meta-analysis of Multitreatment Studies
Hasselblad, V. (1998) · Medical Decision Making · doi:10.1177/0272989x9801800110 · Cited by 165
Efficacy of minor analgesics in primary dysmenorrhoea: a systematic review
Zhang, W. Y., & Li Wan Po, A. (1998) · BJOG: An International Journal of Obstetrics & Gynaecology · doi:10.1111/j.1471-0528.1998.tb10210.x · Cited by 165
Meta-analysis, Simpson's paradox, and the number needed to treat
Altman, D. G., & Deeks, J. J. (2002) · BMC Medical Research Methodology · doi:10.1186/1471-2288-2-3 · Cited by 162
Self-citationTreatment of lupus nephritis: A meta-analysis of clinical trials
Bansal, V. K., & Beto, J. A. (1997) · American Journal of Kidney Diseases · doi:10.1016/s0272-6386(97)90029-9 · Cited by 162
Meta-analysis by the confidence profile method
Eddy, D. M. (1992) · Cited by 144
de Craen, A. J. M., Giulio, G., Lampe-Schoenmaeckers, A. J. E. M., Kessels, A. G. H., & Kleijnen, J. (1996) · BMJ · doi:10.1136/bmj.313.7053.321 · Cited by 143
Statistical Methods for Comparison to Placebo in Active-Control Trials
Hasselblad, V., & Kong, D. F. (2001) · Drug Information Journal · doi:10.1177/009286150103500212 · Cited by 139
Ades, A. E. (2003) · Statistics in Medicine · doi:10.1002/sim.1566 · Cited by 131
Prevention of Nonsteroidal Anti-inflammatory Drug—Induced Gastrointestinal Mucosal Injury
Koch, M. (1996) · Archives of Internal Medicine · doi:10.1001/archinte.1996.00440190069008 · Cited by 119
Schmieder, R. E. (1996) · JAMA · doi:10.1001/jama.275.19.1507 · Cited by 118
Baker, S. G., & Kramer, B. S. (2002) · BMC Medical Research Methodology · doi:10.1186/1471-2288-2-13 · Cited by 116
Why and how Sources of Heterogeneity Should be Investigated
Thompson, S. G. (2001) · Wiley eBooks · doi:10.1002/9780470693926.ch9 · Cited by 114
Medical Treatment for Stroke Prevention
Matchar, D. B., McCrory, D. C., Barnett, H. J. M., & Feussner, J. R. (1994) · Annals of Internal Medicine · doi:10.7326/0003-4819-121-1-199407010-00008 · Cited by 113
Lipid-lowering interventions in angiographic trials
Rossouw, J. E. (1995) · The American Journal of Cardiology · doi:10.1016/s0002-9149(99)80476-7 · Cited by 110
Golzari, H., Cebul, R. D., & Bahler, R. C. (1996) · Annals of Internal Medicine · doi:10.7326/0003-4819-125-4-199608150-00010 · Cited by 93
Some Issues in the Design and Analysis of Equivalence Trials
Hauck, W. W., & Anderson, S. (1999) · Drug Information Journal · doi:10.1177/009286159903300114 · Cited by 91
Fisher, L. D., Gent, M., & Buller, H. R. (2001) · American Heart Journal · doi:10.1067/mhj.2001.111262 · Cited by 89
Evans, M., & Pollock, A. V. (1985) · British journal of surgery · doi:10.1002/bjs.1800720403 · Cited by 85
Utility and pitfalls of some statistical methods in active controlled clinical trials
Wang, S., Hung, H., & Tsong, Y. (2002) · Controlled Clinical Trials · doi:10.1016/s0197-2456(01)00155-6 · Cited by 83
Zhang, W., & Po, A. L. W. (1996) · Journal of Clinical Pharmacy and Therapeutics · doi:10.1111/j.1365-2710.1996.tb01148.x · Cited by 82
Poynard, T. (1996) · Hepatology · doi:10.1053/jhep.1996.v24.pm0008855176 · Cited by 79
Bhansali, M. S., Vaidya, J. S., Bhatt, R. G., Patil, P. K., Badwe, R. A., & Desai, P. B. (1996) · Annals of Oncology · doi:10.1093/oxfordjournals.annonc.a010601 · Cited by 78
Song, F., Glenny, A., & Altman, D. G. (2000) · Controlled Clinical Trials · doi:10.1016/s0197-2456(00)00055-6 · Cited by 77
Self-citationSong, F., & Glenny, A. (1998) · Health Technology Assessment · doi:10.3310/hta2070 · Cited by 67
Self-citationLi, Z., & Begg, C. (1994) · Journal of the American Statistical Association · doi:10.1080/01621459.1994.10476892 · Cited by 65
Eriksson, S., Långström, G., Rikner, L., Carlsson, R., & Næsdal, J. (1995) · PubMed · Cited by 64
A Model for Incorporating Historical Controls into a Meta-Analysis
Begg, C. B., & Pilote, L. (1991) · Biometrics · doi:10.2307/2532647 · Cited by 64
Poynard, T., Lemaire, M., & Agostini, H. (1995) · PubMed · Cited by 63
Overview of Clinical Trials Comparing Natural and Synthetic Surfactants
Halliday, H. L. (2009) · Biology of the Neonate · doi:10.1159/000244205 · Cited by 62
Cholesterol reduction and its impact on coronary artery disease and total mortality
Holme, I. (1995) · The American Journal of Cardiology · doi:10.1016/s0002-9149(99)80465-2 · Cited by 57
Does drug treatment improve survival? Reconciling the trials in mild-to-moderate hypertension
Hoes, A. W., Grobbee, D. E., & Lubsen, J. C. (1995) · Journal of Hypertension · doi:10.1097/00004872-199507000-00013 · Cited by 50
Hoes, A. W., Grobbee, D. E., Peet, T. M., & Lubsen, J. C. (1994) · Drugs · doi:10.2165/00003495-199447050-00002 · Cited by 49
Tsong, Y., Wang, S., Hung, H., & Cui, L. (2003) · Journal of Biopharmaceutical Statistics · doi:10.1081/bip-120017724 · Cited by 42
Going Beyond the Grand Mean: Subgroup Analysis in Meta‐Analysis of Randomised Trials
Smith, G. D., & Egger, M. (2001) · Wiley eBooks · doi:10.1002/9780470693926.ch8 · Cited by 34
Meta‐analysis on the treatment of panic disorder with agoraphobia: Review and re‐examination
van Balkom, A. J. L. M., Nauta, M. C. E., & Bakker, A. (1995) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.5640020101 · Cited by 32
Reporting on Methods in Clinical Trials
DerSimonian, R., Charette, L. J., McPeek, B., & Mosteller, F. C. (2019) · CRC Press eBooks · doi:10.1201/9780429187445-17 · Cited by 30
Meunier, F., Paesmans, M., & Autier, P. (1994) · European Journal of Cancer Part B Oral Oncology · doi:10.1016/0964-1955(94)90091-4 · Cited by 29
Aro, J. (1991) · The Prostate · doi:10.1002/pros.2990180205 · Cited by 27
Number-needed-to-treat and placebo-controlled trials
de Craen, A. J. M., Vickers, A. J., Tijssen, J. G. P., & Kleijnen, J. (1998) · The Lancet · doi:10.1016/s0140-6736(05)78341-0 · Cited by 27
Chang, D. C., & Wilson, S. E. (1997) · The American Journal of Surgery · doi:10.1016/s0002-9610(97)00137-2 · Cited by 27
Sauriol, L., Laporta, M., Edwardes, M. D., Deslandes, M., Ricard, N., & Suissa, S. (2001) · Clinical Therapeutics · doi:10.1016/s0149-2918(01)80082-5 · Cited by 24
A multilevel model framework for meta‐analysis of clinical trials with binary outcomes
Turner, R., Omar, R., Yang, M., Goldstein, H., & Thompson, S. G. (2000) · Statistics in Medicine · doi:10.1002/1097-0258(20001230)19:24<3417::aid-sim614>3.3.co;2-c · Cited by 24
Meta-Analysis of Migraine Headache Treatments: Combining Information from Heterogeneous Designs
Dominici, F., Parmigiani, G., Wolpert, R. L., & Hasselblad, V. (1999) · Journal of the American Statistical Association · doi:10.2307/2669674 · Cited by 18
Secondary prevention of stroke: does dipyridamole add to aspirin?
Löwenthal, A., & Buyse, M. E. (1994) · PubMed · Cited by 13
Trial and error: cross-trial comparisons of antiretroviral regimens.
Phillips, A. N. (2003) · PubMed · doi:10.1097/01.aids.0000050807.28043.83 · Cited by 12
Equivalence and noninferiority trials
Lee, K. L. (2000) · American Heart Journal · doi:10.1067/mhj.2000.104184 · Cited by 10
Engels, E. (2000) · doi:10.1002/1097-0258(20000715)19:13 · Cited by 2
Explaining heterogeneity in meta-analysis: a comparison of methods
Thompson, S. G., & Sharp, S. J. (1999) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19991030)18:20
Cited by
GRADE guidelines: 8. Rating the quality of evidence—indirectness
Guyatt, G. H., Oxman, A. D., Kunz, R., Woodcock, J., Brozek, J., Helfand, M., Alonso-Coello, P., Falck-Ytter, Y., Jaeschke, R., Vist, G., et al. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2011.04.014 · Cited by 1,843
Simultaneous comparison of multiple treatments: Combining direct and indirect evidence.
Caldwell, D. M., Ades, A. E., & Higgins, J. P. T. (2005) · BMJ · doi:10.1136/bmj.331.7521.897 · Cited by 1,600
Dias, S., Sutton, A. J., Ades, A. E., & Welton, N. J. (2013) · Medical Decision Making · doi:10.1177/0272989x12458724 · Cited by 1,207
Evaluation of networks of randomized trials
Salanti, G., Higgins, J. P., Ades, A., & Ioannidis, J. P. (2008) · Statistical Methods in Medical Research · doi:10.1177/0962280207080643 · Cited by 1,078
Fu, R., Gartlehner, G., Grant, M., Shamliyan, T., Sedrakyan, A., Wilt, T. J., Griffith, L., Oremus, M., Raina, P., Ismaila, A., et al. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.08.010 · Cited by 730
Metadata
- Authors
- Glenny, A., Altman, D., Song, F., Sakarovitch, C., Deeks, J., D'Amico, R., Bradburn, M., & Eastwood, A.
- Venue
- Health Technology Assessment
- Published
- 2005-07
- Volume
- 9
- Issue
- 26
- Pages
- 1-134, iii
- ISSN
- 1366-5278 (ISSN-L)
- 2046-4924
- OpenAlex
- W2099326967
- Cited by
- 677
- References
- 101
- FWCI
- 26.18
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.