The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Meta-Analyses of Randomized Controlled Trials
Abstract
A new type of research, termed meta-analysis, attempts to analyze and combine the results of previous reports. We found 86 meta-analyses of reports of randomized controlled trials in the English-language literature. We evaluated the quality of these meta-analyses, using a scoring method that considered 23 items in six major areas--study design, combinability, control of bias, statistical analysis, sensitivity analysis, and application of results. Only 24 meta-analyses (28 percent) addressed all six areas, 31 (36 percent) addressed five, 25 (29 percent) addressed four, 5 (6 percent) addressed three, and 1 (1 percent) addressed two. Of the 23 individual items, between 1 and 14 were addressed satisfactorily (mean +/- SD, 7.7 +/- 2.7). We conclude that an urgent need exists for improved methods in literature searching, quality evaluation of trials, and synthesizing of the results.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068
The combination of estimates from different experiments
Cochran, W. G. (1954) · Biometrics · doi:10.2307/3001666 · Cited by 5,380
Primary, Secondary, and Meta-Analysis of Research
GLASS, G. V. (1976) · Educational Researcher · doi:10.3102/0013189x005010003 · Cited by 4,890
Beta blockade during and after myocardial infarction: An overview of the randomized trials
Yusuf, S., Peto, R., Lewis, J., Collins, R., & Sleight, P. (1985) · Progress in Cardiovascular Diseases · doi:10.1016/s0033-0620(85)80003-7 · Cited by 3,205
A method for assessing the quality of a randomized control trial
Chalmers, T. C., Smith, H., Blackburn, B., Silverman, B., Schroeder, B., Reitman, D., & Ambroz, A. (1981) · Controlled Clinical Trials · doi:10.1016/0197-2456(81)90056-8 · Cited by 1,349
Self-citation
Research works printed but not linked: 16
- Light, 1971, Harvard Educ Rev, 41, 429, 10.17763/haer.41.4.437714870334w144 · DOI
- Louis, 1985, Annu Rev Public Health, 6, 1, 10.1146/annurev.pu.06.050185.000245 · DOI
- Beecher, 1955, JAMA, 159, 1602, 10.1001/jama.1955.02960340022006 · DOI
- Tran, 1985, JAMA, 254, 919, 10.1001/jama.1985.03360070057023 · DOI
- Dickersin, 1985, Controlled Clin Trials, 6, 306, 10.1016/0197-2456(85)90106-0 · DOI
- Sacks, 1982, Am J Med, 72, 233, 10.1016/0002-9343(82)90815-4 · DOI · Paper page
- Scheffé H. Analysis of variance. New York: John Wiley, 1959:221–89.
- Rosenthal, 1978, Psychol Bull, 85, 185, 10.1037/0033-2909.85.1.185 · DOI · Paper page
- DerSimonian, 1982, N Engl J Med, 306, 1332, 10.1056/NEJM198206033062204 · DOI
- Chan, 1982, Clin Res, 30, 234A
- Mantel, 1959, JNCI, 22, 719
- Levitt, 1977, Cancer, 39, 924, 10.1002/1097-0142(197702)39:2+<924::AID-CNCR2820390731>3.0.CO;2-7 · DOI
- Levitt, 1977, Cancer, 39, 933, 10.1002/1097-0142(197702)39:2+<933::AID-CNCR2820390732>3.0.CO;2-6 · DOI
- Relman, 1980, N Engl J Med, 303, 277, 10.1056/NEJM198007313030509 · DOI
- Elashoff, 1978, Gastroenterology, 75, 1170, 10.1016/0016-5085(78)90094-X · DOI
- Goldman, 1979, Ann Intern Med, 90, 92, 10.7326/0003-4819-90-1-92 · DOI
Cited by
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042
“In 1987, Sacks and colleagues (6) evaluated the adequacy of reporting of 83 meta-analyses on 23 characteristics in six domains.”
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164
“Of note, a survey of systematic reviews indexed in MEDLINE in November 2004 found that reports of protocol use had increased to about 46% [3] from 8% noted in previous surveys [49].”
BackgroundPreferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.005 · Cited by 19,575
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gotzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · BMJ · doi:10.1136/bmj.b2700 · Cited by 17,648
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2010) · International Journal of Surgery · doi:10.1016/j.ijsu.2010.02.007 · Cited by 12,156
Shea, B. J., Reeves, B. C., Wells, G., Thuku, M., Hamel, C., Moran, J., Moher, D., Tugwell, P., Welch, V., Kristjansson, E., et al. (2017) · BMJ · doi:10.1136/bmj.j4008 · Cited by 10,636
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.006 · Cited by 10,578
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00136 · Cited by 10,349
Downs, S. H., & Black, N. (1998) · Journal of Epidemiology and Community Health · doi:10.1136/jech.52.6.377 · Cited by 8,252
Moher, D., Cook, D. J., Eastwood, S., Olkin, I., Rennie, D., & Stroup, D. F. (1999) · The Lancet · doi:10.1016/s0140-6736(99)04149-5 · Cited by 4,826
Development of AMSTAR: A measurement tool to assess the methodological quality of systematic reviews
Shea, B. J., Grimshaw, J. M., Wells, G. A., Boers, M., Andersson, N., Hamel, C., Porter, A. C., Tugwell, P., Moher, D., & Bouter, L. M. (2007) · BMC Medical Research Methodology · doi:10.1186/1471-2288-7-10 · Cited by 4,374
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Italian Journal of Public Health · doi:10.2427/5768 · Cited by 3,374
Moher, D., Schulz, K. F., & Altman, D. G. (2001) · BMC Medical Research Methodology · doi:10.1186/1471-2288-1-2 · Cited by 2,755
Reprint—Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & and the PRISMA Group (2009) · Physical Therapy · doi:10.1093/ptj/89.9.873 · Cited by 2,486
Zeng, X., Zhang, Y., Kwong, J. S. W., Zhang, C., Li, S., Sun, F., Niu, Y., & Du, L. (2015) · Journal of Evidence-Based Medicine · doi:10.1111/jebm.12141 · Cited by 2,082
Shea, B. J., Hamel, C., Wells, G. A., Bouter, L. M., Kristjansson, E., Grimshaw, J., Henry, D. A., & Boers, M. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.10.009 · Cited by 1,755
Ma, L.-L., Wang, Y.-Y., Yang, Z.-H., Huang, D., Weng, H., & Zeng, X.-T. (2020) · Military Medical Research · doi:10.1186/s40779-020-00238-8 · Cited by 1,648
Publication bias in meta-analysis its causes and consequences
Thornton, A. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(99)00161-4 · Cited by 1,291
Seventy-five trials and eleven systematic reviews a day: how will we ever keep up?
Bastian, H., Glasziou, P., & Chalmers, I. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000326 · Cited by 1,188
Cumulative Meta-Analysis of Therapeutic Trials for Myocardial Infarction
Lau, J., Antman, E. M., Jimenez-Silva, J., Kupelnick, B., Mosteller, F., & Chalmers, T. C. (1992) · New England Journal of Medicine · doi:10.1056/nejm199207233270406 · Cited by 1,140
Self-citationSmith, T. B., McCullough, M. E., & Poll, J. (2003) · Psychological Bulletin · doi:10.1037/0033-2909.129.4.614 · Cited by 1,150
Epidemiology and reporting characteristics of systematic reviews.
Moher, D., Tetzlaff, J., Tricco, A. C., Sampson, M., & Altman, D. G. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040078 · Cited by 891
Moher, D. (2009) · Journal of Chinese Integrative Medicine · doi:10.3736/jcim20090918 · Cited by 909
Users' Guides to the Medical Literature: IX. A Method for Grading Health Care Recommendations
Guyatt, G. H. (1995) · JAMA · doi:10.1001/jama.1995.03530220066035 · Cited by 846
Publication bias and clinical trials
Dickersin, K., Chan, S., Chalmersx, T. C., Sacks, H. S., & Smith, H. (1987) · Controlled Clinical Trials · doi:10.1016/0197-2456(87)90155-3 · Cited by 715
Self-citationPRISMA for Abstracts: Reporting Systematic Reviews in Journal and Conference Abstracts
Beller, E. M., Glasziou, P. P., Altman, D. G., Hopewell, S., Bastian, H., Chalmers, I., Gøtzsche, P. C., Lasserson, T., Tovey, D., & for the PRISMA for Abstracts Group (2013) · PLoS Medicine · doi:10.1371/journal.pmed.1001419 · Cited by 706
Problems in the “Evidence” of “Evidence-Based Medicine”
Feinstein, A. R., & Horwitz, R. I. (1997) · The American Journal of Medicine · doi:10.1016/s0002-9343(97)00244-1 · Cited by 653
Incorporating variations in the quality of individual randomized trials into meta-analysis
Detsky, A. S., Naylor, C. D., O'Rourke, K., McGeer, A. J., & L'Abbé, K. A. (1992) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(92)90085-2 · Cited by 640
External Validation of a Measurement Tool to Assess Systematic Reviews (AMSTAR)
Shea, B. J., Bouter, L. M., Peterson, J., Boers, M., Andersson, N., Ortiz, Z., Ramsay, T., Bai, A., Shukla, V. K., & Grimshaw, J. M. (2007) · PLoS ONE · doi:10.1371/journal.pone.0001350 · Cited by 569
“…to further explore the impact of the following items on the construct validity of AMSTAR: a) Cochrane systematic review vs. non-Cochrane systematic reviews [59], [60], b) journal type [61], c) year of publication [62], d) conflict of interest [63], e) impact factor [64], and number of pages [64].”
BackgroundKelley, G. A., & Kelley, K. S. (2000) · Hypertension · doi:10.1161/01.hyp.35.3.838 · Cited by 555
A brief history of research synthesis
Chalmers, I., Hedges, L. V., & Cooper, H. (2002) · Evaluation & the Health Professions · doi:10.1177/0163278702025001003 · Cited by 552
Does blinding of readers affect the results of meta-analyses?
Berlin, J. A. (1997) · The Lancet · doi:10.1016/s0140-6736(05)62352-5 · Cited by 478
Clinical Outcomes After Ablation and Pacing Therapy for Atrial Fibrillation: A Meta-Analysis
Wood, M. A., Brown-Mahoney, C., Kay, G. N., & Ellenbogen, K. A. (2000) · Circulation · doi:10.1161/01.cir.101.10.1138 · Cited by 476
Why review articles on the health effects of passive smoking reach different conclusions
Barnes, D. E. (1998) · JAMA · doi:10.1001/jama.279.19.1566 · Cited by 442
Gurevitch, J., Curtis, P. S., & Jones, M. H. (2001) · Advances in Ecological Research · doi:10.1016/s0065-2504(01)32013-5 · Cited by 421
Gøtzsche, P. C. (1989) · Controlled Clinical Trials · doi:10.1016/0197-2456(89)90017-2 · Cited by 339
Anderson, J. W., Allgood, L. D., Lawrence, A., Altringer, L. A., Jerdack, G. R., Hengehold, D. A., & Morel, J. G. (2000) · The American Journal of Clinical Nutrition · doi:10.1093/ajcn/71.2.472 · Cited by 337
Systematic review adherence to methodological or reporting quality
Pussegoda, K., Turner, L., Garritty, C., Mayhew, A., Skidmore, B., Stevens, A., Boutron, I., Sarkis-Onofre, R., Bjerre, L. M., Hróbjartsson, A., et al. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0527-2 · Cited by 322
Kung, J. (2010) · The Open Dentistry Journal · doi:10.2174/1874210601004020084 · Cited by 329
Stergiou, G. S., Asayama, K., Thijs, L., Kollias, A., Niiranen, T. J., Hozawa, A., Boggia, J., Johansson, J. K., Ohkubo, T., Tsuji, I., et al. (2014) · Hypertension · doi:10.1161/hypertensionaha.113.02741 · Cited by 304
Page, M. J., McKenzie, J. E., Kirkham, J., Dwan, K., Kramer, S., Green, S., & Forbes, A. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000035.pub2 · Cited by 281
Determinants of compliance with iron supplementation: Supplies, side effects, or psychology?
Galloway, R., & McGuire, J. (1994) · Social Science & Medicine · doi:10.1016/0277-9536(94)90135-x · Cited by 277
Meta-analysis: Neither quick nor easy
Berman, N. G., & Parker, R. A. (2002) · BMC Medical Research Methodology · doi:10.1186/1471-2288-2-10 · Cited by 270
Kelley, G. A., & Kelley, K. S. (2009) · Preventive Medicine · doi:10.1016/j.ypmed.2008.10.010 · Cited by 263
Heterogeneity in Meta-analysis of Data from Epidemiologic Studies: A Commentary
Colditz, G. A., Burdick, E., & Mosteller, F. (1995) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a117644 · Cited by 245
Miles, P. G., Vig, P. S., Weyant, R. J., Forrest, T. D., & Rockette, H. E. (1996) · American Journal of Orthodontics and Dentofacial Orthopedics · doi:10.1016/s0889-5406(96)70177-4 · Cited by 237
Kelley, G. A., Kelley, K. S., & Tran, Z. V. (2004) · Journal of Women's Health · doi:10.1089/jwh.2004.13.1148 · Cited by 225
Moseley, A. M., Elkins, M. R., Herbert, R. D., Maher, C. G., & Sherrington, C. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.09.018 · Cited by 202
Halbert, J., Silagy, C., Finucane, P., Withers, R., & Hamdorf, P. (1999) · European Journal of Clinical Nutrition · doi:10.1038/sj.ejcn.1600784 · Cited by 207
Popat, S., & Houlston, R. S. (2005) · European Journal of Cancer · doi:10.1016/j.ejca.2005.04.039 · Cited by 187
Manchikanti, L. (2009) · Pain Physician · doi:10.36076/ppj.2009/12/819 · Cited by 168
Olson, B. H., Anderson, S. M., Becker, M. P., Anderson, J. W., Hunninghake, D. B., Jenkins, D. J. A., LaRosa, J. C., Rippe, J. M., Roberts, D. C. K., Stoy, D. B., et al. (1997) · The Journal of Nutrition · doi:10.1093/jn/127.10.1973 · Cited by 167
Pereira, T. V., & Ioannidis, J. P. A. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.12.012 · Cited by 160
Effects of Sodium Bicarbonate Ingestion on Anaerobic Performance: A Meta-Analytic Review
Matson, L. G., & Tran, Z. V. (1993) · International Journal of Sport Nutrition · doi:10.1123/ijsn.3.1.2 · Cited by 159
Lunny, C., Brennan, S. E., McDonald, S., & McKenzie, J. E. (2018) · Systematic Reviews · doi:10.1186/s13643-018-0784-8 · Cited by 139
Kraemer, H. C., Gardner, C., Brooks, J. O., & Yesavage, J. A. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.1.23 · Cited by 141
Beyond the single study: function/location metanalysis in cognitive neuroimaging
Fox, P. T., Parsons, L. M., & Lancaster, J. L. (1998) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(98)80138-4 · Cited by 136
Evaluating Meta-analyses in the General Surgical Literature: A Critical Appraisal
Dixon, E., Hameed, M., Sutherland, F., Cook, D. J., & Doig, C. (2005) · Annals of Surgery · doi:10.1097/01.sla.0000154258.30305.df · Cited by 129
Aerobic exercise and lipids and lipoproteins in men: a meta-analysis of randomized controlled trials
Kelley, G. A., & Kelley, K. S. (2006) · The Journal of Men's Health & Gender · doi:10.1016/j.jmhg.2005.09.003 · Cited by 127
Kelley, G. A., Kelley, K. S., Roberts, S., & Haskell, W. (2012) · Clinical Nutrition · doi:10.1016/j.clnu.2011.11.011 · Cited by 125
Effects of antihistamines in adult asthma: a meta-analysis of clinical trials
Van Ganse, E., Kaufman, L., Derde, M., Yernault, J., Delaunois, L., & Vincken, W. (1997) · European Respiratory Journal · doi:10.1183/09031936.97.10102216 · Cited by 107
Cochrane and non-Cochrane systematic reviews in leading orthodontic journals: a quality paradigm?
Fleming, P. S., Seehra, J., Polychronopoulou, A., Fedorowicz, Z., & Pandis, N. (2013) · The European Journal of Orthodontics · doi:10.1093/ejo/cjs016 · Cited by 95
Systemic steroids for otitis media with effusion in children
Rosenfeld, R. M., Mandel, E. M., & Bluestone, C. D. (1991) · Archives of Otolaryngology - Head and Neck Surgery · doi:10.1001/archotol.1991.01870210056008 · Cited by 99
Pitfalls of Systematic Reviews and Meta-Analyses in Imaging Research
McInnes, M. D. F., & Bossuyt, P. M. M. (2015) · Radiology · doi:10.1148/radiol.2015142779 · Cited by 99
Asayama, K., Thijs, L., Brguljan-Hitij, J., Niiranen, T. J., Hozawa, A., Boggia, J., Aparicio, L. S., Hara, A., Johansson, J. K., Ohkubo, T., et al. (2014) · PLoS Medicine · doi:10.1371/journal.pmed.1001591 · Cited by 87
The reporting quality of meta-analyses improves: a random sampling study
Wen, J., Ren, Y., Wang, L., Li, Y., Liu, Y., Zhou, M., Liu, P., Ye, L., Li, Y., & Tian, W. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.10.008 · Cited by 84
Lunny, C., Brennan, S. E., Reid, J., McDonald, S., & McKenzie, J. E. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.09.025 · Cited by 71
Chen, J.-J., Liu, Z., Zhu, D., Li, Q., Zhang, H., Huang, H., Wei, Y., Mu, J., Yang, D., & Xie, P. (2014) · Psychiatry Research · doi:10.1016/j.psychres.2014.05.010 · Cited by 71
Efficacy of aerobic exercise on coronary heart disease risk factors
Kelley, G. A., & Kelley, K. S. (2008) · Preventive Cardiology · doi:10.1111/j.1751-7141.2008.08037.x · Cited by 62
Ma, B., Guo, J., Qi, G., Li, H., Peng, J., Zhang, Y., Ding, Y., & Yang, K. (2011) · PLoS ONE · doi:10.1371/journal.pone.0020185 · Cited by 56
“This instrument, developed on the biasis of the Oxman-Guyatt Overview Quality Assessment Questionnaire (OQAQ) [11] and Sack’s Quality Assessment Checklist [12] is considered a validated tool in assessing the methodological quality of systematic reviews, and receives recognition from international agencies, including T…”
MethodCardona, J. M., & Pastor, E. (1997) · Osteoporosis International · doi:10.1007/bf01622285 · Cited by 53
Heise, T. L., Seidler, A., Girbig, M., Freiberg, A., Alayli, A., Fischer, M., Haß, W., & Zeeb, H. (2022) · BMC Medical Research Methodology · doi:10.1186/s12874-022-01821-4 · Cited by 20
Systematic Reviews and Cancer Research: a Suggested Stepwise Approach
Kelley, G. A., & Kelley, K. S. (2018) · BMC Cancer · doi:10.1186/s12885-018-4163-6 · Cited by 13
Systematic reviews and meta-analysis in rheumatology: a gentle introduction for clinicians
Kelley, G. A., & Kelley, K. S. (2019) · Clinical Rheumatology · doi:10.1007/s10067-019-04590-6 · Cited by 8
Practical Application of Nonrandomized Research to Patient Care: A Case Study of Nesiritide
Winegardner, M. L., Reaume, K. T., Dabaja, G. S., & Kalus, J. S. (2007) · Pharmacotherapy: The Journal of Human Pharmacology and Drug Therapy · doi:10.1592/phco.27.1.143 · Cited by 2
Metadata
- Authors
- Sacks, H. S., Berrier, J., Reitman, D., Ancona-Berk, V. A., & Chalmers, T. C.
- Venue
- New England Journal of Medicine
- Publisher
- Massachusetts Medical Society
- Published
- 1987-02-19
- Volume
- 316
- Issue
- 8
- Pages
- 450-455
- ISSN
- 0028-4793 (ISSN-L)
- 1533-4406
- OpenAlex
- W2067550511
- Cited by
- 1,250
- References
- 5
- FWCI
- 90.62
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.