Assessing the Gold Standard — Lessons from the History of RCTs
The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Abstract
Randomized, controlled trials have become the gold standard of medical knowledge. Yet their scientific and political history offers lessons about the complexity of medicine and disease and the economic and political forces shaping the production and circulation of knowledge.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Randomized clinical trials (RCT) serve as the most valid study design to inform clinical practice according to evidence-based medicine (EBM) principles.1,2”
From Integrity of randomized clinical trials: Performance of integrity tests and checklists requires assessment (2023) · cites this paper as [1]
Citations
Cites
Optimal Medical Therapy with or without PCI for Stable Coronary Disease
Boden, W. E., O'Rourke, R. A., Teo, K. K., Hartigan, P. M., Maron, D. J., Kostuk, W. J., Knudtson, M., Dada, M., Casperson, P., Harris, C. L., et al. (2007) · New England Journal of Medicine · doi:10.1056/nejmoa070829 · Cited by 4,699
Elkin, I. (1989) · Archives of General Psychiatry · doi:10.1001/archpsyc.1989.01810110013002 · Cited by 2,300
Zika Virus Infection in Pregnant Women in Rio de Janeiro
Brasil, P., Pereira, J. P., Moreira, M. E., Ribeiro Nogueira, R. M., Damasceno, L., Wakimoto, M., Rabello, R. S., Valderramos, S. G., Halai, U.-A., Salles, T. S., et al. (2016) · New England Journal of Medicine · doi:10.1056/nejmoa1602412 · Cited by 2,196
A Controlled Trial of Arthroscopic Surgery for Osteoarthritis of the Knee
Moseley, J. B., O'Malley, K., Petersen, N. J., Menke, T. J., Brody, B. A., Kuykendall, D. H., Hollingsworth, J. C., Ashton, C. M., & Wray, N. P. (2002) · New England Journal of Medicine · doi:10.1056/nejmoa013259 · Cited by 2,149
Impure Science: AIDS, Activism, and the Politics of Knowledge
(1997) · Nature Medicine · doi:10.1038/nm0297-242 · Cited by 1,666
The effectiveness of psychotherapy: the Consumer Reports study
Seligman, M. E. P. (1995) · American Psychologist · doi:10.1037/0003-066x.50.12.965 · Cited by 1,608
Emergence of Zaire Ebola Virus Disease in Guinea
Baize, S., Pannetier, D., Oestereich, L., Rieger, T., Koivogui, L., Magassouba, N., Soropogui, B., Sow, M. S., Keïta, S., De Clerck, H., et al. (2014) · New England Journal of Medicine · doi:10.1056/nejmoa1404505 · Cited by 1,366
TRANSLUMINAL DILATATION OF CORONARY-ARTERY STENOSIS
Grüntzig, A. (1978) · The Lancet · doi:10.1016/s0140-6736(78)90500-7 · Cited by 1,343
Instruments, Randomization, and Learning about Development
Deaton, A. (2010) · Journal of Economic Literature · doi:10.1257/jel.48.2.424 · Cited by 1,286
A review of uses of health care utilization databases for epidemiologic research on therapeutics
Schneeweiss, S., & Avorn, J. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.10.012 · Cited by 1,277
Research works printed but not linked: 3
- Podolsky SH, Jones DS, Kaptchuk TJ. From trials to trials: blinding, medicine, and honest adjudication. In: Robertson CT, Kesselheim AS, eds. Blinding as a solution to bias: strengthening biomedical science, forensic science, and law. Amsterdam: Elsevier, 2016:45-58.
- Kuo W-H. Japan and Taiwan in the wake of bio-globalization: drugs, race and standards (Ph.D. dissertation). Cambridge: Massachusetts Institute of Technology, 2005.
- Rothman DJ, 2000, New York Rev Books, 47, 60
Cited by
Items 601–698 of 698
Bozer, J. J., & Hussain, N. (2025) · A&A Practice · doi:10.1213/xaa.0000000000001934
Kwaliteit van de gezondheidszorg
de Bruijne, M. C., Kringos, D. S., & van Laarhoven, H. W. M. (2025) · doi:10.1007/978-90-368-3103-1_8
The Beginning of Experimentation in the Social Sciences
Welsh, B. C., Zane, S. N., & Podolsky, S. H. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780197675946.003.0005
Self-citationJoan McCord and Delinquency Causation
Welsh, B. C., Zane, S. N., & Podolsky, S. H. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780197675946.003.0009
Self-citationHistorical Understanding for Modern Criminology
Welsh, B. C., Zane, S. N., & Podolsky, S. H. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780197675946.003.0010
Self-citationEffects on Delinquency and Criminal Offending: The First Three Full Evaluations
Welsh, B. C., Zane, S. N., & Podolsky, S. H. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780197675946.003.0008
Self-citationWelsh, B. C., Zane, S. N., & Podolsky, S. H. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780197675946.002.0009
Self-citationWelsh, B. C., Zane, S. N., & Podolsky, S. H. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780197675946.002.0005
Self-citationAn Idea Is Born: The Influence of the Gluecks and Others
Welsh, B. C., Zane, S. N., & Podolsky, S. H. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780197675946.003.0003
Self-citationWelsh, B. C., Zane, S. N., & Podolsky, S. H. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780197675946.002.0007
Self-citationWelsh, B. C., Zane, S. N., & Podolsky, S. H. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780197675946.002.0010
Self-citationOperation of the Study, 1939–1945
Welsh, B. C., Zane, S. N., & Podolsky, S. H. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780197675946.003.0007
Self-citationThe Historical Context of Experimentation in Medicine and Public Health
Welsh, B. C., Zane, S. N., & Podolsky, S. H. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780197675946.003.0006
Self-citationIdeals and Pragmatism: Between Medicine and Society
Welsh, B. C., Zane, S. N., & Podolsky, S. H. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780197675946.003.0002
Self-citationPlanning and Development of the Study, 1935–1939
Welsh, B. C., Zane, S. N., & Podolsky, S. H. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780197675946.003.0004
Self-citationIntroduction: Between Medicine and Criminology
Welsh, B. C., Zane, S. N., & Podolsky, S. H. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780197675946.003.0001
Self-citationWelsh, B. C., Zane, S. N., & Podolsky, S. H. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780197675946.002.0012
Self-citationWelsh, B. C., Zane, S. N., & Podolsky, S. H. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780197675946.002.0008
Self-citationWelsh, B. C., Zane, S. N., & Podolsky, S. H. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780197675946.002.0004
Self-citationExploring the Role of Immune Cells in Glioma: Causal Associations and Clinical Implications
Pan, Y., Sun, X., Luo, F., Chen, Z., Liu, C., Zhu, Y., Wang, J., Chen, R., Liu, Q., Wu, C., et al. (2025) · International Journal of Medical Sciences · doi:10.7150/ijms.116560
“Although randomized controlled trials (RCTs) are considered the gold standard for establishing causal effects, their practical implementation can be challenging [21].”
Nardi, E. P. (2024) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/t.5.2024.tde-09062025-123737
VLUCI: Variational Learning of Unobserved Confounders for Counterfactual Inference
Zhao, Y., Wang, Y., Fu, S., Peng, Y., & Sun, H. (2025) · Communications in computer and information science · doi:10.1007/978-981-96-6948-6_3
Graf, B. M. (2025) · Die Anaesthesiologie · doi:10.1007/s00101-025-01556-z
Exclusionary data, inclusionary appeals: Gender and equity in an HIV-prevention clinical trial
D’Amours, J. V., & Waggoner, M. R. (2025) · Social Studies of Science · doi:10.1177/03063127251349231
“Although randomized controlled trials (RCTs) have many limitations (Bothwell et al., 2016), they have long formed the basis of knowledge for drug safety and efficacy in the United States.”
Real-World and Subgroup Data Synthesis to Guide PCSK9 Inhibitor Use in Cardiovascular DiseasePreprint
Sun, L., Zhou, D., Hu, H., Ding, W., Zhong, Y., & Tian, L. (2025) · Research Square · doi:10.21203/rs.3.rs-7274417/v1
Scoping Out Clinical Trial Emulation
Ouyang, D., & Drazen, J. M. (2025) · NEJM AI · doi:10.1056/aie2500877
Fuller, J. (2025) · Oxford University Press eBooks · doi:10.1093/9780190066178.002.0004
Fuller, J. (2025) · Oxford University Press eBooks · doi:10.1093/9780190066178.003.0002
Medical Interventions and Risk
Fuller, J. (2025) · Oxford University Press eBooks · doi:10.1093/9780190066178.003.0009
Medical Evidence and Prediction
Fuller, J. (2025) · Oxford University Press eBooks · doi:10.1093/9780190066178.003.0008
The Nature of Chronic Diseases and Mental Disorders
Fuller, J. (2025) · Oxford University Press eBooks · doi:10.1093/9780190066178.003.0006
Fuller, J. (2025) · Oxford University Press eBooks · doi:10.1093/9780190066178.003.0011
Fuller, J. (2025) · Oxford University Press eBooks · doi:10.1093/9780190066178.003.0014
Causation and Classification of Disease
Fuller, J. (2025) · Oxford University Press eBooks · doi:10.1093/9780190066178.003.0005
Twenty-First-Century Medicine: Epidemiological, Personalized, or Postmodern?
Fuller, J. (2025) · Oxford University Press eBooks · doi:10.1093/9780190066178.003.0013
Theories of Contagion and Cancer
Fuller, J. (2025) · Oxford University Press eBooks · doi:10.1093/9780190066178.003.0003
Effect Measures and the Sufficient-Component Cause Model
Fuller, J. (2025) · Oxford University Press eBooks · doi:10.1093/9780190066178.005.0001
Fuller, J. (2025) · Oxford University Press eBooks · doi:10.1093/9780190066178.003.0010
Integrating a pilot study and large trial into one adaptive design
Dai, J., Gajewski, B. J., Shergina, E., Mount, R. R., & Gibbs, H. (2025) · Contemporary Clinical Trials · doi:10.1016/j.cct.2025.108112
Major study types with designs, measures, and examples
Abdelrashid, M., & Lobbous, M. (2025) · Elsevier eBooks · doi:10.1016/b978-0-323-90509-1.00041-2
Anis, L., Benzies, K., Ewashen, C., Hart, M. J., & Letourneau, N. L. (2025) · Children · doi:10.3390/children12121605
“Due to high costs and participant attrition, it may be challenging to evaluate the longer-term effects of an intervention, and thus very rare harmful effects of the intervention may not be detected by RCTs [2,24,31].”
Advances in psychotherapy research and precision mental health
Friedl, N. (2020) · BORIS Theses (Bern Open Research Information System) (Bern University Library, Hochschulstrasse 6, 3012 Bern, Switzerland) · doi:10.48549/2379
Almulhim, A. N., Hartley, H., Norman, P., Caton, S. J., Doğru, O. C., & Goyder, E. (2023) · Figshare · doi:10.6084/m9.figshare.22598573
Kumar, N., Ainooson, J., Billings, A., Chen, G., Cueto, L. N., Janmohamed, K., Jiang, J., Niaura, R., & Zhang, A. (2020) · Figshare · doi:10.6084/m9.figshare.12172212
Kumar, N., Ainooson, J., Billings, A., Chen, G., Cueto, L. N., Janmohamed, K., Jiang, J., Niaura, R., & Zhang, A. (2020) · Figshare · doi:10.6084/m9.figshare.12172203
Murphy, E. K., O’Keeffe, A., O Shea, N., Long, E. B., Eustace, J., & Shiely, F. (2021) · Figshare · doi:10.6084/m9.figshare.16576031
Palmowski, A. (2021) · Refubium (Universitätsbibliothek der Freien Universität Berlin) · doi:10.17169/refubium-30860
The role of psychological recovery in back pain prevention and rehabilitation
Heidari, J. (2019) · Dokumentenrepositorium der RUB (Ruhr University Bochum) · doi:10.13154/294-6221
Stratification of personal risk in colorectal cancer screening
King, D. (2024) · UNSWorks (University of New South Wales, Sydney, Australia) · doi:10.26190/unsworks/30156
Williams, A., Lennox, L., Harris, M. J., & Antonacci, G. (2024) · Figshare · doi:10.6084/m9.figshare.26633211
Rides At The Door, M. (2019) · ScholarWorks at University of Montana
Bias in Public Health Research: Ethical Implications and Objective Assessment Tools
Valdez, Jr. (2018) · OakTrust (Texas A&M University Libraries) · Cited by 1
van Gelder, N. E. (2024) · Radboud Repository (Radboud University)
Krytyczna ocena badań klinicznych w onkologii — część I
Kaczor, M., Wójcik, R., Połowinczak-Przybyłek, J., & Potemski, P. (2018) · Via Medica Journals
Beesley, R. E. (2025) · Lancaster EPrints (Lancaster University) · doi:10.17635/lancaster/thesis/2973
Diddeniya, P. (2025) · ePrints Soton (University of Southampton) · Cited by 1
Ahmad, F., Rahim, M., Qazi, F. K., Khan, Z., Rasool, S., Kibria, Z., Sanauddin, N., Gul, M., Naeem, F., Firaz, M., et al. (2025) · Trials · doi:10.1186/s13063-025-09284-w
“RCTs typically focus on clinical outcomes such as morbidity and intervention effectiveness, neglecting the contextual factors, implementation processes, and stakeholder experiences that influence these results [19].”
Sources of Data Used in Pharmacoepidemiology and Pharmacovigilance
Chinzowu, T., & Nishtala, P. S. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-26472-6.00082-6
The paradigm of clinical research in the world: evolution, modern models and prospects
Mykhalchuk, V. M. (2026) · Reproductive health of woman · doi:10.30841/2708-8731.1.2026.354629
Le rapport coût-efficacité de la psychothérapie
Spycher, J., Marti, J., Bourgeois, M., & Avendaño, M. (2026) · IRIS · doi:10.16908/rds-essentiels/73
A Value-Based Approach to Designing Inclusive Clinical TrialsPreprint
Jiao, B., Griffin, S., Kunst, N., Rothery, C., & Pandya, A. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6511080
Caussié, S. (2022) · theses.fr (ABES) · doi:10.70675/4ba7a406zde7fz41f7z832ez6d0fe0c2104f · Cited by 5
Dey, S. K., Qureshi, A. I., & Shyu, C. (2026) · medRxiv · doi:10.64898/2026.04.09.26350523
Reframing Pharma through Global Health and Social Science: Evidence Ecologies
Fagan, G. P. (2026) · CRC Press eBooks · doi:10.1201/9781003783558
Cho, N., Jeong, I., Ahn, S.-J., Kim, Y., Park, J.-H., Kim, J. H., Kim, Y. W., Kim, B., Oh, S. W., Lee�, H., et al. (2026) · Communications Medicine · doi:10.1038/s43856-026-01589-4
Definitions, Principles, and Concepts of Pharmacoepidemiology and Pharmacovigilance
Chinzowu, T., & Nishtala, P. S. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-26472-6.00047-4
On the intellectual unity of futures studies
Virmajoki, V. (2026) · Futures · doi:10.1016/j.futures.2026.103971
Li, K., Liu, M. W., He, B., Cheng, H., Lv, J., Wang, J., Song, P., & Chen, S. (2026) · Frontiers in Pharmacology · doi:10.3389/fphar.2026.1815376
A systematic review of the methodological quality of randomised trials in IBD surgery
Aimar, K., Gaur, A., Peirson, M., Walshaw, J., Pinkney, T. D., & Lee, M. J. (2026) · Colorectal Disease · doi:10.1111/codi.70531
“…controlled trials (RCTs) provide the highest level of evidence to evaluate treat-ment effects and underpin modern evidence-based practice [ 8] While numerous RCTs provide evidence for the medical management of IBD, particularly with biologic agents [ 9, 10], surgical RCTs remain…”
Oliynyk, I. (2026) · Scientific Reports · doi:10.1038/s41598-026-56497-3
“The classical FDA phase model (I–IV), originally designed for commercial drug development, does not adequately capture the full spectrum of biomedical research 8 , including observational, retrospective, or registry-based studies common in neuro-oncology.”
Controlled Clinical Trials and Evidence-Based Medicine
Bothwell, L. E., & Podolsky, S. H. (2026) · Oxford University Press eBooks · doi:10.1093/9780190645083.003.20
Self-citationMalakellis, M., Shee, A. W., Alston, L. V., Versace, V. L., Griffith, P., Odgers, J., & Namara, K. M. (2026) · Australian Journal of Rural Health · doi:10.1111/ajr.70232
Dil, N. (2026) · Springer eBooks · doi:10.1007/978-3-032-19175-5_6
James, T. E., Monawar, M.-Y. S., Shaker, E., Haskell-Mendoza, A. P., González, A., Chongsathidkiet, P., Dalton, T., Folz, C. C., Krishnamoorthy, V., Patel, A., et al. (2026) · Neurosurgical Review · doi:10.1007/s10143-026-04389-5
“These additions reflect a broader shift in biomedical research towards open science, reproducibility, and data sharing practices marking a promising trend for future RCTs [57].”
Yin, X., Burcu, M., Stewart, M. D., Stuart, E. A., & Davi, R. C. (2026) · Research Square · doi:10.21203/rs.3.rs-9682017/v1
Methodological Pluralism in Surgical Evidence: from Concept to Practice
Dumont, F., Bourgin, C., & Vignaud, T. (2026) · Surgery in Practice and Science · doi:10.1016/j.sipas.2026.100358
“RCTs have become the gold standard for establishing truth in medicine, a status reinforced by political, regulatory, and institutional decisions that govern reimbursement of new treatments and guide therapeutic choices 27 .”
Rethinking Covariate Selection for Causal Effect Inference: The Primacy of Proximal Confounders
Zhao, Y., Wang, Y., Han, D., Ma, C., & Sun, H. (2026) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3833418
Veertig jaar ideeën over volksgezondheid: herhaling van zetten?
Alex Burdorf, A. (2026) · TSG - Tijdschrift voor gezondheidswetenschappen · doi:10.1007/s12508-026-00532-1
“Daardoor krijgen belangrijke interven-ties die zich niet als een experiment laten onderzoe-ken te weinig aandacht [14].”
Chemaitelly, H. S., Akhtar, N., Jerdi, S. A., Kamran, S., Joseph, S., Morgan, D., Uy, R., Abid, F. B., Al‐Khal, A., Abou‐Samra, A., et al. (2026) · Expert Review of Vaccines · doi:10.1080/14760584.2026.2720953
Characteristics of Authorized Clinical Trials in Peru, 2017–2025: A National Registry-Based Study
Mendoza-Aucaruri, L., Acevedo-Cahuana, A. G., Villalba-Ugarte, F. P., Ttito-Paricahua, L., Ale-Mauricio, D. A., & Taype-Rondan, A. (2026) · Therapeutic Innovation & Regulatory Science · doi:10.1007/s43441-026-01040-9
“Clinical trials (CTs) provide the highest level of evidence for assessing the efficacy and safety of health interven - tions, and they remain central to therapeutic and regulatory decision-making [1].”
Hao, P., Yaacoub, S. G., & Porcher, R. (2026) · BMC Medical Research Methodology · doi:10.1186/s12874-026-02997-9
Jørgensen, M. J., Gräf, D. D., & Hallgreen, C. E. (2026) · Clinical Pharmacology & Therapeutics · doi:10.1002/cpt.70475
Studies in Normative Pragmatics
Innocenti, B., & Goodwin, J. (2026) · doi:10.22329/wsia.17.2026
Artificial intelligence and target trial emulation: toward scalable and credible real-world evidence
Liu, T., & Wang, Y. (2026) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2026.112501
Sukik, L., Paul, P., Ayoub, H. H., Coyle, P. V., Tang, P., Hasan, M. R., Yassine, H. M., Thani, A. A. A., Kanaani, Z. A., Al‐Kuwari, E., et al. (2026) · International Journal of Epidemiology · doi:10.1093/ije/dyag210
Cusumano, D., Scaggion, A., Yolande, L., Clementel, E., Nuyens, S., Alongi, F., Benavente, S., Braam, P., Dirix, P., Hemmatazad, H., et al. (2026) · Clinical and Translational Radiation Oncology · doi:10.1016/j.ctro.2026.101296
“…generation, but their scope is often insufficient to capture the full complexity of clinical practice, the pace at which they produce evidence can be slow and their methodology less appropriate to capture the often incremental and operator-dependent nature of radiotherapy innovations [6,7].”
Hans, U. (2026) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.70657
Yamamoto, R., Endo, A., Matsuda, W., Wada, T., Miyamoto, K., Ohbe, H., Fujii, T., Yamakawa, K., Sato, Y., & Kushimoto, S. (2026) · BMJ Open · doi:10.1136/bmjopen-2026-123087
Lee, S.-W., Lee, S., Lee, S.-S., Yoo, H., & Cho, J. M. (2026) · Journal of Medical Internet Research · doi:10.2196/103706
“The Hidden Limitation of Human Trials Human trials have long been regarded as the gold standard for evaluating the efficacy and safety of interventions in human populations [1].”
Li, Q., & Anderson, C. S. (2026) · Stroke · doi:10.1161/strokeaha.126.057797
Time to simplify things! Streamlining the ethical enrolment process in perioperative research
Renew, J. R., & Jones, P. M. (2026) · Canadian Journal of Anesthesia/Journal canadien d anesthésie · doi:10.1007/s12630-026-03224-1
Metadata
- Authors
- Bothwell, L. E., Greene, J. A., Podolsky, S. H., & Jones, D. S.
- Affiliations
- Brigham and Women's Hospital (US)
- Venue
- New England Journal of Medicine
- Publisher
- Massachusetts Medical Society
- Published
- 2016-06-02
- Volume
- 374
- Issue
- 22
- Pages
- 2175-2181
- ISSN
- 0028-4793 (ISSN-L)
- 1533-4406
- OpenAlex
- W2413861456
- Cited by
- 664
- References
- 54
- Citations by year
- 2026: 40 · 2025: 101 · 2024: 59 · 2023: 53 · 2022: 49 · 2021: 76 · 2020: 93 · 2019: 71 · 2018: 74 · 2017: 43 · 2016: 5
- FWCI
- 337.69
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- New England Journal of Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Arts and Humanities › History and Philosophy of Science › History of Science and Medicine
- Health Sciences › Medicine › Pharmacology (medical) › Historical Medical Research and Treatments
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Philosophy of Biology and Scientific Explanation
- Keywords
- randomized controlled trials, history of medicine, evidence-based medicine, scientific knowledge production, medical politics, health research funding
- MeSH terms
- Drug Industry, Female, Humans, Legislation, Drug, Pregnancy, Randomized Controlled Trials as Topic, Drug Approval, History, 20th Century, History, 21st Century
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.