Student or educator? Sign up with your school email and get 6 months of Pro free.

The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index; 24 of the 64 sources its claims cite were checked for support.

Artificial intelligence to enhance research integrity in evidence-based medicine: toward scalable trustworthiness assessment

Open access
Mo, Moses, Arora, Rohit, Cao, Christian, Tricco, Andrea C., Moher, David · 2026 · Frontiers in Research Metrics and Analytics

Abstract

Fraudulent, falsified, and otherwise unreliable clinical research threatens the foundations of evidence-based medicine because systematic reviews, meta-analyses, and clinical practice guidelines depend on the trustworthiness of the studies they include. Retractions are increasing faster than publication output and often occur only after substantial delay, allowing problematic trials to be cited, pooled, and incorporated into downstream clinical recommendations. Recent evidence shows that retracted randomized trials have contaminated thousands of meta-analyses and hundreds of guideline documents, while only a small minority of affected reviews later self-correct. This is not only a clinical problem but also an integrity analytics problem: unreliable studies generate article-level, trial-level, and network-level signals that are not yet systematically integrated into evidence-synthesis workflows. Existing approaches can detect some image anomalies, textual irregularities, reporting inconsistencies, and statistical red flags, but important blind spots remain. Fabricated clinical datasets may appear statistically plausible, outcome switching often requires registration-publication comparison, and most available tools operate in isolation rather than as coordinated screening systems. We argue that the next generation of safeguards should combine AI/ML-based detection systems, statistical forensic methods, structured trustworthiness appraisal tools, and workflow-level screening frameworks within evidence synthesis. Embedding staged trustworthiness assessment early in systematic reviews, alongside stronger publisher- and database-level integrity infrastructure, could help prevent unreliable trials from distorting pooled estimates and downstream guidance. Such systems should support triage and prioritization rather than replace human judgment. Framed in this way, scalable trustworthiness assessment represents a practical research metrics and analytics agenda for strengthening the evidence ecosystem from primary studies to reviews, guidelines, and policy decisions.

Overview

CoChat Summary

## TL;DR

This paper argues that AI/ML, statistical forensics, and structured trustworthiness tools should be embedded into systematic review workflows to detect unreliable clinical trials earlier and at scale. The goal is to prevent fabricated, falsified, or otherwise problematic studies from distorting meta-analyses, guidelines, and patient care.

## Key findings

  • Retractions are rising faster than publication output: the paper cites a 22.09% compound annual growth rate for retracted papers from 2000 to 2022, versus 6.25% for total publications.
  • Retractions can materially alter evidence syntheses: the 2025 VITALITY study identified 1,330 retracted randomized controlled trials contaminating 4,095 meta-analyses from 847 systematic reviews; retracted trials changed pooled effect direction in 8.4% of meta-analyses and statistical significance in 16.0% of contaminated meta-analyses.
  • Retractions propagate into downstream guidance: evidence from 68 distorted systematic reviews fed into 157 clinical practice guideline documents, and only 5% of systematic reviews corrected themselves after retraction.
  • Existing integrity checks catch some problems but miss others: for example, a 2021 audit of 153 clinical trials submitted to Anaesthesia found 44% contained false data and 26% contained fabricated data, while the paper argues that plausible fabricated datasets and outcome switching often evade current tools.

## Methods

  • Narrative perspective/review article, not an empirical study.
  • Synthesizes previously published evidence, including retraction statistics, audits, and tool descriptions, to argue for a layered AI-assisted trustworthiness workflow in evidence synthesis.
  • Uses illustrative case examples and reported study numbers from prior work to motivate proposed screening stages (study identification, eligibility assessment, pre-extraction trustworthiness checks, and targeted forensic review).

## Limitations

  • Not stated in the paper.
  • Evident from the text: this is a conceptual argument and roadmap, so it does not present a new dataset, experiment, or direct evaluation of the proposed integrated AI system.
  • Evident from the text: the paper itself notes that no widely adopted integrated system exists today, so the proposal remains unvalidated at scale.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.3389/frma.2026.1833223

Cites

24 of 24 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

23 Valid · 8 Not valid · 24 Not checked · 14 Own results and interpretations

31 more claims · 7 with their cited sources checked

Create a free account to see all 69 claims and every source verdict.

See all claims — free account
  • It may state two separate claims as one. 27
  • Probably not a substantial claim. 13

Create a free account to see these claims.

Citations

Cites

Show all 24 references

Research works printed but not linked: 5

  1. Science-wide mapping and ranking of institutions based on affiliated authors Ioannidis J. P. A. Baas J. Boverhof R. Voyant C. bioRxiv [Preprint]
  2. Retracted randomized trials attributed to super-retractors and top-cited scientists with multiple retractions: secondary analysis of the VITALITY retrospective cohort Lyu C. Matbouriahi M. Naudet F. Ioannidis J. P. A. Cristea I. A. medRxiv [Preprint]. 2025
  3. AI in Research Integrity: Springer Nature's Innovative Tools Geppetto and SnappShot 2026
  4. Springer Nature unveils two new AI tools to protect research integrity 2026
  5. Prevalence and trends in global retractions explored through a topic lens Zhou Z. Lou Y. Shen Z. Li M. arXiv [Preprint] 2025

Metadata

Authors
Mo, M., Arora, R., Cao, C., Tricco, A. C., & Moher, D.
Affiliations
  • University of Calgary (CA)
  • Harvard University (US)
  • University of Toronto (CA)
  • St. Michael's Hospital (CA)
  • University of Ottawa (CA)
Corresponding author
Mo, Moses
Venue
Frontiers in Research Metrics and Analytics
Published
2026-07-08
Volume
11
Pages
1833223-1833223
ISSN
2504-0537 (ISSN-L)
OpenAlex
W7167700499
Cited by
0
References
24
FWCI
0.00
Type
journal article
Language
en
Open access
Locations
  • Frontiers in Research Metrics and Analytics (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • PubMed Central (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
Topics
  • Social Sciences › Education › Academic integrity and plagiarism
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
Keywords
research integrity, trustworthiness assessment, evidence synthesis, systematic reviews, meta-analysis, AI-based detection, research metrics, publication integrity

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-01, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-01 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Artificial intelligence to enhance research integrity in evidence-based medicine: toward scalable trustworthiness assessment. https://app.cochat.ai/papers/10.3389/frma.2026.1833223
The paper
Mo, M., Arora, R., Cao, C., Tricco, A. C., & Moher, D. (2026). Artificial intelligence to enhance research integrity in evidence-based medicine: toward scalable trustworthiness assessment. Frontiers in Research Metrics and Analytics. https://doi.org/10.3389/frma.2026.1833223

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.