Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 154Meta-analysis and systematic reviewsPharmaceutical industry and healthcareAcademic integrity and plagiarism

The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index; 7 of the 13 sources its claims cite were checked for support.

Checklist to assess Trustworthiness in RAndomised Controlled Trials (TRACT checklist): concept proposal and pilot

Open access

Published version of a preprint

Abstract

OBJECTIVES: To propose a checklist that can be used to assess trustworthiness of randomized controlled trials (RCTs). DESIGN: A screening tool was developed using the four-stage approach proposed by Moher et al. This included defining the scope, reviewing the evidence base, suggesting a list of items from piloting, and holding a consensus meeting. The initial checklist was set-up by a core group who had been involved in the assessment of problematic RCTs for several years. We piloted this in a consensus panel of several stakeholders, including health professionals, reviewers, journal editors, policymakers, researchers, and evidence-synthesis specialists. Each member was asked to score three articles with the checklist and the results were then discussed in consensus meetings. OUTCOME: The Trustworthiness in RAndomised Clinical Trials (TRACT) checklist includes 19 items organised into seven domains that are applicable to every RCT: 1) Governance, 2) Author Group, 3) Plausibility of Intervention Usage, 4) Timeframe, 5) Drop-out Rates, 6) Baseline Characteristics, and 7) Outcomes. Each item can be answered as either no concerns, some concerns/no information, or major concerns. If a study is assessed and found to have a majority of items rated at a major concern level, then editors, reviewers or evidence synthesizers should consider a more thorough investigation, including assessment of original individual participant data. CONCLUSIONS: The TRACT checklist is the first checklist developed specifically to detect trustworthiness issues in RCTs. It might help editors, publishers and researchers to screen for such issues in submitted or published RCTs in a transparent and replicable manner.

Overview

CoChat Summary

TL;DR

The authors propose TRACT, a 19-item, seven-domain screening checklist to assess trustworthiness of randomized controlled trials and triage possible research misconduct. In a pilot consensus process, users showed 65% agreement on item ratings, and the checklist is intended to prompt further investigation when most items are rated as major concerns.

Key findings

  • The TRACT checklist includes 19 items organized into seven domains: Governance, Author Group, Plausibility of Intervention Usage, Timeframe, Drop-out Rates, Baseline Characteristics, and Outcomes.
  • Each item is rated as no concerns, some concerns/no information, or major concerns; if a study has a majority of items rated at major concern level, editors, reviewers, or evidence synthesizers should consider a more thorough investigation, including assessment of original individual participant data.
  • In pilot comparisons, there was 65% overall agreement on item ratings between users, and all item numbers except one had a 50% or more chance of similar results between users; the exception was “Effect size that is much larger than in other RCTs regarding the same topic” in the Outcomes domain.
  • The paper states the TRACT checklist is the first checklist developed specifically to detect trustworthiness issues in RCTs, and the authors report having assessed the integrity of over 300 RCTs in women’s health over recent years.

Methods

  • Development was adapted from Moher et al.’s four-stage approach: define the scope, review the evidence base, suggest a list of items from piloting, and hold a consensus process.
  • A steering group of evidence-synthesis experts, clinical researchers, reviewers, editors, biostatisticians, and evidence-synthesis specialists defined the scope; a scoping review and four published systematic analyses informed the first checklist version.
  • In the consensus process, stakeholders used the draft checklist to screen up to three articles and completed a questionnaire rating each item’s usefulness and ease on a five-point Likert scale; items with a median rating of 3 or more in both usefulness and ease were eligible for inclusion, and responses were compared where assessors rated the same article.

Limitations

  • The paper states the checklist is not yet validated, that a formalized Delphi method would allow greater verification of utility and useability, that some concern patterns are crude and may miss other misconduct patterns, that fabricators could use the checklist to fabricate a paper fitting all items, that it may misclassify papers, and that using it can be time consuming.
  • The paper also states no formal cut-off at which the checklist scores positive has been provided, and that this will be addressed in subsequent detection accuracy studies.
  • Evident from the text: the pilot agreement was 65%, and one item had less than a 50% chance of similar results between users, suggesting inter-user reliability may be limited.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1186/s41073-023-00130-8

Cites

25 of 25 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

6 Valid · 3 Not valid · 4 Not checked · 46 Own results and interpretations

14 more claims

Create a free account to see all 59 claims and every source verdict.

See all claims — free account
  • Probably not a substantial claim. 35
  • It may state two separate claims as one. 17

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

1 of 1

Citations

Cites

Show all 24 references

Cited by

See all 154

Metadata

Authors
Mol, B. W., Lai, S., Rahim, A., Bordewijk, E. M., Wang, R., van Eekelen, R., Gurrin, L. C., Thornton, J. G., van Wely, M., & Li, W.
Affiliations
  • University of Aberdeen (GB)
  • Monash University (AU)
  • Amsterdam UMC Location University of Amsterdam (NL)
  • The University of Melbourne (AU)
  • University of Nottingham (GB)
Corresponding author
Gurrin, Lyle C.
Venue
Research Integrity and Peer Review
Published
2023-06-20
Volume
8
Issue
1
Pages
6-6
ISSN
2058-8615 (ISSN-L)
OpenAlex
W4381250920
Cited by
154
References
24
Citations by year
2026: 48 · 2025: 49 · 2024: 43 · 2023: 14
FWCI
15.81
Type
journal article
Language
en
Open access
Licence
Locations
  • Research Integrity and Peer Review (publishedVersion, cc-by)
  • Research Square (submittedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Pure Amsterdam UMC (publishedVersion, other-oa)
  • Aberdeen University Research Archive (Aberdeen University) (submittedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Health Sciences › Nursing › Issues, ethics and legal aspects › Pharmaceutical industry and healthcare
  • Social Sciences › Education › Academic integrity and plagiarism
Keywords
trustworthiness assessment, randomized controlled trials, screening tool, research integrity, questionable research practices, peer review, individual patient data, dropout rates

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-09-30, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-09-30 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Checklist to assess Trustworthiness in RAndomised Controlled Trials (TRACT checklist): concept proposal and pilot. https://app.cochat.ai/papers/10.1186/s41073-023-00130-8
The paper
Mol, B. W., Lai, S., Rahim, A., Bordewijk, E. M., Wang, R., van Eekelen, R., Gurrin, L. C., Thornton, J. G., van Wely, M., & Li, W. (2023). Checklist to assess Trustworthiness in RAndomised Controlled Trials (TRACT checklist): concept proposal and pilot. Research Integrity and Peer Review. https://doi.org/10.1186/s41073-023-00130-8

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.