Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.

Protocol for the development of a tool (INSPECT-SR) to identify problematic randomised controlled trials in systematic reviews of health interventions

Open access

Published version of a preprint

Abstract

Introduction: Randomised controlled trials (RCTs) inform healthcare decisions. It is now apparent that some published RCTs contain false data and some appear to have been entirely fabricated. Systematic reviews are performed to identify and synthesise all RCTs that have been conducted on a given topic. While it is usual to assess methodological features of the RCTs in the process of undertaking a systematic review, it is not usual to consider whether the RCTs contain false data. Studies containing false data therefore go unnoticed and contribute to systematic review conclusions. The INveStigating ProblEmatic Clinical Trials in Systematic Reviews (INSPECT-SR) project will develop a tool to assess the trustworthiness of RCTs in systematic reviews of healthcare-related interventions. Methods and analysis: The INSPECT-SR tool will be developed using expert consensus in combination with empirical evidence, over five stages: (1) a survey of experts to assemble a comprehensive list of checks for detecting problematic RCTs, (2) an evaluation of the feasibility and impact of applying the checks to systematic reviews, (3) a Delphi survey to determine which of the checks are supported by expert consensus, culminating in, (4) a consensus meeting to select checks to be included in a draft tool and to determine its format and (5) prospective testing of the draft tool in the production of new health systematic reviews, to allow refinement based on user feedback. We anticipate that the INSPECT-SR tool will help researchers to identify problematic studies and will help patients by protecting them from the influence of false data on their healthcare. Ethics and dissemination: The University of Manchester ethics decision tool was used, and this returned the result that ethical approval was not required for this project (30 September 2022), which incorporates secondary research and surveys of professionals about subjects relating to their expertise. Informed consent will be obtained from all survey participants. All results will be published as open-access articles. The final tool will be made freely available.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1136/bmjopen-2024-084164

Cites

21 of 21 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 INveStigating ProblEmatic Clinical Trials in Systematic Reviews development process.
Figure 1 INveStigating ProblEmatic Clinical Trials in Systematic Reviews development process.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

1 more claim about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

1 retracted

Show all 20 references

Research works printed but not linked: 1

  1. Cochrane . Cochrane database of systematic reviews: editorial policies Cochrane library. 2021 Available: https://www.cochranelibrary.com/cdsr/editorial-policies

Cited by

See all 45

Metadata

Authors
Wilkinson, J., Heal, C., Antoniou, G. A., Flemyng, E., Alfirevic, Z., Avenell, A., Barbour, G., Brown, N. J. L., Carlisle, J., Clarke, M., Dicker, P., Dumville, J. C., Grey, A., Grohmann, S., Gurrin, L., Hayden, J. A., Heathers, J., Hunter, K. E., Lasserson, T., Lam, E., Lensen, S., Li, T., Li, W., Loder, E., Lundh, A., Meyerowitz-Katz, G., Mol, B. W., O'Connell, N. E., Parker, L., Redman, B. K., Seidler, L., Sheldrick, K. A., Sydenham, E., Torgerson, D., van Wely, M., Wang, R., Bero, L., & Kirkham, J. J.
Affiliations
  • Manchester Academic Health Science Centre (GB)
  • Cochrane Canada (CA)
  • Department of Women's and Children's Health, University of Liverpool, Liverpool, UK
  • University of Aberdeen (GB)
  • Medical Journal of Australia, Sydney, New South Wales, Australia
  • Linnaeus University (SE)
  • Torbay Hospital (GB)
  • Queen's University Belfast (GB)
  • University of Auckland (NZ)
  • The University of Melbourne (AU)
  • Dalhousie University (CA)
  • SafeBeat Rx Inc, St Louis, Missouri, USA
  • The University of Sydney (AU)
  • Independent Lay Member, Cheshire, UK
  • Royal Women's Hospital (AU)
  • University of Colorado Anschutz (US)
  • Monash University (AU)
  • Brigham and Women's Hospital (US)
  • University of Southern Denmark (DK)
  • School of Health and Society, University of Wollongong, Wollongong, New South Wales, Australia
  • Brunel University of London (GB)
  • New York University (US)
  • Evidence Integration, NHMRC Clinical Trials Centre, University of Sydney, Sydney, New South Wales, Australia
  • UNSW Sydney (AU)
  • Cochrane (GB)
  • University of York (GB)
  • Cochrane Gynaecology and Fertility Satellite and Cochrane Sexually Transmitted Infection Group, Cochrane, Duivendrecht, The Netherlands
Corresponding author
Wilkinson, Jack
Venue
BMJ Open
Publisher
BMJ
Published
2024-03
Volume
14
Issue
3
Pages
e084164
ISSN
2044-6055 (ISSN-L)
OpenAlex
W4392712333
Cited by
45
References
20
Citations by year
2026: 11 · 2025: 27 · 2024: 7
FWCI
5.66
Type
journal article
Language
en
Open access
Locations
  • BMJ Open (publishedVersion, cc-by)
  • medRxiv (acceptedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Research Explorer (The University of Manchester) (publishedVersion, cc-by)
  • Research Portal (Queen's University Belfast) (publishedVersion, cc-by)
  • DiVA (Linnaeus University) (submittedVersion, other-oa)
  • Aberdeen University Research Archive (Aberdeen University) (submittedVersion, other-oa)
  • PubMed Central (submittedVersion, cc-by)
  • Research Online (University of Wollongong) (submittedVersion)
  • Brunel University Research Archive (BURA) (Brunel University London) (submittedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • Figshare (submittedVersion, cc-by)
  • Minerva Access (University of Melbourne) (submittedVersion, cc-by)
  • HighWire Press Open Archive (submittedVersion)
  • Pure Amsterdam UMC (submittedVersion, other-oa)
  • University of Southern Denmark Research Portal (University of Southern Denmark) (submittedVersion, cc-by)
Funders
NIHR (NIHR203568)
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Social Sciences › Education › Academic integrity and plagiarism
  • Health Sciences › Nursing › Issues, ethics and legal aspects › Pharmaceutical industry and healthcare
Keywords
randomized controlled trials, research integrity, data fabrication, research misconduct, systematic reviews, trustworthiness assessment, expert consensus, Delphi method, health interventions

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Protocol for the development of a tool (INSPECT-SR) to identify problematic randomised controlled trials in systematic reviews of health interventions. https://app.cochat.ai/papers/10.1136/bmjopen-2024-084164
The paper
Wilkinson, J., Heal, C., Antoniou, G. A., Flemyng, E., Alfirevic, Z., Avenell, A., Barbour, G., Brown, N. J. L., Carlisle, J., Clarke, M., Dicker, P., Dumville, J. C., Grey, A., Grohmann, S., Gurrin, L., Hayden, J. A., Heathers, J., Hunter, K. E., Lasserson, T., . . . Kirkham, J. J. (2024). Protocol for the development of a tool (INSPECT-SR) to identify problematic randomised controlled trials in systematic reviews of health interventions. BMJ Open. https://doi.org/10.1136/bmjopen-2024-084164

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.