CoChat

Reporting Quality of Social and Psychological Intervention Trials: A Systematic Review of Reporting Guidelines and Trial Publications

Open access
Grant, Sean P., Mayo-Wilson, Evan, Melendez-Torres, G. J., Montgomery, Paul · 2013 · PLoS ONE

The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.

Abstract

BACKGROUND: Previous reviews show that reporting guidelines have improved the quality of trial reports in medicine, yet existing guidelines may not be fully suited for social and psychological intervention trials. OBJECTIVE/DESIGN: We conducted a two-part study that reviewed (1) reporting guidelines for and (2) the reporting quality of social and psychological intervention trials. DATA SOURCES: (1) To identify reporting guidelines, we systematically searched multiple electronic databases and reporting guideline registries. (2) To identify trials, we hand-searched 40 journals with the 10 highest impact factors in clinical psychology, criminology, education, and social work. ELIGIBILITY: (1) Reporting guidelines consisted of articles introducing a checklist of reporting standards relevant to social and psychological intervention trials. (2) Trials reported randomised experiments of complex interventions with psychological, social, or health outcomes. RESULTS: (1) We identified 19 reporting guidelines that yielded 147 reporting standards relevant to social and psychological interventions. Social and behavioural science guidelines included 89 standards not found in CONSORT guidelines. However, CONSORT guidelines used more recommended techniques for development and dissemination compared to other guidelines. (2) Our review of trials (n = 239) revealed that many standards were poorly reported, such as identification as a randomised trial in titles (20% reported the information) and abstracts (55%); information about blinding (15%), sequence generation (23%), and allocation concealment (17%); and details about actual delivery of experimental (43%) and control interventions (34%), participant uptake (25%), and service environment (28%). Only 11 of 40 journals referenced reporting guidelines in "Instructions to Authors." CONCLUSION: Existing reporting guidelines have important limitations in content, development, and/or dissemination. Important details are routinely missing from trial publications; most leading journals in social and behavioural sciences do not ask authors to follow reporting standards. Findings demonstrate a need to develop a CONSORT extension with updated standards for social and psychological intervention trials.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1371/journal.pone.0065442

Cites

62 of 62 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Flowchart of reporting guidelines through systematic literature search.
Figure 1 Flowchart of reporting guidelines through systematic literature search.CC BY · PubMed Central
Figure 2 Flowchart of considered RCT publications through systematic literature search.
Figure 2 Flowchart of considered RCT publications through systematic literature search.CC BY · PubMed Central
Figure 3 Average compliance of RCTs with key reporting standards.
Figure 3 Average compliance of RCTs with key reporting standards.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 1

  1. L Moore, 2002, Research design for the rigorous evaluation of complex educational interventions: Lessons from health services research, Building Research Capacity, 1, 4

Cited by

See all 111

Metadata

Authors
Grant, S. P., Mayo-Wilson, E., Melendez-Torres, G. J., & Montgomery, P.
Affiliations
University of Oxford (GB)
Corresponding author
Grant, Sean P.
Venue
PLoS ONE
Published
2013-05-29
Volume
8
Issue
5
Pages
e65442
ISSN
1932-6203 (ISSN-L)
OpenAlex
W2162696461
Cited by
111
References
62
Citations by year
2026: 2 · 2025: 5 · 2024: 2 · 2023: 10 · 2022: 9 · 2021: 16 · 2020: 5 · 2019: 7 · 2018: 9 · 2017: 9 · 2016: 8 · 2015: 8 · 2014: 11 · 2013: 10
FWCI
2.50
Type
journal article
Language
en
Open access
Locations
  • PLoS ONE (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • RePEc: Research Papers in Economics (submittedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • UCL Discovery (University College London) (submittedVersion)
  • Figshare (submittedVersion, cc-by)
  • University of Birmingham Research Portal (University of Birmingham) (submittedVersion)
Funders
  • Economic and Social Research Council (ES/K00087X/1)
  • Clarendon Fund
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
Keywords
reporting guidelines, reporting quality, complex interventions, CONSORT extension, randomised trials, blinding, allocation concealment
MeSH terms
Mental Disorders, Humans, Research Design, Social Adjustment, Randomized Controlled Trials as Topic, Guidelines as Topic, Information Dissemination, Biomedical Research, Research Report

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.