Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index; 13 of the 20 sources its claims cite were checked for support.

Impact of an online writing aid tool for writing a randomized trial report: the COBWEB (Consort-based WEB tool) randomized controlled trial

Open access

Abstract

BACKGROUND: Incomplete reporting is a frequent waste in research. Our aim was to evaluate the impact of a writing aid tool (WAT) based on the CONSORT statement and its extension for non-pharmacologic treatments on the completeness of reporting of randomized controlled trials (RCTs). METHODS: We performed a 'split-manuscript' RCT with blinded outcome assessment. Participants were masters and doctoral students in public health. They were asked to write, over a 4-hour period, the methods section of a manuscript based on a real RCT protocol, with a different protocol provided to each participant. Methods sections were divided into six different domains: 'trial design', 'randomization', 'blinding', 'participants', 'interventions', and 'outcomes'. Participants had to draft all six domains with access to the WAT for a random three of six domains. The random sequence was computer-generated and concealed. For each domain, the WAT comprised reminders of the corresponding CONSORT item(s), bullet points detailing all the key elements to be reported, and examples of good reporting. The control intervention consisted of no reminders. The primary outcome was the mean global score for completeness of reporting (scale 0-10) for all domains written with or without the WAT. RESULTS: Forty-one participants wrote 41 different manuscripts of RCT methods sections, corresponding to 246 domains (six for each of the 41 protocols). All domains were analyzed. For the primary outcome, the mean (SD) global score for completeness of reporting was higher with than without use of the WAT: 7.1 (1.2) versus 5.0 (1.6), with a mean (95 % CI) difference 2.1 (1.5-2.7; P <0.01). Completeness of reporting was significantly higher with the WAT for all domains except for blinding and outcomes. CONCLUSION: Use of the WAT could improve the completeness of manuscripts reporting the results of RCTs. TRIAL REGISTRATION: Clinicaltrials.gov ( http://clinicaltrials.gov NCT02127567 , registration date first received April 29, 2014).

Overview

CoChat Summary

TL;DR

A split-manuscript RCT tested whether an online CONSORT-based writing aid tool improves completeness of reporting in randomized trial methods sections. Among 41 public health master’s/doctoral students writing 246 domains, use of the tool increased the mean global completeness score from 5.0 to 7.1 on a 0–10 scale.

Key findings

  • The primary outcome, mean global completeness score, was higher with the writing aid tool than without: 7.1 (SD 1.2) vs 5.0 (SD 1.6), mean difference 2.1 (95% CI 1.5–2.7; P < 0.001).
  • Completeness was significantly higher with the tool for trial design (mean difference 5.4, 95% CI 4.1–6.7), randomization (3.8, 95% CI 1.1–4.4), participants (2.2, 95% CI 0.8–3.6), and interventions (1.8, 95% CI 0.7–2.9), but not for blinding or outcomes.
  • Completeness of reporting for pre-specified essential elements was also higher with the tool: mean difference 1.4 (95% CI 0.5–2.3; P = 0.002).
  • In an ancillary comparison, sections written without the tool did not significantly differ from published reports (mean difference −0.48, 95% CI −1.07 to 0.11), whereas sections written with the tool scored higher than published reports (mean difference +1.73, 95% CI 1.10–2.37; P < 0.001).

Methods

  • Design: a “split-manuscript” RCT with blinded outcome assessment; the unit of randomization was the methods-section domain, embedded within each participant’s manuscript.
  • Sample and data: 41 master’s and doctoral students in public health wrote methods sections for 41 different real RCT protocols over a 4-hour period, producing 246 domains (six per participant); each participant had access to the writing aid tool for a random three of six domains.
  • Analysis: the primary outcome was the mean global completeness score (0–10) for all domains written with or without the tool; data were analyzed with mixed models including a fixed intervention effect, random participant effect, and random participant-group effect, with domain-specific Student t-tests and sensitivity analyses on weighting.

Limitations

  • The paper states that participants were master’s and doctoral students and the writing session lasted only 4 hours, which is not representative of typical authors or the typical context of writing an RCT report.
  • The paper states that the tool covered only six methods-section domains using CONSORT 2010 and the non-pharmacologic treatment extension, not all CONSORT items and extensions; it also notes relatedness between the experimental intervention and the evaluation, and lack of a validated outcome measure for reporting quality.
  • The text makes evident that the ancillary comparison was not blinded to journal or author names, and the authors caution that readability of sections was not evaluated, so more complete sections could be harder to read.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1186/s12916-015-0460-y

Cites

31 of 31 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Fig. 1 Schema of the study design
Fig. 1 Schema of the study designCC BY · PubMed Central
Fig. 2 Example of the experimental writing tool
Fig. 2 Example of the experimental writing toolCC BY · PubMed Central
Fig. 3 Flow diagram of participants and domain randomization
Fig. 3 Flow diagram of participants and domain randomizationCC BY · PubMed Central

Verification

Claims the paper makes

4 Valid · 1 Not valid · 1 Not checked · 43 Own results and interpretations

14 more claims

Create a free account to see all 49 claims and every source verdict.

See all claims — free account
  • It may state two separate claims as one. 12
  • Probably not a substantial claim. 26

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

5 of 7 · the rest aren’t loaded

2 more findings

Create a free account to see every finding of this check.

See all findings — free account

Citations

Cites

Show all 31 references

Cited by

See all 135

Metadata

Authors
Barnes, C., Boutron, I., Giraudeau, B., Porcher, R., Altman, D. G., & Ravaud, P.
Affiliations
  • Inserm (FR)
  • Université de Tours (FR)
  • University of Oxford (GB)
Corresponding author
Boutron, Isabelle
Venue
BMC Medicine
Published
2015-09-15
Volume
13
Issue
1
Pages
221-221
ISSN
1741-7015 (ISSN-L)
OpenAlex
W1913246108
Cited by
135
References
31
Citations by year
2026: 7 · 2025: 18 · 2024: 13 · 2023: 6 · 2022: 11 · 2021: 30 · 2020: 14 · 2019: 11 · 2018: 3 · 2017: 13 · 2016: 6 · 2015: 3
FWCI
3.98
Type
journal article
Language
en
Open access
Locations
  • BMC Medicine (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • HAL (submittedVersion, cc-by)
  • Oxford University Research Archive (ORA) (University of Oxford) (submittedVersion, cc-by)
Funders
  • Cancer Research UK (16895)
  • National Institute for Health and Care Research (NF-SI-0513-10131)
  • Medical Research Council (MR/J00488X/1)
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Social Sciences › Library and Information Sciences › Academic Writing and Publishing
  • Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
Keywords
CONSORT statement, reporting completeness, trial reporting, methods section, non-pharmacological treatment, research training, public health students, reporting guidelines
MeSH terms
Adult, Female, Humans, Male, Periodicals as Topic, Publishing, Research Design, Software, Randomized Controlled Trials as Topic, Medical Writing

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-12, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-12 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Impact of an online writing aid tool for writing a randomized trial report: the COBWEB (Consort-based WEB tool) randomized controlled trial. https://app.cochat.ai/papers/10.1186/s12916-015-0460-y
The paper
Barnes, C., Boutron, I., Giraudeau, B., Porcher, R., Altman, D. G., & Ravaud, P. (2015). Impact of an online writing aid tool for writing a randomized trial report: the COBWEB (Consort-based WEB tool) randomized controlled trial. BMC Medicine. https://doi.org/10.1186/s12916-015-0460-y

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.