Student or educator? Sign up with your school email and get 6 months of Pro free.

The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.

ACCORD (ACcurate COnsensus Reporting Document): A reporting guideline for consensus methods in biomedicine developed via a modified Delphi

Open access

Published version of a preprint

Abstract

Background: In biomedical research, it is often desirable to seek consensus among individuals who have differing perspectives and experience. This is important when evidence is emerging, inconsistent, limited, or absent. Even when research evidence is abundant, clinical recommendations, policy decisions, and priority-setting may still require agreement from multiple, sometimes ideologically opposed parties. Despite their prominence and influence on key decisions, consensus methods are often poorly reported. Our aim was to develop the first reporting guideline dedicated to and applicable to all consensus methods used in biomedical research regardless of the objective of the consensus process, called ACCORD (ACcurate COnsensus Reporting Document). Methods and findings: We followed methodology recommended by the EQUATOR Network for the development of reporting guidelines: a systematic review was followed by a Delphi process and meetings to finalize the ACCORD checklist. The preliminary checklist was drawn from the systematic review of existing literature on the quality of reporting of consensus methods and suggestions from the Steering Committee. A Delphi panel ( n = 72) was recruited with representation from 6 continents and a broad range of experience, including clinical, research, policy, and patient perspectives. The 3 rounds of the Delphi process were completed by 58, 54, and 51 panelists. The preliminary checklist of 56 items was refined to a final checklist of 35 items relating to the article title ( n = 1), introduction ( n = 3), methods ( n = 21), results ( n = 5), discussion ( n = 2), and other information ( n = 3). Conclusions: The ACCORD checklist is the first reporting guideline applicable to all consensus-based studies. It will support authors in writing accurate, detailed manuscripts, thereby improving the completeness and transparency of reporting and providing readers with clarity regarding the methods used to reach agreement. Furthermore, the checklist will make the rigor of the consensus methods used to guide the recommendations clear for readers. Reporting consensus studies with greater clarity and transparency may enhance trust in the recommendations made by consensus panels.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1371/journal.pmed.1004326

Cites

39 of 39 references verified0 citation errors · 0 not checkable

Statistics

Figures

Fig 1 A flow diagram to show the development of checklist items. *Potential items from relevant information beyond the predefined data extraction form [19]. †New item (T1) proposed at checklist review meeting.
Fig 1 A flow diagram to show the development of checklist items. *Potential items from relevant information beyond the predefined data extraction form [19]. †New item (T1) proposed at checklist review meeting.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 37 references

Research works printed but not linked: 4

  1. J. Surowiecki, 2004, The wisdom of crowds
  2. Open Science Framework, 2022, ACCORD registration with the Open Science Framework
  3. The EQUATOR Network, 2021, ACCORD registration at the EQUATOR Network
  4. The EQUATOR Network, 2021, EQUATOR Network Newsletter October 2021

Cited by

See all 701

Metadata

Authors
Gattrell, W. T., Logullo, P., van Zuuren, E. J., Price, A., Hughes, E. L., Blazey, P., Winchester, C. C., Tovey, D., Goldman, K., Hungin, A. P., & Harrison, N.
Affiliations
  • Bristol-Myers Squibb (United Kingdom) (GB)
  • Stanford Medicine (US)
  • University of British Columbia (CA)
  • University of Oxford (GB)
  • AbbVie (United States) (US)
  • Newcastle University (GB)
Corresponding author
Gattrell, William T.
Venue
PLOS Medicine
Published
2024-01-23
Volume
21
Issue
1
Pages
e1004326
ISSN
  • 1549-1277 (ISSN-L)
  • 1549-1676
OpenAlex
W4391135337
Cited by
701
References
37
Citations by year
2026: 340 · 2025: 251 · 2024: 107
FWCI
499.02
Type
journal article
Language
en
Open access
Locations
  • PLoS Medicine (publishedVersion, cc-by)
  • medRxiv (acceptedVersion, other-oa)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Leiden Repository (Leiden University) (submittedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • Newcastle University ePrints (Newcastle Univesity) (cc-by)
Funders
  • Bristol-Myers Squibb
  • Cancer Research UK (27294)
  • Universiteit Leiden
  • Ipsen
Topics
  • Social Sciences › Sociology and Political Science › Delphi Technique in Research
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
Keywords
consensus methods, reporting guidelines, consensus study, reporting quality, transparency, clinical guidelines, EQUATOR Network, Delphi method, consensus panel
MeSH terms
Humans, Consensus, Trust, Biomedical Research, Checklist, Policy

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: ACCORD (ACcurate COnsensus Reporting Document): A reporting guideline for consensus methods in biomedicine developed via a modified Delphi. https://app.cochat.ai/papers/10.1371/journal.pmed.1004326
The paper
Gattrell, W. T., Logullo, P., van Zuuren, E. J., Price, A., Hughes, E. L., Blazey, P., Winchester, C. C., Tovey, D., Goldman, K., Hungin, A. P., & Harrison, N. (2024). ACCORD (ACcurate COnsensus Reporting Document): A reporting guideline for consensus methods in biomedicine developed via a modified Delphi. PLOS Medicine. https://doi.org/10.1371/journal.pmed.1004326

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.