The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index; 8 of the 45 sources its claims cite were checked for support.
Reporting guideline for overviews of reviews of healthcare interventions: development of the PRIOR statement.
Open accessAbstract
Objective: To develop a reporting guideline for overviews of reviews of healthcare interventions. Design: Development of the preferred reporting items for overviews of reviews (PRIOR) statement. Participants: Core team (seven individuals) led day-to-day operations, and an expert advisory group (three individuals) provided methodological advice. A panel of 100 experts (authors, editors, readers including members of the public or patients) was invited to participate in a modified Delphi exercise. 11 expert panellists (chosen on the basis of expertise, and representing relevant stakeholder groups) were invited to take part in a virtual face-to-face meeting to reach agreement (≥70%) on final checklist items. 21 authors of recently published overviews were invited to pilot test the checklist. Setting: International consensus. Intervention: Four stage process established by the EQUATOR Network for developing reporting guidelines in health research: project launch (establish a core team and expert advisory group, register intent), evidence reviews (systematic review of published overviews to describe reporting quality, scoping review of methodological guidance and author reported challenges related to undertaking overviews of reviews), modified Delphi exercise (two online Delphi surveys to reach agreement (≥70%) on relevant reporting items followed by a virtual face-to-face meeting), and development of the reporting guideline. Results: From the evidence reviews, we drafted an initial list of 47 potentially relevant reporting items. An international group of 52 experts participated in the first Delphi survey (52% participation rate); agreement was reached for inclusion of 43 (91%) items. 44 experts (85% retention rate) completed the second Delphi survey, which included the four items lacking agreement from the first survey and five new items based on respondent comments. During the second round, agreement was not reached for the inclusion or exclusion of the nine remaining items. 19 individuals (6 core team and 3 expert advisory group members, and 10 expert panellists) attended the virtual face-to-face meeting. Among the nine items discussed, high agreement was reached for the inclusion of three and exclusion of six. Six authors participated in pilot testing, resulting in minor wording changes. The final checklist includes 27 main items (with 19 sub-items) across all stages of an overview of reviews. Conclusions: PRIOR fills an important gap in reporting guidance for overviews of reviews of healthcare interventions. The checklist, along with rationale and example for each item, provides guidance for authors that will facilitate complete and transparent reporting. This will allow readers to assess the methods used in overviews of reviews of healthcare interventions and understand the trustworthiness and applicability of their findings.
Overview
CoChat Summary
TL;DR
The PRIOR statement is an evidence- and consensus-based reporting guideline for overviews of reviews of healthcare interventions, developed through a four-stage EQUATOR Network process. Its final checklist contains 27 main items with 19 sub-items, plus an explanation and elaboration document and flow diagram.
Key findings
Evidence reviews informed an initial list of 47 potential reporting items; in Delphi round 1, 52 experts participated and agreement (≥70%) was reached for inclusion of 43/47 (91%) items.
- In round 2, 44/52 (85%) round 1 participants responded, and agreement was not reached for inclusion or exclusion of any of the nine remaining items.
- In round 3, 19 individuals attended virtual meetings and 13 voted; agreement was reached to exclude five items (≥77%), retain three items (≥85% each), and for the final item, after near agreement (69%) for exclusion, 92% agreed to remove it and incorporate its content into item 8a.
- The final PRIOR checklist includes 27 main items with 19 sub-items; pilot testing involved 6 of 21 invited authors (29%) and resulted in minor wording changes but no content changes.
Methods
Development followed the EQUATOR Network’s four-stage process: project launch, evidence reviews (a systematic review of reporting quality and a scoping review of methodological guidance and author-reported challenges), a modified Delphi exercise, and guideline development.
- The modified Delphi used two online surveys and a virtual face-to-face meeting, with a prespecified ≥70% agreement threshold; 100 experts were invited, 52 completed round 1, 44 completed round 2, and 11 expert panellists were invited to round 3.
- Agreement was calculated as proportions agreeing/disagreeing, with Likert responses 1–2 treated as “disagree” and 3–4 as “agree”; “I don’t know” responses were included in the denominator but did not contribute to agreement or disagreement, and free-text comments were grouped to inform wording and additional items.
Limitations
Stated in the paper: the final guideline could differ with another participant set or a higher/lower agreement threshold; round 3 was held online rather than in person because of covid-19 travel restrictions, which might have reduced depth of discussion; panellists were not selected based on prior Delphi responses; pilot testing involved only six authors; no information was collected on participants’ clinical expertise or patient experience; representation of all relevant specialties was unlikely; PRIOR is intended for overviews of reviews of healthcare interventions and may not apply to other fields or overview types; some items lack methodological guidance, examples are sometimes imperfect, and periodic updates are expected.
- Evident from the text: the pilot test had a small sample (6/21 invited authors, 29%), limiting the generalisability of usability feedback; the paper also notes that impact on future reporting will need evaluation rather than being demonstrated here.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
6 Valid · 0 Not valid · 31 Not checked · 64 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“Identifying and interpreting evidence from the growing number of sometimes redundant, misleading, or conflicting syntheses is an onerous task”
§ Reporting guideline for overviews of reviews of healthcare interventions: development of the PRIOR statement > Introduction
What the sources say
- Supportedcites [4] source
The Meta-analyses of Randomized Trials of Humans section (p. ~6) states that overlapping syntheses often reach different conclusions and that 'navigating through these discrepancies can be demanding even for investigators who are well trained in evidence-based medicine,' which is the substance of the claim's 'onerous task' of identifying and interpreting evidence. The Introduction (p. 1) and Abstract (p. 1) supply the other elements: rapid growth in publications (2,728% rise in systematic reviews 1991-2014) and reviews that 'suffer from extensive redundancy, little value, misleading claims, and/or vested interests.' (LLM, conf=0.88)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: unclear — It is unclear whether it could be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“We followed the methods suggested by the EQUATOR Network for developing reporting guidelines in health research.”
§ Reporting guideline for overviews of reviews of healthcare interventions: development of the PRIOR statement > Methods > Approach
What the sources say
- Supportedcites [28] source
Our copy of Moher et al. (2010) is precisely the EQUATOR-affiliated guidance the citing sentence refers to: the Abstract (p.1) states 'David Moher and colleagues from the EQUATOR network offer guidance and recommended steps for developing health research reporting guidelines,' and the Discussion (p.1) describes 'this guidance on how to develop a reporting guideline, including an 18-step checklist.' The Introduction (p.1) further situates it within the EQUATOR Network's role in assisting the development of reporting guidelines. So the cited work is the methods guidance for developing health research reporting guidelines associated with the EQUATOR Network; whether PRIOR's authors in fact followed every step is outside this source's scope. (LLM, conf=0.90)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Although few published evaluations exist, evidence suggests that the endorsement of PRISMA by journals is associated with more complete reporting of systematic reviews than in journals not endorsing the reporting guideline.50 51 52”
§ Reporting guideline for overviews of reviews of healthcare interventions: development of the PRIOR statement > Discussion > Dissemination and evaluation
What the sources say
- Supportedcites [50] source
In the Results section (Table 7; page not available in our copy), the PRISMA mean summed reporting score is higher for reviews in endorsing journals than in non-endorsing journals, with a standardized mean difference of 0.53 (99% CI 0.02 to 1.03). The paper notes that relatively few evaluations were available, consistent with the citing sentence’s cautious wording. (LLM, conf=0.94)
- Partly supportedcites [51] sourceExperimental — accuracy not yet measured
The Results (page unavailable) associate more complete reporting with reviews that self-reported using PRISMA. The Discussion (page unavailable) notes that journal endorsement varies, but the paper does not compare reporting completeness in endorsing versus non-endorsing journals. (LLM, conf=0.88)
- Partly supportedcites [52] sourceExperimental — accuracy not yet measured
The Results section (page not provided) reports higher reporting scores for network meta-analyses published in journals endorsing PRISMA than for those in journals not explicitly endorsing it, though the difference was described as not substantial. The claim extends that finding from reviews with network meta-analysis to systematic reviews generally. (LLM, conf=0.86)
hedgedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“PRIOR is the first reporting guideline for overviews of reviews to be developed that adheres to the rigorous, systematic, and transparent methodology outlined by Moher et al.28”
§ Reporting guideline for overviews of reviews of healthcare interventions: development of the PRIOR statement > Discussion > Reporting guideline
What the sources say
- Supportedcites [28] source
The Introduction outlines a robust, explicit methodology for developing reporting guidelines, proposing 18 steps in five phases. That supports the citation’s attribution of the methodology to Moher et al.; the claim that PRIOR was the first guideline of its kind is the citing authors’ own characterization, not a finding attributed to this source. (LLM, conf=0.90)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Agreement (≥70%) was not reached for the inclusion or exclusion of any of the nine items on the survey (four items that did not reach agreement in the first round, and five new items; appendix 4 in the supplementary materials).”
§ Reporting guideline for overviews of reviews of healthcare interventions: development of the PRIOR statement > Results > Round 2 results—online survey
plainn = 44- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
11 more claims
Create a free account to see all 101 claims and to verify the 37 references still open.
- Probably not a substantial claim. 70
- It may state two separate claims as one. 42
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“This review was prospectively registered on the International Platform of Registered Systematic Review and Meta-analysis Protocols (INPLASY202360071; https://inplasy.com/inplasy-2023-6-0071/) and conducted in alignment with the Preferred Reporting Items for Overviews of Reviews (PRIOR) (16).”
The cited source says what the claim attributes to it.
In the citing paper
“This umbrella review followed the Joanna Briggs Institute’s (JBI) methodology for umbrella reviews [21] and is reported in accordance with the Preferred Reporting Items for Overviews of Reviews (PRIOR) [22] (Supplementary file 1).”
From School-based healthy eating interventions for adolescents aged 10–19 years: an umbrella review (2024) · cites this paper as [22]
The cited source says what the claim attributes to it.
In the citing paper
“This overview was conducted in accordance with the PRIOR reporting guidelines.13”
From Acupuncture Therapy for Sciatica: An Overview of Systematic Reviews and Meta-Analysis (2025) · cites this paper as [13]
The cited source says what the claim attributes to it.
In the citing paper
“The reporting of this overview of reviews was guided by the standards of the Preferred Reporting Items for Overviews of Reviews (PRIOR) Statement (Gates et al., 2022).”
From Meta-analytic evidence on the efficacy of hypnosis for mental and somatic health issues: a 20-year perspective (2024) · cites this paper as Gates et al., 2022
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Previous meta-meta-analyses have been limited to adult populations 24 29 or included populations with confounding factors, such as chronic diseases 30 .”
From Effect of exercise on depression and anxiety symptoms: systematic umbrella review with meta-meta-analysis (2026) · cites this paper as [30]
Experimental — accuracy not yet measured
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
RoB 2: a revised tool for assessing risk of bias in randomised trials
Sterne, J. A. C., Savović, J., Page, M. J., Elbers, R. G., Blencowe, N. S., Boutron, I., Cates, C. J., Cheng, H.-Y., Corbett, M. S., Eldridge, S. M., et al. (2019) · BMJ · doi:10.1136/bmj.l4898 · Cited by 34,787
Self-citationThe PRISMA 2020 statement: an updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · Systematic Reviews · doi:10.1186/s13643-021-01626-4 · Cited by 13,874
Self-citationA typology of reviews: an analysis of 14 review types and associated methodologies
Grant, M. J., & Booth, A. (2009) · Health Information & Libraries Journal · doi:10.1111/j.1471-1842.2009.00848.x · Cited by 10,817
Shea, B. J., Reeves, B. C., Wells, G., Thuku, M., Hamel, C., Moran, J., Moher, D., Tugwell, P., Welch, V., Kristjansson, E., et al. (2017) · BMJ · doi:10.1136/bmj.j4008 · Cited by 10,636
Self-citationResearch guidelines for the Delphi survey technique
Hasson, F. (2000) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.2000.01567.x · Cited by 5,951
The PRISMA 2020 statement: an updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J., Bossuyt, P., Boutron, I., Hoffmann, T., mulrow, C., Shamseer, L., Tetzlaff, J., Akl, E., Brennan, S. E., et al. (2020) · doi:10.31222/osf.io/v7gm2 · Cited by 5,177
Self-citationThe Delphi Technique: Making Sense of Consensus
Hsu, C.-C., & Sandford, B. A. (2007) · University of Massachusetts Amherst · doi:10.7275/pdz9-th90 · Cited by 4,500
Diamond, I. R., Grant, R. C., Feldman, B. M., Pencharz, P. B., Ling, S. C., Moore, A. M., & Wales, P. W. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.12.002 · Cited by 3,740
ROBIS: A new tool to assess risk of bias in systematic reviews was developed
Whiting, P., Savović, J., Higgins, J. P. T., Caldwell, D. M., Reeves, B. C., Shea, B., Davies, P., Kleijnen, J., & Churchill, R. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.06.005 · Cited by 2,272
Self-citationJünger, S., Payne, S. A., Brine, J., Radbruch, L., & Brearley, S. G. (2017) · Palliative Medicine · doi:10.1177/0269216317690685 · Cited by 2,210
Research works printed but not linked: 2
- Dillman DA . Mail and Internet Surveys: The Tailored Design Method–2007 Update with New Internet, Visual, and Mixed-Mode Guide. John Wiley & Sons, 2011.
- 10.1371/journal.pmed.1002028 · DOI · Paper page
Cited by
Solmi, M., De Toffol, M., Kim, J. Y., Choi, M. J., Stubbs, B., Thompson, T., Firth, J., Miola, A., Croatto, G., Baggio, F., et al. (2023) · BMJ · doi:10.1136/bmj-2022-072348 · Cited by 271
Self-citationLang, J. J., Prince, S. A., Merucci, K., Cadenas-Sanchez, C., Chaput, J.-P., Fraser, B. J., Manyanga, T., McGrath, R., Ortega, F. B., Singh, B., et al. (2024) · British Journal of Sports Medicine · doi:10.1136/bjsports-2023-107849 · Cited by 220
Guidance to best tools and practices for systematic reviews
Kolaski, K., Logan, L. R., & Ioannidis, J. P. A. (2023) · Systematic Reviews · doi:10.1186/s13643-023-02255-9 · Cited by 232
Emergency department crowding: an overview of reviews describing measures causes, and harms
Pearce, S., Marchand, T., Shannon, T., Ganshorn, H., & Lang, E. (2023) · Internal and Emergency Medicine · doi:10.1007/s11739-023-03239-2 · Cited by 168
The Role of Social Determinants of Health in Cardiovascular Diseases: An Umbrella Review
Teshale, A. B., Htun, H. L., Owen, A., Gasevic, D., Phyo, A. Z. Z., Fancourt, D., Ryan, J., Steptoe, A., & Freak‐Poli, R. (2023) · Journal of the American Heart Association · doi:10.1161/jaha.123.029765 · Cited by 163
Metadata
- Authors
- Gates, M., Gates, A., Pieper, D., Fernandes, R. M., Tricco, A. C., Moher, D., Brennan, S. E., Li, T., Pollock, M., Lunny, C., Sepúlveda, D., McKenzie, J. E., Scott, S. D., Robinson, K. A., Matthias, K., Bougioukas, K. I., Fusar-Poli, P., Whiting, P., Moss, S. J., & Hartling, L.
- Affiliations
- University of Alberta (CA)
- Witten/Herdecke University (DE)
- University of Lisbon (PT)
- St. Michael's Hospital (CA)
- University of Ottawa (CA)
- Monash University (AU)
- University of Colorado Anschutz (US)
- Institute of Health Economics (CA)
- Ministry of Health (CL)
- Johns Hopkins University (US)
- University of Applied Sciences Stralsund (DE)
- Aristotle University of Thessaloniki (GR)
- Early Psychosis: Interventions and Clinical-detection Laboratory, Department of Psychosis Studies, Institute of Psychiatry, Psychology, and Neuroscience, King’s Collect London, London, UK
- University of Bristol (GB)
- University of Calgary (CA)
- Corresponding author
- Li, Tianjing
- Hartling, Lisa
- ORCID
- Venue
- BMJ
- Publisher
- BMJ
- Published
- 2022-08-09
- Volume
- 378
- Pages
- e070849
- ISSN
- 1756-1833 (ISSN-L)
- PMC
- PMC9361065
- OpenAlex
- W4290769249
- Cited by
- 856
- References
- 44
- Citations by year
- 2026: 241 · 2025: 218 · 2024: 256 · 2023: 133 · 2022: 8
- FWCI
- 93.04
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- BMJ (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- Research Portal (King's College London) (publishedVersion, cc-by-nc)
- Funders
- National Eye Institute (UG1EY020522)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- overviews of reviews, reporting guidelines, health interventions, reporting checklist, transparency in research reporting, EQUATOR Network, Delphi consensus, reporting quality, stakeholder engagement, patient and public involvement, conflict of interest disclosure
- MeSH terms
- Delivery of Health Care, Delphi Technique, Health Facilities, Humans, Surveys and Questionnaires, Research Design, Consensus, Checklist
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Reporting guideline for overviews of reviews of healthcare interventions: development of the PRIOR statement. https://app.cochat.ai/papers/10.1136/bmj-2022-070849
- The paper
- Gates, M., Gates, A., Pieper, D., Fernandes, R. M., Tricco, A. C., Moher, D., Brennan, S. E., Li, T., Pollock, M., Lunny, C., Sepúlveda, D., McKenzie, J. E., Scott, S. D., Robinson, K. A., Matthias, K., Bougioukas, K. I., Fusar-Poli, P., Whiting, P., Moss, S. J., & Hartling, L. (2022). Reporting guideline for overviews of reviews of healthcare interventions: development of the PRIOR statement. BMJ. https://doi.org/10.1136/bmj-2022-070849
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.