Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 58 of the 58 references it cites were found in a registry or an index.

Applying GRADE-CERQual to qualitative evidence synthesis findings: introduction to the series

Open access

Abstract

The GRADE-CERQual ('Confidence in the Evidence from Reviews of Qualitative research') approach provides guidance for assessing how much confidence to place in findings from systematic reviews of qualitative research (or qualitative evidence syntheses). The approach has been developed to support the use of findings from qualitative evidence syntheses in decision-making, including guideline development and policy formulation. Confidence in the evidence from qualitative evidence syntheses is an assessment of the extent to which a review finding is a reasonable representation of the phenomenon of interest. CERQual provides a systematic and transparent framework for assessing confidence in individual review findings, based on consideration of four components: (1) methodological limitations, (2) coherence, (3) adequacy of data, and (4) relevance. A fifth component, dissemination (or publication) bias, may also be important and is being explored. As with the GRADE (Grading of Recommendations Assessment, Development, and Evaluation) approach for effectiveness evidence, CERQual suggests summarising evidence in succinct, transparent, and informative Summary of Qualitative Findings tables. These tables are designed to communicate the review findings and the CERQual assessment of confidence in each finding. This article is the first of a seven-part series providing guidance on how to apply the CERQual approach. In this paper, we describe the rationale and conceptual basis for CERQual, the aims of the approach, how the approach was developed, and its main components. We also outline the purpose and structure of this series and discuss the growing role for qualitative evidence in decision-making. Papers 3, 4, 5, 6, and 7 in this series discuss each CERQual component, including the rationale for including the component in the approach, how the component is conceptualised, and how it should be assessed. Paper 2 discusses how to make an overall assessment of confidence in a review finding and how to create a Summary of Qualitative Findings table. The series is intended primarily for those undertaking qualitative evidence syntheses or using their findings in decision-making processes but is also relevant to guideline development agencies, primary qualitative researchers, and implementation scientists and practitioners.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/s13012-017-0688-3

Cites

58 of 58 references verified0 citation errors · 0 not checkable

Statistics

Figures

Fig. 1 Overview of the GRADE-CERQual series of papers
Fig. 1 Overview of the GRADE-CERQual series of papersCC BY · PubMed Central
Fig. 2 How the papers in the GRADE-CERQual series can be used
Fig. 2 How the papers in the GRADE-CERQual series can be usedCC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 58 references

Research works printed but not linked: 5

  1. Davies P: Evidence-based government: how can we make it happen? CHSRF (Canada Health Services Research Foundation) 7th annual invitational workshop - leveraging knowledge: tools and strategies for action. Montreal, Canada; 2005.
  2. Pope C, Mays N, Popay J. Synthesising qualitative and quantitative health evidence: a guide to methods. United Kingdom: McGraw-Hill Education; 2007.
  3. Glenton C, Lewin S, Norris SL. Using evidence from qualitative research to develop WHO guidelines (Chapter 15). In: World Health Organization, editor. Handbook for Guideline Development. 2nd ed. Geneva: WHO; 2016.
  4. NICE. Community engagement: improving health and wellbeing and reducing health inequalities. NICE Guideline. London, UK: National Institute for Health and Care Excellence (NICE); 2016.
  5. WHO. Handbook for guideline development (2nd edition). Geneva: World Health Organization; 2016.

Cited by

See all 1,231

Metadata

Authors
Lewin, S., Booth, A., Glenton, C., Munthe-Kaas, H., Rashidian, A., Wainwright, M., Bohren, M. A., Tunçalp, Ö., Colvin, C. J., Garside, R., Carlsen, B., Langlois, E. V., & Noyes, J.
Affiliations
  • South African Medical Research Council (ZA)
  • University of Sheffield (GB)
  • Norwegian Institute of Public Health (NO)
  • World Health Organization Regional Office for the Eastern Mediterranean (EG)
  • University of Cape Town (ZA)
  • World Health Organization (CH)
  • University of Exeter (GB)
  • Uni Research (Norway) (NO)
  • Bangor University (GB)
Corresponding author
Lewin, Simon
Venue
Implementation Science
Published
2018-01
Volume
13
Issue
S1
Pages
2-2
ISSN
1748-5908 (ISSN-L)
OpenAlex
W2784472800
Cited by
1,231
References
58
Citations by year
2026: 179 · 2025: 180 · 2024: 179 · 2023: 140 · 2022: 168 · 2021: 188 · 2020: 98 · 2019: 68 · 2018: 24
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Implementation Science (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • White Rose Research Online (University of Leeds, The University of Sheffield, University of York) (acceptedVersion)
  • Durham Research Online (Durham University) (acceptedVersion, other-oa)
  • Durham Research Online (Durham University) (submittedVersion, cc-by)
  • Minerva Access (University of Melbourne) (submittedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
  • NORA - Norwegian Open Research Archives (submittedVersion, other-oa)
  • Figshare (submittedVersion, cc-by)
  • Open University of Cape Town (University of Cape Town) (submittedVersion)
  • Open Research Exeter (University of Exeter) (submittedVersion, cc-by)
  • Bangor University Research Portal (Bangor University) (submittedVersion, other-oa)
Funders
  • World Health Organization
  • South African Medical Research Council
  • Norges Forskningsråd
  • Alliance for Health Policy and Systems Research
  • Medical Research Council
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Social Sciences › Education › Qualitative Research Methods and Applications
  • Social Sciences › Sociology and Political Science › Delphi Technique in Research
Keywords
GRADE-CERQual, qualitative evidence synthesis, methodological limitations, coherence, relevance, publication bias, evidence-informed decision-making, guideline development
MeSH terms
Data Accuracy, Systematic Reviews as Topic, Decision Making, Humans, Publishing, Confidence Intervals, Evidence-Based Medicine, Biomedical Research, Qualitative Research

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Applying GRADE-CERQual to qualitative evidence synthesis findings: introduction to the series. https://app.cochat.ai/papers/10.1186/s13012-017-0688-3
The paper
Lewin, S., Booth, A., Glenton, C., Munthe-Kaas, H., Rashidian, A., Wainwright, M., Bohren, M. A., Tunçalp, Ö., Colvin, C. J., Garside, R., Carlsen, B., Langlois, E. V., & Noyes, J. (2018). Applying GRADE-CERQual to qualitative evidence synthesis findings: introduction to the series. Implementation Science. https://doi.org/10.1186/s13012-017-0688-3

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.