Cited by 480Meta-analysis and systematic reviewsHealth Policy Implementation ScienceQualitative Research Methods and Applications

Cochrane Qualitative and Implementation Methods Group guidance series-paper 3: methods for assessing methodological limitations, data extraction and synthesis, and confidence in synthesized qualitative findings

Open access
Noyes, Jane, Booth, Andrew, Flemming, Kate, Garside, Ruth, Harden, Angela, Lewin, Simon, Pantoja, Tomas, Hannes, Karin +2 more·2018·Journal of Clinical Epidemiology

Abstract

The Cochrane Qualitative and Implementation Methods Group develops and publishes guidance on the synthesis of qualitative and mixed-method implementation evidence. Choice of appropriate methodologies, methods, and tools is essential when developing a rigorous protocol and conducting the synthesis. Cochrane authors who conduct qualitative evidence syntheses have thus far used a small number of relatively simple methods to address similarly written questions. Cochrane has invested in methodological work to develop new tools and to encourage the production of exemplar reviews to show the value of more innovative methods that address a wider range of questions. In this paper, in the series, we report updated guidance on the selection of tools to assess methodological limitations in qualitative studies and methods to extract and synthesize qualitative evidence. We recommend application of Grades of Recommendation, Assessment, Development, and Evaluation-Confidence in the Evidence from Qualitative Reviews to assess confidence in qualitative synthesized findings. This guidance aims to support review authors to undertake a qualitative evidence synthesis that is intended to be integrated subsequently with the findings of one or more Cochrane reviews of the effects of similar interventions. The review of intervention effects may be undertaken concurrently with or separate to the qualitative evidence synthesis. We encourage further development through reflection and formal testing.

Integrity signals

Registry

Crossref · 10.1016/j.jclinepi.2017.06.020

Cites

35 of 35 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Noyes, J., Booth, A., Flemming, K., Garside, R., Harden, A., Lewin, S., Pantoja, T., Hannes, K., Cargo, M., & Thomas, J.
Affiliations
  • Bangor University (GB)
  • University of Sheffield (GB)
  • University of York (GB)
  • University of Exeter (GB)
  • University of East London (GB)
  • South African Medical Research Council (ZA)
  • KU Leuven (BE)
  • University of South Australia (AU)
  • University College London (GB)
Corresponding author
Noyes, Jane
Venue
Journal of Clinical Epidemiology
Publisher
Elsevier BV
Published
2018-05
Volume
97
Pages
49-58
ISSN
0895-4356 (ISSN-L)
OpenAlex
W2775212908
Cited by
480
References
35
Citations by year
2026: 54 · 2025: 69 · 2024: 67 · 2023: 72 · 2022: 60 · 2021: 45 · 2020: 49 · 2019: 51 · 2018: 10 · 2017: 3
FWCI
27.65
Type
journal article
Language
en
Open access
Locations
  • Journal of Clinical Epidemiology (publishedVersion)
  • PubMed (publishedVersion)
  • UEL Research Repository (University of East London) (acceptedVersion)
  • Adelaide Research & Scholarship (AR&S) (University of Adelaide) (submittedVersion)
  • UCL Discovery (University College London) (submittedVersion)
  • UEL Research Repository (University of East London) (submittedVersion, cc-by-nc-nd)
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
  • Social Sciences › Education › Qualitative Research Methods and Applications
Keywords
qualitative evidence synthesis, data extraction
MeSH terms
Data Accuracy, Systematic Reviews as Topic, Data Analysis, Decision Making, Humans, Evidence-Based Medicine, Biomedical Research, Qualitative Research

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review