Cited by 653Qualitative Research Methods and ApplicationsMeta-analysis and systematic reviewsQualitative Research Methods and Ethics

The problem of appraising qualitative research

Open access
Dixon-Woods, M·2004·Quality and Safety in Health Care

Abstract

Qualitative research can make a valuable contribution to the study of quality and safety in health care. Sound ways of appraising qualitative research are needed, but currently there are many different proposals with few signs of an emerging consensus. One problem has been the tendency to treat qualitative research as a unified field. We distinguish universal features of quality from those specific to methodology and offer a set of minimally prescriptive prompts to assist with the assessment of generic features of qualitative research. In using these, account will need to be taken of the particular method of data collection and methodological approach being used. There may be a need for appraisal criteria suited to the different methods of qualitative data collection and to different methodological approaches. These more specific criteria would help to distinguish fatal flaws from more minor errors in the design, conduct, and reporting of qualitative research. There will be difficulties in doing this because some aspects of qualitative research, particularly those relating to quality of insight and interpretation, will remain difficult to appraise and will rely largely on subjective judgement.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1136/qshc.2003.008714

Cites

25 of 25 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • How or whether to appraise papers for inclusion in an interpretive review has received a great deal of attention, but there is little sign of an emergent consensus.

    “How or whether to appraise papers for inclusion in an interpretive reviews has received a great deal of attention, but there is little sign of an emergent consensus [22].”

    From Conducting a critical interpretive synthesis of the literature on access to healthcare by vulnerable groups (2006) · cites this paper as [22]

    The Abstract says that proposals for appraising qualitative research show few signs of consensus, and the introduction discusses disagreement over whether quality criteria should exist. The introduction also says quality assessments are needed for reviews. The paper does not specifically address appraisal for inclusion in interpretive reviews, so the claim is more specific than the source. (LLM, conf=0.82)

    Experimental — accuracy not yet measured
  • Some authors have raised concerns that strict adherence to universal checklists may stifle the diversity and multiplicity of practices in qualitative research.

    “Some authors have raised concerns about the use of such checklists and adherence to strict, universal criteria because they do not afford sufficient flexibility to accommodate the diverse approaches and multiple interpretive practices often represented in qualitative studies.[7][8][9][10][11]”
  • Qualitative studies will be appraised using Dixon-Woods and colleague's tool for appraising qualitative research.

    “Qualitative studies will be appraised using Dixon-Woods and colleague’s tool for appraising qualitative research [69].”
  • Seven criteria for quality appraisal were adopted from different published tools to appraise transparency, description of key terms, and coherence.

    “Given the plurality of methodologies used in the identified studies, seven criteria for quality appraisal were adopted from different published tools (29–31)1 with the aim of appraising transparency, description of key terms, and coherence.”
  • There is no consistent approach or theoretical framework in broad-based qualitative research that one might use as a guideline to apply qualitative inquiry to the development of PROs.

    “There is no consistent approach or theoretical framework, however, in this broad-based research that one might use as a guideline to apply qualitative inquiry to the development of PROs [30–33].”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Dixon-Woods, M.
Venue
Quality and Safety in Health Care
Publisher
BMJ
Published
2004-06-01
Volume
13
Issue
3
Pages
223-225
ISSN
  • 1475-3898 (ISSN-L)
  • 1475-3901
OpenAlex
W2161835779
Cited by
653
References
23
Citations by year
2026: 9 · 2025: 21 · 2024: 20 · 2023: 25 · 2022: 36 · 2021: 44 · 2020: 46 · 2019: 41 · 2018: 36 · 2017: 47 · 2016: 39 · 2015: 46 · 2014: 35 · 2013: 41 · 2012: 34
FWCI
75.64
Type
journal article
Language
en
Open access
Locations
  • BMJ Quality & Safety (publishedVersion)
  • PubMed Central (publishedVersion)
  • PubMed (publishedVersion)
  • Aston Publications Explorer (Aston University) (acceptedVersion)
  • Aston Publications Explorer (Aston University) (submittedVersion)
  • BIROn (Birkbeck, University of London) (submittedVersion)
  • Leicester Research Archive (University of Leicester) (submittedVersion)
Funders
Economic and Social Research Council (RES-333-34-3002)
Topics
  • Social Sciences › Education › Qualitative Research Methods and Applications
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Social Sciences › Sociology and Political Science › Qualitative Research Methods and Ethics
Keywords
appraisal criteria, research quality, healthcare quality and safety, methodological approaches, interpreting quality
MeSH terms
United Kingdom, Health Services Research, Humans, Quality of Health Care, Research Design, Safety Management, Consensus, Qualitative Research

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review