Should we appraise the quality of qualitative research reports for systematic reviews, and if so, how?
The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
Systematic reviews of qualitative research have increasing currency for evidence-based policy-making. Potentially, this can prevent further marginalization of qualitative evidence, increase our understanding of the body of work undertaken by qualitative researchers and allow broader, more overarching theories about studied phenomenon to be built. Qualitative researchers have so far failed to agree what constitutes “validity” or “quality” in their work: these debates have mirrored the epistemological differences within which such research is undertaken. This paper explores the arguments about quality appraisal and, drawing on this literature, builds a proposal to which, it is hoped, qualitative researchers from across disciplines may be able to ascribe. Technical reporting standards could be agreed that make the conduct of the research clearer. Additional elements, related to study trustworthiness and theoretical and practical considerations, could be appraised discursively, allowing the intention of the researchers working within their particular milieu to be accommodated.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Discovery of Grounded Theory; Strategies for Qualitative Research
Glaser, B. G., Strauss, A. L., & Strutzel, E. (1968) · Nursing Research · doi:10.1097/00006199-196807000-00014 · Cited by 39,449
Handbook of Qualitative Research
Crozier, G., Denzin, N., & Lincoln, Y. (1994) · British Journal of Educational Studies · doi:10.2307/3121684 · Cited by 26,666
Systematic Reviews in the Social Sciences: A Practical Guide
Petticrew, M., & Roberts, H. (2006) · doi:10.1002/9780470754887 · Cited by 3,586
Checklists for improving rigour in qualitative research: a case of the tail wagging the dog?
Barbour, R. S. (2001) · BMJ · doi:10.1136/bmj.322.7294.1115 · Cited by 2,613
Using meta ethnography to synthesise qualitative research: a worked example
Britten, N., Campbell, R., Pope, C., Donovan, J., Morgan, M., & Pill, R. (2002) · Journal of Health Services Research & Policy · doi:10.1258/135581902320432732 · Cited by 1,110
The Place of Inter-Rater Reliability in Qualitative Research: An Empirical Study
Armstrong, D., Gosling, A., Weinman, J., & Marteau, T. (1997) · Sociology · doi:10.1177/0038038597031003015 · Cited by 1,008
Meta-Study of Qualitative Health Research
Paterson, B., Thorne, S., Canam, C., & Jillings, C. (2001) · doi:10.4135/9781412985017 · Cited by 664 · cited 5×
“The conduct and scope of research is bound to particular socio-cultural moments (Greenhalgh et al. 2005; Paterson et al. 2001) and the aspects of design considered indicative of good quality may also change over time (Barbour and Barbour 2003).”
BackgroundInfluentialThe problem of appraising qualitative research
Dixon-Woods, M. (2004) · Quality and Safety in Health Care · doi:10.1136/qshc.2003.008714 · Cited by 653 · cited 1×
“Adapting the work of Dixon-Woods et al. (2004), the following criteria (see Table 2) offer a simple descriptive framework for assessing the technical aspects of any study report. information need not use up limited word counts at the expense of greater description of the study findings, but could…”
Ensuring rigour in qualitative research
Seale, C. (1997) · The European Journal of Public Health · doi:10.1093/eurpub/7.4.379 · Cited by 583 · cited 2×
“…require considerable judgment and experience on the part of the reviewer: Some quality criteria require an explicitly theoretical approach (e.g. Seale and Silverman 1997), with an emphasis on language and concepts that may appear inaccessible to those from more traditional medical research…”
BackgroundAggregating Qualitative Findings: An Approach to Theory Development
Estabrooks, C. A., Field, P. A., & Morse, J. M. (1994) · Qualitative Health Research · doi:10.1177/104973239400400410 · Cited by 261
Cited by
Long, H. A., French, D. P., & Brooks, J. M. (2020) · Research Methods in Medicine & Health Sciences · doi:10.1177/2632084320947559 · Cited by 1,112
Noyes, J., Booth, A., Flemming, K., Garside, R., Harden, A., Lewin, S., Pantoja, T., Hannes, K., Cargo, M., & Thomas, J. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.06.020 · Cited by 480
Self-citationDos Santos, P. H., Neves, S. M., Sant’Anna, D. O., Oliveira, C. H. D., & Carvalho, H. D. (2019) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2018.11.270 · Cited by 430
Qualitative Evidence Synthesis: Where Are We at?
Flemming, K., & Noyes, J. (2021) · International Journal of Qualitative Methods · doi:10.1177/1609406921993276 · Cited by 333
Appraising Qualitative Research for Evidence Syntheses: A Compendium of Quality Appraisal Tools
Majid, U., & Vanstone, M. (2018) · Qualitative Health Research · doi:10.1177/1049732318785358 · Cited by 301
Metadata
- Authors
- Garside, R.
- Venue
- Innovation: The European Journal of Social Science Research
- Publisher
- Informa UK Limited
- Published
- 2013-04-24
- Volume
- 27
- Issue
- 1
- Pages
- 67-79
- ISSN
- 1351-1610 (ISSN-L)
- 1469-8412
- OpenAlex
- W2059587585
- Cited by
- 134
- References
- 10
- FWCI
- 4.61
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Should we appraise the quality of qualitative research reports for systematic reviews, and if so, how? https://app.cochat.ai/papers/10.1080/13511610.2013.777270
- The paper
- Garside, R. (2014). Should we appraise the quality of qualitative research reports for systematic reviews, and if so, how? Innovation: The European Journal of Social Science Research. https://doi.org/10.1080/13511610.2013.777270
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.