The DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
Qualitative Evidence Synthesis: Where Are We at?
Open accessAbstract
Qualitative evidence syntheses (QES) have increased in prominence and profile over the last decade as a discrete set of methodologies to undertake systematic reviews of primary qualitative research in health and social care and in education. The findings from a qualitative evidence synthesis can enable a richer interpretation of a particular phenomenon, set of circumstances, or experiences than single primary qualitative research studies can achieve. Qualitative evidence synthesis methods were developed in response to an increasing demand from health and social professionals, policy makers, guideline developers and educationalists for review evidence that goes beyond “what works” afforded by systematic reviews of effectiveness. The increasing interest in the synthesis of qualitative research has led to methodological developments documented across a plethora of texts and journal articles. This “State of the Method” paper aims to bring together these methodological developments in one place, contextualizing advances in methods with exemplars to support readers in making choices in approach to a synthesis and aid understanding. The paper clarifies what a “qualitative evidence synthesis” is and explores its role, purpose and development. It details the kind of questions a QES can explore, the processes associated with a QES, including the methods for synthesis. The rational and methods for integrating a QES with systematic reviews of effectiveness are also detailed. Finally approaches reporting and recognition of what a “good” or rigorous QES look like are provided.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2010) · International Journal of Surgery · doi:10.1016/j.ijsu.2010.02.007 · Cited by 12,156
Methods for the thematic synthesis of qualitative research in systematic reviews
Thomas, J., & Harden, A. (2008) · BMC Medical Research Methodology · doi:10.1186/1471-2288-8-45 · Cited by 9,312
Enhancing transparency in reporting the synthesis of qualitative research: ENTREQ
Tong, A., Flemming, K., McInnes, E., Oliver, S., & Craig, J. (2012) · BMC Medical Research Methodology · doi:10.1186/1471-2288-12-181 · Cited by 3,569 · cited 7×
“Since the development of ENTREQ, other methodologically specific reporting guidelines have been developed.”
MethodInfluentialSelf-citationNoblit, G., & Hare, R. (1988) · doi:10.4135/9781412985000 · Cited by 2,723
Beyond PICO: The SPIDER Tool for Qualitative Evidence Synthesis
Cooke, A., Smith, D., & Booth, A. (2012) · Qualitative Health Research · doi:10.1177/1049732312452938 · Cited by 2,608 · cited 1×
“SPICE (Setting, Perspective, Intervention or Phenomenon of Interest, Comparison, Evaluation) (Booth., 2006b) SPIDER (Sample, Phenomenon of Interest, Design, Evaluation, Research type); (Cooke et al., 2012).”
Purposeful Sampling in Qualitative Research Synthesis
Suri, H. (2011) · Qualitative Research Journal · doi:10.3316/qrj1102063 · Cited by 2,284
RAMESES publication standards: realist syntheses
Wong, G., Greenhalgh, T., Westhorp, G., Buckingham, J., & Pawson, R. (2013) · BMC Medicine · doi:10.1186/1741-7015-11-21 · Cited by 1,374 · cited 1×
“The RAMESES statements support the reporting of Realist Reviews (Wong et al., 2013a) and meta-narrative reviews (Wong et al., 2013b).”
MethodSystematic Approaches to a Successful Literature Review
Booth, A., Sutton, A., Clowes, M., & Martyn-St James, M. (2022) · SAGE Publications Ltd eBooks · doi:10.4135/9781036232009 · Cited by 1,172
Conducting a meta-ethnography of qualitative literature: Lessons learnt
Atkins, S., Lewin, S., Smith, H., Engel, M., Fretheim, A., & Volmink, J. (2008) · BMC Medical Research Methodology · doi:10.1186/1471-2288-8-21 · Cited by 981
RAMESES publication standards: meta-narrative reviews
Wong, G., Greenhalgh, T., Westhorp, G., Buckingham, J., & Pawson, R. (2013) · BMC Medicine · doi:10.1186/1741-7015-11-20 · Cited by 610
Ames, H., Glenton, C., & Lewin, S. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-019-0665-4 · Cited by 609
Booth, A. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0249-x · Cited by 569
Lewin, S., Bohren, M., Rashidian, A., Munthe-Kaas, H., Glenton, C., Colvin, C. J., Garside, R., Noyes, J., Booth, A., Tunçalp, Ö., et al. (2018) · Implementation Science · doi:10.1186/s13012-017-0689-2 · Cited by 562
Self-citationNoyes, J., Booth, A., Moore, G., Flemming, K., Tunçalp, Ö., & Shakibazadeh, E. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-000893 · Cited by 497
Self-citationNoyes, J., Booth, A., Flemming, K., Garside, R., Harden, A., Lewin, S., Pantoja, T., Hannes, K., Cargo, M., & Thomas, J. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.06.020 · Cited by 480
Self-citationCarroll, C., Booth, A., & Cooper, K. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-29 · Cited by 461
Glenton, C., Colvin, C., Carlsen, B., Swartz, A., Lewin, S., Noyes, J., & Rashidian, A. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010414.pub2 · Cited by 454 · cited 4×
“…the barriers and facilitators experienced when implementing lay health worker programmes to improve access to maternal and child health (Glenton et al., 2013) Explore and explain health outcomes of online consumer health information in primary care in order to help patients to find and…”
BackgroundInfluentialSelf-citationFlemming, K., Booth, A., Garside, R., Tunçalp, Ö., & Noyes, J. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-000882 · Cited by 389
Self-citationClear and present questions: formulating questions for evidence based practice
Booth, A. (2006) · Library Hi Tech · doi:10.1108/07378830610692127 · Cited by 344
A multidimensional conceptual framework for analysing public involvement in health services research
Oliver, S. R., Rees, R. W., Clarke‐Jones, L., Milne, R., Oakley, A. R., Gabbay, J., Stein, K., Buchanan, P., & Gyte, G. (2008) · Health Expectations · doi:10.1111/j.1369-7625.2007.00476.x · Cited by 343
Eakin, J. M., & Mykhalovskiy, E. (2003) · Journal of Evaluation in Clinical Practice · doi:10.1046/j.1365-2753.2003.00392.x · Cited by 287
Hannes, K., & Lockwood, C. (2011) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2011.05636.x · Cited by 286
Noyes, J., Booth, A., Lewin, S., Carlsen, B., Glenton, C., Colvin, C. J., Garside, R., Bohren, M. A., Rashidian, A., Wainwright, M., et al. (2018) · Implementation Science · doi:10.1186/s13012-017-0693-6 · Cited by 266
Self-citationFormulating questions to explore complex interventions within qualitative evidence synthesis
Booth, A., Noyes, J., Flemming, K., Moore, G., Tunçalp, Ö., & Shakibazadeh, E. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-001107 · Cited by 258
Self-citationWalker, R. C., Tong, A., Howard, K., & Palmer, S. C. (2019) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2019.01.013 · Cited by 250 · cited 2×
“Exploring patient expectations and experiences of remote monitoring for chronic diseases (Walker et al., 2019) Examining the research burden of randomized controlled trial participation (Naidoo et al., 2020).”
BackgroundGarside, R. (2013) · Innovation The European Journal of Social Science Research · doi:10.1080/13511610.2013.777270 · Cited by 228
Booth, A., Noyes, J., Flemming, K., Gerhardus, A., Wahlster, P., van der Wilt, G. J., Mozygemba, K., Refolo, P., Sacchini, D., Tummers, M., et al. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2018.03.003 · Cited by 198 · cited 2×
“In summary, the domains in the RETREAT guidance are those that any reviewer needs to take into account prior to starting their review (Booth et al., 2018) (Table 2).”
BackgroundMethodSelf-citationNoyes, J., Booth, A., Cargo, M., Flemming, K., Harden, A., Harris, J., Garside, R., Hannes, K., Pantoja, T., & Thomas, J. (2019) · Wiley eBooks · doi:10.1002/9781119536604.ch21 · Cited by 190
Self-citationCochrane Qualitative and Implementation Methods Group guidance series—paper 1: introduction
Noyes, J., Booth, A., Cargo, M., Flemming, K., Garside, R., Hannes, K., Harden, A., Harris, J., Lewin, S., Pantoja, T., et al. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.09.025 · Cited by 177
Self-citationKarimi-Shahanjarini, A., Shakibazadeh, E., Rashidian, A., Hajimiri, K., Glenton, C., Noyes, J., Lewin, S., Laurant, M., & Colvin, C. J. (2019) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010412.pub2 · Cited by 177
Self-citationHarris, J. L., Booth, A., Cargo, M., Hannes, K., Harden, A., Flemming, K., Garside, R., Pantoja, T., Thomas, J., & Noyes, J. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.10.023 · Cited by 165 · cited 5×
““Scope” refers to the kind of boundaries that will exist around the review, framing the topic of interest and mapping the existing information available (Harris et al., 2018).”
BackgroundInfluentialSelf-citationUsing Mixed Methods Research Synthesis for Literature Reviews
Heyvaert, M., Hannes, K., & Onghena, P. (2017) · doi:10.4135/9781506333243 · Cited by 164
Harden, A., Thomas, J., Cargo, M., Harris, J., Pantoja, T., Flemming, K., Booth, A., Garside, R., Hannes, K., & Noyes, J. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.11.029 · Cited by 164
Self-citationElectronic searching to locate qualitative research: evaluation of three strategies
Flemming, K., & Briggs, M. (2006) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2006.04083.x · Cited by 161
Self-citationFlemming, K., Graham, H. M., Heirs, M. K., Fox, D., & Sowden, A. J. (2012) · Journal of Advanced Nursing · doi:10.1111/jan.12066 · Cited by 158
Self-citationMetasynthetic Madness: What Kind of Monster Have We Created?
Thorne, S. E. (2016) · Qualitative Health Research · doi:10.1177/1049732316679370 · Cited by 158
Patients’ experiences of chronic non-malignant musculoskeletal pain: a qualitative systematic review
Toye, F., Seers, K., Allcock, N., Briggs, M., Carr, E., Andrews, J., & Barker, K. (2013) · British Journal of General Practice · doi:10.3399/bjgp13x675412 · Cited by 156 · cited 1×
“When you do see one it is an absolute pleasure to read—see for example Toye et al., 2013, Gomersall et al., 2011.”
BackgroundBooth, A. (2016) · White Rose Research Online (University of Leeds, The University of Sheffield, University of York) · doi:10.13140/rg.2.1.2318.0562 · Cited by 152
Naidoo, N., Nguyen, V. T., Ravaud, P., Young, B., Amiel, P., Schanté, D., Clarke, M., & Boutron, I. (2020) · BMC Medicine · doi:10.1186/s12916-019-1476-5 · Cited by 144 · cited 2×
“Exploring patient expectations and experiences of remote monitoring for chronic diseases (Walker et al., 2019) Examining the research burden of randomized controlled trial participation (Naidoo et al., 2020).”
BackgroundFlemming, K., Booth, A., Hannes, K., Cargo, M., & Noyes, J. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.10.022 · Cited by 140
Self-citationKakemam, E., Liang, Z., Janati, A., Arab‐Zozani, M., Mohaghegh, B., & Gholizadeh, M. (2020) · Journal of Healthcare Leadership · doi:10.2147/jhl.s265825 · Cited by 135
A Metasynthesis of the Self-Management of Type 2 Diabetes
Gomersall, T., Madill, A., & Summers, L. K. M. (2011) · Qualitative Health Research · doi:10.1177/1049732311402096 · Cited by 126
Improving reporting of meta‐ethnography: The eMERG e reporting guidance
France, E. F., Cunningham, M., Ring, N., Uny, I., Duncan, E., Jepson, R. G., Maxwell, M., Roberts, R. J., Turley, R. L., Booth, A., et al. (2019) · Journal of Advanced Nursing · doi:10.1111/jan.13809 · Cited by 120
Self-citationToyé, F., & Barker, K. L. (2020) · BMC Urology · doi:10.1186/s12894-019-0555-4 · Cited by 119
Qualitative evidence synthesis to improve implementation of clinical guidelines
Carroll, C. (2017) · BMJ · doi:10.1136/bmj.j80 · Cited by 90
Pluye, P., Sherif, R. E., Granikov, V., Hong, Q. N., Vedel, I., Galvão, M. C. B., Frati, F., Desroches, S., Repchinsky, C. A., Rihoux, B., et al. (2019) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24178 · Cited by 79
Graham, H. M., de Bell, S., Flemming, K., Sowden, A. J., White, P. C. L., & Wright, K. E. (2018) · Ageing and Society · doi:10.1017/s0144686x18001381 · Cited by 56
Self-citationKrishnasamy, C., Ong, S. Y., Loo, M. E., & Thistlethwaite, J. E. (2019) · Medical Teacher · doi:10.1080/0142159x.2019.1630731 · Cited by 56
The synthesis of qualitative research and evidence-based nursing
Flemming, K. (2007) · Evidence-Based Nursing · doi:10.1136/ebn.10.3.68 · Cited by 53
Self-citationJiménez, E., Waddington, H. S., Goel, N., Prost, A., Pullin, A. S., White, H., Lahiri, S., & Narain, A. (2018) · Journal of Development Effectiveness · doi:10.1080/19439342.2018.1534875 · Cited by 53
Synthesising Qualitative Research
Pope, C. J., & Mays, N. (2006) · Wiley eBooks · doi:10.1002/9780470750841.ch13 · Cited by 41
Lovell, N., Etkind, S. N., Bajwah, S., Maddocks, M. M., & Higginson, I. J. (2018) · Journal of Pain and Symptom Management · doi:10.1016/j.jpainsymman.2018.09.021 · Cited by 40
Barken, T. L., Söderhamn, U., & Thygesen, E. (2019) · Journal of Advanced Nursing · doi:10.1111/jan.14117 · Cited by 30
The Experience of Living to an Extreme Age: A Meta-Ethnography
Toyé, F., Jenkins, C., & Barker, K. L. (2019) · Qualitative Health Research · doi:10.1177/1049732319880537 · Cited by 16
Cited by
The lived experience of autistic adults in employment: a systematic search and synthesis
Thorpe, D., McKinlay, M., Richards, J., Sang, K., & Stewart, M. E. (2024) · Autism in Adulthood · doi:10.1089/aut.2022.0114 · Cited by 43
Overview of evidence synthesis types and modes
Nussbaumer-Streit, B., Booth, A., Garritty, C., Hamel, C., Munn, Z., Tricco, A. C., & Pollock, D. (2025) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2025.111970 · Cited by 19
Vick, J. B., Golden, B. P., Cantrell, S., Harris-Gersten, M. L., Selmanoff, M. R., Hastings, S. N., Oyesanya, T. O., Goldstein, K. M., & Van Houtven, C. (2024) · JMIR Research Protocols · doi:10.2196/53255 · Cited by 1
Metadata
- Authors
- Flemming, K., & Noyes, J.
- Venue
- International Journal of Qualitative Methods
- Publisher
- SAGE Publications
- Published
- 2021-01-01
- Volume
- 20
- ISSN
- 1609-4069 (ISSN-L)
- OpenAlex
- W3131132846
- Cited by
- 333
- References
- 54
- FWCI
- 23.73
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.