Are we entering a new era for qualitative research? Using qualitative evidence to support guidance and guideline development by the World Health Organization
Open accessAbstract
Qualitative approaches are one of several methodologies utilised within the social sciences. New developments within qualitative methods are widening the opportunities for using qualitative evidence to inform health policy and systems decisions. In this commentary, we discuss how, in our work with the World Health Organization (WHO), we have explored ways of broadening the types of evidence used to develop evidence-informed guidance for health systems.Health systems decisions are commonly informed by evidence on the effectiveness of health system interventions. However, decision makers and other stakeholders also typically have additional questions, including how different stakeholders value different outcomes, the acceptability and feasibility of different interventions and the impacts of these interventions on equity and human rights. Evidence from qualitative research can help address these questions, and a number of WHO guidelines are now using qualitative evidence in this way. This growing use of qualitative evidence to inform decision making has been facilitated by recent methodological developments, including robust methods for qualitative evidence syntheses and approaches for assessing how much confidence to place in findings from such syntheses. For research evidence to contribute optimally to improving and sustaining the performance of health systems, it needs to be transferred easily between different elements of what has been termed the 'evidence ecosystem'. This ecosystem includes primary and secondary evidence producers, guidance developers and those implementing and evaluating interventions to strengthen health systems. We argue that most of the elements of an ecosystem for qualitative evidence are now in place - an important milestone that suggests that we are entering a new era for qualitative research. However, a number of challenges and constraints remain. These include how to build stronger links between the communities involved in the different parts of the qualitative evidence ecosystem and the need to strengthen capacity, particularly in low and middle income countries, to produce and utilise qualitative evidence and decision products informed by such evidence. We invite others who want to support the wider use of qualitative evidence in decision processes to look for opportunities in their settings to put this into practice.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Tong, A., Sainsbury, P., & Craig, J. (2007) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzm042 · Cited by 42,509 · see citing works
Transforming Our World: The 2030 Agenda for Sustainable Development
Desa, U. (2018) · Springer Publishing Company eBooks · doi:10.1891/9780826190123.ap02 · Cited by 19,434 · see citing works
Standards for Reporting Qualitative Research: A Synthesis of Recommendations
O’Brien, B. C., Harris, I. B., Beckman, T. J., Reed, D. A., & Cook, D. A. (2014) · Academic Medicine · doi:10.1097/acm.0000000000000388 · Cited by 12,211 · see citing works
Lost in knowledge translation: Time for a map?
Graham, I. D., Logan, J., Harrison, M. B., Straus, S. E., Tetroe, J., Caswell, W., & Robinson, N. (2006) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.47 · Cited by 4,705 · see citing works
Alonso-Coello, P., Schünemann, H. J., Moberg, J., Brignardello-Petersen, R., Akl, E. A., Davoli, M., Treweek, S., Mustafa, R. A., Rada, G., Rosenbaum, S., et al. (2016) · BMJ · doi:10.1136/bmj.i2016 · Cited by 1,317 · see citing works
Applying GRADE-CERQual to qualitative evidence synthesis findings: introduction to the series
Lewin, S., Booth, A., Glenton, C., Munthe-Kaas, H., Rashidian, A., Wainwright, M., Bohren, M. A., Tunçalp, Ö., Colvin, C. J., Garside, R., et al. (2018) · Implementation Science · doi:10.1186/s13012-017-0688-3 · Cited by 1,231 · see citing works
Self-citationLewin, S., Glenton, C., Munthe-Kaas, H., Carlsen, B., Colvin, C. J., Gülmezoglu, M., Noyes, J., Booth, A., Garside, R., & Rashidian, A. (2015) · PLOS Medicine · doi:10.1371/journal.pmed.1001895 · Cited by 866 · see citing works
Self-citationLiving Systematic Reviews: An Emerging Opportunity to Narrow the Evidence-Practice Gap
Elliott, J. H., Turner, T., Clavisi, O., Thomas, J., Higgins, J. P. T., Mavergames, C., & Gruen, R. L. (2014) · PLoS Medicine · doi:10.1371/journal.pmed.1001603 · Cited by 596 · see citing works
Oxman, A. D., Lavis, J. N., Lewin, S. A., & Fretheim, A. (2009) · Health Research Policy and Systems · doi:10.1186/1478-4505-7-s1-s1 · Cited by 399 · see citing works
Self-citationThe GRADE Evidence to Decision (EtD) framework for health system and public health decisions
for the GRADE Working Group, Moberg, J., Oxman, A. D., Rosenbaum, S., Schünemann, H. J., Guyatt, G., Flottorp, S., Glenton, C., Lewin, S., Morelli, A., et al. (2018) · Health Research Policy and Systems · doi:10.1186/s12961-018-0320-2 · Cited by 376 · see citing works
Self-citationOladapo, O. T., Tunçalp, Ö., Bonet, M., Ta, L., Portela, A. G., Downe, S. M., & Gülmezoglu, A. M. (2018) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/1471-0528.15237 · Cited by 259 · see citing works
Downe, S. M., Finlayson, K. W., Tunçalp, Ö., & Gülmezoglu, A. M. (2015) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/1471-0528.13819 · Cited by 242 · see citing works
Munabi-Babigumira, S. K., Glenton, C., Lewin, S. A., Fretheim, A., & Nabudere, H. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011558.pub2 · Cited by 215 · see citing works
Self-citationLavis, J. N., Permanand, G., Oxman, A. D., Lewin, S. A., & Fretheim, A. (2009) · Health Research Policy and Systems · doi:10.1186/1478-4505-7-s1-s13 · Cited by 199 · see citing works
Self-citationCochrane Qualitative and Implementation Methods Group guidance series—paper 1: introduction
Noyes, J., Booth, A., Cargo, M., Flemming, K., Garside, R., Hannes, K., Harden, A., Harris, J., Lewin, S. A., Tomás Pantoja, C., et al. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.09.025 · Cited by 178 · see citing works
Self-citationProvision and uptake of routine antenatal services: a qualitative evidence synthesis
Downe, S. M., Finlayson, K. W., Tunçalp, Ö., & Gülmezoglu, A. M. (2019) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012392.pub2 · Cited by 171 · see citing works
Bosch‐Capblanch, X., Lavis, J. N., Lewin, S. A., Atun, R. A., Røttingen, J., Dröschel, D., Beck, L., Abalos, E. J., El‐Jardali, F., Gilson, L., et al. (2012) · PLoS Medicine · doi:10.1371/journal.pmed.1001185 · Cited by 139 · see citing works
Self-citationEvidence briefs and deliberative dialogues: perceptions and intentions to act on what was learnt
Moat, K. A., Lavis, J. N., Clancy, S. J., El‐Jardali, F., Tomás Pantoja, C., & for the Knowledge Translation Platform Evaluation study team (2013) · Bulletin of the World Health Organization · doi:10.2471/blt.12.116806 · Cited by 110 · see citing works
Fretheim, A., Munabi-Babigumira, S. K., Oxman, A. D., Lavis, J. N., & Lewin, S. A. (2009) · Health Research Policy and Systems · doi:10.1186/1478-4505-7-s1-s6 · Cited by 101 · see citing works
Self-citationQualitative evidence synthesis to improve implementation of clinical guidelines
Carroll, C. (2017) · BMJ · doi:10.1136/bmj.j80 · Cited by 90 · see citing works
Developing and refining the methods for a ‘one-stop shop’ for research evidence about health systems
Lavis, J. N., Wilson, M. G., Moat, K. A., Hammill, A. C., Boyko, J. A., Grimshaw, J., & Flottorp, S. A. (2015) · Health Research Policy and Systems · doi:10.1186/1478-4505-13-10 · Cited by 76 · see citing works
Jha, A., Lin, L. K., Short, S. M., Argentini, G., Gamhewage, G., & Savoia, E. (2018) · PLoS ONE · doi:10.1371/journal.pone.0205555 · Cited by 72 · see citing works
Lewin, S. A., Oxman, A. D., Lavis, J. N., Fretheim, A., Martí, S. G., & Munabi-Babigumira, S. K. (2009) · Health Research Policy and Systems · doi:10.1186/1478-4505-7-s1-s11 · Cited by 62 · see citing works
Self-citationPitchforth, E. (2006) · Quality and Safety in Health Care · doi:10.1136/qshc.2005.017285 · Cited by 53 · see citing works
Christof, C., Nußbaumer-Streit, B., & Gartlehner, G. (2019) · Das Gesundheitswesen · doi:10.1055/a-0887-4545 · Cited by 46 · see citing works
Epistemonikos: A Free, Relational, Collaborative, Multilingual Database of Health Evidence
Gabriel Rada, G., Daniel, P., & Daniel Capurro, N. (2013) · Studies in health technology and informatics · doi:10.3233/978-1-61499-289-9-486 · Cited by 45 · see citing works
Humanised care and a change in practice in a hospital in Benin
Fujita, N., Perrin, X. R., Vodounon, J. A., Gozo, M. K., Matsumoto, Y., Uchida, S., & Sugiura, Y. (2011) · Midwifery · doi:10.1016/j.midw.2011.07.003 · Cited by 43 · see citing works
Tan, T., Stokes, T., & Shaw, E. J. (2009) · International Journal of Evidence-Based Healthcare · doi:10.1111/j.1744-1609.2009.00135.x · Cited by 36 · see citing works
Daniels, K., Loewenson, R. H., George, A. S., Howard, N., Koleva, G., Lewin, S. A., Marchal, B., Nambiar, D., Paina, L., Sacks, E., et al. (2016) · International Journal for Equity in Health · doi:10.1186/s12939-016-0368-y · Cited by 36 · see citing works
Self-citationGlenton, C., Lewin, S. A., & Gülmezoglu, A. M. (2015) · Implementation Science · doi:10.1186/s13012-016-0470-y · Cited by 35 · see citing works
Self-citationde Gruchy, J., & Lewin, S. M. (2001) · American Journal of Public Health · doi:10.2105/ajph.91.6.865 · Cited by 26 · see citing works
Self-citationHow to achieve more effective services: the evidence ecosystem
Shepherd, J. P. (2014) · ORCA Online Research @Cardiff (Cardiff University) · Cited by 26 · see citing works
Downe, S. M., Finlayson, K. W., Tunçalp, Ö., & Gülmezoglu, A. M. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012392 · Cited by 20 · see citing works
Adebiyi, B. O., Mukumbang, F. C., Okop, K., & Beytell, A.-M. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-019907 · Cited by 20 · see citing works
Straus, S. E., Kitson, A. A., Harrison, M. B., et al. (2009) · doi:10.1002/9781444311747.ch3 · Cited by 18 · see citing works
The ‘community’ in community case management of childhood illnesses in Malawi
Zembe‐Mkabile, W., Jackson, D. J., Sanders, D. M., et al. (2016) · Global Health Action · doi:10.3402/gha.v9.29177 · Cited by 17 · see citing works
Doherty, T., Lewin, S. A., Kinney, M. V., et al. (2018) · BMJ Global Health · doi:10.1136/bmjgh-2018-000741 · Cited by 13 · see citing works
Self-citationDaniels, K., Loewenson, R. H., George, A. S., Koleva, G., Lewin, S. A., Marchal, B., Paina, L., Sacks, E., Sheikh, K., Tetui, M., et al. (2016) · Cited by 5 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 5
- [8]Glenton C, Lewin S, Norris SL. Using evidence from qualitative research to develop WHO guidelines (Chapter 15). In: World Health Organization. Handbook for Guideline Development. 2nd ed. Geneva: WHO; 2016.
- [16]WHO WHO recommendations on antenatal care for a positive pregnancy experience 2016 Geneva World Health Organization 28079998
- [19]WHO Health worker roles in providing safe abortion care and post-abortion contraception 2015 Geneva World Health Organization 26401543
- [20]WHO WHO recommendations: intrapartum care for a positive childbirth experience 2018 Geneva World Health Organization 30070803
- [21]WHO Communicating risk in public health emergencies. A WHO guideline for emergency risk communication (ERC) policy and practice 2018 Geneva World Health Organization 31059213
Cited by
Sorted by citations
Cooper, J., Murphy, J., Woods, C., Van Nassau, F., McGrath, A., Callaghan, D., Carroll, P., Kelly, P., Murphy, N., Murphy, M., et al. (2021) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-021-01177-w · Cited by 114 · see citing works
Snow, M. E., Salmon, A., Banjo, J., Morrow, M., & Varcoe, C. (2026) · PLOS One · doi:10.1371/journal.pone.0329049
“These insights are critical for developing interventions and policies that address the root causes of health inequities [36,37].”
- Authors
- Lewin, S., & Glenton, C.
- Affiliations
- South African Medical Research Council (ZA)
- Norwegian Institute of Public Health (NO)
- Corresponding author
- Lewin, Simon
- Venue
- International Journal for Equity in Health
- Published
- 2018-09-24
- Volume
- 17
- Issue
- 1
- Pages
- 126-126
- ISSN
- 1475-9276 (ISSN-L)
- PMC
- PMC6151925
- OpenAlex
- W2888011912
- Cited by
- 92
- References
- 39
- Citations by year
- 2026: 5 · 2025: 9 · 2024: 22 · 2023: 12 · 2022: 11 · 2021: 10 · 2020: 13 · 2019: 9 · 2018: 1
- FWCI
- 12.60
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- International Journal for Equity in Health (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, other-oa)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Education › Qualitative Research Methods and Applications
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- qualitative evidence, WHO guidelines, evidence-informed decision-making, qualitative evidence synthesis, evidence ecosystem, health policy, stakeholder value, feasibility and acceptability, capacity building, low- and middle-income countries
- MeSH terms
- Delivery of Health Care, Health Policy, Humans, World Health Organization, Guidelines as Topic, Evidence-Based Medicine, Qualitative Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
