Synthesising quantitative and qualitative evidence to inform guidelines on complex interventions: clarifying the purposes, designs and outlining some methods
Open accessAbstract
Guideline developers are increasingly dealing with more difficult decisions concerning whether to recommend complex interventions in complex and highly variable health systems. There is greater recognition that both quantitative and qualitative evidence can be combined in a mixed-method synthesis and that this can be helpful in understanding how complexity impacts on interventions in specific contexts. This paper aims to clarify the different purposes, review designs, questions, synthesis methods and opportunities to combine quantitative and qualitative evidence to explore the complexity of complex interventions and health systems. Three case studies of guidelines developed by WHO, which incorporated quantitative and qualitative evidence, are used to illustrate possible uses of mixed-method reviews and evidence. Additional examples of methods that can be used or may have potential for use in a guideline process are outlined. Consideration is given to the opportunities for potential integration of quantitative and qualitative evidence at different stages of the review and guideline process. Encouragement is given to guideline commissioners and developers and review authors to consider including quantitative and qualitative evidence. Recommendations are made concerning the future development of methods to better address questions in systematic reviews and guidelines that adopt a complexity perspective.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The first author read all charted data before coding each study's findings to preserve its original context and ensure that its findings could be fully understood without misinterpretation.
“the first author read all the charted data (including study aims, methods, and samples) before coding each study’s findings to preserve its original context and ensure that its findings could be fully understood without misinterpretation [39].”
From Experiences of Using Digital Mindfulness-Based Interventions: Rapid Scoping Review and Thematic Synthesis (2023) · cites this paper as [39]
The ‘Types of findings produced by specific methods’ section says that third-order interpretations preserve studies’ original context, and ‘Data extraction’ notes that a synthesis framework may arise from reading included studies early in a review. Neither passage specifies that a first author should read all charted data before coding, nor says that doing so ensures findings are understood without misinterpretation. No page numbers were available in our copy. (LLM, conf=0.82)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Tong, A., Sainsbury, P., & Craig, J. (2007) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzm042 · Cited by 42,509 · see citing works
The Cochrane Collaboration's tool for assessing risk of bias in randomised trials
Higgins, J. P. T., Altman, D. G., Gotzsche, P. C., Juni, P., Moher, D., Oxman, A. D., Savovic, J., Schulz, K. F., Weeks, L., Sterne, J. A. C., et al. (2011) · BMJ · doi:10.1136/bmj.d5928 · Cited by 33,817 · see citing works
Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048 · see citing works
Dermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,577 · see citing works
Designing and Conducting Mixed Methods Research
Robinson, P. M. (2007) · Australian and New Zealand Journal of Public Health · doi:10.1111/j.1753-6405.2007.00096.x · Cited by 23,297 · see citing works
Methods for the thematic synthesis of qualitative research in systematic reviews
Thomas, J., & Harden, A. (2008) · BMC Medical Research Methodology · doi:10.1186/1471-2288-8-45 · Cited by 9,312 · see citing works
(2006) · Cited by 7,081 · see citing works
SAGE Handbook of Mixed Methods in Social & Behavioral Research
Tashakkori, A., & Teddlie, C. (2010) · doi:10.4135/9781506335193 · Cited by 6,215 · see citing works
Process evaluation of complex interventions: Medical Research Council guidance
Moore, G. F., Audrey, S., Barker, M., Bond, L., Bonell, C., Hardeman, W., Moore, L., O'Cathain, A., Tinati, T., Wight, D., et al. (2015) · BMJ · doi:10.1136/bmj.h1258 · Cited by 6,204 · see citing works
Self-citationNoblit, G., & Hare, R. (1988) · doi:10.4135/9781412985000 · Cited by 2,723 · see citing works
Meta-Ethnography: Synthesizing Qualitative Studies
Noblit, G. W., & Hare, R. D. (1988) · Medical Entomology and Zoology · Cited by 2,191 · see citing works
Pluye, P., & Hong, Q. N. (2014) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-032013-182440 · Cited by 1,363 · see citing works
Hong, Q. N., Gonzalez‐Reyes, A., & Pluye, P. (2018) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.12884 · Cited by 1,107 · see citing works
Evidence-Based Public Health: Moving Beyond Randomized Trials
Victora, C. G., Habicht, J.-P., & Bryce, J. (2004) · American Journal of Public Health · doi:10.2105/ajph.94.3.400 · Cited by 1,056 · see citing works
Storylines of research in diffusion of innovation: a meta-narrative approach to systematic review
Greenhalgh, T., Robert, G., Macfarlane, F., Bate, P., Kyriakidou, O., & Peacock, R. (2005) · Social Science & Medicine · doi:10.1016/j.socscimed.2004.12.001 · Cited by 913 · see citing works
Lewin, S., Glenton, C., Munthe-Kaas, H., Carlsen, B., Colvin, C. J., Gülmezoglu, M., Noyes, J., Booth, A., Garside, R., & Rashidian, A. (2015) · PLOS Medicine · doi:10.1371/journal.pmed.1001895 · Cited by 866 · see citing works
Self-citationMixing Methods: qualitative and quantitative research
(2017) · Routledge eBooks · doi:10.4324/9781315248813 · Cited by 787 · see citing works
Hong, Q. N., Pluye, P., Bujold, M., & Wassef, M. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0454-2 · Cited by 754 · see citing works
Guidance on the conduct of narrative synthesis in sytematic reviews
Popay, J., Roberts, H. M., Sowden, A. J., Petticrew, M. P., Arai, L., Rodgers, M., & Britten, N. (2006) · Cited by 690 · see citing works
“Best fit” framework synthesis: refining the method
Carroll, C., Booth, A., Leaviss, J., & Rick, J. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-37 · Cited by 649 · see citing works
Rodgers, M., Sowden, A., Petticrew, M., Arai, L., Roberts, H., Britten, N., & Popay, J. (2009) · Evaluation · doi:10.1177/1356389008097871 · Cited by 561 · see citing works
A Systematic Review of Theory-Driven Evaluation Practice From 1990 to 2009
Coryn, C. L. S., Noakes, L. A., Westine, C. D., & Schröter, D. C. (2011) · American Journal of Evaluation · doi:10.1177/1098214010389321 · Cited by 531 · see citing works
Integrating qualitative research with trials in systematic reviews
Thomas, J., Harden, A., Oakley, A., Oliver, S., Sutcliffe, K., Rees, R., Brunton, G., & Kavanagh, J. (2004) · BMJ · doi:10.1136/bmj.328.7446.1010 · Cited by 515 · see citing works
Southern, D. A., Norris, C. M., Quan, H., Shrive, F. M., Galbraith, P. D., Humphries, K. H., Gao, M., Knudtson, M. L., Ghali, W. A., & the APPROACH Investigators (2008) · BMC Medical Research Methodology · doi:10.1186/1471-2288-8-1 · Cited by 503 · see citing works
Using framework-based synthesis for conducting reviews of qualitative studies
Dixon‐Woods, M. (2011) · BMC Medicine · doi:10.1186/1741-7015-9-39 · Cited by 496 · see citing works
(2006) · PubMed · Cited by 485 · see citing works
Noyes, J., Booth, A., Flemming, K., Garside, R., Harden, A., Lewin, S., Pantoja, T., Hannes, K., Cargo, M., & Thomas, J. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.06.020 · Cited by 480 · see citing works
Self-citationO’Cathain, A., Hoddinott, P., Lewin, S., Thomas, K. J., Young, B., Adamson, J., Jansen, Y. J., Mills, N., Moore, G., & Donovan, J. L. (2015) · Pilot and Feasibility Studies · doi:10.1186/s40814-015-0026-y · Cited by 458 · see citing works
Self-citationAtun, R., de Jongh, T., Secci, F., Ohiri, K., & Adeyi, O. (2010) · Health Policy and Planning · doi:10.1093/heapol/czp055 · Cited by 427 · see citing works
Flemming, K., Booth, A., Garside, R., Tunçalp, Ö., & Noyes, J. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-000882 · Cited by 389 · see citing works
Self-citationUsing logic models to capture complexity in systematic reviews: Logic Models in Systematic Reviews
Anderson, L. M., Petticrew, M., Rehfuess, E., Armstrong, R., Ueffing, E., Baker, P., Francis, D., & Tugwell, P. (2011) · Research Synthesis Methods · doi:10.1002/jrsm.32 · Cited by 372 · see citing works
Researching public health: Behind the qualitative-quantitative methodological debate
Baum, F. (1995) · Social Science & Medicine · doi:10.1016/0277-9536(94)e0103-y · Cited by 335 · see citing works
Synthesising quantitative evidence in systematic reviews of complex health interventions
Higgins, J. P. T., López-López, J. A., Becker, B. J., Davies, S. R., Dawson, S., Grimshaw, J. M., McGuinness, L. A., Moore, T. H. M., Rehfuess, E. A., Thomas, J., et al. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-000858 · Cited by 322 · see citing works
Mixed Methods Research for Nursing and the Health Sciences
(2009) · Wiley eBooks · doi:10.1002/9781444316490 · Cited by 315 · see citing works
Fletcher, A., Jamal, F., Moore, G., Evans, R. E., Murphy, S., & Bonell, C. (2016) · Evaluation · doi:10.1177/1356389016652743 · Cited by 294 · see citing works
Self-citationPetticrew, M. P., Rehfuess, E. A., Noyes, J., Higgins, J. P. T., Mayhew, A., Tomás Pantoja, C., Shemilt, I., & Sowden, A. J. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.06.005 · Cited by 292 · see citing works
Self-citationDeconstructing the qualitative-quantitative divide 1
Hammersley, M. (2017) · Routledge eBooks · doi:10.4324/9781315248813-2 · Cited by 272 · see citing works
Mapping the Mixed Methods–Mixed Research Synthesis Terrain
Sandelowski, M., Voils, C. I., Leeman, J., & Crandell, J. (2011) · Journal of Mixed Methods Research · doi:10.1177/1558689811427913 · Cited by 266 · see citing works
Formulating questions to explore complex interventions within qualitative evidence synthesis
Booth, A., Noyes, J., Flemming, K., Moore, G., Tunçalp, Ö., & Shakibazadeh, E. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-001107 · Cited by 258 · see citing works
Self-citationRehfuess, E. A., Stratil, J. M., Scheel, I. B., Portela, A. G., Norris, S. L., & Baltussen, R. M. P. M. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-000844 · Cited by 209 · see citing works
Petticrew, M. P., Knai, C., Thomas, J., Rehfuess, E. A., Noyes, J., Gerhardus, A., Grimshaw, J., Rutter, H., & McGill, E. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-000899 · Cited by 201 · see citing works
Self-citationFood sovereignty, food security and health equity: a meta-narrative mapping exercise
Weiler, A. M., Hergesheimer, C., Brisbois, B., Wittman, H. K., Yassi, A., & Spiegel, J. (2014) · Health Policy and Planning · doi:10.1093/heapol/czu109 · Cited by 194 · see citing works
Raine, R., Fitzpatrick, R. M., Barratt, H., Bevan, G., Black, N. A., Boaden, R., Bower, P., Campbell, M., Denis, J., Devers, K. J., et al. (2016) · Health Services and Delivery Research · doi:10.3310/hsdr04160 · Cited by 187 · see citing works
Self-citationUsing Mixed Methods Research Synthesis for Literature Reviews
Heyvaert, M., Hannes, K., & Onghena, P. (2017) · doi:10.4135/9781506333243 · Cited by 164 · see citing works
Roberts, K. A., Dixon‐Woods, M., Fitzpatrick, R. M., Abrams, K. R., & Jones, D. R. (2002) · The Lancet · doi:10.1016/s0140-6736(02)11560-1 · Cited by 159 · see citing works
O’Cathain, A., Thomas, K. J., Drabble, S. J., Rudolph, A., Goode, J., & Hewison, J. (2014) · Health Technology Assessment · doi:10.3310/hta18380 · Cited by 159 · see citing works
Harden, A., Thomas, J., Cargo, M., Harris, J., Tomás Pantoja, C., Flemming, K., Booth, A., Garside, R., Hannes, K., & Noyes, J. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.11.029 · Cited by 146 · see citing works
Self-citationMixed Methods and Systematic Reviews: Examples and Emerging Issues
Harden, A., & Thomas, J. (2010) · Sage eBooks · doi:10.4135/9781506335193.n29 · Cited by 145 · see citing works
Synthesis of quantitative and qualitative research: an example using Critical Interpretive Synthesis
Flemming, K. (2009) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2009.05173.x · Cited by 129 · see citing works
Self-citationFlemming, K., Booth, A., Hannes, K., Cargo, M., & Noyes, J. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.10.022 · Cited by 128 · see citing works
Self-citationKneale, D., Thomas, J., & Harris, K. (2015) · PLoS ONE · doi:10.1371/journal.pone.0142187 · Cited by 126 · see citing works
Taking account of context in systematic reviews and guidelines considering a complexity perspective
Booth, A., Moore, G. F., Flemming, K., Garside, R., Rollins, N. C., Tunçalp, Ö., & Noyes, J. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-000840 · Cited by 119 · see citing works
Self-citationMixed Methods Intervention Trials
Creswell, J. W., Fetters, M. D., Plano Clark, V. L., & Morales, A. (2009) · Mixed Methods Research for Nursing and the Health Sciences · doi:10.1002/9781444316490.ch9 · Cited by 99 · see citing works
Providing effective and preferred care closer to home: a realist review of intermediate care
Pearson, M., Hunt, H. A., Cooper, C., Shepperd, S., Pawson, R., & Anderson, R. (2015) · Health & Social Care in the Community · doi:10.1111/hsc.12183 · Cited by 76 · see citing works
Tricco, A. C., Antony, J., Soobiah, C., Kastner, M., MacDonald, H. R., Cogo, E., Lillie, E., Tran, J., & Straus, S. E. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.12.011 · Cited by 72 · see citing works
Montgomery, P., Movsisyan, A., Grant, S., Macdonald, G. M., & Rehfuess, E. A. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-000848 · Cited by 72 · see citing works
Chandler, J., Rycroft‐Malone, J., Hawkes, C., & Noyes, J. (2016) · Journal of Advanced Nursing · doi:10.1111/jan.12815 · Cited by 70 · see citing works
Self-citationCargo, M., Harris, J., Tomás Pantoja, C., Booth, A., Harden, A., Hannes, K., Thomas, J., Flemming, K., Garside, R., & Noyes, J. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.11.028 · Cited by 67 · see citing works
Self-citationNoyes, J., Hendry, M., Booth, A., Chandler, J., Lewin, S. A., Glenton, C., & Garside, R. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.12.009 · Cited by 58 · see citing works
Self-citationKelly, M. P., Noyes, J., Kane, R. L., Chang, C., Uhl, S., Robinson, K. A., Springs, S., Butler, M. E., & Guise, J.-M. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.06.012 · Cited by 49 · see citing works
Self-citationMixed Methods Research Prevalence Studies
Molina-Azorín, J. F., & Fetters, M. D. (2016) · Journal of Mixed Methods Research · doi:10.1177/1558689816636707 · Cited by 47 · see citing works
Weir, M., Grimshaw, J., Mayhew, A., & Fergusson, D. A. (2012) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2011.12.012 · Cited by 38 · see citing works
Turley, R., Saith, R., Bhan, N., Doyle, J., Jones, K., & Waters, E. (2013) · Journal of Public Health · doi:10.1093/pubmed/fdt008 · Cited by 18 · see citing works
Flagged first, then by citations
Research works printed but not linked: 2
- [2]de Savigny D, Borghi J, Windish R. Chapter 3. Systems thinging: applying a systems perspective to design and evaluate health systems interventions. In: de Savigny D, Tagheed A, eds. Systems thinging for health systems strengtheing. Geneva: World Health Organisation, 2009.
- [12]Fletcher A, Jamal F, Moore G, et al. Realist complex intervention science: applying realist principles across all phases of the medical research council framework for developing and evaluating complex interventions. Evaluation 2016; 22: 286– 303. 10.1177/1356389016652743 27478401 PMC4946011 · DOI · Paper page
Cited by
Sorted by citations
Methodological guidance for the conduct of mixed methods systematic reviews
Stern, C., Lizarondo, L. M., Carrier, J., Godfrey, C. M., Rieger, K. L., Salmond, S. W., Apóstolo, J., Kirkpatrick, P., & Loveday, H. P. (2020) · JBI Evidence Synthesis · doi:10.11124/jbisrir-d-19-00169 · Cited by 747 · see citing works
Meeting the review family: exploring review types and associated information retrieval requirements
Sutton, A., Clowes, M., Preston, L., & Booth, A. (2019) · Health Information & Libraries Journal · doi:10.1111/hir.12276 · Cited by 570 · see citing works
Self-citationSkivington, K., Matthews, L., Simpson, S. A., Craig, P., Baird, J., Blazeby, J. M., Boyd, K., Craig, N. J., French, D., McIntosh, E., et al. (2021) · Health Technology Assessment · doi:10.3310/hta25570 · Cited by 535 · see citing works
Flemming, K., Booth, A., Garside, R., Tunçalp, Ö., & Noyes, J. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-000882 · Cited by 389 · see citing works
Self-citationQualitative Evidence Synthesis: Where Are We at?
Flemming, K., & Noyes, J. (2021) · International Journal of Qualitative Methods · doi:10.1177/1609406921993276 · Cited by 369 · see citing works
Self-citationSynthesising quantitative evidence in systematic reviews of complex health interventions
Higgins, J. P. T., López-López, J. A., Becker, B. J., Davies, S. R., Dawson, S., Grimshaw, J. M., McGuinness, L. A., Moore, T. H. M., Rehfuess, E. A., Thomas, J., et al. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-000858 · Cited by 322 · see citing works
Waddell, A., Lennox, A., Spassova, G., & Bragge, P. (2021) · Implementation Science · doi:10.1186/s13012-021-01142-y · Cited by 309 · see citing works
Formulating questions to explore complex interventions within qualitative evidence synthesis
Booth, A., Noyes, J., Flemming, K., Moore, G., Tunçalp, Ö., & Shakibazadeh, E. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-001107 · Cited by 258 · see citing works
Self-citationHealth system resilience: a literature review of empirical research
Biddle, L., Wahedi, K., & Bozorgmehr, K. (2020) · Health Policy and Planning · doi:10.1093/heapol/czaa032 · Cited by 273 · see citing works
Innovations in framework synthesis as a systematic review method
Brunton, G., Oliver, S. R., & Thomas, J. (2020) · Research Synthesis Methods · doi:10.1002/jrsm.1399 · Cited by 237 · see citing works
Methodological guidance for the conduct of mixed methods systematic reviews
Stern, C., Lizarondo, L. M., Carrier, J., Godfrey, C. M., Rieger, K. L., Salmond, S. W., Apóstolo, J., Kirkpatrick, P., & Loveday, H. P. (2021) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000282 · Cited by 214 · see citing works
Petticrew, M. P., Knai, C., Thomas, J., Rehfuess, E. A., Noyes, J., Gerhardus, A., Grimshaw, J., Rutter, H., & McGill, E. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-000899 · Cited by 201 · see citing works
Self-citationDigital contact tracing technologies in epidemics: a rapid review
Anglemyer, A. T., Moore, T. H., Parker, L., Chambers, T. J., Grady, A., Chiu, K., Parry, M. F., Wilczynska, M., Flemyng, E., & Bero, L. A. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013699 · Cited by 204 · see citing works
Rehfuess, E. A., Stratil, J. M., Scheel, I. B., Portela, A. G., Norris, S. L., & Baltussen, R. M. P. M. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-000844 · Cited by 209 · see citing works
Climate change, mental health, and reproductive decision-making: A systematic review
Dillarstone, H., Brown, L. J., & Flores, E. C. (2023) · PLOS Climate · doi:10.1371/journal.pclm.0000236 · Cited by 165 · see citing works
Noyes, J., Booth, A., Cargo, M., Flemming, K., Harden, A., Harris, J., Garside, R., Hannes, K., Tomás Pantoja, C., & Thomas, J. (2019) · Wiley eBooks · doi:10.1002/9781119536604.ch21 · Cited by 161 · see citing works
Self-citationHult, M., Terkamo‐Moisio, A., Kaakinen, P., Karki, S., Nurmeksela, A., Palonen, M., Peltonen, L., & Häggman‐Laitila, A. (2023) · Nursing Open · doi:10.1002/nop2.1876 · Cited by 131 · see citing works
Jones, A., Blake, J., Adams, M., Kelly, D. M., Mannion, R., & Maben, J. (2021) · Health Policy · doi:10.1016/j.healthpol.2020.12.016 · Cited by 127 · see citing works
Taking account of context in systematic reviews and guidelines considering a complexity perspective
Booth, A., Moore, G. F., Flemming, K., Garside, R., Rollins, N. C., Tunçalp, Ö., & Noyes, J. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-000840 · Cited by 119 · see citing works
Self-citationNursing students' professional identity development: An integrative review
Vabo, G., Slettebø, Å., & Fossum, M. (2022) · Nordic Journal of Nursing Research · doi:10.1177/20571585211029857 · Cited by 121 · see citing works
Application of IoT in Healthcare: Keys to Implementation of the Sustainable Development Goals
Espinosa, Á. V., Ruiz, J. L. L., Mata, F., & Espinilla, M. (2021) · Sensors · doi:10.3390/s21072330 · Cited by 115 · see citing works
A systematic review and framework for digital leadership research maturity in higher education
Jameson, J., Rumyantseva, N. L., Cai, M., Markowski, M., Essex, R., & McNay, I. (2022) · Computers and Education Open · doi:10.1016/j.caeo.2022.100115 · Cited by 177 · see citing works
Schneider, J., Pegram, G., Gibson, B., Talamonti, D., Tinoco, A., Craddock, N., Matheson, E. L., & Forshaw, M. J. (2022) · International Journal of Eating Disorders · doi:10.1002/eat.23706 · Cited by 114 · see citing works
Skinner, G. C. M., Bywaters, P., & Kennedy, E. (2022) · Child Abuse Review · doi:10.1002/car.2795 · Cited by 87 · see citing works
Lafortune, D., Blais, M., Miller, G., Dion, L., Lalonde, F., & Dargis, L. (2021) · Archives of Sexual Behavior · doi:10.1007/s10508-020-01741-8 · Cited by 105 · see citing works
Peryer, G., Kelly, S. A., Blake, J., Burton, J. K., Irvine, L., Cowan, A., Akdur, G., Killett, A., Brand, S. L., Musa, M. K., et al. (2022) · Age and Ageing · doi:10.1093/ageing/afac014 · Cited by 79 · see citing works
Chung, S., Marlow, S., Tobias, N., Alogna, A., Alogna, I., You, S., Khunti, K. K., McKee, M., Michie, S., & Pillay, D. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-047832 · Cited by 84 · see citing works
Ade-Ojo, G. O., Markowski, M., Essex, R., Stiell, M., & Jameson, J. (2022) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12653 · Cited by 93 · see citing works
Mörelius, E., Robinson, S., Arabiat, D. H., & Whitehead, L. (2021) · Journal of Medical Internet Research · doi:10.2196/31665 · Cited by 79 · see citing works
Promoting Physical Activity Through Conversational Agents: Mixed Methods Systematic Review
Luo, T. C., Aguilera, A., Lyles, C. R., & Figueroa, C. A. (2021) · Journal of Medical Internet Research · doi:10.2196/25486 · Cited by 68 · see citing works
Decolonising research approaches towards non-extractive research
Igwe, P. A., Madichie, N. O., & Rugara, D. G. (2022) · Qualitative Market Research An International Journal · doi:10.1108/qmr-11-2021-0135 · Cited by 74 · see citing works
Meehan, D. E., Grunseit, A. C., Condie, J., HaGani, N., & Merom, D. (2023) · BMC Geriatrics · doi:10.1186/s12877-023-04418-8 · Cited by 79 · see citing works
A comprehensive guide to conduct a systematic review and meta-analysis in medical research
Martinez, E. C., Hasbun, P. G., Vargas, V. P. S., González, O. Y. G., Madera, M. D. F., Rueda-Capristran, D. E., Carmona, T. C., Cruz, C. S., & Hooper, C. T. (2025) · Medicine · doi:10.1097/md.0000000000041868 · Cited by 95 · see citing works
Baudinet, J., Eisler, I., Dawson, L., Simic, M., & Schmidt, U. H. (2021) · International Journal of Eating Disorders · doi:10.1002/eat.23616 · Cited by 71 · see citing works
Martinez‐Santos, A., de la Iglesia, J. D. C. F., Sheaf, G., & Coyne, I. (2021) · Journal of Advanced Nursing · doi:10.1111/jan.14784 · Cited by 69 · see citing works
Anudjo, M. N. K., Vitale, C. H., Elshami, W., Hancock, A., Adeleke, S. M., Franklin, J. M., & Akudjedu, T. N. (2023) · Radiography · doi:10.1016/j.radi.2023.09.006 · Cited by 72 · see citing works
Reflections on project ECHO: qualitative findings from five different ECHO programs
Agley, J. D., Delong, J., Janota, A. D., Carson, A. T., Roberts, J., & Maupomé, G. (2021) · Medical Education Online · doi:10.1080/10872981.2021.1936435 · Cited by 66 · see citing works
Dance for Chronic Pain Conditions: A Systematic Review
Hickman, B., Pourkazemi, F., Pebdani, R. N., Hiller, C. E., & Yan, A. F. (2022) · Pain Medicine · doi:10.1093/pm/pnac092 · Cited by 67 · see citing works
Status and determinants of enrollment and dropout of health insurance in Nepal: an explorative study
Ranabhat, C. L., Subedi, R., & Karn, S. (2020) · Cost Effectiveness and Resource Allocation · doi:10.1186/s12962-020-00227-7 · Cited by 65 · see citing works
Dakic, J. G., Hay‐Smith, J., Cook, J. L., Lin, K., Calo, M., & Frawley, H. (2021) · Journal of Orthopaedic and Sports Physical Therapy · doi:10.2519/jospt.2021.10200 · Cited by 65 · see citing works
Conducting and Writing Quantitative and Qualitative Research
Barroga, E. F., Matanguihan, J. B., Furuta, A., Arima, M., Tsuchiya, S., Kawahara, C., Takamiya, Y., & Izumi, M. (2023) · Journal of Korean Medical Science · doi:10.3346/jkms.2023.38.e291 · Cited by 63 · see citing works
Rodríguez-Abad, C., de la Iglesia, J. D. C. F., Martinez‐Santos, A., & Rodríguez‐González, R. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18084262 · Cited by 62 · see citing works
Norris, S. L., Rehfuess, E. A., Smith, H. E., Tunçalp, Ö., Grimshaw, J., Ford, N. P., & Portela, A. G. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-000963 · Cited by 62 · see citing works
Self-citationBray, N., Kolehmainen, N., McAnuff, J., Tanner, L., Tuersley, L., Beyer, F. R., Grayston, A., Wilson, D., Edwards, R. T., Noyes, J., et al. (2020) · Health Technology Assessment · doi:10.3310/hta24500 · Cited by 62 · see citing works
Self-citationA review of methods for addressing components of interventions in meta-analysis
Πετροπούλου, Μ., Efthimiou, O., Rücker, G., Schwarzer, G., Furukawa, T. A., Pompoli, A., Koek, H. L., Giovane, C. D., Rodondi, N., & Mavridis, D. (2021) · PLoS ONE · doi:10.1371/journal.pone.0246631 · Cited by 60 · see citing works
Towards remote leadership in health care: Lessons learned from an integrative review
Terkamo‐Moisio, A., Karki, S., Kangasniemi, M. K., Lammintakanen, J., & Häggman‐Laitila, A. (2021) · Journal of Advanced Nursing · doi:10.1111/jan.15028 · Cited by 63 · see citing works
Registered nurses' perceptions of having a calling to nursing: A mixed‐method study
Kallio, H., Kangasniemi, M. K., & Hult, M. (2022) · Journal of Advanced Nursing · doi:10.1111/jan.15157 · Cited by 58 · see citing works
Gram, L., Fitchett, A., Ashraf, A., Daruwalla, N., & Osrin, D. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2019-001972 · Cited by 56 · see citing works
Darley, S., Coulson, T., Peek, N., Moschogianis, S., van der Veer, S. N., Wong, D. C., & Brown, B. C. (2022) · Journal of Medical Internet Research · doi:10.2196/37436 · Cited by 53 · see citing works
Kneale, D., Rojas‐García, A., & Thomas, J. (2019) · Health Research Policy and Systems · doi:10.1186/s12961-019-0446-x · Cited by 54 · see citing works
Essex, R., Kalocsányiová, E., Rumyantseva, N. L., & Jameson, J. (2021) · Journal of International Migration and Integration / Revue de l integration et de la migration internationale · doi:10.1007/s12134-021-00850-0 · Cited by 56 · see citing works
Niño de Guzmán Quispe, E., Martínez García, L., Orrego Villagrán, C., Heijmans, M., Sunol, R., Fraile-Navarro, D., Pérez-Bracchiglione, J., Ninov, L., Salas-Gama, K., Viteri García, A., et al. (2021) · The Patient - Patient-Centered Outcomes Research · doi:10.1007/s40271-021-00514-2 · Cited by 54 · see citing works
Hospital surge capacity preparedness in disasters and emergencies: a systematic review
Hasan, M. K., Nasrullah, S. M., Quattrocchi, A., González, P. I. A., & Delgado, R. C. (2023) · Public Health · doi:10.1016/j.puhe.2023.09.017 · Cited by 55 · see citing works
Foong, H. F., Kyaw, B. M., Upton, Z., & Car, L. T. (2020) · International Wound Journal · doi:10.1111/iwj.13396 · Cited by 54 · see citing works
Health service use among adults with cerebral palsy: a mixed‐methods systematic review
Manikandan, M., Kerr, C., Lavelle, G., Walsh, M. P., Walsh, A., & Ryan, J. M. (2021) · Developmental Medicine & Child Neurology · doi:10.1111/dmcn.15097 · Cited by 51 · see citing works
González‐González, A. I., Schmucker, C. M., Nothacker, J., Nury, E., Dinh, T. S., Brueckle, M.-S., Blom, J. W., van den Akker, M., Röttger, K., Wegwarth, O., et al. (2020) · Journal of Clinical Medicine · doi:10.3390/jcm10010091 · Cited by 53 · see citing works
Greenfield, K., Holley, S., Schoth, D. E., Harrop, E. J., Howard, R. F., Bayliss, J., Brook, L. A., Jassal, S. S., Johnson, M., Wong, I. C. K., et al. (2020) · Palliative Medicine · doi:10.1177/0269216320907065 · Cited by 52 · see citing works
Madsgaard, A., Smith‐Strøm, H., Hunskår, I., & Røykenes, K. (2021) · Nursing Open · doi:10.1002/nop2.1100 · Cited by 51 · see citing works
Crooks, J., Trotter, S., Obe, R. B., Monaghan, E., & Clarke, G. (2023) · BMC Palliative Care · doi:10.1186/s12904-023-01168-7 · Cited by 50 · see citing works
Brown, M. J., McCann, E., Truesdale, M., Linden, M., & Marsh, L. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17207568 · Cited by 47 · see citing works
Akudjedu, T., Mishio, N., Elshami, W., Culp, M., Lawal, O., Botwe, B., Wuni, A.-R., Julka-Anderson, N., Shanahan, M., Totman, J., et al. (2021) · Radiography · doi:10.1016/j.radi.2021.07.004 · Cited by 44 · see citing works
Integrated malaria prevention in low- and middle-income countries: a systematic review
Musoke, D., Atusingwize, E., Namata, C., Ndejjo, R., Wanyenze, R. K., & Kamya, M. R. (2023) · Malaria Journal · doi:10.1186/s12936-023-04500-x · Cited by 47 · see citing works
An integrative review of the factors influencing older nurses’ timing of retirement
Markowski, M., Cleaver, K., & Weldon, S. M. (2020) · Journal of Advanced Nursing · doi:10.1111/jan.14442 · Cited by 47 · see citing works
The use of GRADE-CERQual in qualitative evidence synthesis: an evaluation of fidelity and reporting
Wainwright, M., Zahroh, R. I., Tunçalp, Ö., Booth, A., Bohren, M. A., Noyes, J., Cheng, W., Munthe‐Kaas, H. M., & Lewin, S. A. (2023) · Health Research Policy and Systems · doi:10.1186/s12961-023-00999-3 · Cited by 48 · see citing works
Self-citationField, S. L., Williams, M. O., Jones, C. R. G., & Fox, J. R. E. (2024) · Autism · doi:10.1177/13623613231223036 · Cited by 45 · see citing works
Social Needs Resource Connections: A Systematic Review of Barriers, Facilitators, and Evaluation
Steeves-Reece, A. L., Totten, A. M., Broadwell, K. D., Richardson, D. M., Nicolaidis, C., & Davis, M. M. (2022) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2021.12.002 · Cited by 47 · see citing works
Five common pitfalls in mixed methods systematic reviews: lessons learned
Lizarondo, L. M., Stern, C., Apóstolo, J., Carrier, J., dos Santos, K. B., Godfrey, C. M., Kirkpatrick, P., Pollock, D., Rieger, K. L., Salmond, S. W., et al. (2022) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2022.03.014 · Cited by 44 · see citing works
Cunha, A. S., Pedro, A. R., & Cordeiro, J. V. (2023) · Journal of Medical Internet Research · doi:10.2196/44188 · Cited by 45 · see citing works
Minckas, N., Gram, L., Smith, C. J., & Mannell, J. (2021) · BMJ Global Health · doi:10.1136/bmjgh-2020-004698 · Cited by 42 · see citing works
Prosocial Interventions and Health Outcomes
Byrne, M., Tan, R. K. J., Wu, D., Marley, G., Hlatshwako, T. G., Tao, Y., Bissram, J., Nachman, S., Tang, W., Ramaswamy, R., et al. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.46789 · Cited by 43 · see citing works
Lizarondo, L. M., Stern, C., Salmond, S. W., Carrier, J., Cooper, K., Godfrey, C. M., Vandyk, M., Pollock, D., Rieger, K. L., Apóstolo, J., et al. (2025) · JBI Evidence Synthesis · doi:10.11124/jbies-24-00331 · Cited by 41 · see citing works
Shang, Z., Wanyan, P., Zhang, B., Wang, M., & Wang, X. (2023) · Stem cell research & therapeutics · doi:10.1186/s13287-023-03332-5 · Cited by 34 · see citing works
Maynard, C., Tariq, S., Sotgiu, G., Migliori, G. B., van den Boom, M., & Field, N. (2023) · eClinicalMedicine · doi:10.1016/j.eclinm.2023.102057 · Cited by 44 · see citing works
Sapeta, P., Centeno, C., Belar, A., & Arantzamendi, M. (2021) · Palliative Medicine · doi:10.1177/02692163211047149 · Cited by 42 · see citing works
Iroegbu, C., Tuot, D. S., Lewis, L. M., & Matura, L. A. (2024) · Journal of Advanced Nursing · doi:10.1111/jan.16492 · Cited by 39 · see citing works
Huang, A., Hong, W., Zhao, B., Lin, J., Rui, X., & Wang, Y. (2022) · Nursing Open · doi:10.1002/nop2.1384 · Cited by 39 · see citing works
Griffiths, R., Dawber, A., McDougall, T., Midgley, S., & Baker, J. A. (2021) · International Journal of Mental Health Nursing · doi:10.1111/inm.12940 · Cited by 38 · see citing works
Interventions to Prevent Potentially Avoidable Hospitalizations: A Mixed Methods Systematic Review
Lyhne, C. N., Bjerrum, M. B., Riis, A. H., & Jørgensen, M. J. (2022) · Frontiers in Public Health · doi:10.3389/fpubh.2022.898359 · Cited by 42 · see citing works
Darlington, C. K., Clark, R. R. S., Jacoby, S. F., Terplan, M., Alexander, K., & Compton, P. A. (2023) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2023.110944 · Cited by 37 · see citing works
Watts, G., Crompton, C. J., Grainger, C., Long, J., Botha, M., Somerville, M., & Cage, E. (2024) · Autism · doi:10.1177/13623613241255811 · Cited by 36 · see citing works
Peer support for people living with rare or young onset dementia: An integrative review
Sullivan, M. P., Williams, V., Grillo, A., McKee‐Jackson, R., Camic, P. M., Windle, G., Stott, J. C. H., Brotherhood, E., & Crutch, S. J. (2022) · Dementia · doi:10.1177/14713012221126368 · Cited by 36 · see citing works
Cooper, D., Uppal, D., Railey, K. S., Wilson, A. B., Maras, K., Zimmerman, E., Bornman, J., & Shea, L. (2022) · Autism · doi:10.1177/13623613211070341 · Cited by 35 · see citing works
Balushi, H. A., Watts, H., & Akudjedu, T. N. (2024) · Radiography · doi:10.1016/j.radi.2024.01.012 · Cited by 36 · see citing works
Osborne, E. L., Ainsworth, B., Hooper, N., & Atkinson, M. J. (2023) · Journal of Medical Internet Research · doi:10.2196/44220 · Cited by 37 · see citing works
Bui, P., Pongsakdi, N., McMullen, J. A., Lehtinen, E., & Hannula‐Sormunen, M. M. (2023) · Educational Research Review · doi:10.1016/j.edurev.2023.100554 · Cited by 44 · see citing works
Wolverson, E., Dunn, R., Moniz-Cook, E. D., Gove, D., & Diaz-Ponce, A. M. (2021) · Journal of Advanced Nursing · doi:10.1111/jan.14787 · Cited by 33 · see citing works
Mbakaya, B. C., Kalembo, F. W., & Zgambo, M. (2020) · BMC Public Health · doi:10.1186/s12889-020-09101-w · Cited by 32 · see citing works
Padigos, J., Reid, S. A., Kirby, E. R., & Broom, J. K. (2020) · Journal of Hospital Infection · doi:10.1016/j.jhin.2020.12.003 · Cited by 33 · see citing works
Non-pharmacological interventions for sleep disturbances in people with dementia
Wilfling, D., Calo, S., Dichter, M. N., Meyer, G., Möhler, R., & Köpke, S. (2023) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011881.pub2 · Cited by 59 · see citing works
Osokpo, O. H., James, R., & Riegel, B. J. (2021) · Journal of Advanced Nursing · doi:10.1111/jan.14804 · Cited by 30 · see citing works
Sud, D., Laughton, E., McAskill, R., Bradley, E., & Maidment, I. D. (2021) · Systematic Reviews · doi:10.1186/s13643-021-01586-9 · Cited by 30 · see citing works
The impact of strike action on healthcare delivery: A scoping review
Essex, R., Ahmed, S., Elliott, H., Lakika, D. M., Mackenzie, L., & Weldon, S. M. (2022) · The International Journal of Health Planning and Management · doi:10.1002/hpm.3610 · Cited by 29 · see citing works
Evans, R., MacDonald, S., Trubey, R., Noyes, J., Robling, M., Willis, S., Boffey, M., Wooders, C., Vinnicombe, S., & Melendez-Torres, G. J. (2023) · Systematic Reviews · doi:10.1186/s13643-023-02260-y · Cited by 29 · see citing works
Self-citationTunnicliffe, D. J., Bateman, S. M., Arnold‐Chamney, M., Dwyer, K. M., Howell, M., Gebadi, A., Jesudason, S., Kelly, J., Lambert, K., Majoni, S. W., et al. (2023) · The Medical Journal of Australia · doi:10.5694/mja2.52114 · Cited by 29 · see citing works
Challenges in heart failure care in four European countries: a comparative study
Steiner, B., Neumann, A., Pelz, Y., Ski, C. F., Hill, L., Thompson, D. R., Fitzsimons, D., Dixon, L., Brandts, J., Verket, M., et al. (2023) · European Journal of Public Health · doi:10.1093/eurpub/ckad059 · Cited by 28 · see citing works
Alsaggaf, F., & Coyne, I. (2020) · Journal of Advanced Nursing · doi:10.1111/jan.14404 · Cited by 27 · see citing works
Léger, A., Lambraki, I. A., Graells, T., Cousins, M., Henriksson, P. J. G., Harbarth, S., Carson, C. A., Majowicz, S. E., Troell, M. F., Parmley, E. J., et al. (2021) · BMC Infectious Diseases · doi:10.1186/s12879-021-06483-z · Cited by 27 · see citing works
Feeley, C., Crossland, N., Betrán, A. P., Weeks, A. D., Downe, S. M., & Kingdon, C. (2021) · Reproductive Health · doi:10.1186/s12978-021-01146-3 · Cited by 27 · see citing works
The impact of strike action on patient morbidity: A systematic literature review
Essex, R., Milligan, W., Williams, G., & Weldon, S. M. (2022) · The International Journal of Health Planning and Management · doi:10.1002/hpm.3418 · Cited by 27 · see citing works
Petticrew, M. P., Glover, R. E., Volmink, J. A., Blanchard, L., Cott, É., Knai, C., Maani, N., Thomas, J., Tompson, A., van Schalkwyk, M. C., et al. (2023) · Systematic Reviews · doi:10.1186/s13643-023-02323-0 · Cited by 27 · see citing works
- Authors
- Noyes, J., Booth, A., Moore, G., Flemming, K., Tunçalp, Ö., & Shakibazadeh, E.
- Affiliations
- Bangor University (GB)
- University of Sheffield (GB)
- Cardiff University (GB)
- University of York (GB)
- World Health Organization (CH)
- Tehran University of Medical Sciences (IR)
- Corresponding author
- Noyes, Jane
- Venue
- BMJ Global Health
- Publisher
- BMJ
- Published
- 2019-01
- Volume
- 4
- Issue
- Suppl 1
- Pages
- e000893
- ISSN
- 2059-7908 (ISSN-L)
- PMC
- PMC6350750
- OpenAlex
- W2906715785
- Cited by
- 497
- References
- 63
- Citations by year
- 2026: 70 · 2025: 80 · 2024: 83 · 2023: 66 · 2022: 51 · 2021: 83 · 2020: 49 · 2019: 13 · 2015: 1 · 2012: 1
- Type
- conference abstract
- Language
- en
- Open access
- gold
- doi.org
- Locations
- BMJ Global Health (publishedVersion, cc-by-nc)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- White Rose Research Online (University of Leeds, The University of Sheffield, University of York) (acceptedVersion)
- ORCA Online Research @Cardiff (Cardiff University) (acceptedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- Funding provided by the World Health Organization Department of Maternal, Newborn, Child and Adolescent Health through a grant received from the United States Agency for International Development.
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- complex interventions, evidence synthesis, clinical guideline development, WHO guidelines, complexity perspective
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review