RAMESES publication standards: realist syntheses
Abstract
Background: There is growing interest in realist synthesis as an alternative systematic review method. This approach offers the potential to expand the knowledge base in policy‐relevant areas – for example, by explaining the success, failure or mixed fortunes of complex interventions. No previous publication standards exist for reporting realist syntheses. This standard was developed as part of the RAMESES (Realist And ME ta‐narrative Evidence Syntheses: Evolving Standards) project. The project's aim is to produce preliminary publication standards for realist systematic reviews. Design: A mixed method study synthesising data between 2011–2012 from a literature review, online Delphi panel and feedback from training, workshops and email list. Methods: We: (a) collated and summarized existing literature on the principles of good practice in realist syntheses; (b) considered the extent to which these principles had been followed by published syntheses, thereby identifying how rigour may be lost and how existing methods could be improved; (c) used a three‐round online Delphi method with an interdisciplinary panel of national and international experts in evidence synthesis, realist research, policy and/or publishing to produce and iteratively refine a draft set of methodological steps and publication standards; (d) provided real‐time support to ongoing realist syntheses and the open‐access RAMESES online discussion list to capture problems and questions as they arose; and (e) synthesized expert input, evidence syntheses and real‐time problem analysis into a definitive set of standards. Results: We identified 35 published realist syntheses, provided real‐time support to 9 ongoing syntheses and captured questions raised in the RAMESES discussion list. Through analysis and discussion within the project team, we summarized the published literature and common questions and challenges into briefing materials for the Delphi panel, comprising 37 members. Within 3 rounds this panel had reached consensus on 19 key publication standards, with an overall response rate of 91%. Conclusions: This project used multiple sources to develop and draw together evidence and expertise in realist synthesis. For each item we have included an explanation for why it is important and guidance on how it might be reported. Realist synthesis is a relatively new method for evidence synthesis and as experience and methodological developments occur, we anticipate that these standards will evolve to reflect further methodological developments. We hope that these standards will act as a resource that will contribute to improving the reporting of realist syntheses.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Wong et al. state that realist reviews reveal what policy makers or practitioners might put in place to change the context or provide resources in such a way as to most likely trigger the right mechanism(s) to produce the desired outcome.
“Wong et al33 states that realist reviews reveal ‘what policy makers or practitioners might put in place to change the context or provide resources in such a way as to most likely trigger the right mechanism(s) to produce the desired outcome’.”
From mHealth text and voice communication for monitoring people with chronic diseases in low-resource settings: a realist review (2018) · cites this paper as [33]
Cites
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164 · see citing works
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gotzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · BMJ · doi:10.1136/bmj.b2700 · Cited by 17,648 · see citing works
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gotzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c869 · Cited by 8,883 · see citing works
AGREE II: advancing guideline development, reporting and evaluation in health care
Brouwers, M. C., Kho, M. E., Browman, G. P., Burgers, J. S., Cluzeau, F., Feder, G., Fervers, B., Graham, I. D., Grimshaw, J., Hanna, S. E., et al. (2010) · Canadian Medical Association Journal · doi:10.1503/cmaj.090449 · Cited by 3,790 · see citing works
Realist review - a new method of systematic review designed for complex policy interventions
Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2005) · Journal of Health Services Research & Policy · doi:10.1258/1355819054308530 · Cited by 3,190 · see citing works
Self-citationSynthesising qualitative and quantitative evidence: A review of possible methods
Dixon-Woods, M., Agarwal, S., Jones, D., Young, B., & Sutton, A. (2005) · Journal of Health Services Research & Policy · doi:10.1177/135581960501000110 · Cited by 2,132 · see citing works
Methods for the synthesis of qualitative research: a critical review
Barnett-Page, E., & Thomas, J. (2009) · BMC Medical Research Methodology · doi:10.1186/1471-2288-9-59 · Cited by 2,087 · see citing works
Pawson, R. (2006) · doi:10.4135/9781849209120 · Cited by 1,791 · see citing works
Self-citationJAGOSH, J., MACAULAY, A. C., PLUYE, P., SALSBERG, J., BUSH, P. L., HENDERSON, J., SIRETT, E., WONG, G., CARGO, M., HERBERT, C. P., et al. (2012) · The Milbank Quarterly · doi:10.1111/j.1468-0009.2012.00665.x · Cited by 1,268 · see citing works
Self-citationIntroduction to Systematic Reviews
(2013) · Active Learning Exercises · doi:10.21019/ale.2000.252 · Cited by 1,239 · see citing works
Unpacking black boxes: mechanisms and theory building in evaluation
Astbury, B., & Leeuw, F. L. (2010) · American Journal of Evaluation · doi:10.1177/1098214010371972 · Cited by 850 · see citing works
Realist synthesis: illustrating the method for implementation research
Rycroft-Malone, J., McCormack, B., Hutchinson, A. M., DeCorby, K., Bucknall, T. K., Kent, B., Schultz, A., Snelgrove-Clarke, E., Stetler, C. B., Titler, M., et al. (2012) · Implementation Science · doi:10.1186/1748-5908-7-33 · Cited by 742 · see citing works
Evidence-based policy: the promise of ‘realist synthesis’
Pawson, R. (2002) · Evaluation · doi:10.1177/135638902401462448 · Cited by 729 · see citing works
Self-citationRealist synthesis - an introduction
Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2004) · UCL Discovery (University College London) · Cited by 570 · see citing works
Self-citationIntroduction to systematic reviews
O’Connor, E., Whitlock, E. P., & Spring, B. J. (2011) · PsycEXTRA Dataset · doi:10.1037/e657462011-001 · Cited by 463 · see citing works
Internet-based medical education: a realist review of what works, for whom and in what circumstances
Wong, G., Greenhalgh, T., & Pawson, R. (2010) · BMC Medical Education · doi:10.1186/1472-6920-10-12 · Cited by 443 · see citing works
Self-citationCan We Systematically Review Studies That Evaluate Complex Interventions?
Shepperd, S., Lewin, S., Straus, S., Clarke, M., Eccles, M. P., Fitzpatrick, R., Wong, G., & Sheikh, A. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000086 · Cited by 408 · see citing works
Self-citationRealist methods in medical education research: what are they and what can they contribute?
Wong, G., Greenhalgh, T., Westhorp, G., & Pawson, R. (2011) · Medical Education · doi:10.1111/j.1365-2923.2011.04045.x · Cited by 405 · see citing works
Self-citationOn Theoretical Sociology: Five Essays, Old and New
Merton, R. Κ. (1967) · Cited by 348 · see citing works
Kastner, M., Tricco, A. C., Soobiah, C., Lillie, E., Perrier, L., Horsley, T., Welch, V., Cogo, E., Antony, J., & Straus, S. E. (2012) · BMC Medical Research Methodology · doi:10.1186/1471-2288-12-114 · Cited by 345 · see citing works
Protocol - realist and meta-narrative evidence synthesis: Evolving Standards (RAMESES)
Greenhalgh, T., Wong, G., Westhorp, G., & Pawson, R. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-115 · Cited by 279 · see citing works
Self-citationDieleman, M. A., Gerretsen, B., & van der Wilt, G. J. (2009) · Health Research Policy and Systems · doi:10.1186/1478-4505-7-7 · Cited by 247 · see citing works
Davidoff, F., Batalden, P. B., Stevens, D., Ogrinc, G. S., Mooney, S. E., & for the SQUIRE development group (2009) · BMJ · doi:10.1136/bmj.a3152 · Cited by 154 · see citing works
Known Knowns, Known Unknowns, Unknown Unknowns
Pawson, R., Wong, G., & Owen, L. (2011) · American Journal of Evaluation · doi:10.1177/1098214011403831 · Cited by 139 · see citing works
Self-citationKane, S. S., Gerretsen, B., Scherpbier, R. W., Poz, M. R. D., & Dieleman, M. A. (2010) · BMC Health Services Research · doi:10.1186/1472-6963-10-286 · Cited by 131 · see citing works
Publication Guidelines for Improvement Studies in Health Care: Evolution of the SQUIRE Project
Davidoff, F., Batalden, P. B., Stevens, D., Ogrinc, G. S., Mooney, S. E., & for the SQUIRE Development Group* (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-149-9-200811040-00009 · Cited by 130 · see citing works
Synthesizing Qualitative and Quantitative Health Research: A Guide to Methods
Pope, C. J., Mays, N., & Popay, J. (2007) · ePrints Soton (University of Southampton) · Cited by 112 · see citing works
Jackson, L., Langille, L., Lyons, R., Hughes, J., Martin, D., & Winstanley, V. (2009) · Health and Place · doi:10.1016/j.healthplace.2009.03.003 · Cited by 90 · see citing works
Policy guidance on threats to legislative interventions in public health: a realist synthesis
Wong, G., Pawson, R., & Owen, L. (2011) · BMC Public Health · doi:10.1186/1471-2458-11-222 · Cited by 65 · see citing works
Self-citationProtocol: a realist review of user fee exemption policies for health services in Africa
Robert, É., Ridde, V., Marchal, B., & Fournier, P. F. (2012) · BMJ Open · doi:10.1136/bmjopen-2011-000706 · Cited by 40 · see citing works
Realist review and synthesis of retention studies for health workers in rural and remote areas
Dieleman, M. A., Kane, S. S., Zwanikken, P. A. C., & Gerretsen, B. (2011) · Data Archiving and Networked Services (DANS) · Cited by 33 · see citing works
Pearson, M., & Coomber, R. (2009) · Addiction · doi:10.1111/j.1360-0443.2009.02713.x · Cited by 18 · see citing works
The Internet in Medical Education: A Worked Example of a Realist Review
Wong, G. (2011) · Wiley eBooks · doi:10.1002/9781119959847.ch5 · Cited by 15 · see citing works
Self-citation
Flagged first, then by citations
1 of the 34 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Time to challenge the spurious hierarchy of systematic over narrative reviews?
Greenhalgh, T., Thorne, S., & Malterud, K. (2018) · European Journal of Clinical Investigation · doi:10.1111/eci.12931 · Cited by 1,267 · see citing works
Self-citationWhat’s in a mechanism? Development of a key concept in realist evaluation
Dalkin, S. M., Greenhalgh, J., Jones, D., Cunningham, B., & Lhussier, M. (2015) · Implementation Science · doi:10.1186/s13012-015-0237-x · Cited by 896 · see citing works
RAMESES II reporting standards for realist evaluations
Wong, G., Westhorp, G., Manzano, A., Greenhalgh, J., Jagosh, J., & Greenhalgh, T. (2016) · BMC Medicine · doi:10.1186/s12916-016-0643-1 · Cited by 880 · see citing works
Self-citationPage, M. J., & Moher, D. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0663-8 · Cited by 769 · see citing works
Hong, Q. N., Pluye, P., Bujold, M., & Wassef, M. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0454-2 · Cited by 754 · see citing works
Miake-Lye, I. M., Hempel, S., Shanman, R., & Shekelle, P. G. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0204-x · Cited by 660 · see citing works
“Best fit” framework synthesis: refining the method
Carroll, C., Booth, A., Leaviss, J., & Rick, J. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-37 · Cited by 649 · see citing works
Greenhalgh, J., Gooding, K., Gibbons, E. J., Dalkin, S. M., Wright, J. M., Valderas, J. M., & Black, N. A. (2018) · Journal of Patient-Reported Outcomes · doi:10.1186/s41687-018-0061-6 · Cited by 597 · see citing works
Booth, A. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0249-x · Cited by 587 · see citing works
Skivington, K., Matthews, L., Simpson, S. A., Craig, P., Baird, J., Blazeby, J. M., Boyd, K., Craig, N. J., French, D., McIntosh, E., et al. (2021) · Health Technology Assessment · doi:10.3310/hta25570 · Cited by 535 · see citing works
Adams, J., Hillier-Brown, F. C., Moore, H. J., Lake, A. A., Araujo-Soares, V., White, M., & Summerbell, C. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0337-y · Cited by 486 · see citing works
What approaches to social prescribing work, for whom, and in what circumstances? A realist review
Husk, K., Blockley, K. V., Lovell, R., Bethel, A. C., Lang, I., Byng, R., & Garside, R. (2019) · Health & Social Care in the Community · doi:10.1111/hsc.12839 · Cited by 386 · see citing works
Wiltshire, G., & Ronkainen, N. J. (2021) · Journal of Critical Realism · doi:10.1080/14767430.2021.1894909 · Cited by 403 · see citing works
Karafillakis, E., Simas, C., Jarrett, C., Verger, P., Peretti-Watel, P., Dib, F., De Angelis, S., Takacs, J., Ali, K. A., Pastore Celentano, L., et al. (2019) · Human Vaccines & Immunotherapeutics · doi:10.1080/21645515.2018.1564436 · Cited by 328 · see citing works
Gray, P., Senabe, S., Naicker, N., Kgalamono, S., Yassi, A., & Spiegel, J. M. (2019) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph16224396 · Cited by 295 · see citing works
Smits, D.-W., van Meeteren, K., Klem, M., Alsem, M., & Ketelaar, M. (2020) · Research Involvement and Engagement · doi:10.1186/s40900-020-00188-4 · Cited by 295 · see citing works
Fletcher, A., Jamal, F., Moore, G., Evans, R. E., Murphy, S., & Bonell, C. (2016) · Evaluation · doi:10.1177/1356389016652743 · Cited by 294 · see citing works
Lacouture, A., Breton, É., Guichard, A., & Ridde, V. (2015) · Implementation Science · doi:10.1186/s13012-015-0345-7 · Cited by 295 · see citing works
A time-responsive tool for informing policy making: rapid realist review
Saul, J. E., Willis, C. D., Bitz, J., & Best, A. (2013) · Implementation Science · doi:10.1186/1748-5908-8-103 · Cited by 278 · see citing works
Abímbọ́lá, Ṣ., Baatiema, L., & Bigdeli, M. (2019) · Health Policy and Planning · doi:10.1093/heapol/czz055 · Cited by 302 · see citing works
Wong, G., Greenhalgh, T., Westhorp, G., & Pawson, R. (2014) · Health Services and Delivery Research · doi:10.3310/hsdr02300 · Cited by 276 · see citing works
Self-citationThe influence of contextual factors on healthcare quality improvement initiatives: a realist review
Coles, E., Anderson, J., Maxwell, M., Harris, F. M., Gray, N. M., Milner, G., & MacGillivray, S. (2020) · Systematic Reviews · doi:10.1186/s13643-020-01344-3 · Cited by 246 · see citing works
Pearson, M., Chilton, R., Wyatt, K. M., Abraham, C., Ford, T. J., Woods, H., & Anderson, R. (2015) · Implementation Science · doi:10.1186/s13012-015-0338-6 · Cited by 247 · see citing works
Zamboni, K., Baker, U., Tyagi, M., Schellenberg, J., Hill, Z. E., & Hanson, C. (2020) · Implementation Science · doi:10.1186/s13012-020-0978-z · Cited by 231 · see citing works
Editorial: The Future of Writing and Reviewing for IJMR
Jones, O., & Gatrell, C. J. (2014) · International Journal of Management Reviews · doi:10.1111/ijmr.12038 · Cited by 220 · see citing works
What Synthesis Methodology Should I Use? A Review and Analysis of Approaches to Research Synthesis.
Schick‐Makaroff, K., MacDonald, M., Plummer, M., Burgess, J., & Neander, W. (2016) · AIMS Public Health · doi:10.3934/publichealth.2016.1.172 · Cited by 227 · see citing works
Training Physicians to Provide High-Value, Cost-Conscious Care
Stammen, L. A., Stalmeijer, R. E., Paternotte, E., Pool, A. O., Driessen, E. W., Scheele, F., & Stassen, L. P. S. (2015) · JAMA · doi:10.1001/jama.2015.16353 · Cited by 207 · see citing works
Bunn, F., Goodman, C. M., Russell, B., Wilson, P. M., Manthorpe, J., Rait, G., Hodkinson, I., & Durand, M. (2018) · BMC Geriatrics · doi:10.1186/s12877-018-0853-9 · Cited by 208 · see citing works
Baker, P., Hawkes, C., Wingrove, K., Demaio, A. R., Parkhurst, J., Thow, A. M., & Walls, H. (2018) · BMJ Global Health · doi:10.1136/bmjgh-2017-000485 · Cited by 204 · see citing works
Protocol—the RAMESES II study: developing guidance and reporting standards for realist evaluation
Greenhalgh, T., Wong, G., Jagosh, J., Greenhalgh, J., Manzano, A., Westhorp, G., & Pawson, R. (2015) · BMJ Open · doi:10.1136/bmjopen-2015-008567 · Cited by 193 · see citing works
Self-citationSawyer, A. D. M., van Lenthe, F. J., Kamphuis, C. B. M., Terragni, L., Roos, G., Poelman, M. P., Nicolaou, M., Waterlander, W. E., Djojosoeparto, S. K., Scheidmeir, M., et al. (2021) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-021-01164-1 · Cited by 186 · see citing works
A methodological systematic review of what’s wrong with meta-ethnography reporting
France, E. F., Ring, N., Thomas, R., Noyes, J., Maxwell, M., & Jepson, R. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-119 · Cited by 183 · see citing works
Paré, G., Tate, M., Johnstone, D., & Kitsiou, S. (2016) · European Journal of Information Systems · doi:10.1057/s41303-016-0020-3 · Cited by 180 · see citing works
Greenhalgh, J., Dalkin, S. M., Gibbons, E. J., Wright, J. M., Valderas, J. M., Meads, D. M., & Black, N. A. (2017) · Journal of Health Services Research & Policy · doi:10.1177/1355819617740925 · Cited by 181 · see citing works
Handley, M., Bunn, F., & Goodman, C. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-015257 · Cited by 158 · see citing works
Jagosh, J., Pluye, P., Wong, G., Cargo, M., Salsberg, J., Bush, P. L., Herbert, C. P., Green, L. W., Greenhalgh, T., & Macaulay, A. C. (2014) · Research Synthesis Methods · doi:10.1002/jrsm.1099 · Cited by 165 · see citing works
Self-citationBeyond the Simulation Laboratory
Griswold‐Theodorson, S., Ponnuru, S., Dong, C., Szyld, D., Reed, T., & McGaghie, W. C. (2015) · Academic Medicine · doi:10.1097/acm.0000000000000938 · Cited by 165 · see citing works
Time to rethink the systematic review catechism? Moving from ‘what works’ to ‘what happens’
Petticrew, M. P. (2015) · Systematic Reviews · doi:10.1186/s13643-015-0027-1 · Cited by 160 · see citing works
Frameworks to assess health systems governance: a systematic review
Pyone, T., Smith, H. J. J., & van den Broek, N. R. (2017) · Health Policy and Planning · doi:10.1093/heapol/czx007 · Cited by 161 · see citing works
How outcomes are achieved through patient portals: a realist review
Otte-Trojel, T., Bont, A. A. D., Rundall, T. G., & van de Klundert, J. J. (2014) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2013-002501 · Cited by 159 · see citing works
Retroductive Theorizing: A Contribution of Critical Realism to Mixed Methods Research
Mukumbang, F. C. (2021) · Journal of Mixed Methods Research · doi:10.1177/15586898211049847 · Cited by 155 · see citing works
10 years of mindlines: a systematic review and commentary
Wieringa, S., & Greenhalgh, T. (2015) · Implementation Science · doi:10.1186/s13012-015-0229-x · Cited by 150 · see citing works
Self-citationMcCormack, B. G., Rycroft‐Malone, J., DeCorby, K., Hutchinson, A. M., Bucknall, T. K., Kent, B., Schultz, A. A., Snelgrove‐Clarke, E., Stetler, C., Titler, M. G., et al. (2013) · Implementation Science · doi:10.1186/1748-5908-8-107 · Cited by 150 · see citing works
Harden, A., Thomas, J., Cargo, M., Harris, J., Tomás Pantoja, C., Flemming, K., Booth, A., Garside, R., Hannes, K., & Noyes, J. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.11.029 · Cited by 146 · see citing works
Patient-Driven Second Opinions in Oncology: A Systematic Review
Hillen, M. A., Medendorp, N. M., Daams, J. G., & Smets, E. M. A. (2017) · The Oncologist · doi:10.1634/theoncologist.2016-0429 · Cited by 141 · see citing works
Klement, R. J. (2017) · Medical Oncology · doi:10.1007/s12032-017-0991-5 · Cited by 140 · see citing works
McLean, S. M., Booth, A., Gee, M., Salway, S., Cobb, M., Bhanbhro, S., & Nancarrow, S. (2016) · Patient Preference and Adherence · doi:10.2147/ppa.s93046 · Cited by 141 · see citing works
Maciver, D., Rutherford, M., Arakelyan, S., Kramer, J. M., Richmond, J. E., Todorova, L., Ayuso, D. M. R., Nakamura‐Thomas, H., ten Velden, M., Finlayson, I. R., et al. (2019) · PLoS ONE · doi:10.1371/journal.pone.0210511 · Cited by 153 · see citing works
Buck, H. G., Stromberg, A., Chung, M. L., Donovan, K. A., Harkness, K., Howard, A. M., Kato, N., Polo, R., & Evangelista, L. S. (2018) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2017.10.007 · Cited by 135 · see citing works
Review of methods used by chiropractors to determine the site for applying manipulation
Triano, J. J., Budgell, B., Bagnulo, A., Roffey, B., Bergmann, T. F., Cooperstein, R., Gleberzon, B. J., Good, C. J., Perron, J., & Tepe, R. E. (2013) · Chiropractic & Manual Therapies · doi:10.1186/2045-709x-21-36 · Cited by 134 · see citing works
Papoutsi, C., Mattick, K. L., Pearson, M., Brennan, N., Briscoe, S., & Wong, G. (2017) · Journal of Antimicrobial Chemotherapy · doi:10.1093/jac/dkx194 · Cited by 133 · see citing works
Self-citationThorne, S. E. (2016) · Qualitative Health Research · doi:10.1177/1049732316679370 · Cited by 134 · see citing works
Dryden‐Palmer, K., Parshuram, C. S., & Berta, W. B. (2020) · BMC Health Services Research · doi:10.1186/s12913-020-4935-y · Cited by 133 · see citing works
Parker, S. M., Prince, A., Thomas, L., Song, H. J., Milosevic, D., & Harris, M. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-019192 · Cited by 127 · see citing works
The “realist search”: A systematic scoping review of current practice and reporting
Booth, A., Briscoe, S., & Wright, J. M. (2019) · Research Synthesis Methods · doi:10.1002/jrsm.1386 · Cited by 116 · see citing works
Hut-Mossel, L., Ahaus, K., Welker, G. A., & Gans, R. O. B. (2021) · PLoS ONE · doi:10.1371/journal.pone.0248677 · Cited by 129 · see citing works
Pearson, M., Brand, S. L., Quinn, C., Shaw, J. J., Maguire, M., Michie, S., Briscoe, S., Lennox, C., Stirzaker, A., Kirkpatrick, T., et al. (2015) · Implementation Science · doi:10.1186/s13012-015-0321-2 · Cited by 115 · see citing works
Who is vulnerable to energy poverty in the Global North, and what is their experience?
Middlemiss, L. (2022) · Wiley Interdisciplinary Reviews Energy and Environment · doi:10.1002/wene.455 · Cited by 126 · see citing works
Clarifying differences between reviews within evidence ecosystems
Gough, D., Thomas, J., & Oliver, S. (2019) · Systematic Reviews · doi:10.1186/s13643-019-1089-2 · Cited by 115 · see citing works
How food insecurity could lead to obesity in LMICs
Farrell, P., Thow, A. M., Abímbọ́lá, Ṣ., Faruqui, N., & Negin, J. (2017) · Health Promotion International · doi:10.1093/heapro/dax026 · Cited by 115 · see citing works
van Dael, J., Reader, T. W., Gillespie, A., Neves, A. L., Darzi, A. W., & Mayer, E. K. (2020) · BMJ Quality & Safety · doi:10.1136/bmjqs-2019-009704 · Cited by 118 · see citing works
A Social Model of Loneliness: The Roles of Disability, Social Resources, and Cognitive Impairment
Burholt, V., Windle, G., Morgan, D., & CFAS Wales team (2016) · The Gerontologist · doi:10.1093/geront/gnw125 · Cited by 111 · see citing works
Wozney, L., Huguet, A., Bennett, K., Radomski, A. D., Hartling, L., Dyson, M., McGrath, P. J., & Newton, A. S. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7573 · Cited by 93 · see citing works
Economic globalization, nutrition and health: a review of quantitative evidence
Cuevas, S., Cornelsen, L., Smith, R., & Walls, H. (2019) · Globalization and Health · doi:10.1186/s12992-019-0456-z · Cited by 108 · see citing works
Greenhalgh, J., Pawson, R., Wright, J. M., Black, N. A., Valderas, J. M., Meads, D. M., Gibbons, E. J., Wood, L. R. J., Wood, C., Mills, C., et al. (2014) · BMJ Open · doi:10.1136/bmjopen-2014-005601 · Cited by 105 · see citing works
Self-citationthe PRISMA-Equity Bellagio group, Welch, V., Petticrew, M., Petkovic, J., Moher, D., Waters, E., White, H., & Tugwell, P. (2015) · International Journal for Equity in Health · doi:10.1186/s12939-015-0219-2 · Cited by 114 · see citing works
Defining gentrification for epidemiologic research: A systematic review
Bhavsar, N. A., Kumar, M., & Richman, L. S. (2020) · PLoS ONE · doi:10.1371/journal.pone.0233361 · Cited by 104 · see citing works
Effective health care for older people living and dying in care homes: a realist review
Goodman, C. M., Dening, T., Gordon, A. L., Davies, S. L., Meyer, J. E., Martin, F. C., Gladman, J. R. F., Bowman, C., Victor, C. R., Handley, M., et al. (2016) · BMC Health Services Research · doi:10.1186/s12913-016-1493-4 · Cited by 100 · see citing works
Systematic reviews in medical education: A practical approach: AMEE Guide 94
Sharma, R., Gordon, M. A., Dharamsi, S., & Gibbs, T. J. (2014) · Medical Teacher · doi:10.3109/0142159x.2014.970996 · Cited by 99 · see citing works
Hnatiuk, J. A., Brown, H. E., Downing, K. L., Hinkley, T., Salmon, J., & Hesketh, K. D. (2018) · Obesity Reviews · doi:10.1111/obr.12763 · Cited by 100 · see citing works
O’Cathain, A., Connell, J., Long, J., & Coster, J. E. (2019) · Health Expectations · doi:10.1111/hex.12995 · Cited by 98 · see citing works
Opoku, D., Stephani, V., & Quentin, W. (2017) · BMC Medicine · doi:10.1186/s12916-017-0782-z · Cited by 97 · see citing works
How stakeholder participation can contribute to systematic reviews of complex interventions
Harris, J., Croot, L., Thompson, J., & Springett, J. (2015) · Journal of Epidemiology & Community Health · doi:10.1136/jech-2015-205701 · Cited by 95 · see citing works
Vareilles, G., Pommier, J., Marchal, B., & Kane, S. S. (2017) · Implementation Science · doi:10.1186/s13012-017-0554-3 · Cited by 89 · see citing works
Huxley, C. J., Atherton, H., Watkins, J. A., & Griffiths, F. (2015) · British Journal of General Practice · doi:10.3399/bjgp15x687853 · Cited by 86 · see citing works
Meta-narrative and realist reviews: guidance, rules, publication standards and quality appraisal
Gough, D. (2013) · BMC Medicine · doi:10.1186/1741-7015-11-22 · Cited by 85 · see citing works
Kastner, M., Hayden, L., Wong, G., Lai, Y., Makarski, J., Treister, V., Chan, J., Lee, J. H., Ivers, N. M., Holroyd-Leduc, J. M., et al. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-025009 · Cited by 87 · see citing works
Self-citationPatient, Family, and Community Advisory Councils in Health Care and Research: a Systematic Review
Oldfield, B. J., Harrison, M. A., Genao, I., Greene, A. T., Pappas, M. E., Glover, J. G., & Rosenthal, M. S. (2018) · Journal of General Internal Medicine · doi:10.1007/s11606-018-4565-9 · Cited by 84 · see citing works
Cooper, A., Davies, F., Edwards, A., Anderson, P., Carson‐Stevens, A., Cooke, M. W., Donaldson, L., Dale, J. R., Evans, B. A., Hibbert, P. D., et al. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-024501 · Cited by 84 · see citing works
Protocol-developing meta-ethnography reporting guidelines (eMERGe)
France, E. F., Ring, N., Noyes, J., Maxwell, M., Jepson, R. G., Duncan, E., Turley, R. L., Jones, D., & Uny, I. (2015) · BMC Medical Research Methodology · doi:10.1186/s12874-015-0068-0 · Cited by 82 · see citing works
What really matters for successful research environments? A realist synthesis
Ajjawi, R., Crampton, P. E. S., & Rees, C. E. (2018) · Medical Education · doi:10.1111/medu.13643 · Cited by 77 · see citing works
Kiss, L., Quinlan-Davidson, M., Pasquero, L., Tejero, P. O., Hogg, C. L., Theis, J., PARK, A. W., Zimmerman, C., & Hossain, M. (2020) · Conflict and Health · doi:10.1186/s13031-020-0254-5 · Cited by 79 · see citing works
Engaging Older Adults in Health Care Decision-Making: A Realist Synthesis
Elliott, J. B., McNeil, H., Ashbourne, J., Huson, K., Boscart, V., & Stolee, P. (2016) · Patient · doi:10.1007/s40271-016-0168-x · Cited by 79 · see citing works
Erku, D., Khatri, R. B., Endalamaw, A., Wolka, E., Nigatu, F., Zewdie, A., & Assefa, Y. A. (2023) · PLoS ONE · doi:10.1371/journal.pone.0285222 · Cited by 78 · see citing works
Enright, G., Allman-Farinelli, M. A., & Redfern, J. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17114099 · Cited by 79 · see citing works
Lodenstein, E., Dieleman, M. A., Gerretsen, B., & Broerse, J. E. W. (2013) · Systematic Reviews · doi:10.1186/2046-4053-2-98 · Cited by 76 · see citing works
Engaging older adults in healthcare research and planning: a realist synthesis
McNeil, H., Elliott, J., Huson, K., Ashbourne, J., Heckman, G., Walker, J., & Stolee, P. (2016) · Research Involvement and Engagement · doi:10.1186/s40900-016-0022-2 · Cited by 76 · see citing works
Lorenc, T., Felix, L. M., Petticrew, M. P., Meléndez‐Torres, G. J., Thomas, J., Thomas, S., O’Mara-Eves, A., & Richardson, M. A. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0366-6 · Cited by 75 · see citing works
Mertens, F., GROOT, E. D., Meijer, L., Wens, J., Cherry, M. G., Deveugele, M. I., Damoiseaux, R. A. M. J., Stes, A., & Pype, P. F. (2017) · Medical Teacher · doi:10.1080/0142159x.2017.1390216 · Cited by 74 · see citing works
Development of a program theory for shared decision-making: a realist synthesis
Waldron, T., Carr, T., McMullen, L. M., Westhorp, G., Duncan, V., Neufeld, S.-M., Bandura, L.-A., & Groot, G. (2020) · BMC Health Services Research · doi:10.1186/s12913-019-4649-1 · Cited by 77 · see citing works
Self-citationPre‐registration interprofessional clinical education in the workplace: a realist review
Kent, F., Hayes, J., Glass, S., & Rees, C. E. (2017) · Medical Education · doi:10.1111/medu.13346 · Cited by 71 · see citing works
Effectiveness of UK optometric enhanced eye care services: a realist review of the literature
Baker, H., Ratnarajan, G., Harper, R. A., Edgar, D. F., & Lawrenson, J. G. (2016) · Ophthalmic and Physiological Optics · doi:10.1111/opo.12312 · Cited by 69 · see citing works
Varieties of Integrative Scholarship
McGaghie, W. C. (2014) · Academic Medicine · doi:10.1097/acm.0000000000000585 · Cited by 67 · see citing works
Shé, É. N., Morton, S., Lambert, V., Cheallaigh, C. N., Lacey, V., Dunn, E., Loughnane, C., O'Connor, J., McCann, A. H., Adshead, M. L., et al. (2019) · Health Expectations · doi:10.1111/hex.12865 · Cited by 68 · see citing works
Mindfulness-based programmes to reduce stress and enhance well-being at work: a realist review
Micklitz, K., Wong, G., & Howick, J. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-043525 · Cited by 71 · see citing works
Self-citationHusk, K., Blockley, K. V., Lovell, R., Bethel, A. C., Bloomfield, D., Warber, S. L., Pearson, M., Lang, I., Byng, R., & Garside, R. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0269-6 · Cited by 66 · see citing works
Chadborn, N., Goodman, C. M., Zubair, M., Sousa, L., Gladman, J. R. F., Dening, T., & Gordon, A. L. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-026921 · Cited by 65 · see citing works
Caspar, S., Davis, E. D., Douziech, A., & Scott, D. R. M. (2017) · Innovation in Aging · doi:10.1093/geroni/igy001 · Cited by 64 · see citing works
The sustainability of Lean in pediatric healthcare: a realist review
Flynn, R., Newton, A. S., Rotter, T., Hartfield, D. S., Walton, S., Fiander, M., & Scott, S. D. (2018) · Systematic Reviews · doi:10.1186/s13643-018-0800-z · Cited by 62 · see citing works
Improving best practice for patients receiving hospital discharge letters: a realist review
Weetman, K., Wong, G., Scott, E. J., Mackenzie, E., Schnurr, S., & Dale, J. R. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-027588 · Cited by 59 · see citing works
Self-citation
- Authors
- Wong, G., Greenhalgh, T., Westhorp, G., Buckingham, J., & Pawson, R.
- Affiliations
- Queen Mary University of London (GB)
- Centre for Primary Care and Public Health Queen Mary University of London UK
- Community Matters Mount Torrens South Australia Australia
- University of Alberta (CA)
- University of Leeds (GB)
- Venue
- Journal of Advanced Nursing
- Publisher
- Wiley
- Published
- 2013-01-29
- Volume
- 69
- Issue
- 5
- Pages
- 1005-1022
- ISSN
- 0309-2402 (ISSN-L)
- 1365-2648
- OpenAlex
- W2005235635
- Cited by
- 385
- References
- 34
- Citations by year
- 2026: 12 · 2025: 7 · 2024: 26 · 2023: 26 · 2022: 26 · 2021: 34 · 2020: 43 · 2019: 44 · 2018: 33 · 2017: 41 · 2016: 35 · 2015: 34 · 2014: 12 · 2013: 11
- FWCI
- 33.78
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Advanced Nursing (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institute for Health and Care Research (NF-SI-0512-10031, 10/1008/07)
- Health Services Research Programme
- Health Services and Delivery Research Programme
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Decision Sciences › Management Science and Operations Research › Evaluation and Performance Assessment
- Keywords
- realist synthesis, publication standards, reporting guidelines, realist research, complex interventions, evidence synthesis, methodological quality, expert consensus, Delphi panel, metanarrative
- MeSH terms
- Delphi Technique, Publishing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
