Development of methodological guidance, publication standards and training materials for realist and meta-narrative reviews: the RAMESES (Realist And Meta-narrative Evidence Syntheses – Evolving Standards) project
Open accessThe DOI matches its Crossref record; 95 of the 97 references it cites were found in a registry or an index.
Abstract
Background: There is growing interest in theory-driven, qualitative and mixed-method approaches to systematic review, such as realist and meta-narrative review. These approaches offer the potential to expand the knowledge base in policy-relevant areas. However, the quality of such reviews can be difficult to assess. Objectives: The aim of this project was to produce methodological guidance, publication standards and training resources for those seeking to undertake realist and/or meta-narrative reviews. Methods/design: We (1) collated and summarised existing literature on the principles of good practice in realist and meta-narrative systematic reviews; (2) considered the extent to which these principles had been followed by published and in-progress reviews, thereby identifying how rigour may have been lost and how existing methods could be improved; (3) used an online Delphi method with an interdisciplinary panel of experts from academia and policy, to produce a draft set of methodological steps and publication standards; (4) produced training materials with learning objectives linked to these steps; (5) refined these standards and training materials prospectively on real reviews in progress, capturing methodological and other challenges as they arose; (6) synthesised expert input, evidence review and real-time problem analysis into more definitive guidance and standards; and (7) disseminated outputs to audiences in academia and policy. Results: An important element of this study was the establishment of an e-mail mailing list to bring together researches in the field ( www.jiscmail.ac.uk/RAMESES ). Our literature review identified 35 and nine realist and meta-narrative reviews respectively. Analysis and discussion within the project team produced a summary of the published literature, and common questions and challenges into briefing materials for the Delphi panel, comprising 37 and 33 members (for realist and meta-narrative reviews respectively). Within three rounds this panel had reached a consensus on 19 (realist) and 20 (meta-narrative) key publication standards, with an overall response rate of 90% and 91% respectively. The Realist And Meta-narrative Evidence Syntheses – Evolving Standards (RAMESES) publication standards for realist syntheses and meta-narrative reviews were published in open-access journals and quickly became highly accessed. The RAMESES quality standards and training materials drew together the following sources of data: (1) personal expertise as researchers and trainers; (2) data from the Delphi panels; (3) feedback from participants at training sessions we ran; and (4) comments made on RAMESES mailing list. The quality standards and training materials are freely available online ( www.ramesesproject.org ). Discussion: The production of these standards and guidance drew on multiple sources of knowledge and expertise, and a high degree of a consensus was achieved despite ongoing debate among researchers about the overall place of these methodologies in the secondary research toolkit. As with all secondary research methods, guidance on quality assurance and uniform reporting is an important step towards improving quality and consistency of studies. We anticipate that as more reviews are undertaken, further refinement will be needed to the publication and quality standards and training materials. Limitations: The project’s outputs are not definitive and in the future updating and further development is likely to be needed. Conclusion: An initial set of publication standards, quality standards and training materials have been produced for researchers, users and funders of realist or meta-narrative reviews. As realist and meta-narrative reviews are relatively new approaches to evidence synthesis, methodological development is needed for both review approaches. Funding: The National Institute for Health Research Health Services and Delivery Research programme.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“The realist approach followed processes set out by Pawson et al. and the Realist and Meta-narrative Evidence Synthesis: Evolving Standards (RAMESES) [29, 32].”
From Do hospital-to-home transitions work for older adults with multiple long-term conditions including dementia? A realist review (2025) · cites this paper as [32]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gotzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · BMJ · doi:10.1136/bmj.b2700 · Cited by 17,648
Methods for the thematic synthesis of qualitative research in systematic reviews
Thomas, J., & Harden, A. (2008) · BMC Medical Research Methodology · doi:10.1186/1471-2288-8-45 · Cited by 9,312
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gotzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c869 · Cited by 8,883
Diffusion of Innovations in Service Organizations: Systematic Review and Recommendations
GREENHALGH, T., ROBERT, G., MACFARLANE, F., BATE, P., & KYRIAKIDOU, O. (2004) · The Milbank Quarterly · doi:10.1111/j.0887-378x.2004.00325.x · Cited by 7,448
Self-citationResearch guidelines for the Delphi survey technique
Hasson, F. (2000) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.2000.01567.x · Cited by 5,951
The Delphi Technique: Making Sense of Consensus
Hsu, C.-C., & Sandford, B. A. (2007) · University of Massachusetts Amherst · doi:10.7275/pdz9-th90 · Cited by 4,500
Realist review - a new method of systematic review designed for complex policy interventions
Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2005) · Journal of Health Services Research & Policy · doi:10.1258/1355819054308530 · Cited by 3,190 · cited 3×
“The quality standards and training materials drew on the following sources of data: (1) personal expertise as researchers and trainers; (2) data from the Delphi panels; (3) feedback from participants at training sessions we ran; and (4) comments made on RAMESES mailing list.”
MethodSelf-citationSynthesising qualitative and quantitative evidence: A review of possible methods
Dixon-Woods, M., Agarwal, S., Jones, D., Young, B., & Sutton, A. (2005) · Journal of Health Services Research & Policy · doi:10.1177/135581960501000110 · Cited by 2,132 · cited 4×
“Two of our initial questions related to these issues: (5) What is the link between realist and meta-narrative review and the policy-making process? How have published reviews been commissioned or sponsored? How have policy-makers been involved in shaping the review? How have they been involved in disseminating and app…”
BackgroundMethodInfluentialGreenhalgh, T., & Peacock, R. (2005) · BMJ · doi:10.1136/bmj.38636.593461.68 · Cited by 2,045
Self-citationMethods for the synthesis of qualitative research: a critical review
Barnett-Page, E., & Thomas, J. (2009) · BMC Medical Research Methodology · doi:10.1186/1471-2288-9-59 · Cited by 2,042
Research works printed but not linked: 3
- Weiss, 1995, New Approaches to Evaluating Community Initiatives: Concepts, Methods, and Contexts, 65
- Meyer, 2008, Independent Learning Literature Review (Research Report DCSF-RR051)
- McLean, 2010, Behavioral caregiving for adults with traumatic brain injury living in nursing homes: developing a practice model, J Theory Constr Test, 14, 17
Cited by
Items 101–200 of 272
Research Synthesis Infrastructures: Shaping Knowledge in Education
Hammond, J. W., Moss, P., Huynh, M. Q., & Lagoze, C. (2020) · Review of Research in Education · doi:10.3102/0091732x20907350 · Cited by 12
“…latter three approaches have standards supporting their enactment or reporting developed by the RAMESES (Realist And Meta-narrative Evidence Syntheses: Evolving Standards) Projects (Wong et al., 2014) and eMERGe (Meta-Ethnography Reporting Guidance) Project (France et al., 2019), respectively.”
BackgroundMethodInfluentialImproving the Use of Simulation in Nursing Education: Protocol for a Realist Review
Meum, T. T., Slettebø, Å., & Fossum, M. (2020) · JMIR Research Protocols · doi:10.2196/16363 · Cited by 15
Senior medical students as assistants in medicine in COVID-19 crisis: a realist evaluation protocol
Monrouxe, L. V., Hockey, P., Khanna, P., Klinner, C., Mogensen, L. L., O'Mara, D. A., Roach, A., Tobin, S., & Davids, J. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-045822 · Cited by 11
Zhao, J., Harvey, G., Vandyk, A. D., Huang, M., Hu, J., Modanloo, S., & Gifford, W. (2022) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2022.0213 · Cited by 14
Lawson, L., Cooper, M., Tolley, C., Hand, A., & Nazar, H. (2025) · BMC Geriatrics · doi:10.1186/s12877-025-06123-0 · Cited by 10
“The realist approach followed processes set out by Pawson et al. and the Realist and Meta-narrative Evidence Synthesis: Evolving Standards (RAMESES) [29, 32].”
Zhai, H., Zhang, L., Xia, J., & Cheng, L. (2024) · Journal of Sport Rehabilitation · doi:10.1123/jsr.2023-0207 · Cited by 10
Yonekura, T., Quintans, J. R., Soares, C. B., & Filho, A. A. D. N. (2019) · Revista da Escola de Enfermagem da USP · doi:10.1590/s1980-220x2018037703515 · Cited by 23
Reducing health inequalities through general practice: protocol for a realist review (EQUALISE)
Ford, J. A., Gkiouleka, A., Kuhn, I. L., Sowden, S. L., Head, F., Siersbaek, R., Bambra, C. L., Harmston, R. R., Manji, S., Moseley, A., et al. (2021) · BMJ Open · doi:10.1136/bmjopen-2021-052746 · Cited by 10
Self-citationJohn Mayne and Rules of Thumb for Contribution Analysis: A Comparison With Two Related Approaches
Leeuw, F. L. (2023) · Canadian Journal of Program Evaluation · doi:10.3138/cjpe.75448 · Cited by 12
Nowland, R. A., Robertson, L., Farrelly, N., Roy, A., Sharpe, D., Harris, C., Morocza, N., & Larkins, C. (2022) · BMJ Open · doi:10.1136/bmjopen-2022-061659 · Cited by 10
Palm, R., Fahsold, A., Roes, M., & Holle, B. (2021) · PLoS ONE · doi:10.1371/journal.pone.0259496 · Cited by 13
“We conducted a realist review following the principles outlined for this method [32,33].”
MethodA systematic review and meta-analysis of residential and transport energy poverty
Dingley, O., Winston, N., Pedroso, M. D. S., & Carroll, P. (2025) · Energy Research & Social Science · doi:10.1016/j.erss.2025.104054 · Cited by 8
Hayward, S., Hayes, D., Griffiths, T., Bloch, S., & Clarke, M. (2025) · Current Developmental Disorders Reports · doi:10.1007/s40474-025-00327-0 · Cited by 12
Fitzgerald, I., Howe, J., Maidment, I., Wallace, E., Zisman‐Ilani, Y., Højlund, M., O’Dwyer, S., Dhubhlaing, C. N., Crowley, E. K., & Sahm, L. J. (2025) · Schizophrenia Bulletin · doi:10.1093/schbul/sbaf059 · Cited by 8
“26 Thus, despite its comprehensiveness, this review does not claim to represent a definitive picture of structural and contextual factors decreasing prescriber engagement with SDM practices nor a definitive statement of the universal practices of clinicians.”
Coproduction and partnership with people and communities
Wilton, C. (2021) · BMJ Leader · doi:10.1136/leader-2020-000424 · Cited by 9
Mirzoev, T. N., de Chavez, A. C., Manzano, A., Agyepong, I. A., Ashinyo, M. E., Danso‐Appiah, A., Gyimah, L., Yevoo, L. L., Awini, E., Ha, B. T. T., et al. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-046992 · Cited by 10
Fletcher, K., Wydera, S., Thorpe, N., Radford, K., das Nair, R., Booth, V., & on behalf of the NeRO Programme and Management Team (2023) · Neuropsychological Rehabilitation · doi:10.1080/09602011.2023.2273580 · Cited by 13
“…data] can contribute to theory building and/or testing ” (Wong et al., 2014), and rigour, indicating whether data are “ trustworthy ” or credible (Wong et al., 2014), thus describing the robustness of the methodology used and credibility of conclusions and inferences described by the authors,…”
BackgroundMethodInfluentialTeam Processes in Canadian Primary HealthCare: A Realist Review
MacPhee, M., Wong, G., Abrams, R., & Merrett, K. (2020) · Healthcare Quarterly · doi:10.12927/hcq.2020.26274 · Cited by 10
Self-citationTinner, L., Caldwell, D. M., & Campbell, R. M. (2021) · Systematic Reviews · doi:10.1186/s13643-021-01696-4 · Cited by 8
“and policy makers through providing accessible recommendations on how interventions might be delivered in different contexts [43].”
BackgroundMethodInfluentialHenderson, R., McInnes, A., Danyluk, A., Wadsworth, I. W., Healy, B. A., & Crowshoe, L. L. (2023) · Harm Reduction Journal · doi:10.1186/s12954-023-00740-x · Cited by 11
“This is not unusual practice for realist reviews, as program mechanisms are not always explicit [49, 50].”
BackgroundMapping precision public health definitions, terminology and applications: a scoping review protocol
Bosward, R., Braunack‐Mayer, A., Frost, E. K., & Carter, S. M. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-058069 · Cited by 7
Craig, S. G., Mitchell, G., O’Halloran, P. D., Stark, P., & Wilson, C. B. (2023) · BMC Geriatrics · doi:10.1186/s12877-023-04090-y · Cited by 8
“(phase I) of the international literature on dementiafriendly communities using RAMESES I (Realist and Meta-narrative Evidence Syntheses: Evolving Standards) reporting standards for realist reviews [30].”
MethodParticipatory systems science for enhancing health and wellbeing in the Indian Ocean territories
Allender, S. E., Munira, S. L., Bourke, S., & Lancsar, E. (2023) · Frontiers in Public Health · doi:10.3389/fpubh.2023.1013869 · Cited by 7
Wettergreen, S. A., Scott, C., Auten, M., Kiles, T. M., Litten, K. P., Scott, D., & Stewart, M. P. (2024) · Currents in Pharmacy Teaching and Learning · doi:10.1016/j.cptl.2024.03.010 · Cited by 10
Operationalising the Recovery College model with people living with dementia: a realist review
Handley, M., Wheeler, C., Duddy, C., Wong, G., Birt, L., Fox, C., Moniz-Cook, E. D., Hackmann, C., Teague, B., & West, J. (2024) · Aging & Mental Health · doi:10.1080/13607863.2024.2356878 · Cited by 9
“The protocol was published on PROSPERO (CRD42021293687) and follows the Realist And Meta-narrative Evidence Syntheses: Evolving Standards (RAMESES) quality and publication standards (Wong et al., 2014).”
MethodSelf-citationBates, G. (2022) · International Review of Sport and Exercise Psychology · doi:10.1080/1750984x.2021.2001838 · Cited by 12
“The work of the RAMESES group (Greenhalgh et al., 2011; Wong et al., 2014) is highly relevant to consider when seeking to explore complexity of intervention implementation and environmental context.”
BackgroundMethodThe social networks of hospital staff: A realist synthesis
Blacklock, C., Darwin, A., English, M., McKnight, J., Hinton, L., Harriss, E., & Wong, G. (2022) · Journal of Health Services Research & Policy · doi:10.1177/13558196221076699 · Cited by 9
“Data extraction and analysis were undertaken concurrently, using an immersive, iterative and refining approach.(19,22) Iterative cycles were undertaken to help visualise, make sense of and configure the data, seeking to”
MethodSelf-citationSiersbaek, R., Parker, S., Kavanagh, P. M., Ford, J. A., & Burke, S. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-060457 · Cited by 7
Papoutsi, C., Hargreaves, D. S., Hagell, A., Hounsome, N., Skirrow, H., Muralidhara, K., Colligan, G., Vijayaraghavan, S., Greenhalgh, T., & Finer, S. (2022) · Health and Social Care Delivery Research · doi:10.3310/nkcr8246 · Cited by 8
Self-citationAntoniou, G. A., Mavridis, D., Tsokani, S., Cano, M. L., Flórez, I. D., Brouwers, M. C., Markar, S. R., Silecchia, G., Francis, N. K., & Antoniou, S. A. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-037107 · Cited by 6
Amenyah, S., Waters, D., Tang, W. J., Fenge, L., & Murphy, J. L. (2022) · BMC Public Health · doi:10.1186/s12889-022-14518-6 · Cited by 10
“Methods This realist synthesis was conducted using steps outlined in the Ray Pawson’s realist review method [32] and according to the Realist And MEta-narrative Evidence Syntheses: Evolving Standards (RAMESES) quality standards for realist synthesis [33] and a registered protocol published in the Prospective Register…”
MethodTatton, C., & Lloyd, J. (2023) · BMC Public Health · doi:10.1186/s12889-023-17378-w · Cited by 7
“The initial programme theory (a set of theoretical explanations or assumptions about how a programme is expected to work) [12] was built using the National Centre for Smoking Cession and Training (NCSCT) Standard Treatment Programme for Pregnant Women [14] and the National Institute for Health and…”
MethodResultThe (dis)organization of leg ulcer care: A realist synthesis
Pagnamenta, F., Lhussier, M., & Rapley, T. (2024) · Journal of Advanced Nursing · doi:10.1111/jan.16210 · Cited by 9
Eaton, G., Williams, V., Wong, G., Roberts, N. W., & Mahtani, K. R. (2019) · British Paramedic Journal · doi:10.29045/14784726.2019.12.4.3.35 · Cited by 8
“As the review progresses, we will seek input from the stakeholder group, as this will continually refine and test the programme theory (Wong et al., 2014).”
BackgroundSelf-citationNetworked information technologies and patient safety: a protocol for a realist synthesis
Keen, J., Greenhalgh, J., Randell, R., Gardner, P. H., Waring, J. J., Longo, R., Fistein, J., Abdulwahid, M., King, N. V., & Wright, J. M. (2019) · Systematic Reviews · doi:10.1186/s13643-019-1223-1 · Cited by 7
“Rigour refers to the requirement for an investigation to be of sufficient standard within type , whether that is a process evaluation, an ethnography or other type of study [14].”
BackgroundMethodInfluentialSachidanandan, G., Bechard, L., Hodgson, K. J., & Sud, A. (2022) · International Journal of Drug Policy · doi:10.1016/j.drugpo.2022.103807 · Cited by 9
Greene, L., Aryankhesal, A., Megson, M., Blake, J., Wong, G., Briscoe, S., Hilton, A., Killett, A., Reeve, J. L., Allan, L. M., et al. (2022) · BMJ Open · doi:10.1136/bmjopen-2022-067424 · Cited by 7
“The Realist and Meta-narrative Evidence Syntheses: Evolving Standards (RAMESES) quality 33 and reporting 30 standards will also be followed.”
Self-citationMurnaghan, A., Weersink, K., Thoma, B., Hall, A. K., & Chan, T. M. (2017) · Canadian Journal of Emergency Medicine · doi:10.1017/cem.2017.29 · Cited by 5
Magnin, M., Jeannot, E., Voahangy, R., & Stoll, B. (2018) · Acta Paediatrica · doi:10.1111/apa.14267 · Cited by 5
“It explores how a particular context can lead to a mechanism that will generate a given outcome (17).”
BackgroundInterventions for Reducing Mental Health–Related Stigma in Emergency Medicine: An Integrative Review
van de Glind, G., Galenkamp, N., Schut, B., Schoonhoven, L., Scheepers, F. E., Muir, R., Baden, D., Werner, L., van Veen, M., Crilly, J. L., et al. (2025) · Journal of Emergency Nursing · doi:10.1016/j.jen.2025.02.013 · Cited by 9
Smith, C., Bhattacharya, D., Hansjee, D., Jeffries, C., Richards, K., & Scott, S. (2024) · BMJ Open · doi:10.1136/bmjopen-2024-086184 · Cited by 6
“…was registered with PROSPERO (CRD42022320327), adhered to the Realist and Meta-narrative Evidence Syntheses: Evolving Standards quality and publication standards (see online supplemental file 1) 41 42 and followed an approach for embedding behaviour change theory into realist review methodology.”
Elbrink, S. H., Elmer, S., & Osborne, R. H. (2024) · Health & Social Care in the Community · doi:10.1155/2024/1960806 · Cited by 13
Flores, A., Harris, J., & Ton, G. (2025) · Agriculture & Food Security · doi:10.1186/s40066-025-00523-6 · Cited by 9
“The steps in this study draw from the Realist and Meta-narrative Evidence Synthesis: Evolving Stand-ards (RAMESES) publication standards guide [28] and modified to fit the context and available resources of the researcher as advised in literature [23].”
Fitzgerald, I., Sahm, L. J., Maidment, I., Wallace, E., Zisman‐Ilani, Y., Højlund, M., O’Dwyer, S., Dhubhlaing, C. N., Crowley, E. K., & Howe, J. (2025) · Schizophrenia Bulletin · doi:10.1093/schbul/sbaf058 · Cited by 6
“24,26 This realist review aimed to address two research questions:”
Meiling, J. B., Schappell, J. B., Twohey, E. E., Prokop, L. J., & Cushman, D. M. (2023) · PM&R · doi:10.1002/pmrj.12952 · Cited by 5
“23,27 Because of the clinical heterogeneity of data, and the combination of results in studies that used more than one type of surgery, a true analysis of the different surgical techniques with regard to preoperative EDX testing and postoperative outcomes could not be performed.”
ResultFitzgerald, I., Sahm, L. J., Howe, J., Maidment, I., Wallace, E., & Crowley, E. K. (2024) · PLoS ONE · doi:10.1371/journal.pone.0304626 · Cited by 5
“Further programme theory refinement will use data identified via formal literature searches [25–27].”
BackgroundMethodResultInfluentialHoverd, E., Staniszewska, S. H., & Dale, J. R. (2021) · Systematic Reviews · doi:10.1186/s13643-021-01652-2 · Cited by 10
Medication optimisation in severe mental illness (MEDIATE): protocol for a realist review
Maidment, I., Wong, G., Duddy, C., Upthegrove, R., Oduola, S., Allen, K. C., Jacklin, S., Howe, J., & MacPhee, M. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-058524 · Cited by 6
Self-citationKeel, T., Machaczek, K. K., Howe, J., King, J. A., Breen, K. C., & Kinnafick, F. (2025) · Mental health and physical activity · doi:10.1016/j.mhpa.2025.100716 · Cited by 4
Shadan, H. H., & Islam, S. M. N. (2025) · FinTech · doi:10.3390/fintech4040052 · Cited by 11
“The researchers [63] emphasise that the essential elements of systematic reviews include the use of exact and repeatable methods for selecting primary research publications, as well as the critical assessment and synthesis of studies that meet the eligibility criteria [64–66].”
Protocol for a realist review of case-based learning in undergraduate medical education
Daly, R., Spooner, M., Offiah, G., Flood, K., & Illing, J. C. (2024) · International Journal of Educational Research Open · doi:10.1016/j.ijedro.2024.100366 · Cited by 7
Jeynes, C., Clifford, N., Callaghan, I., Thorpe, N., Crosbie, B., Forsyth, K., Fazel, S., & Whiting, D. (2025) · BMJ Open · doi:10.1136/bmjopen-2025-099747 · Cited by 5
“20 The RAMESES guidelines do not recommend any particular checklist; however, when considering text or data for inclusion, the following questions will be asked: are the data likely to be biased?”
InfluentialRealist reviews: making sense of evidence for complex nursing interventions
Fitzgerald, I., Harrison, M., Clibbens, N., & Howe, J. (2025) · Evidence-Based Nursing · doi:10.1136/ebnurs-2025-104289 · Cited by 4
“10 11 Identifying relevant data sources In realist reviews, and unlike systematic reviews, developing PT occurs iteratively as the review progresses and moves from data sources to theory development, and in the reverse order.”
InfluentialHammond, S. P., Mickleburgh, E., Duddy, C., Hiller, R. M., Neil, E., Blackett, R., Williams, K., Wilson, J., & Wong, G. (2023) · BMJ Open · doi:10.1136/bmjopen-2023-075093 · Cited by 5
“The coded data was closely inspected, and interpretations were made about whether evidence was functioning as a context, mechanism or outcome and which CMOC the evidence belonged to (EM and SH).”
BackgroundInfluentialSelf-citationMoons, L., Ombelet, F., Deschodt, M., Roo, M. L. D., Oldenburger, E., Bossuyt, I., & Pype, P. F. (2024) · PLoS ONE · doi:10.1371/journal.pone.0310709 · Cited by 5
Sánchez, I. M. H., Méndez, S. R., & Medina-Anzano, S. (2019) · Human Affairs · doi:10.1515/humaff-2019-0004 · Cited by 7
Strategies for Alleviating Spatial Disadvantage: A Systems Thinking Analysis and Plan of Action
Tucker, R., Johnson, L., Liang, J., & Allender, S. E. (2022) · Sustainability · doi:10.3390/su141710477 · Cited by 4
Owen-Boukra, E., Abrams, R., Cai, Z., Duddy, C., Fudge, N., Hamer-Hunt, J., Husson, F., Mahtani, K. R., Ogden, M., Swinglehurst, D., et al. (2022) · BMJ Open · doi:10.1136/bmjopen-2022-067034 · Cited by 4
Self-citationMcLeod, M. C., Campbell, A., Hayhoe, B. W. J., Borek, A., Tonkin-Crine, S. K., Moore, M. V., Butler, C., Walker, A. S., Holmes, A. H., Wong, G., et al. (2024) · BMC Public Health · doi:10.1186/s12889-024-20248-8 · Cited by 7
Self-citationEggleton, K. S., Wearn, A. M., & Goodyear‐Smith, F. (2019) · Education for Primary Care · doi:10.1080/14739879.2019.1705921 · Cited by 4
Abdelfatah, O. A., Hilton, A., Schafheutle, E. I., Wong, G., Holden, K., Scott, L., Roberts, N. W., Haddington, N., Kelly, T., Hibberd, V., et al. (2024) · NIHR Open Research · doi:10.3310/nihropenres.13766.1 · Cited by 5
Self-citationManson, J., Taylor, P., Mawson, S., Bayly, J., Keen, C., Gath, J., Green, T., Anderson, F., Smith, R. A., & O’Cathain, A. (2025) · Palliative Medicine · doi:10.1177/02692163251331166 · Cited by 7
“14 This included creating CMOCs (see Table 2) to inform and refine the programme theory 19 and iteratively going back and forth between the data and CMOCs using realist conceptual tools of situating, juxtaposition, consolidation and reconciling to guide the process.”
InfluentialGP workforce sustainability to maximise effective and equitable patient care: a realist review
Owen-Boukra, E., Burford, B. C., Cohen, T., Duddy, C., Dunn, H., Fadia, V., Goodman, C. M., Henry, C., Lamb, E. I., Ogden, M., et al. (2025) · British Journal of General Practice · doi:10.3399/bjgp.2025.0061 · Cited by 8
Self-citationGreenhalgh, T., Helm, R. K., Poliseli, L., Ratnayake, S., Trofimov, A., & Williamson, J. (2025) · Systematic Reviews · doi:10.1186/s13643-025-02973-2 · Cited by 5
“…reviews (narrative reviews which combine qualitative and quantitative evidence) [127]; and meta-narrative reviews (over-arching reviews which explore how research on a topic has unfolded in different traditions over time, with early ideas and discoveries influencing subsequent work) [128, 129].”
Self-citationSmith, C., Bhattacharya, D., & Scott, S. (2023) · BMJ Open · doi:10.1136/bmjopen-2022-065121 · Cited by 5
Potter, L. C., McDonagh, L., Horwood, J. P., Farr, M., Feder, G. S., & Wong, G. (2023) · Wellcome Open Research · doi:10.12688/wellcomeopenres.19460.2 · Cited by 3
Self-citationSomerville, S. G., Howden, S., Ker, J., & Schofield, S. J. (2024) · International Journal of Healthcare Simulation · doi:10.54531/porh1951 · Cited by 8
Lynch, A. (2025) · Journal of Social Work · doi:10.1177/14680173251353087 · Cited by 8
“…balancing of the guiding principles, enabled a thorough “ sensemaking of the literature ” and created “ a rich picture ” of the “ multiple perspectives ” that have framed understanding of empathy in social work internationally (Wong et al., 2014, p. 40), and identi fi ed areas for further research.”
Meiling, J. B., Moman, R. N., Pagan-Rosado, R. D., Kinzelman-Vesely, E. A., Hunt, C., & Hooten, W. M. (2021) · Journal of Pain Research · doi:10.2147/jpr.s327504 · Cited by 3
“A narrative approach is indicated when a content area has been studied using disparate methods.(9,10) This approach is useful when key clinical factors vary among studies.”
BackgroundAlghamdi, A., Abrams, R., Bailey, J., Alves, P., & Park, S. E. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-055959 · Cited by 5
Broome, E., Meyer, C., Church, P., & Henshaw, H. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-059836 · Cited by 5
Hognon, L., Héraud, N., Varray, A. L., & Torre, K. (2023) · Systematic Reviews · doi:10.1186/s13643-023-02268-4 · Cited by 3
An introduction to realist evaluation and synthesis for kidney research
Taylor, D. M., Nimmo, A., Hole, B. D., & Meléndez‐Torres, G. J. (2023) · Kidney International · doi:10.1016/j.kint.2023.09.015 · Cited by 4
Morton, T. A., Atkinson, T. J., Brooker, D., Wong, G., Evans, S., & Kennard, C. (2019) · BMJ Open · doi:10.1136/bmjopen-2019-032109 · Cited by 5
“Further areas may arise as the searching and analysis continues, as in a realist review this is an iterative process to be revised as necessary as the review progresses.(18) If required, documents focused on interventions that only meet some, not all, of the inclusion criteria may be searched for to gather more inform…”
BackgroundMethodInfluentialSelf-citationBooth, D., & Laguna‐Camacho, A. (2022) · European Journal of Clinical Nutrition · doi:10.1038/s41430-022-01247-7 · Cited by 4
“RANDOMISED SEQUENCES OF BEHAVIOUR COMPONENTS Recent developments of design and analysis of clinical trials by social scientists encompass evaluation of the full organisational complexity of delivering a treatment programme, even when it has just a single component [21, 22].”
BackgroundErku, D., Khatri, R. B., Endalamaw, A., Wolka, E., Nigatu, F., Zewdie, A., & Assefa, Y. A. (2023) · BMJ Open · doi:10.1136/bmjopen-2022-070370 · Cited by 4
“22 Dissemination of these findings is of particular importance for policy-makers and researchers in furthering the debate on promoting PHC reforms and strategies to achieve PHC goals.”
Graham, V. E., Campbell, S., West, C., & CLOUGH, A. R. (2017) · Australian and New Zealand Journal of Public Health · doi:10.1111/1753-6405.12691 · Cited by 3
Surgey, A., Disbeschl, S., Lewis, R. A., Hiscock, J., Nafees, S. B., Law, R., Roberts, J. L., Hendry, A., Hoare, Z., Goulden, N., et al. (2020) · medRxiv · doi:10.1101/2020.11.20.20235614 · Cited by 2
Towards Equitable Diabetes Care: A Global Perspective on Quality Measurement Exchange
Rasooly, A., Manor, O., Shao, R., Ellen, M., & Davidovitch, N. (2025) · Health Systems & Reform · doi:10.1080/23288604.2024.2435076 · Cited by 4
Hong, Q. N., & Brunton, G. (2025) · Education for Information · doi:10.1177/01678329251323445 · Cited by 2
“…tools were mainly developed to assess the quality of a speci fi c type of systematic review approaches such as realist and meta-narrative reviews (Wong et al., 2014), mixed methods systematic reviews (Jimenez et al., 2018), systematic reviews of randomized and non-randomized studies of…”
Backhouse, T., Killett, A., Bratches, R. W. R., & Mioshi, E. (2026) · Journal of Advanced Nursing · doi:10.1111/jan.70204 · Cited by 2
“This synthesis has drawn on the publication standards for re-alist synthesis (RAMESES 1) (Wong et al. 2014).”
Understanding the Mechanisms that Operate within CHIME: A Realist Review Protocol
Norton, M. J., Byrne, J.-P., Bedenik, T., Ryan, M., Brogan, C., Dwyer, D., Walsh, K. R., & Shé, É. N. (2025) · HRB Open Research · doi:10.12688/hrbopenres.14171.1 · Cited by 2
“I [RAMESES-I] guidelines 22–24 .”
Effects of Combined Music and Exercise Therapy on Depression: A Systematic Review and Meta-Analysis
Luo, X., Zhang, X., Vicario, C. M., Mei, Z., & Qi, F. (2026) · Journal of Integrative and Complementary Medicine · doi:10.1177/27683605261416759 · Cited by 2
Pomeroy, M. L., Sanchez, J. O., Cai, C., Garfinkel, S., Côté, P., Frontera, W. R., & Gerber, L. H. (2022) · American Journal of Physical Medicine & Rehabilitation · doi:10.1097/phm.0000000000002046 · Cited by 2
Keel, T., Machaczek, K. K., King, J. A., Breen, K. C., Stubbs, B., & Kinnafick, F. (2023) · BMJ Open · doi:10.1136/bmjopen-2023-073453 · Cited by 4
Nicholls, G., Eaton, G., Ortega, M., Sumera, K., Baliousis, M., Hodgson, J. C., Laparidou, D., Siriwardena, A. N., Leighton, P. A., Redsell, S. A., et al. (2024) · NIHR Open Research · doi:10.3310/nihropenres.13627.2 · Cited by 2
Pennesi, J., Jabs, M., Baillie, S. E., Hart, L., Hay, P., Mitchison, D., Norton, L., Prnjak, K., & Wade, T. D. (2024) · International Journal of Eating Disorders · doi:10.1002/eat.24359 · Cited by 2
Handley, M., Windle, G., Mathie, E., Greco, H.-A., Underwood, B. R., Surr, C., Dening, K. H., Milton, S., Pujari, A. N., Lebcir, R., et al. (2025) · Aging & Mental Health · doi:10.1080/13607863.2025.2478168 · Cited by 3
“The Realist And Meta-narrative Evidence Syntheses: Evolving Standards (RAMESES) quality and publication standards (Wong et al., 2014) guided the development of this review.”
Hammond, S. P., Duddy, C., Mickleburgh, E., Hiller, R. M., Neil, E., Williams, K., Rodgers, L., Wilson, J., & Wong, G. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-058424 · Cited by 2
Self-citationLidegaard, M., Olsen, K. B., & Legg, S. J. (2019) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2019.01.002 · Cited by 3
Turner, S., Sharp, C. A., Sheringham, J., Leamon, S. M., & Fulop, N. (2019) · BMC Health Services Research · doi:10.1186/s12913-019-4792-8 · Cited by 2
“literature searches, team’s expertise, Delphi panels, email discussion list, and workshops [16].”
BackgroundInfluentialMa, J., Li, J., Huang, W., & Wang, H. (2023) · BMJ Open · doi:10.1136/bmjopen-2023-074162 · Cited by 3
“39 However, Mukumbang et al 40 suggested that the CMO configuration based on the fact that interventions (I) can only work when adopted by actors (A), 40 and modified the CMO to Intervention- Context- Actors- Mechanism-Outcome (ICAMO) configurations to improve its explanatory power.”
BackgroundMeta-Synthesis of Qualitative Research
Dawson, A. J. (2018) · Springer eBooks · doi:10.1007/978-981-10-2779-6_112-1 · Cited by 2
Owen-Boukra, E., Burford, B. C., Cohen, T., Duddy, C., Dunn, H., Fadia, V., Goodman, C. M., Henry, C., Lamb, E. I., Ogden, M., et al. (2025) · medRxiv · doi:10.1101/2025.01.26.25321129 · Cited by 2
Self-citationErtuğrul, B., Dullat, J. K., McDonnell, T., O'Dowd, M., & McAuliffe, É. (2025) · PLoS ONE · doi:10.1371/journal.pone.0321720 · Cited by 1
“This will provide a refined realist programme theory [23,27].”
InfluentialEvaluating pharmacist prescribing education programmes: a realist synthesis protocol
Xenos, K., Rees, C. E., Heslop, I., Benrimoj, S. I., & Dineen‐Griffin, S. (2025) · BMJ Open · doi:10.1136/bmjopen-2025-105951 · Cited by 1
Parry, S. L., Oakes, L., Eve, Z., Edwards, S., Lobban, F. A., Chitsabesan, P., & Wong, G. (2025) · Systematic Reviews · doi:10.1186/s13643-025-02882-4 · Cited by 1
“The protocol was registered on PROSPERO on 29 May 2024 (CRD42024542081), and the review will be conducted and reported in adherence to RAMESES quality and publication standards [35].”
Self-citationLock, K., Goh, A., Gerber, K., Tropea, J., Moore, K. J., & Lim, W. K. (2025) · JMIR Research Protocols · doi:10.2196/68332 · Cited by 1
“Following the theory testing phase, all CMOCs and program theories from the case studies will be reviewed for demi-regularities (frequently occurring themes or patterns) to make cross-case comparisons [40,64].”
InfluentialAbdelfatah, O. A., Simpson, J., Giga, S. I., Morris, A. S., & Harding, A. J. E. (2025) · International Coaching Psychology Review · doi:10.53841/bpsicpr.2025.20.2.6 · Cited by 1
Goodwin, R., Wong, G., Moffatt, F., Hendrick, P. A., Kelly, R., & Logan, P. (2026) · BMC Family Practice · doi:10.1186/s12875-026-03197-6 · Cited by 1
“The realist review followed the key stages of a realist review, as previously described by Pawson et al. [37, 42].”
InfluentialSelf-citation
Metadata
- Authors
- Wong, G., Greenhalgh, T., Westhorp, G., & Pawson, R.
- Affiliations
- University of London (GB)
- Centre for Primary Care and Public Health, Queen Mary University of London, London, UK
- Community Matters, Mount Torrens, SA, Australia
- University of Leeds (GB)
- Corresponding author
- Wong, Geoff
- Venue
- Health Services and Delivery Research
- Published
- 2014-09
- Volume
- 2
- Issue
- 30
- Pages
- 1-252
- ISSN
- 2050-4349 (ISSN-L)
- 2050-4357
- OpenAlex
- W2072084577
- Cited by
- 276
- References
- 97
- Citations by year
- 2026: 26 · 2025: 40 · 2024: 31 · 2023: 24 · 2022: 36 · 2021: 40 · 2020: 15 · 2019: 20 · 2018: 14 · 2017: 16 · 2016: 8 · 2015: 6
- FWCI
- 2.75
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Locations
- Health Services and Delivery Research (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Institute for Health Research (10/1008/07)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Keywords
- realist review, meta-narrative review, methodological recommendations, publication standards, training materials, expert consensus, Delphi method, review quality, research training, policy-relevant research, research capacity building
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.