The DOI matches its Crossref record; 93 of the 93 references it cites were found in a registry or an index.
Is realist evaluation keeping its promise? A review of published empirical studies in the field of health systems research
Abstract
This overview aims to stimulate conceptual and practical discussions to help unlock the full potential of realist evaluation in health systems research. Based on a structured literature search, this review maps how the concepts of realist evaluation are applied in health systems research and which methodological problems are encountered. We found a great diversity in the depth of application of the philosophical concepts, use of terminology and scope of application in the research process. Terms of theory-driven evaluation, theories of change and realist evaluation are often used interchangeably. Diverging views exist regarding the nature of ‘mechanism’ and the difference between mechanism and essential context condition. A lack of methodological guidance was highlighted by many authors. Realist evaluation is slowly gaining traction in health systems research, but more clarity is needed concerning the definitions of mechanisms and context and how the configuration of context, mechanism and intervention can be described and assessed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Marchal et al. [18], in a systematic review on realist evaluation in health systems research, also noted that ToC and realist evaluation were often used together or interchangeably.”
From Using theory of change to design and evaluate public health interventions: a systematic review (2015) · cites this paper as [18]
In the citing paper
“Both a published literature review 112 and critical discussions in the applied literature cite several methodological challenges associated with a RE approach, including deciding what constitutes a mechanism, 127 and indeed differentiating between what is a mechanism and what is context.”
From ReseArch with Patient and Public invOlvement: a RealisT evaluation – the RAPPORT study (2015) · cites this paper as [112]
Citations
Cites
Social Theory and Social Structure
Ross, E. J., & Merton, R. Κ. (1958) · The American Catholic Sociological Review · doi:10.2307/3709394 · Cited by 10,318
Social Theory and Social Structure.
Bock, K. E., & Merton, R. Κ. (1969) · American Sociological Review · doi:10.2307/2091967 · Cited by 6,687
Systems Thinking, Systems Practice
Checkland, P. B. (1981) · Cumulative Index of Computer Aided Architectural Design · Cited by 6,256
Systems thinking, systems practice
(1982) · European Journal of Operational Research · doi:10.1016/0377-2217(82)90206-5 · Cited by 3,579
Realist review - a new method of systematic review designed for complex policy interventions
Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2005) · Journal of Health Services Research & Policy · doi:10.1258/1355819054308530 · Cited by 3,190
A set-theoretic approach to organizational configurations
Fiss, P. C. (2007) · Academy of Management Review · doi:10.5465/amr.2007.26586092 · Cited by 2,225
Pawson, R. (2006) · doi:10.4135/9781849209120 · Cited by 1,791
Critical realism: essential readings
(1999) · Choice Reviews Online · doi:10.5860/choice.36-5017 · Cited by 1,683
Designing and evaluating complex interventions to improve health care
Campbell, N. C., Murray, E., Darbyshire, J., Emery, J., Farmer, A., Griffiths, F., Guthrie, B., Lester, H., Wilson, P., & Kinmonth, A. L. (2007) · BMJ · doi:10.1136/bmj.39108.379965.be · Cited by 1,331
Chen, H.-T. (1990) · Medical Entomology and Zoology · Cited by 1,227
Research works printed but not linked: 4
- Connell JP, 1995, New Approaches To Evaluating Community Initiatives. Concepts, Methods, and Contexts
- Kernick D, 2005, British Journal of Medical Practice, 55, 908
- Pawson R, 1997, Realistic Evaluation
- Weiss C, 1995, New Approaches to Evaluating Comprehensive Community Initiatives: Concepts, Methods and Contexts
Cited by
Sorted by citations
Items 401–474 of 474
Realistic Evaluation and the 5Is: A Systematic Approach for Evaluating Security Interventions
Newton, A. (2022) · Springer eBooks · doi:10.1007/978-3-030-91735-7_24
Parsons, D. (2017) · Policy Press eBooks · doi:10.51952/9781447333913.bm001
Co-location of health and leisure to promote physical activity: a realist synthesis
Grinvalds, N. (2022) · Sheffield Hallam University · doi:10.7190/shu-thesis-00480
Hitting the TARGET in primary care
Smeets, R. G. M. (2022) · doi:10.26481/dis.20230113rs
Downey, J., Fornasiero, M., Cooper, S., Bassett, L., Doherty, M., Fong, A. D., Bradley, N., & Cornwall, J. (2023) · Palliative Medicine · doi:10.1177/02692163231152524
Middleton, L. (2017) · doi:10.26686/wgtn.17060417.v1
“While claims are made that realist evaluations are likely to produce findings that are useful to policy-makers (Marchal et al., 2012), others warn that those who commission realist evaluations need to understand that the realist approach does not judge programme effectiveness but “strives instead to enlighten decision…”
BackgroundAlla, F., Cambon, L., & Ridde, V. (2024) · IRD Éditions eBooks · doi:10.4000/books.irdeditions.48333
Alla, F., Cambon, L., & Ridde, V. (2023) · IRD Éditions eBooks · doi:10.4000/books.irdeditions.48412
A graphical method for causal program attribution in theory-based evaluation
Schmidt, R. (2024) · Evaluation · doi:10.1177/13563890231223171
“Moderating variables lie off the impact path—they are not causally affected by the project intervention (Chen, 2005: 240–241; Marchal et al., 2012: 195).”
InfluentialMedical Student Intentions to Move Abroad: A UK-Based Realist Evaluation
McCulloch, E. C., Proctor, D. W., & Mattick, K. L. (2024) · Perspectives on Medical Education · doi:10.5334/pme.1170
Uwamahoro, N. S., Forsyth, J., Andre, F., Mandlate, D., Gilmore, B., & Muhajarine, N. (2024) · BMJ Open · doi:10.1136/bmjopen-2023-075681
Indar, A., Sim, M., Martin‐Misener, R., Sampalli, T., Guk, J., Rose, A. E., & Murphy, G. T. (2024) · Research Square · doi:10.21203/rs.3.rs-4606799/v1
Hudon, C., Chouinard, M., Doucet, S. A., Piccinini‐Vallis, H., Fairman, K., Sampalli, T., Zed, J., Brodeur, M., Chênevert, D., Dépelteau, A., et al. (2024) · BMJ Open · doi:10.1136/bmjopen-2023-083783
“35 36 This will provide an explanation of the relationships between the actors, contextual factors, mechanisms, and outcomes of scale-up.”
BackgroundMitani, S., Ogawara, H., Haruta, J., Sakakibara, T., & Fukahori, H. (2024) · BMJ Open · doi:10.1136/bmjopen-2023-078256
“24 To the best of our knowledge, literature reviews of studies using RE have focused on the healthcare system, 23 knowledge translation, 25 public health, 26 nursing interventions 27 and health promotion.”
BackgroundBosongo, S., Belrhiti, Z., Chenge, F., Criel, B., Marchal, B., & Coppieters, Y. (2024) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph21121646
Self-citationDélamou, A., Grovogui, F. M., Camara, F., Kolié, D., Goumou, T., Miller, L., Nye, A., & Bossert, T. J. (2025) · Bundesgesundheitsblatt - Gesundheitsforschung - Gesundheitsschutz · doi:10.1007/s00103-025-04076-8
Lee, J., Chan, A. W.-M., & Graves, N. (2025) · Springer eBooks · doi:10.1007/978-981-99-7842-7_181
Kaitosalmi, J., & Ratia, M. (2025) · Communications in computer and information science · doi:10.1007/978-3-032-06878-1_12
A Systematic View of the Evaluation of Prevention Programs in the Twenty-First Century
Scoppetta, O. (2025) · Advances in mental health and addiction · doi:10.1007/978-3-031-99621-4_9
Causal Inference, Agency, and the Problem of Inherent Endogeneity
Williams, M. J. (2025) · Annual Review of Political Science · doi:10.1146/annurev-polisci-032624-013736
Wielle, F. V. D., Vandecasteele, R., Verbestel, V., Verloigne, M., Deforche, B. I., Crutzen, R., & Clays, E. (2025) · BMC Public Health · doi:10.1186/s12889-025-24091-3
“Realist evaluation contrasts with traditional RCTs by focusing on the context in which a program operates and the underlying mechanisms driving change [18–22].”
Pomey, M. P., de Guise, M., Desforges, M., Bouchard, K., Vialaron, C., Normandin, L., Iliescu-Nelea, M., Fortin, I., Ganache, I., Régis, C., et al. (2021) · Figshare · doi:10.6084/m9.figshare.13521072
Bosongo, S., Belrhiti, Z., Chenge, F. M., Criel, B., Coppieters, Y., & Marchal, B. (2024) · Figshare · doi:10.6084/m9.figshare.26683297
Self-citationKabongo, E. M., Mukumbang, F. C., Delobelle, P., & Nicol, E. (2021) · Figshare · doi:10.6084/m9.figshare.14189889
Hazen, A. C. M., Sloeserwij, V., GROOT, E. D., de Gier, J. J., de Wit, N. J., Bont, A. A. D., & Zwart, D. L. M. (2024) · Figshare · doi:10.6084/m9.figshare.25678586
Pomey, M. P., de Guise, M., Desforges, M., Bouchard, K., Vialaron, C., Normandin, L., Iliescu-Nelea, M., Fortin, I., Ganache, I., Régis, C., et al. (2021) · Figshare · doi:10.6084/m9.figshare.13521069
Orgill, M., Marchal, B., Shung-King, M., Sikuza, L., & Gilson, L. (2021) · Figshare · doi:10.6084/m9.figshare.14302701
Self-citationShukla, S., Abejirinde, I.-O. O., Meyer, S. R., Shenderovich, Y., & Steinert, J. (2024) · Figshare · doi:10.6084/m9.figshare.25466580
Pomey, M. P., de Guise, M., Desforges, M., Bouchard, K., Vialaron, C., Normandin, L., Iliescu-Nelea, M., Fortin, I., Ganache, I., Régis, C., et al. (2021) · Figshare · doi:10.6084/m9.figshare.13521084
Pomey, M. P., de Guise, M., Desforges, M., Bouchard, K., Vialaron, C., Normandin, L., Iliescu-Nelea, M., Fortin, I., Ganache, I., Régis, C., et al. (2021) · Figshare · doi:10.6084/m9.figshare.13521066
Pomey, M. P., de Guise, M., Desforges, M., Bouchard, K., Vialaron, C., Normandin, L., Iliescu-Nelea, M., Fortin, I., Ganache, I., Régis, C., et al. (2021) · Figshare · doi:10.6084/m9.figshare.13521087
Orgill, M., Marchal, B., Shung-King, M., Sikuza, L., & Gilson, L. (2021) · Figshare · doi:10.6084/m9.figshare.14302704
Self-citationAkuze, J., Annerstedt, K. S., Benova, L., Chipeta, E. K., Dossou, J.-P., Groß, M. M., Kidanto, H., Marchal, B., Alvesson, H. M., Pembe, A. B., et al. (2021) · Figshare · doi:10.6084/m9.figshare.17162942
Self-citationWells, R., Acartürk, C., Mozumder, M. K., Kurt, G., Klein, L. A., Lekkeh, S. A., Beetar, A., Jahan, S., Almeamari, F., Faruk, M. O., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26646265
Akuze, J., Annerstedt, K. S., Benova, L., Chipeta, E. K., Dossou, J.-P., Groß, M. M., Kidanto, H., Marchal, B., Alvesson, H. M., Pembe, A. B., et al. (2021) · Figshare · doi:10.6084/m9.figshare.17162936
Self-citationAkuze, J., Annerstedt, K. S., Benova, L., Chipeta, E. K., Dossou, J.-P., Groß, M. M., Kidanto, H., Marchal, B., Alvesson, H. M., Pembe, A. B., et al. (2021) · Figshare · doi:10.6084/m9.figshare.17162945
Self-citationOrgill, M., Marchal, B., Shung-King, M., Sikuza, L., & Gilson, L. (2021) · Figshare · doi:10.6084/m9.figshare.14302698
Self-citationOrgill, M., Marchal, B., Shung-King, M., Sikuza, L., & Gilson, L. (2021) · Figshare · doi:10.6084/m9.figshare.14302692
Self-citationAkuze, J., Annerstedt, K. S., Benova, L., Chipeta, E. K., Dossou, J.-P., Groß, M. M., Kidanto, H., Marchal, B., Alvesson, H. M., Pembe, A. B., et al. (2021) · Figshare · doi:10.6084/m9.figshare.17162939
Self-citationBosongo, S., Belrhiti, Z., Chenge, F. M., Criel, B., Coppieters, Y., & Marchal, B. (2024) · Figshare · doi:10.6084/m9.figshare.26683285
Self-citationKabongo, E. M., Mukumbang, F. C., Delobelle, P., & Nicol, E. (2021) · Figshare · doi:10.6084/m9.figshare.14189886
Pomey, M. P., de Guise, M., Desforges, M., Bouchard, K., Vialaron, C., Normandin, L., Iliescu-Nelea, M., Fortin, I., Ganache, I., Régis, C., et al. (2021) · Figshare · doi:10.6084/m9.figshare.13521081
Cunningham, U., De Brún, A., & McAuliffe, É. (2020) · Figshare · doi:10.6084/m9.figshare.12375557
Additional file 4 of Standardised data on initiatives—STARDIT: Beta version
Nunn, J., Shafee, T., Chang, S., Stephens, R., Elliott, J., Oliver, S. R., John, D., Smith, M., Orr, N., Preston, J., et al. (2022) · Figshare · doi:10.6084/m9.figshare.20342238
Additional file 1 of Standardised data on initiatives—STARDIT: Beta version
Nunn, J. S., Shafee, T., Chang, S., Stephens, R., Elliott, J., Oliver, S. R., John, D., Smith, M., Orr, N., Preston, J., et al. (2022) · Figshare · doi:10.6084/m9.figshare.20342226
Craig, S. G., Mitchell, G., Halloran, P. O., Stark, P., & Wilson, C. B. (2024) · Figshare · doi:10.6084/m9.figshare.26596151
Additional file 3 of Standardised data on initiatives—STARDIT: Beta version
Nunn, J. S., Shafee, T., Chang, S., Stephens, R., Elliott, J., Oliver, S. R., John, D., Smith, M., Orr, N., Preston, J., et al. (2022) · Figshare · doi:10.6084/m9.figshare.20342235
Orgill, M., Marchal, B., Shung-King, M., Sikuza, L., & Gilson, L. (2021) · Figshare · doi:10.6084/m9.figshare.14302695
Self-citationPomey, M. P., de Guise, M., Desforges, M., Bouchard, K., Vialaron, C., Normandin, L., Iliescu-Nelea, M., Fortin, I., Ganache, I., Régis, C., et al. (2021) · Figshare · doi:10.6084/m9.figshare.13521075
Wells, R., Acarturk, C., Mozumder, M. K., Kurt, G., Klein, L. A., Lekkeh, S. A., Beetar, A., Jahan, S., Almeamari, F., Faruk, M. O., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26646262
Hazen, A. C. M., Sloeserwij, V., GROOT, E. D., de Gier, J. J., de Wit, N. J., Bont, A. A. D., & Zwart, D. L. M. (2024) · Figshare · doi:10.6084/m9.figshare.25678718
Additional file 2 of Standardised data on initiatives—STARDIT: Beta version
Nunn, J. S., Shafee, T., Chang, S., Stephens, R., Elliott, J., Oliver, S. R., John, D., Smith, M., Orr, N., Preston, J., et al. (2022) · Figshare · doi:10.6084/m9.figshare.20342232
Bosongo, S., Belrhiti, Z., Chenge, F. M., Criel, B., Coppieters, Y., & Marchal, B. (2024) · Figshare · doi:10.6084/m9.figshare.26683288
Self-citationBosongo, S., Belrhiti, Z., Chenge, F. M., Criel, B., Coppieters, Y., & Marchal, B. (2024) · Figshare · doi:10.6084/m9.figshare.26683291
Self-citationHawkins, J., Whittaker, A., Salmon, A., Kenny, F., & King-Roskamp, M. R. (2025) · medRxiv · doi:10.64898/2025.11.28.25341232
Jagosh, J., Briscoe, S., Greenley, S. L., Edwards, A., Klok, F. A., Johnson, M., Noble, S., & Pearson, M. (2026) · Research Synthesis Methods · doi:10.1017/rsm.2025.10068
McCulloch, P., Family, H. E., Shaw, A., Vojt, G., Gilchrist, G., Matheson, C., Maxwell, M., Neale, J., Myring, G., McLeod, H., et al. (2026) · International Journal of Drug Policy · doi:10.1016/j.drugpo.2026.105174
Godthelp, J., Heerings, M., Köhne, A. C. J., Noordhof, A., Truijens, F. L., Nooteboom, L. A., & Welten, C. C. M. (2026) · BMC Psychiatry · doi:10.1186/s12888-026-07933-1
“By answering these questions, we aim to provide program designers, policy makers and researchers with a theory grounded in scientific research (program theory) on the effectiveness, transferability, and adaptability of this innovative approach in different contexts [23].”
Scoles, L. H., Myers, T., Holland, M. J. G., & Benkwitz, A. (2026) · Journal of Psychosocial Rehabilitation and Mental Health · doi:10.1007/s40737-026-00524-z
Filipović-Pierucci, A., Irusta, L. A., de la Croix, T., Ledoux, A., & Durme, T. V. (2026) · BMC Family Practice · doi:10.1186/s12875-026-03306-5
“0 programme [32].”
Westlake, D., Meindl, M., & Bennett, V. (2026) · Evaluation · doi:10.1177/13563890261439289
“It keeps the range of contextual factors to consider manageable, which is important since gathering rich contextual data is resource-and time-consuming, and inevitable trade-offs exist between depth of understanding of the programme versus the context (Marchal et al., 2012).”
Rind, G. M. (2026) · International Journal of Educational Reform · doi:10.1177/10567879261453839
Lambert, M., Chouinard, M., Howse, D., Robert, É., Bisson, M., Delahunty‐Pike, A., Dumont‐Samson, O., Schwarz, C., & Hudon, C. (2026) · American Journal of Evaluation · doi:10.1177/10982140261454370
“Theory-driven evaluation approaches, such as realist evaluation, are particularly useful for identifying the mechanisms and contextual factors that contribute to program effectiveness (Marchal et al., 2012).”
Souza, M. F. S., Chinapaw, M. J. M., Silva, C. S., Demetriadou, L., Madsen, L. W., Maluleke, V., Ndwandwe, L., Okafor, A. C., Ogunleye, A. B., Vargas, J., et al. (2026) · Health Promotion International · doi:10.1093/heapro/daag134
“Within public health, it has mostly been conducted in health systems and healthcare settings (e.g. Marchal et al .”
Terminal discharge of the imminently dying from hospital to home: A realist evaluation
Chong, P. H., Low, M., Yeo, Z. Z., Tan, Y. Y., Chen, X., Jason, T. T. E., Tewani, K. G., Koh, L. H., Wong, Y. P., Lee, G., et al. (2026) · Palliative Medicine · doi:10.1177/02692163261485101
Otukpa, E. O., Ziraba, A. K., & Bain, L. E. (2026) · PLOS Global Public Health · doi:10.1371/journal.pgph.0007405
“…premise on which the theory tests and the finding that cases combining systems thinking with participatory design score more evenly than cases operationalizing a single framework is a context– mechanism–outcome claim in its application, as well as in the rigor of its theoretical concept [41,43].”
Zancajo, A., Jover, A., Quilabert, E., & Pagès, M. (2026) · Journal of Education Policy · doi:10.1080/02680939.2026.2743590
Cocoman, O., Maliqi, B., Dsane-Aidoo, P. H., Dohlsten, M., Ruysen, H., Jackson, D. J., & Gilmore, B. (2026) · International Journal of Qualitative Methods · doi:10.1177/16094069261489339
Metadata
- Authors
- Marchal, B., van Belle, S., van Olmen, J., Hoerée, T., & Kegels, G.
- Affiliations
- ITM-A, Belgium
- BTC, Belgium
- Venue
- Evaluation
- Publisher
- SAGE Publications
- Published
- 2012-04
- Volume
- 18
- Issue
- 2
- Pages
- 192-212
- ISSN
- 1356-3890 (ISSN-L)
- 1461-7153
- OpenAlex
- W2077589521
- Cited by
- 476
- References
- 92
- Citations by year
- 2026: 22 · 2025: 29 · 2024: 41 · 2023: 29 · 2022: 51 · 2021: 64 · 2020: 31 · 2019: 40 · 2018: 37 · 2017: 28 · 2016: 31 · 2015: 34 · 2014: 24 · 2013: 12 · 2012: 3
- FWCI
- 30.83
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Evaluation (publishedVersion)
- Topics
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Keywords
- realist evaluation, health systems research, mechanisms, context, intervention, theory of change, theory-based evaluation, methodological recommendations, conceptual clarity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review