Theories of Change and Realistic Evaluation: Peas in a Pod or Apples and Oranges?

Blamey, Avril; Mackenzie, Mhairi

doi:10.1177/1356389007082129

Cited by 383Evaluation and Performance AssessmentAdvanced Causal Inference TechniquesHealth Policy Implementation Science

Theories of Change and Realistic Evaluation: Peas in a Pod or Apples and Oranges?

Blamey, Avril, Mackenzie, Mhairi·2007·Evaluation

DOI 10.1177/1356389007082129

Open this paper in CoChat — free account

Abstract

Two proponents of theory-based approaches to evaluation that have found favour in the UK in recent years are Theories of Change and Realistic Evaluation. In this article we share our evolving views on the points of connection and digression between the approaches based on our reading of the theory-based evaluation literature and our practice experience. We provide a background to the two approaches that emphasizes the importance of programme context in understanding how complex programmes lead to changes in outcomes.We then explore some of the differences in how `theory' is conceptualized and used within the two approaches and consider how knowledge is generated and cumulated in subtly different ways depending on the approach that is taken. Finally, we offer our thoughts on what this means for evaluators on the ground seeking an appropriate framework for their practice.

Integrity signals

Registry

Crossref · 10.1177/1356389007082129

Cites

27 of 27 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Realist approaches have a different theoretical basis to ToC and differ in several ways including how they articulate and generate theory, the degree to which stakeholders are involved and the types of knowledge they seek to generate.
“Realist approaches have a different theoretical basis to ToC and differ in several ways including how they articulate and generate theory, the degree to which stakeholders are involved and the types of knowledge they seek to generate [20].”
From Using theory of change to design and evaluate public health interventions: a systematic review (2015) · cites this paper as [20]

Evidence-based Policy
Pawson, R. (2006) · doi:10.4135/9781849209120 · Cited by 1,791 · see citing works
Theory-driven evaluations
Chen, H.-T. (1990) · Medical Entomology and Zoology · Cited by 1,227 · see citing works
Evaluation : methods for studying programs and policies
Weiss, C. H. (1997) · Cited by 931 · see citing works
What works?Evidence-based policy and practice in public services
Davies, H. T. O., Nutley, S., & SMITH, P. C. (2000) · Policy Press eBooks · doi:10.1332/policypress/9781861341914.001.0001 · Cited by 912 · see citing works
Evidence-based policy: the promise of ‘realist synthesis’
Pawson, R. (2002) · Evaluation · doi:10.1177/135638902401462448 · Cited by 729 · see citing works
Applying a Theory of Change Approach to the Evaluation of Comprehensive Community Initiatives: Progress, Prospects, and Problems
Kubisch, J. P. C. A. A. C. (1998) · Cited by 461 · see citing works
Evidence-based Policy: In Search of a Method
Pawson, R. (2002) · Evaluation · doi:10.1177/1358902002008002512 · Cited by 403 · see citing works
Theory-Based Evaluation and Types of Complexity
Stame, N. (2004) · Evaluation · doi:10.1177/1356389004043135 · Cited by 350 · see citing works
Conceptualising successful partnerships
Dowling, B., Powell, M. A., & Glendinning, C. (2004) · Health & Social Care in the Community · doi:10.1111/j.1365-2524.2004.00500.x · Cited by 348 · see citing works
Evidence, Understanding and Complexity: Evaluation in Non-Linear Systems
Barnes, M., Matka, E., & Sullivan, H. (2003) · Evaluation · doi:10.1177/13563890030093003 · Cited by 208 · see citing works
Nothing as Practical as a Good Theory
Pawson, R. (2003) · Evaluation · doi:10.1177/1356389003094007 · Cited by 194 · see citing works
Nothing as Practical as a Good Theory
Andersen, K. H. (2019) · Princeton University Press eBooks · doi:10.23943/princeton/9780691192956.003.0001 · Cited by 108 · see citing works
Promoting Social Change: The Experience of Health Action Zones in England
BAULD, L., JUDGE, K., BARNES, M., BENZEVAL, M., MACKENZIE, M., & SULLIVAN, H. (2005) · Journal of Social Policy · doi:10.1017/s0047279405008858 · Cited by 106 · see citing works
Self-citation
Evaluating Public Policy Experiments
Martin, S. J., & Sanderson, I. R. (1999) · Evaluation · doi:10.1177/13563899922208977 · Cited by 98 · see citing works
Who Owns the Theory of Change?
Sullivan, H. T., & Stewart, M. (2006) · Evaluation · doi:10.1177/1356389006066971 · Cited by 95 · see citing works
Building Collaborative Capacity through `Theories of Change'
Sullivan, H. T., Barnes, M., & Matka, E. (2002) · Evaluation · doi:10.1177/1358902002008002514 · Cited by 85 · see citing works
The Practice and the Theory
Mackenzie, M., & Blamey, A. (2005) · Evaluation · doi:10.1177/1356389005055538 · Cited by 85 · see citing works
Self-citation
From Programme Theory to Constructivism
Dahler‐Larsen, P. (2001) · Evaluation · doi:10.1177/13563890122209711 · Cited by 83 · see citing works
Integrating a Comparison Group Design into a Theory of Change Evaluation: The Case of the Urban Health Initiative
Weitzman, B. C., Silver, D., & Dillman, K.-N. (2002) · American Journal of Evaluation · doi:10.1177/109821400202300402 · Cited by 52 · see citing works
Integrating a Comparison Group Design into a Theory of Change Evaluation: The Case of the Urban Health Initiative
Weitzman, B. C., Silver, D., & Dillman, K.-N. (2002) · American Journal of Evaluation · doi:10.1016/s1098-2140(02)00236-9 · Cited by 51 · see citing works
Health Action Zones
Barnes, M., Bauld, L., Benzeval, M., Mackenzie, M., Sullivan, H., & Judge, K. (2012) · Routledge eBooks · doi:10.4324/9780203358337 · Cited by 48 · see citing works
Self-citation
The Non-profit Sector Meets the Performance-management Movement
Lindgren, L. (2001) · Evaluation · doi:10.1177/13563890122209694 · Cited by 44 · see citing works
Review: Promoting Realism in Evaluation
Julnes, G., Mark, M. M., & Henry, G. T. (1998) · Evaluation · doi:10.1177/13563899822208743 · Cited by 42 · see citing works
Applying theory-driven evaluation to the British Crime Reduction Programme
Tilley, N. (2004) · Criminal Justice · doi:10.1177/1466802504048465 · Cited by 42 · see citing works
Health Action Zones: Partnerships for Health Equity
Wild, A. (2006) · Health & Social Care in the Community · doi:10.1111/j.1365-2524.2006.00634_3.x · Cited by 40 · see citing works
Using theory-based evaluation to build evidence-based health and social care policy and practice
Bonner, L. (2003) · Critical Public Health · doi:10.1080/0958159031000100224 · Cited by 33 · see citing works
Using and generating evidence: policy makers’ reflections on commissioning and learning from the Scottish Health Demonstration Projects
Mackenzie, M., Blamey, A., & Hanlon, P. (2006) · Evidence & Policy · doi:10.1332/174426406777068885 · Cited by 9 · see citing works
Self-citation

Flagged first, then by citations

Sorted by citations

RAMESES II reporting standards for realist evaluations
Wong, G., Westhorp, G., Manzano, A., Greenhalgh, J., Jagosh, J., & Greenhalgh, T. (2016) · BMC Medicine · doi:10.1186/s12916-016-0643-1 · Cited by 880 · see citing works
The craft of interviewing in realist evaluation
Manzano, A. (2016) · Evaluation · doi:10.1177/1356389016638615 · Cited by 691 · see citing works
Framework for the development and evaluation of complex interventions: gap analysis, workshop and consultation-informed update
Skivington, K., Matthews, L., Simpson, S. A., Craig, P., Baird, J., Blazeby, J. M., Boyd, K., Craig, N. J., French, D., McIntosh, E., et al. (2021) · Health Technology Assessment · doi:10.3310/hta25570 · Cited by 535 · see citing works
Is realist evaluation keeping its promise? A review of published empirical studies in the field of health systems research
Marchal, B., van Belle, S., van Olmen, J., Hoerée, T., & Kegels, G. (2012) · Evaluation · doi:10.1177/1356389012442444 · Cited by 476 · see citing works
Using theory of change to design and evaluate public health interventions: a systematic review
Breuer, E., Lee, L., De Silva, M., & Lund, C. (2015) · Implementation Science · doi:10.1186/s13012-016-0422-6 · Cited by 425 · see citing works
Contribution analysis: Coming of age?
Mayne, J. (2012) · Evaluation · doi:10.1177/1356389012451663 · Cited by 387 · see citing works
What works for whom in which circumstances? On the need to move beyond the ‘what works?’ question in organizational intervention research
Nielsen, K. M., & Miraglia, M. (2016) · Human Relations · doi:10.1177/0018726716670226 · Cited by 334 · see citing works
Using realist evaluation to open the black box of knowledge translation: a state-of-the-art review
Salter, K. L., & Kothari, A. R. (2014) · Implementation Science · doi:10.1186/s13012-014-0115-y · Cited by 282 · see citing works
How and under what circumstances do quality improvement collaboratives lead to better outcomes? A systematic review
Zamboni, K., Baker, U., Tyagi, M., Schellenberg, J., Hill, Z. E., & Hanson, C. (2020) · Implementation Science · doi:10.1186/s13012-020-0978-z · Cited by 231 · see citing works
Capturing Collaborative Challenges: Designing Complexity-Sensitive Theories of Change for Cross-Sector Partnerships
van Tulder, R., & Keen, N. (2018) · Journal of Business Ethics · doi:10.1007/s10551-018-3857-7 · Cited by 188 · see citing works
Evaluating complex social interventions in a complex world
Byrne, D. (2013) · Evaluation · doi:10.1177/1356389013495617 · Cited by 207 · see citing works
Rethinking models of professional learning as tools: a conceptual analysis to inform research and practice
Boylan, M., Coldwell, M., Maxwell, B., & Jordan, J. (2017) · Professional Development in Education · doi:10.1080/19415257.2017.1306789 · Cited by 188 · see citing works
Evaluating community engagement in global health research: the need for metrics
the Ethics Working Group of the HIV Prevention Trials Network, MacQueen, K. M., Bhan, A., Frohlich, J., Holzer, J., & Sugarman, J. (2015) · BMC Medical Ethics · doi:10.1186/s12910-015-0033-9 · Cited by 157 · see citing works
A realist evaluation of the management of a well- performing regional hospital in Ghana
Marchal, B., Dedzo, M., & Kegels, G. (2010) · BMC Health Services Research · doi:10.1186/1472-6963-10-24 · Cited by 156 · see citing works
Using kaizen to improve employee well-being: Results from two organizational intervention studies
Schwarz, U. V. T., Nielsen, K. M., Stenfors, T., & Hasson, H. (2016) · Human Relations · doi:10.1177/0018726716677071 · Cited by 159 · see citing works
Health provider responsiveness to social accountability initiatives in low- and middle-income countries: a realist review
Lodenstein, E., Dieleman, M. A., Gerretsen, B., & Broerse, J. E. W. (2016) · Health Policy and Planning · doi:10.1093/heapol/czw089 · Cited by 145 · see citing works
A New Realistic Evaluation Analysis Method
Jackson, S. F., & Kolla, G. (2012) · American Journal of Evaluation · doi:10.1177/1098214012440030 · Cited by 143 · see citing works
Exploring the influence of professional development on teacher careers: A path model approach
Coldwell, M. (2016) · Teaching and Teacher Education · doi:10.1016/j.tate.2016.10.015 · Cited by 136 · see citing works
Realist review
Hunter, R. L., Gorely, T., Beattie, M., & Harris, K. (2022) · International Review of Sport and Exercise Psychology · doi:10.1080/1750984x.2021.1969674 · Cited by 123 · see citing works
Planning and evaluating mental health services in low- and middle-income countries using theory of change
Breuer, E., De Silva, M. J., Shidaye, R., Petersen, I., Nakku, J., Jordans, M. J. D., Fekadu, A., & Lund, C. (2016) · British Journal of Psychiatry · doi:10.1192/bjp.bp.114.153841 · Cited by 111 · see citing works
Using logic model methods in systematic review synthesis: describing complex pathways in referral management interventions
Baxter, S. K., Blank, L., Woods, H. B., Payne, N., Rimmer, M., & Goyder, E. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-62 · Cited by 114 · see citing works
From intervention to interventional system: towards greater theorization in population health intervention research
Cambon, L., Terral, P., & Alla, F. (2019) · BMC Public Health · doi:10.1186/s12889-019-6663-y · Cited by 105 · see citing works
The realist approach to evaluation research: an introduction
Hewitt, G., Sims, S., & Harris, R. G. (2012) · International Journal of Therapy and Rehabilitation · doi:10.12968/ijtr.2012.19.5.250 · Cited by 100 · see citing works
Towards an integrated framework for evaluating transformative innovation policy
Haddad, C. R., & Bergek, A. (2022) · Research Policy · doi:10.1016/j.respol.2022.104676 · Cited by 99 · see citing works
Theories of change in sustainability science: Understanding how change happens
Oberlack, C., Breu, T., Giger, M., Harari, N., Herweg, K., Mathez-Stiefel, S.-L., Messerli, P., Moser, S., Ott, C., Providoli, I., et al. (2019) · GAIA - Ecological Perspectives for Science and Society · doi:10.14512/gaia.28.2.8 · Cited by 95 · see citing works
How to develop a theory-driven evaluation design? Lessons learned from an adolescent sexual and reproductive health programme in West Africa
Belle, S. V., Marchal, B., Dubourg, D., & Kegels, G. (2010) · BMC Public Health · doi:10.1186/1471-2458-10-741 · Cited by 95 · see citing works
Theory-based evaluation and the social impact of the arts
Galloway, S. (2009) · Cultural Trends · doi:10.1080/09548960902826143 · Cited by 94 · see citing works
Social innovation, financialisation and commodification: a critique of social impact bonds
Sinclair, S., McHugh, N., & Roy, M. J. (2019) · Journal of Economic Policy Reform · doi:10.1080/17487870.2019.1571415 · Cited by 88 · see citing works
Using theories of change in the CGIAR Research Program on Agriculture for Nutrition and Health
Mayne, J. W., & Johnson, N. L. (2015) · Evaluation · doi:10.1177/1356389015605198 · Cited by 87 · see citing works
Enhancing Mentoring in Palliative Care: An Evidence Based Mentoring Framework
Krishna, L. K. R., Tan, L. H. E., Ong, Y. T., Tay, K. T., Hee, J. M., Chiam, M., Chia, E. W. Y., Sheri, K., Tan, X. H., Teo, Y. H., et al. (2020) · Journal of Medical Education and Curricular Development · doi:10.1177/2382120520957649 · Cited by 83 · see citing works
Level models of continuing professional development evaluation: a grounded review and critique
Coldwell, M., & Simkins, T. (2010) · Professional Development in Education · doi:10.1080/19415257.2010.495497 · Cited by 81 · see citing works
Healthy partnerships, healthy citizens? An international review of partnerships in health and social care and patient/user outcomes
Rummery, K. (2009) · Social Science & Medicine · doi:10.1016/j.socscimed.2009.09.004 · Cited by 75 · see citing works
The Dynamic Integrated Evaluation Model (DIEM): Achieving Sustainability in Organizational Intervention through a Participatory Evaluation Approach
Schwarz, U. V. T., Lundmark, R., & Hasson, H. (2016) · Stress and Health · doi:10.1002/smi.2701 · Cited by 71 · see citing works
Dealing with context in logic model development: Reflections from a realist evaluation of a community health worker programme in Nigeria
Ebenso, B., Manzano, A., Uzochukwu, B. S. C., Etiaba, E., Huss, R., Ensor, T., Newell, J. N., Onwujekwe, O. E., Ezumah, N., Hicks, J. P., et al. (2018) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2018.12.002 · Cited by 71 · see citing works
Urban travelers’ pro-environmental behaviors: Composition and role of pro-environmental contextual force
Qin, Q., & Hsu, C. H. C. (2022) · Tourism Management · doi:10.1016/j.tourman.2022.104561 · Cited by 70 · see citing works
The Impact Evaluation of Sustainable Consumption Policy Instruments
Wolff, F., & Schönherr, N. (2011) · Journal of Consumer Policy · doi:10.1007/s10603-010-9152-3 · Cited by 70 · see citing works
Evaluating Climate Change Action for Sustainable Development
van den Berg, R. D., Puri, J., & Uitto, J. I. (2017) · Springer eBooks · doi:10.1007/978-3-319-43702-6 · Cited by 69 · see citing works
Developing a Framework for a Program Theory-Based Approach to Evaluating Policy Processes and Outcomes: Health in All Policies in South Australia
Lawless, A. P., Baum, F. E., Delany‐Crowe, T., MacDougall, C., Williams, C., McDermott, D. R., & van Eyk, H. (2017) · International Journal of Health Policy and Management · doi:10.15171/ijhpm.2017.121 · Cited by 68 · see citing works
Paving the way for sustainable educational change: Reconceptualizing what it means to make educational changes that last
Hubers, M. D. (2020) · Teaching and Teacher Education · doi:10.1016/j.tate.2020.103083 · Cited by 72 · see citing works
Developing a Theory of Change model of service user and caregiver involvement in mental health system strengthening in primary health care in rural Ethiopia
Abayneh, S., Lempp, H. K., Alem, A., Kohrt, B. A., Fekadu, A., & Hanlon, C. (2020) · International Journal of Mental Health Systems · doi:10.1186/s13033-020-00383-6 · Cited by 71 · see citing works
Combining Theories of Change and Realist Evaluation in practice: Lessons from a research on evaluation study
Rolfe, S. (2019) · Evaluation · doi:10.1177/1356389019835229 · Cited by 68 · see citing works
Collaboration between Health Services Managers and Researchers: Making a Difference?
Bullock, A. D., Morris, Z. S., & Atwell, C. (2012) · Journal of Health Services Research & Policy · doi:10.1258/jhsrp.2011.011099 · Cited by 66 · see citing works
Exploring complex causal pathways between urban renewal, health and health inequality using a theory-driven realist approach
Mehdipanah, R., Manzano, A., Borrell, C., Malmusi, D., Rodríguez‐Sanz, M., Greenhalgh, J., Muntaner, C., & Pawson, R. (2014) · Social Science & Medicine · doi:10.1016/j.socscimed.2014.11.050 · Cited by 66 · see citing works
Implementing large-scale workforce change: learning from 55 pilot sites of allied health workforce redesign in Queensland, Australia
Nancarrow, S., Roots, A., Grace, S., Moran, A. M., & Vanniekerk-Lyons, K. (2013) · Human Resources for Health · doi:10.1186/1478-4491-11-66 · Cited by 65 · see citing works
Unpacking context in realist evaluations: Findings from a comprehensive review
Nielsen, S. B., Lemire, S. T., & Tangsig, S. (2021) · Evaluation · doi:10.1177/13563890211053032 · Cited by 63 · see citing works
Integration of robotic surgery into routine practice and impacts on communication, collaboration, and decision making: a realist process evaluation protocol
Randell, R., Greenhalgh, J., Hindmarsh, J., Dowding, D., Jayne, D. G., Pearman, A. D., Gardner, P. H., Croft, J., & Kotzé, A. (2014) · Implementation Science · doi:10.1186/1748-5908-9-52 · Cited by 60 · see citing works
Middle‐Class Political Activism and Middle‐Class Advantage in Relation to Public Services: A Realist Synthesis of the Evidence Base
Matthews, P. J., & Hastings, A. (2012) · Social Policy and Administration · doi:10.1111/j.1467-9515.2012.00866.x · Cited by 58 · see citing works
Some reflections on Pawson’s Science of Evaluation: A Realist Manifesto
Astbury, B. (2013) · Evaluation · doi:10.1177/1356389013505039 · Cited by 56 · see citing works
Putting context centre stage: evidence from a systems evaluation of an area based empowerment initiative in England
Orton, L., Halliday, E. C., Collins, M., Egan, M., Lewis, S., Ponsford, R., Powell, K., Salway, S., Townsend, A. F., Whitehead, M. M., et al. (2016) · Critical Public Health · doi:10.1080/09581596.2016.1250868 · Cited by 56 · see citing works
Effective characteristics of professional development programs for science and technology education
Hubers, M. D., Endedijk, M., & van Veen, K. (2020) · Professional Development in Education · doi:10.1080/19415257.2020.1752289 · Cited by 72 · see citing works
Addressing gender inequality in science: the multifaceted challenge of assessing impact
Schmidt, E. K., & Cacace, M. (2017) · Research Evaluation · doi:10.1093/reseval/rvx003 · Cited by 55 · see citing works
Evaluation of patient engagement in medicine development: A multi‐stakeholder framework with metrics
Vat, L. E., Finlay, T. M. D., Robinson, P., Barbareschi, G., Boudes, M., Ponce, A. M., Dinboeck, M., Eichmann, L., Ferrer, E., Fruytier, S. E., et al. (2021) · Health Expectations · doi:10.1111/hex.13191 · Cited by 53 · see citing works
Benefits of psychosocial intervention and continuity of care by child and family health nurses in the pre‐ and postnatal period: process evaluation
Kemp, L., Harris, E., McMahon, C. A., Matthey, S., Vimpani, G., Anderson, T. M., Schmied, V. A., & Aslam, H. (2012) · Journal of Advanced Nursing · doi:10.1111/jan.12052 · Cited by 53 · see citing works
The contribution of process tracing to theory-based evaluations of complex aid instruments
Schmitt, J., & Beach, D. (2015) · Evaluation · doi:10.1177/1356389015607739 · Cited by 53 · see citing works
Indicators for measuring the contributions of individual knowledge brokers
Maag, S., Alexander, T. J., Kase, R., & Hoffmann, S. (2018) · Environmental Science & Policy · doi:10.1016/j.envsci.2018.06.002 · Cited by 53 · see citing works
Applying a realist(ic) framework to the evaluation of a new model of emergency department based mental health nursing practice
Wand, T., White, K., & Patching, J. (2010) · Nursing Inquiry · doi:10.1111/j.1440-1800.2010.00488.x · Cited by 53 · see citing works
Evaluating unintended consequences: New insights into solving practical, ethical and political challenges of evaluation
Oliver, K. A., Lorenc, T., & Tinkler, J. (2019) · Evaluation · doi:10.1177/1356389019850847 · Cited by 53 · see citing works
To what extent can the activities of the South Australian Health in All Policies initiative be linked to population health outcomes using a program theory-based evaluation?
Baum, F. E., Delany‐Crowe, T., MacDougall, C., van Eyk, H., Lawless, A. P., Williams, C., & Marmot, M. G. (2019) · BMC Public Health · doi:10.1186/s12889-019-6408-y · Cited by 50 · see citing works
Towards appropriate mainstreaming of “Theory of Change” approaches into agricultural research for development: Challenges and opportunities
Maru, Y., Sparrow, A. D., Butler, J., Banerjee, O., Ison, R. L., Hall, A., & Carberry, P. (2018) · Agricultural Systems · doi:10.1016/j.agsy.2018.04.010 · Cited by 50 · see citing works
A mandala of faculty development: using theory-based evaluation to explore contexts, mechanisms and outcomes
Onyura, B., Ng, S., Baker, L. R., Lieff, S., Millar, B., & Mori, B. (2016) · Advances in Health Sciences Education · doi:10.1007/s10459-016-9690-9 · Cited by 49 · see citing works
A study of human resource competencies required to implement community rehabilitation in less resourced settings
Gilmore, B., MacLachlan, M., McVeigh, J., McClean, C., Carr, S. C., Duttine, A., Mannan, H., McAuliffe, É., Mji, G., Eide, A. H., et al. (2017) · Human Resources for Health · doi:10.1186/s12960-017-0240-1 · Cited by 48 · see citing works
Contexts, Mechanisms, and Outcomes That Matter in Dutch Community-Based Physical Activity Programs Targeting Socially Vulnerable Groups
Herens, M. C., Wagemakers, A., Vaandrager, L., van Ophem, J., & Koelen, M. A. (2016) · Evaluation & the Health Professions · doi:10.1177/0163278716652940 · Cited by 45 · see citing works
Evaluating outcome-based payment programmes: challenges for evidence-based policy
Fox, C., & Morris, S. P. (2019) · Journal of Economic Policy Reform · doi:10.1080/17487870.2019.1575217 · Cited by 44 · see citing works
Towards Developing an Initial Programme Theory: Programme Designers and Managers Assumptions on the Antiretroviral Treatment Adherence Club Programme in Primary Health Care Facilities in the Metropolitan Area of Western Cape Province, South Africa
Mukumbang, F. C., Belle, S. V., Marchal, B., & van Wyk, B. E. (2016) · PLoS ONE · doi:10.1371/journal.pone.0161790 · Cited by 44 · see citing works
The health promoting sports club model: an intervention planning framework
Hoye, A. V., Johnson, S., Geidne, S., Donaldson, A., Rostan, F., Lemonnier, F., & Vuillemin, A. (2020) · Health Promotion International · doi:10.1093/heapro/daaa093 · Cited by 43 · see citing works
Finding “What Works”: Theory of Change, Contingent Universals, and Virtuous Failure in Global Mental Health
Bemme, D. (2019) · Culture Medicine and Psychiatry · doi:10.1007/s11013-019-09637-6 · Cited by 40 · see citing works
Protocol: Realist synthesis of the impact of unemployment insurance policies on poverty and health
Molnar, A., O'Campo, P. J., Ng, E., Mitchell, C., Muntaner, C., Renahy, É., John, A. S., & Shankardass, K. (2014) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2014.09.002 · Cited by 39 · see citing works
Chinese martial arts and the Olympics: Analysing the policy of the International Wushu Federation
Han, Q.-S., Theeboom, M., & Zhu, D. H. (2020) · International Review for the Sociology of Sport · doi:10.1177/1012690220957177 · Cited by 39 · see citing works
Enabling conditions for effective marine spatial planning
Zuercher, R., Ban, N. C., Flannery, W., Guerry, A. D., Halpern, B. S., Magris, R. A., Mahajan, S. L., Motzer, N., Spalding, A. K., Stelzenmüller, V., et al. (2022) · Marine Policy · doi:10.1016/j.marpol.2022.105141 · Cited by 38 · see citing works
What is the evidence on interventions to manage referral from primary to specialist non-emergency care? A systematic review and logic model synthesis
Blank, L., Baxter, S. K., Woods, H. B., Goyder, E., Lee, A. C., Payne, N., & Rimmer, M. (2015) · Health Services and Delivery Research · doi:10.3310/hsdr03240 · Cited by 37 · see citing works
Developing a programme theory for sport and employability programmes for NEETs
Coalter, F., Theeboom, M., & Truyens, J. (2020) · International Journal of Sport Policy and Politics · doi:10.1080/19406940.2020.1832136 · Cited by 39 · see citing works
Realistic evaluation of an emergency department‐based mental health nurse practitioner outpatient service in Australia
Wand, T., White, K., & Patching, J. (2011) · Nursing and Health Sciences · doi:10.1111/j.1442-2018.2011.00601.x · Cited by 36 · see citing works
A realistic evaluation of fines for hospital discharges: Incorporating the history of programme evaluations in the analysis
Manzano, A. (2011) · Evaluation · doi:10.1177/1356389010389913 · Cited by 36 · see citing works
Reconsidering context: Six underlying features of context to improve learning from evaluation
Coldwell, M. (2018) · Evaluation · doi:10.1177/1356389018803234 · Cited by 36 · see citing works
Current challenges in population health intervention research
Cambon, L., & Alla, F. (2019) · Journal of Epidemiology & Community Health · doi:10.1136/jech-2019-212225 · Cited by 37 · see citing works
European Rural Demographic Strategies: Foreshadowing Post-Lisbon Rural Development Policy?
Dax, T., & Copus, A. (2022) · World · doi:10.3390/world3040053 · Cited by 35 · see citing works
A theory of change for student-led academic integrity
Richards, D., Saddiqui, S., White, F., McGuigan, N., & Homewood, J. (2016) · Quality in Higher Education · doi:10.1080/13538322.2016.1265849 · Cited by 34 · see citing works
An integrative framework to evaluate impacts of complex tourism change initiatives
Roodbari, H., & Olya, H. (2023) · Tourism Management · doi:10.1016/j.tourman.2023.104829 · Cited by 34 · see citing works
Monitoring population‐level responses of marine mammals to human activities
Fleishman, E., da Costa, D. P., Harwood, J., Kraus, S. D., Moretti, D., New, L., Schick, R. S., Schwarz, L. K., Simmons, S. E., Thomas, L., et al. (2016) · Marine Mammal Science · doi:10.1111/mms.12310 · Cited by 33 · see citing works
Designing an Integrated Care Initiative for Vulnerable Families: Operationalisation of Realist Causal and Programme Theory, Sydney Australia
Eastwood, J. G., Shaw, M., Garg, P., de Souza, D., Tyler, I. V., Dean, L., Macsween, M., & Moore, M. (2019) · International Journal of Integrated Care · doi:10.5334/ijic.3980 · Cited by 33 · see citing works
Sport, disability and (inclusive) education: critical insights and understandings from the Playdagogy programme
Sandford, R. A., Beckett, A. E., & Giulianotti, R. (2021) · Sport Education and Society · doi:10.1080/13573322.2021.1902299 · Cited by 33 · see citing works
Using theories of change to design monitoring and evaluation of community engagement in research: experiences from a research institute in Malawi
Gooding, K., Makwinja, R., Nyirenda, D., Vincent, R., & Sambakunsi, R. (2018) · Wellcome Open Research · doi:10.12688/wellcomeopenres.13790.1 · Cited by 32 · see citing works
A Systems Approach to Evaluating Organisational Change in Children's Social Care
Munro, E. R., & Hubbard, A. (2011) · The British Journal of Social Work · doi:10.1093/bjsw/bcr074 · Cited by 32 · see citing works
Working better together: new approaches for understanding the value and challenges of organizational partnerships
Riggs, E., Block, K., Warr, D. J., & Gibbs, L. F. (2013) · Health Promotion International · doi:10.1093/heapro/dat022 · Cited by 32 · see citing works
Using theory-based evaluation to understand what works in asset-based community development
Ward, S. (2021) · Community Development Journal · doi:10.1093/cdj/bsab046 · Cited by 31 · see citing works
Going Beyond Mixed Methods to Mixed Approaches: A Systems Perspective for Asking the Right Questions
Garcia, J. R., & Zazueta, A. E. (2015) · IDS Bulletin · doi:10.1111/1759-5436.12119 · Cited by 31 · see citing works
Exploring taught masters education for healthcare practitioners: a systematic review of literature
Madi, M., Hamzeh, H., Griffiths, M., Rushton, A. B., & Heneghan, N. R. (2019) · BMC Medical Education · doi:10.1186/s12909-019-1768-7 · Cited by 31 · see citing works
Conceptualising the Contexts, Mechanisms and Outcomes of Intensive Family Intervention Projects
Batty, E., & Flint, J. (2012) · Social Policy and Society · doi:10.1017/s1474746412000073 · Cited by 31 · see citing works
Beyond the RCT
Goodman, L. A., Epstein, D., & Sullivan, C. M. (2017) · American Journal of Evaluation · doi:10.1177/1098214017721008 · Cited by 31 · see citing works
Using measures of wellbeing for impact evaluation: Proof of concept developed with an Indigenous community undertaking land management programs in northern Australia
Larson, S., Stoeckl, N., Jarvis, D., Addison, J., Prior, S., & Esparon, M. (2018) · AMBIO · doi:10.1007/s13280-018-1058-3 · Cited by 31 · see citing works
Using theory of change to develop an intervention theory for designing and evaluating behavior change SDApps for healthy eating and physical exercise: the OCAPREV theory
Aromatario, O., Hoye, A. V., Vuillemin, A., Foucaut, A.-M., Pommier, J., & Cambon, L. (2019) · BMC Public Health · doi:10.1186/s12889-019-7828-4 · Cited by 32 · see citing works
Integrated approaches to natural resources management—Theory and practice
Tengberg, A. E., & Valencia, S. C. (2018) · Land Degradation and Development · doi:10.1002/ldr.2946 · Cited by 31 · see citing works
Designing Initiatives for Vulnerable Families: From Theory to Design in Sydney, Australia
Eastwood, J. G., de Souza, D., Shaw, M., Garg, P., Woolfenden, S. R., Tyler, I. V., & Kemp, L. (2019) · International Journal of Integrated Care · doi:10.5334/ijic.3963 · Cited by 29 · see citing works
Childsmile after 10 years part 2: programme development, implementation and evaluation
Macpherson, L. M. D., Rodgers, J., & Conway, D. I. (2019) · Dental Update · doi:10.12968/denu.2019.46.3.238 · Cited by 29 · see citing works
Sustainability and social justice dimension indicators for applied renewable energy research: A responsible approach proposal
Carbajo, R., & Cabeza, L. F. (2019) · Applied Energy · doi:10.1016/j.apenergy.2019.113429 · Cited by 27 · see citing works
Combining the theory of change and realist evaluation approaches to elicit an initial program theory of the MomConnect program in South Africa
Kabongo, E. M., Mukumbang, F. C., Delobelle, P., & Nicol, E. (2020) · BMC Medical Research Methodology · doi:10.1186/s12874-020-01164-y · Cited by 27 · see citing works
Community Theories of Change: Linking Environmental Justice to Sustainability through Stakeholder Perceptions in Milwaukee (WI, USA)
Hornik, K., Cutts, B. B., & Greenlee, A. J. (2016) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph13100979 · Cited by 27 · see citing works
Understanding the implementation and effectiveness of a group-based early parenting intervention: a process evaluation protocol
Hickey, G., McGilloway, S., Furlong, M., Leckey, Y., Bywater, T. J., & Donnelly, M. (2016) · BMC Health Services Research · doi:10.1186/s12913-016-1737-3 · Cited by 26 · see citing works
Strengthening health system to improve immunization for migrants in China
Fang, H., Yang, L., Zhang, H., Li, C., Wen, L., Sun, L. J., Hanson, K., & Meng, Q. (2017) · International Journal for Equity in Health · doi:10.1186/s12939-016-0504-8 · Cited by 26 · see citing works
Tensions of evaluating innovation in a living lab: Moving beyond actionable knowledge production
Dekker, R., Geuijen, K., & Oliver, C. (2021) · Evaluation · doi:10.1177/1356389021997848 · Cited by 26 · see citing works

Authors: Blamey, A., & Mackenzie, M.
Affiliations: National Health Service Scotland (GB)
University of Glasgow (GB)
ORCID: Blamey, Avril
Mackenzie, Mhairi
Venue: Evaluation
Publisher: SAGE Publications
Published: 2007-10
Volume: 13
Issue: 4
Pages: 439-455
ISSN: 1356-3890 (ISSN-L)
1461-7153
DOI: 10.1177/1356389007082129
OpenAlex: W2145892273
Cited by: 383
References: 27
Citations by year: 2026: 13 · 2025: 16 · 2024: 20 · 2023: 18 · 2022: 26 · 2021: 23 · 2020: 41 · 2019: 45 · 2018: 21 · 2017: 26 · 2016: 34 · 2015: 20 · 2014: 15 · 2013: 14 · 2012: 23
FWCI: 9.03
Type: journal article
Language: en
Open access: closed
Licence: journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations: Evaluation (publishedVersion)
Topics: Social Sciences › Decision Sciences › Management Science and Operations Research › Evaluation and Performance Assessment
Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
Keywords: theory of change, realist evaluation, theory-based evaluation, program outcomes, knowledge production, evaluator practice, evaluation framework

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Theories of Change and Realistic Evaluation: Peas in a Pod or Apples and Oranges?

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Cites

Cited by

Related

Record

About these checks