Cited by 383Evaluation and Performance AssessmentAdvanced Causal Inference TechniquesHealth Policy Implementation Science

The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.

Theories of Change and Realistic Evaluation: Peas in a Pod or Apples and Oranges?

Blamey, Avril, Mackenzie, Mhairi·2007·Evaluation

DOI 10.1177/1356389007082129

Open this paper in CoChat — free account

Abstract

Two proponents of theory-based approaches to evaluation that have found favour in the UK in recent years are Theories of Change and Realistic Evaluation. In this article we share our evolving views on the points of connection and digression between the approaches based on our reading of the theory-based evaluation literature and our practice experience. We provide a background to the two approaches that emphasizes the importance of programme context in understanding how complex programmes lead to changes in outcomes.We then explore some of the differences in how `theory' is conceptualized and used within the two approaches and consider how knowledge is generated and cumulated in subtly different ways depending on the approach that is taken. Finally, we offer our thoughts on what this means for evaluators on the ground seeking an appropriate framework for their practice.

Integrity signals

Registry

Crossref · 10.1177/1356389007082129

Cites

27 of 27 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Evidence-based Policy
Pawson, R. (2006) · doi:10.4135/9781849209120 · Cited by 1,791
Theory-driven evaluations
Chen, H.-T. (1990) · Medical Entomology and Zoology · Cited by 1,227
Evaluation : methods for studying programs and policies
Weiss, C. H. (1997) · Cited by 931
Evidence-based policy: the promise of ‘realist synthesis’
Pawson, R. (2002) · Evaluation · doi:10.1177/135638902401462448 · Cited by 729
What works?Evidence-based policy and practice in public services
Davies, H., Nutley, S., & Smith, P. C. (2000) · Policy Press eBooks · doi:10.1332/policypress/9781861341914.001.0001 · Cited by 558
Applying a Theory of Change Approach to the Evaluation of Comprehensive Community Initiatives: Progress, Prospects, and Problems
Kubisch, J. P. C. A. A. C. (1998) · Cited by 461
Evidence-based Policy: In Search of a Method
Pawson, R. (2002) · Evaluation · doi:10.1177/1358902002008002512 · Cited by 403
Theory-Based Evaluation and Types of Complexity
Stame, N. (2004) · Evaluation · doi:10.1177/1356389004043135 · Cited by 383
Conceptualising successful partnerships
Dowling, B., Powell, M. A., & Glendinning, C. (2004) · Health & Social Care in the Community · doi:10.1111/j.1365-2524.2004.00500.x · Cited by 348
Evidence, Understanding and Complexity: Evaluation in Non-Linear Systems
Barnes, M., Matka, E., & Sullivan, H. (2003) · Evaluation · doi:10.1177/13563890030093003 · Cited by 208

Show all 27 references

Research works printed but not linked: 8

Auspos, P., 2004, Building Knowledge about Community Change: Moving beyond Evaluations
Chen, H.T., 1990, Evaluation
Connell, J.P., 1995, New Approaches to Evaluating Community Initiatives, vol. 1, Concepts, Methods and Contexts
Dowling, B., 2004, Community, 12, 309
Fulbright-Anderson, K., 1998, New Approaches to Evaluating Community Initiatives, vol. 2, Theory, Measurement, and Analysis
Gambone, M., 1998, Challenges of Measurement in Community Change Initiatives
Mackenzie, M., 2006, Policy, 2, 211
Pawson, R., 1997, Evaluation

Sorted by citations

RAMESES II reporting standards for realist evaluations
Wong, G., Westhorp, G., Manzano, A., Greenhalgh, J., Jagosh, J., & Greenhalgh, T. (2016) · BMC Medicine · doi:10.1186/s12916-016-0643-1 · Cited by 880
The craft of interviewing in realist evaluation
Manzano, A. (2016) · Evaluation · doi:10.1177/1356389016638615 · Cited by 691
Framework for the development and evaluation of complex interventions: gap analysis, workshop and consultation-informed update
Skivington, K., Matthews, L., Simpson, S. A., Craig, P., Baird, J., Blazeby, J. M., Boyd, K., Craig, N. J., French, D., McIntosh, E., et al. (2021) · Health Technology Assessment · doi:10.3310/hta25570 · Cited by 585
Is realist evaluation keeping its promise? A review of published empirical studies in the field of health systems research
Marchal, B., van Belle, S., van Olmen, J., Hoerée, T., & Kegels, G. (2012) · Evaluation · doi:10.1177/1356389012442444 · Cited by 476
Using theory of change to design and evaluate public health interventions: a systematic review
Breuer, E., Lee, L., De Silva, M., & Lund, C. (2015) · Implementation Science · doi:10.1186/s13012-016-0422-6 · Cited by 425
Contribution analysis: Coming of age?
Mayne, J. (2012) · Evaluation · doi:10.1177/1356389012451663 · Cited by 387
What works for whom in which circumstances? On the need to move beyond the ‘what works?’ question in organizational intervention research
Nielsen, K. M., & Miraglia, M. (2016) · Human Relations · doi:10.1177/0018726716670226 · Cited by 385
Using realist evaluation to open the black box of knowledge translation: a state-of-the-art review
Salter, K. L., & Kothari, A. R. (2014) · Implementation Science · doi:10.1186/s13012-014-0115-y · Cited by 308
How and under what circumstances do quality improvement collaboratives lead to better outcomes? A systematic review
Zamboni, K., Baker, U., Tyagi, M., Schellenberg, J., Hill, Z. E., & Hanson, C. (2020) · Implementation Science · doi:10.1186/s13012-020-0978-z · Cited by 238
Capturing Collaborative Challenges: Designing Complexity-Sensitive Theories of Change for Cross-Sector Partnerships
van Tulder, R. J. M., & Keen, N. (2018) · Journal of Business Ethics · doi:10.1007/s10551-018-3857-7 · Cited by 238
Evaluating complex social interventions in a complex world
Byrne, D. (2013) · Evaluation · doi:10.1177/1356389013495617 · Cited by 207
Rethinking models of professional learning as tools: a conceptual analysis to inform research and practice
Boylan, M., Coldwell, M., Maxwell, B., & Jordan, J. (2017) · Professional Development in Education · doi:10.1080/19415257.2017.1306789 · Cited by 188
Evaluating community engagement in global health research: the need for metrics
the Ethics Working Group of the HIV Prevention Trials Network, MacQueen, K. M., Bhan, A., Frohlich, J., Holzer, J., & Sugarman, J. (2015) · BMC Medical Ethics · doi:10.1186/s12910-015-0033-9 · Cited by 157
A realist evaluation of the management of a well- performing regional hospital in Ghana
Marchal, B., Dedzo, M., & Kegels, G. (2010) · BMC Health Services Research · doi:10.1186/1472-6963-10-24 · Cited by 156
Using kaizen to improve employee well-being: Results from two organizational intervention studies
Schwarz, U. V. T., Nielsen, K. M., Stenfors, T., & Hasson, H. (2016) · Human Relations · doi:10.1177/0018726716677071 · Cited by 159
Health provider responsiveness to social accountability initiatives in low- and middle-income countries: a realist review
Lodenstein, E., Dieleman, M. A., Gerretsen, B., & Broerse, J. E. W. (2016) · Health Policy and Planning · doi:10.1093/heapol/czw089 · Cited by 145
A New Realistic Evaluation Analysis Method
Jackson, S. F., & Kolla, G. (2012) · American Journal of Evaluation · doi:10.1177/1098214012440030 · Cited by 143
Exploring the influence of professional development on teacher careers: A path model approach
Coldwell, M. (2016) · Teaching and Teacher Education · doi:10.1016/j.tate.2016.10.015 · Cited by 136
Realist review
Hunter, R. L., Gorely, T., Beattie, M., & Harris, K. (2022) · International Review of Sport and Exercise Psychology · doi:10.1080/1750984x.2021.1969674 · Cited by 123
Planning and evaluating mental health services in low- and middle-income countries using theory of change
Breuer, E., De Silva, M. J., Shidaye, R., Petersen, I., Nakku, J., Jordans, M. J. D., Fekadu, A., & Lund, C. (2016) · British Journal of Psychiatry · doi:10.1192/bjp.bp.114.153841 · Cited by 111
Using logic model methods in systematic review synthesis: describing complex pathways in referral management interventions
Baxter, S. K., Blank, L., Woods, H. B., Payne, N., Rimmer, M., & Goyder, E. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-62 · Cited by 114
From intervention to interventional system: towards greater theorization in population health intervention research
Cambon, L., Terral, P., & Alla, F. (2019) · BMC Public Health · doi:10.1186/s12889-019-6663-y · Cited by 105
The realist approach to evaluation research: an introduction
Hewitt, G., Sims, S., & Harris, R. G. (2012) · International Journal of Therapy and Rehabilitation · doi:10.12968/ijtr.2012.19.5.250 · Cited by 100
Towards an integrated framework for evaluating transformative innovation policy
Haddad, C. R., & Bergek, A. (2022) · Research Policy · doi:10.1016/j.respol.2022.104676 · Cited by 99
Theories of change in sustainability science: Understanding how change happens
Oberlack, C., Breu, T., Giger, M., Harari, N., Herweg, K., Mathez-Stiefel, S.-L., Messerli, P., Moser, S., Ott, C., Providoli, I., et al. (2019) · GAIA - Ecological Perspectives for Science and Society · doi:10.14512/gaia.28.2.8 · Cited by 95
How to develop a theory-driven evaluation design? Lessons learned from an adolescent sexual and reproductive health programme in West Africa
Belle, S. V., Marchal, B., Dubourg, D., & Kegels, G. (2010) · BMC Public Health · doi:10.1186/1471-2458-10-741 · Cited by 95
Theory-based evaluation and the social impact of the arts
Galloway, S. (2009) · Cultural Trends · doi:10.1080/09548960902826143 · Cited by 94
Social innovation, financialisation and commodification: a critique of social impact bonds
Sinclair, S., McHugh, N., & Roy, M. J. (2019) · Journal of Economic Policy Reform · doi:10.1080/17487870.2019.1571415 · Cited by 88
Using theories of change in the CGIAR Research Program on Agriculture for Nutrition and Health
Mayne, J. W., & Johnson, N. L. (2015) · Evaluation · doi:10.1177/1356389015605198 · Cited by 87
Enhancing Mentoring in Palliative Care: An Evidence Based Mentoring Framework
Krishna, L. K. R., Tan, L. H. E., Ong, Y. T., Tay, K. T., Hee, J. M., Chiam, M., Chia, E. W. Y., Sheri, K., Tan, X. H., Teo, Y. H., et al. (2020) · Journal of Medical Education and Curricular Development · doi:10.1177/2382120520957649 · Cited by 86
Level models of continuing professional development evaluation: a grounded review and critique
Coldwell, M., & Simkins, T. (2010) · Professional Development in Education · doi:10.1080/19415257.2010.495497 · Cited by 81
Healthy partnerships, healthy citizens? An international review of partnerships in health and social care and patient/user outcomes
Rummery, K. (2009) · Social Science & Medicine · doi:10.1016/j.socscimed.2009.09.004 · Cited by 75
The Dynamic Integrated Evaluation Model (DIEM): Achieving Sustainability in Organizational Intervention through a Participatory Evaluation Approach
Schwarz, U. V. T., Lundmark, R., & Hasson, H. (2016) · Stress and Health · doi:10.1002/smi.2701 · Cited by 71
Dealing with context in logic model development: Reflections from a realist evaluation of a community health worker programme in Nigeria
Ebenso, B., Manzano, A., Uzochukwu, B. S. C., Etiaba, E., Huss, R., Ensor, T., Newell, J. N., Onwujekwe, O. E., Ezumah, N., Hicks, J. P., et al. (2018) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2018.12.002 · Cited by 71
Urban travelers’ pro-environmental behaviors: Composition and role of pro-environmental contextual force
Qin, Q., & Hsu, C. H. C. (2022) · Tourism Management · doi:10.1016/j.tourman.2022.104561 · Cited by 70
The Impact Evaluation of Sustainable Consumption Policy Instruments
Wolff, F., & Schönherr, N. (2011) · Journal of Consumer Policy · doi:10.1007/s10603-010-9152-3 · Cited by 70
Evaluating Climate Change Action for Sustainable Development
van den Berg, R. D., Puri, J., & Uitto, J. I. (2017) · Springer eBooks · doi:10.1007/978-3-319-43702-6 · Cited by 69
Developing a Framework for a Program Theory-Based Approach to Evaluating Policy Processes and Outcomes: Health in All Policies in South Australia
Lawless, A. P., Baum, F. E., Delany‐Crowe, T., MacDougall, C., Williams, C., McDermott, D. R., & van Eyk, H. (2017) · International Journal of Health Policy and Management · doi:10.15171/ijhpm.2017.121 · Cited by 68
Paving the way for sustainable educational change: Reconceptualizing what it means to make educational changes that last
Hubers, M. D. (2020) · Teaching and Teacher Education · doi:10.1016/j.tate.2020.103083 · Cited by 94
Developing a Theory of Change model of service user and caregiver involvement in mental health system strengthening in primary health care in rural Ethiopia
Abayneh, S., Lempp, H. K., Alem, A., Kohrt, B. A., Fekadu, A., & Hanlon, C. (2020) · International Journal of Mental Health Systems · doi:10.1186/s13033-020-00383-6 · Cited by 67
Combining Theories of Change and Realist Evaluation in practice: Lessons from a research on evaluation study
Rolfe, S. (2019) · Evaluation · doi:10.1177/1356389019835229 · Cited by 68
Collaboration between Health Services Managers and Researchers: Making a Difference?
Bullock, A. D., Morris, Z. S., & Atwell, C. (2012) · Journal of Health Services Research & Policy · doi:10.1258/jhsrp.2011.011099 · Cited by 66
Exploring complex causal pathways between urban renewal, health and health inequality using a theory-driven realist approach
Mehdipanah, R., Manzano, A., Borrell, C., Malmusi, D., Rodríguez‐Sanz, M., Greenhalgh, J., Muntaner, C., & Pawson, R. (2014) · Social Science & Medicine · doi:10.1016/j.socscimed.2014.11.050 · Cited by 66
Implementing large-scale workforce change: learning from 55 pilot sites of allied health workforce redesign in Queensland, Australia
Nancarrow, S., Roots, A., Grace, S., Moran, A. M., & Vanniekerk-Lyons, K. (2013) · Human Resources for Health · doi:10.1186/1478-4491-11-66 · Cited by 72
Unpacking context in realist evaluations: Findings from a comprehensive review
Nielsen, S. B., Lemire, S. T., & Tangsig, S. (2021) · Evaluation · doi:10.1177/13563890211053032 · Cited by 63
Integration of robotic surgery into routine practice and impacts on communication, collaboration, and decision making: a realist process evaluation protocol
Randell, R., Greenhalgh, J., Hindmarsh, J., Dowding, D., Jayne, D. G., Pearman, A. D., Gardner, P. H., Croft, J., & Kotzé, A. (2014) · Implementation Science · doi:10.1186/1748-5908-9-52 · Cited by 60
Middle‐Class Political Activism and Middle‐Class Advantage in Relation to Public Services: A Realist Synthesis of the Evidence Base
Matthews, P. J., & Hastings, A. (2012) · Social Policy and Administration · doi:10.1111/j.1467-9515.2012.00866.x · Cited by 58
Some reflections on Pawson’s Science of Evaluation: A Realist Manifesto
Astbury, B. (2013) · Evaluation · doi:10.1177/1356389013505039 · Cited by 56
Putting context centre stage: evidence from a systems evaluation of an area based empowerment initiative in England
Orton, L., Halliday, E. C., Collins, M., Egan, M., Lewis, S., Ponsford, R., Powell, K., Salway, S., Townsend, A. F., Whitehead, M. M., et al. (2016) · Critical Public Health · doi:10.1080/09581596.2016.1250868 · Cited by 56
Effective characteristics of professional development programs for science and technology education
Hubers, M. D., Endedijk, M., & van Veen, K. (2020) · Professional Development in Education · doi:10.1080/19415257.2020.1752289 · Cited by 88
Addressing gender inequality in science: the multifaceted challenge of assessing impact
Schmidt, E. K., & Cacace, M. (2017) · Research Evaluation · doi:10.1093/reseval/rvx003 · Cited by 55
Evaluation of patient engagement in medicine development: A multi‐stakeholder framework with metrics
Vat, L. E., Finlay, T. M. D., Robinson, P., Barbareschi, G., Boudes, M., Ponce, A. M., Dinboeck, M., Eichmann, L., Ferrer, E., Fruytier, S. E., et al. (2021) · Health Expectations · doi:10.1111/hex.13191 · Cited by 53
Benefits of psychosocial intervention and continuity of care by child and family health nurses in the pre‐ and postnatal period: process evaluation
Kemp, L., Harris, E., McMahon, C. A., Matthey, S., Vimpani, G., Anderson, T. M., Schmied, V. A., & Aslam, H. (2012) · Journal of Advanced Nursing · doi:10.1111/jan.12052 · Cited by 56
The contribution of process tracing to theory-based evaluations of complex aid instruments
Schmitt, J., & Beach, D. (2015) · Evaluation · doi:10.1177/1356389015607739 · Cited by 53
Indicators for measuring the contributions of individual knowledge brokers
Maag, S., Alexander, T. J., Kase, R., & Hoffmann, S. (2018) · Environmental Science & Policy · doi:10.1016/j.envsci.2018.06.002 · Cited by 53
Applying a realist(ic) framework to the evaluation of a new model of emergency department based mental health nursing practice
Wand, T., White, K., & Patching, J. (2010) · Nursing Inquiry · doi:10.1111/j.1440-1800.2010.00488.x · Cited by 53
Evaluating unintended consequences: New insights into solving practical, ethical and political challenges of evaluation
Oliver, K. A., Lorenc, T., & Tinkler, J. (2019) · Evaluation · doi:10.1177/1356389019850847 · Cited by 53
To what extent can the activities of the South Australian Health in All Policies initiative be linked to population health outcomes using a program theory-based evaluation?
Baum, F. E., Delany‐Crowe, T., MacDougall, C., van Eyk, H., Lawless, A. P., Williams, C., & Marmot, M. G. (2019) · BMC Public Health · doi:10.1186/s12889-019-6408-y · Cited by 50
Towards appropriate mainstreaming of “Theory of Change” approaches into agricultural research for development: Challenges and opportunities
Maru, Y., Sparrow, A. D., Butler, J., Banerjee, O., Ison, R. L., Hall, A., & Carberry, P. (2018) · Agricultural Systems · doi:10.1016/j.agsy.2018.04.010 · Cited by 50
A mandala of faculty development: using theory-based evaluation to explore contexts, mechanisms and outcomes
Onyura, B., Ng, S., Baker, L. R., Lieff, S., Millar, B., & Mori, B. (2016) · Advances in Health Sciences Education · doi:10.1007/s10459-016-9690-9 · Cited by 53
A study of human resource competencies required to implement community rehabilitation in less resourced settings
Gilmore, B., MacLachlan, M., McVeigh, J., McClean, C., Carr, S. C., Duttine, A., Mannan, H., McAuliffe, É., Mji, G., Eide, A. H., et al. (2017) · Human Resources for Health · doi:10.1186/s12960-017-0240-1 · Cited by 51
Contexts, Mechanisms, and Outcomes That Matter in Dutch Community-Based Physical Activity Programs Targeting Socially Vulnerable Groups
Herens, M. C., Wagemakers, A., Vaandrager, L., van Ophem, J., & Koelen, M. A. (2016) · Evaluation & the Health Professions · doi:10.1177/0163278716652940 · Cited by 45
Evaluating outcome-based payment programmes: challenges for evidence-based policy
Fox, C., & Morris, S. P. (2019) · Journal of Economic Policy Reform · doi:10.1080/17487870.2019.1575217 · Cited by 44
Towards Developing an Initial Programme Theory: Programme Designers and Managers Assumptions on the Antiretroviral Treatment Adherence Club Programme in Primary Health Care Facilities in the Metropolitan Area of Western Cape Province, South Africa
Mukumbang, F. C., Belle, S. V., Marchal, B., & van Wyk, B. E. (2016) · PLoS ONE · doi:10.1371/journal.pone.0161790 · Cited by 50
The health promoting sports club model: an intervention planning framework
Hoye, A. V., Johnson, S., Geidne, S., Donaldson, A., Rostan, F., Lemonnier, F., & Vuillemin, A. (2020) · Health Promotion International · doi:10.1093/heapro/daaa093 · Cited by 43
Finding “What Works”: Theory of Change, Contingent Universals, and Virtuous Failure in Global Mental Health
Bemme, D. (2019) · Culture Medicine and Psychiatry · doi:10.1007/s11013-019-09637-6 · Cited by 41
Protocol: Realist synthesis of the impact of unemployment insurance policies on poverty and health
Molnar, A., O'Campo, P. J., Ng, E., Mitchell, C., Muntaner, C., Renahy, É., John, A. S., & Shankardass, K. (2014) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2014.09.002 · Cited by 41
Chinese martial arts and the Olympics: Analysing the policy of the International Wushu Federation
Han, Q.-S., Theeboom, M., & Zhu, D. H. (2020) · International Review for the Sociology of Sport · doi:10.1177/1012690220957177 · Cited by 39
Enabling conditions for effective marine spatial planning
Zuercher, R., Ban, N. C., Flannery, W., Guerry, A. D., Halpern, B. S., Magris, R. A., Mahajan, S. L., Motzer, N., Spalding, A. K., Stelzenmüller, V., et al. (2022) · Marine Policy · doi:10.1016/j.marpol.2022.105141 · Cited by 38
What is the evidence on interventions to manage referral from primary to specialist non-emergency care? A systematic review and logic model synthesis
Blank, L., Baxter, S. K., Woods, H. B., Goyder, E., Lee, A. C., Payne, N., & Rimmer, M. (2015) · Health Services and Delivery Research · doi:10.3310/hsdr03240 · Cited by 37
Developing a programme theory for sport and employability programmes for NEETs
Coalter, F., Theeboom, M., & Truyens, J. (2020) · International Journal of Sport Policy and Politics · doi:10.1080/19406940.2020.1832136 · Cited by 39
Realistic evaluation of an emergency department‐based mental health nurse practitioner outpatient service in Australia
Wand, T., White, K., & Patching, J. (2011) · Nursing and Health Sciences · doi:10.1111/j.1442-2018.2011.00601.x · Cited by 36
A realistic evaluation of fines for hospital discharges: Incorporating the history of programme evaluations in the analysis
Manzano, A. (2011) · Evaluation · doi:10.1177/1356389010389913 · Cited by 36
Reconsidering context: Six underlying features of context to improve learning from evaluation
Coldwell, M. (2018) · Evaluation · doi:10.1177/1356389018803234 · Cited by 36
Current challenges in population health intervention research
Cambon, L., & Alla, F. (2019) · Journal of Epidemiology & Community Health · doi:10.1136/jech-2019-212225 · Cited by 37
European Rural Demographic Strategies: Foreshadowing Post-Lisbon Rural Development Policy?
Dax, T., & Copus, A. (2022) · World · doi:10.3390/world3040053 · Cited by 35
A theory of change for student-led academic integrity
Richards, D., Saddiqui, S., White, F., McGuigan, N., & Homewood, J. (2016) · Quality in Higher Education · doi:10.1080/13538322.2016.1265849 · Cited by 34
An integrative framework to evaluate impacts of complex tourism change initiatives
Roodbari, H., & Olya, H. (2023) · Tourism Management · doi:10.1016/j.tourman.2023.104829 · Cited by 41
Monitoring population‐level responses of marine mammals to human activities
Fleishman, E., da Costa, D. P., Harwood, J., Kraus, S. D., Moretti, D., New, L., Schick, R. S., Schwarz, L. K., Simmons, S. E., Thomas, L., et al. (2016) · Marine Mammal Science · doi:10.1111/mms.12310 · Cited by 33
Designing an Integrated Care Initiative for Vulnerable Families: Operationalisation of Realist Causal and Programme Theory, Sydney Australia
Eastwood, J. G., Shaw, M., Garg, P., de Souza, D., Tyler, I. V., Dean, L., Macsween, M., & Moore, M. (2019) · International Journal of Integrated Care · doi:10.5334/ijic.3980 · Cited by 33
Sport, disability and (inclusive) education: critical insights and understandings from the Playdagogy programme
Sandford, R. A., Beckett, A. E., & Giulianotti, R. (2021) · Sport Education and Society · doi:10.1080/13573322.2021.1902299 · Cited by 33
Using theories of change to design monitoring and evaluation of community engagement in research: experiences from a research institute in Malawi
Gooding, K., Makwinja, R., Nyirenda, D., Vincent, R., & Sambakunsi, R. (2018) · Wellcome Open Research · doi:10.12688/wellcomeopenres.13790.1 · Cited by 32
A Systems Approach to Evaluating Organisational Change in Children's Social Care
Munro, E. R., & Hubbard, A. (2011) · The British Journal of Social Work · doi:10.1093/bjsw/bcr074 · Cited by 32
Working better together: new approaches for understanding the value and challenges of organizational partnerships
Riggs, E., Block, K., Warr, D. J., & Gibbs, L. F. (2013) · Health Promotion International · doi:10.1093/heapro/dat022 · Cited by 32
Using theory-based evaluation to understand what works in asset-based community development
Ward, S. (2021) · Community Development Journal · doi:10.1093/cdj/bsab046 · Cited by 31
Going Beyond Mixed Methods to Mixed Approaches: A Systems Perspective for Asking the Right Questions
Garcia, J. R., & Zazueta, A. E. (2015) · IDS Bulletin · doi:10.1111/1759-5436.12119 · Cited by 31
Exploring taught masters education for healthcare practitioners: a systematic review of literature
Madi, M., Hamzeh, H., Griffiths, M., Rushton, A., & Heneghan, N. R. (2019) · BMC Medical Education · doi:10.1186/s12909-019-1768-7 · Cited by 34
Conceptualising the Contexts, Mechanisms and Outcomes of Intensive Family Intervention Projects
Batty, E., & Flint, J. (2012) · Social Policy and Society · doi:10.1017/s1474746412000073 · Cited by 31
Beyond the RCT
Goodman, L. A., Epstein, D., & Sullivan, C. M. (2017) · American Journal of Evaluation · doi:10.1177/1098214017721008 · Cited by 31
Using measures of wellbeing for impact evaluation: Proof of concept developed with an Indigenous community undertaking land management programs in northern Australia
Larson, S., Stoeckl, N., Jarvis, D., Addison, J., Prior, S., & Esparon, M. (2018) · AMBIO · doi:10.1007/s13280-018-1058-3 · Cited by 31
Using theory of change to develop an intervention theory for designing and evaluating behavior change SDApps for healthy eating and physical exercise: the OCAPREV theory
Aromatario, O., Hoye, A. V., Vuillemin, A., Foucaut, A.-M., Pommier, J., & Cambon, L. (2019) · BMC Public Health · doi:10.1186/s12889-019-7828-4 · Cited by 32
Integrated approaches to natural resources management—Theory and practice
Tengberg, A. E., & Valencia, S. C. (2018) · Land Degradation and Development · doi:10.1002/ldr.2946 · Cited by 31
Designing Initiatives for Vulnerable Families: From Theory to Design in Sydney, Australia
Eastwood, J. G., de Souza, D., Shaw, M., Garg, P., Woolfenden, S. R., Tyler, I. V., & Kemp, L. (2019) · International Journal of Integrated Care · doi:10.5334/ijic.3963 · Cited by 29
Childsmile after 10 years part 2: programme development, implementation and evaluation
Macpherson, L. M. D., Rodgers, J., & Conway, D. I. (2019) · Dental Update · doi:10.12968/denu.2019.46.3.238 · Cited by 29
Sustainability and social justice dimension indicators for applied renewable energy research: A responsible approach proposal
Carbajo, R., & Cabeza, L. F. (2019) · Applied Energy · doi:10.1016/j.apenergy.2019.113429 · Cited by 27
Combining the theory of change and realist evaluation approaches to elicit an initial program theory of the MomConnect program in South Africa
Kabongo, E. M., Mukumbang, F. C., Delobelle, P., & Nicol, E. (2020) · BMC Medical Research Methodology · doi:10.1186/s12874-020-01164-y · Cited by 32
Community Theories of Change: Linking Environmental Justice to Sustainability through Stakeholder Perceptions in Milwaukee (WI, USA)
Hornik, K., Cutts, B. B., & Greenlee, A. J. (2016) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph13100979 · Cited by 27
Understanding the implementation and effectiveness of a group-based early parenting intervention: a process evaluation protocol
Hickey, G., McGilloway, S., Furlong, M., Leckey, Y., Bywater, T. J., & Donnelly, M. (2016) · BMC Health Services Research · doi:10.1186/s12913-016-1737-3 · Cited by 26
Strengthening health system to improve immunization for migrants in China
Fang, H., Yang, L., Zhang, H., Li, C., Wen, L., Sun, L. J., Hanson, K., & Meng, Q. (2017) · International Journal for Equity in Health · doi:10.1186/s12939-016-0504-8 · Cited by 26
Tensions of evaluating innovation in a living lab: Moving beyond actionable knowledge production
Dekker, R., Geuijen, K., & Oliver, C. (2021) · Evaluation · doi:10.1177/1356389021997848 · Cited by 26

Authors: Blamey, A., & Mackenzie, M.
Affiliations: National Health Service Scotland (GB)
University of Glasgow (GB)
ORCID: Blamey, Avril
Mackenzie, Mhairi
Venue: Evaluation
Publisher: SAGE Publications
Published: 2007-10
Volume: 13
Issue: 4
Pages: 439-455
ISSN: 1356-3890 (ISSN-L)
1461-7153
DOI: 10.1177/1356389007082129
OpenAlex: W2145892273
Cited by: 383
References: 27
Citations by year: 2026: 13 · 2025: 16 · 2024: 20 · 2023: 18 · 2022: 26 · 2021: 23 · 2020: 41 · 2019: 45 · 2018: 21 · 2017: 26 · 2016: 34 · 2015: 20 · 2014: 15 · 2013: 14 · 2012: 23
FWCI: 9.03
Type: journal article
Language: en
Open access: closed
Licence: journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations: Evaluation (publishedVersion)
Topics: Social Sciences › Public Administration › Evaluation and Performance Assessment
Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
Keywords: theory of change, realist evaluation, theory-based evaluation, program outcomes, knowledge production, evaluator practice, evaluation framework

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Theories of Change and Realistic Evaluation: Peas in a Pod or Apples and Oranges?

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks