Cited by 383Evaluation and Performance AssessmentAdvanced Causal Inference TechniquesHealth Policy Implementation Science

The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.

Theories of Change and Realistic Evaluation: Peas in a Pod or Apples and Oranges?

Blamey, Avril, Mackenzie, Mhairi·2007·Evaluation

DOI 10.1177/1356389007082129

Open this paper in CoChat — free account

Abstract

Two proponents of theory-based approaches to evaluation that have found favour in the UK in recent years are Theories of Change and Realistic Evaluation. In this article we share our evolving views on the points of connection and digression between the approaches based on our reading of the theory-based evaluation literature and our practice experience. We provide a background to the two approaches that emphasizes the importance of programme context in understanding how complex programmes lead to changes in outcomes.We then explore some of the differences in how `theory' is conceptualized and used within the two approaches and consider how knowledge is generated and cumulated in subtly different ways depending on the approach that is taken. Finally, we offer our thoughts on what this means for evaluators on the ground seeking an appropriate framework for their practice.

Integrity signals

Registry

Crossref · 10.1177/1356389007082129

Cites

27 of 27 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Evidence-based Policy
Pawson, R. (2006) · doi:10.4135/9781849209120 · Cited by 1,791
Theory-driven evaluations
Chen, H.-T. (1990) · Medical Entomology and Zoology · Cited by 1,227
Evaluation : methods for studying programs and policies
Weiss, C. H. (1997) · Cited by 931
Evidence-based policy: the promise of ‘realist synthesis’
Pawson, R. (2002) · Evaluation · doi:10.1177/135638902401462448 · Cited by 729
What works?Evidence-based policy and practice in public services
Davies, H., Nutley, S., & Smith, P. C. (2000) · Policy Press eBooks · doi:10.1332/policypress/9781861341914.001.0001 · Cited by 558
Applying a Theory of Change Approach to the Evaluation of Comprehensive Community Initiatives: Progress, Prospects, and Problems
Kubisch, J. P. C. A. A. C. (1998) · Cited by 461
Evidence-based Policy: In Search of a Method
Pawson, R. (2002) · Evaluation · doi:10.1177/1358902002008002512 · Cited by 403
Theory-Based Evaluation and Types of Complexity
Stame, N. (2004) · Evaluation · doi:10.1177/1356389004043135 · Cited by 383
Conceptualising successful partnerships
Dowling, B., Powell, M. A., & Glendinning, C. (2004) · Health & Social Care in the Community · doi:10.1111/j.1365-2524.2004.00500.x · Cited by 348
Evidence, Understanding and Complexity: Evaluation in Non-Linear Systems
Barnes, M., Matka, E., & Sullivan, H. (2003) · Evaluation · doi:10.1177/13563890030093003 · Cited by 208

Show all 27 references

Research works printed but not linked: 8

Auspos, P., 2004, Building Knowledge about Community Change: Moving beyond Evaluations
Chen, H.T., 1990, Evaluation
Connell, J.P., 1995, New Approaches to Evaluating Community Initiatives, vol. 1, Concepts, Methods and Contexts
Dowling, B., 2004, Community, 12, 309
Fulbright-Anderson, K., 1998, New Approaches to Evaluating Community Initiatives, vol. 2, Theory, Measurement, and Analysis
Gambone, M., 1998, Challenges of Measurement in Community Change Initiatives
Mackenzie, M., 2006, Policy, 2, 211
Pawson, R., 1997, Evaluation

Sorted by citations

Items 301–381 of 381

Change-making in a (post)apartheid city: An auto-ethnographical essay
Beer, S. F. D., & de Beer, W. (2018) · HTS Teologiese Studies / Theological Studies · doi:10.4102/hts.v74i3.4986 · Cited by 1
Results-Based Monitoring and Evaluation and Knowledge Management Approaches in Government to Government Partnerships: The Case of the Shandong and WCG Partnership
Chen, X. Q., Coning, C. D., & Pretorius, L. (2019) · Journal of Reviews on Global Economics · doi:10.6000/1929-7092.2019.08.47 · Cited by 1
Retrospective Pretest and Counterfactual Self-Report: Different or Same?
Lam, T. C. M., & Valencia, E. (2019) · Journal of MultiDisciplinary Evaluation · doi:10.56645/jmde.v15i33.575 · Cited by 1
EVALUATION OF PUBLIC INTERVENTIONS IN A COMPLEX ENVIRONMENT: DEVELOPING GENERALIZABLE KNOWLEDGE FROM CASE STUDIES
Kubera, P. (2020) · Journal of Positive Management · doi:10.12775/jpm.2019.003 · Cited by 1
Translational Research: Bridging the Chasm Between New Knowledge and Useful Knowledge
Kemp, L. (2019) · Springer eBooks · doi:10.1007/978-981-10-5251-4_72 · Cited by 1
Modern Matrons in an Acute Setting: a Qualitative Case Study
Brown, A. S. (2013) · University of Hertfordshire Research Archive (University of Hertfordshire) · doi:10.18745/th.12304 · Cited by 1
The LoTS (Longer-Term Stroke) care system of care : an evaluation of its local implementation at two community stroke services
Alvarado, N. (2013) · White Rose eTheses Online (University of Leeds, The University of Sheffield, University of York) · Cited by 1
Evidence based practice in sport development: a realistic evaluation of a sport and physical activity strategy
Daniels, J. (2026) · e-space (Manchester Metropolitan University) · doi:10.83056/mmu.32438556 · Cited by 1
Rigour in Methods and Evaluation for Community Engagement
Yordy, C. (2012) · doi:10.22215/cfice-2012-01 · Cited by 1
Development and implementation of a training programme for preceptors: a realist evaluation
Hugo, L. (2018) · Cited by 1
Implementing Interventions in Indigenous Primary Health Care: A Realist Evaluation
Clark, L. A. (2017) · Adelaide Research & Scholarship (AR&S) (University of Adelaide) · Cited by 1
The Process of Transformative Learning in Executive Coaching : a Realist Evaluation
Mbokota, G. (2019) · UpSpace Institutional Repository (University of Pretoria) · Cited by 1
Where's Betty?: Integrating Gender-Based Analysis Plus (GBA+) in Canada’s Federal Government Evaluation Function
Whynot, J. (2021) · uO Research (University of Ottawa) · doi:10.20381/ruor-26465 · Cited by 1
Policies to promote sustainable consumption: First results from an EU-wide impact evaluation project
Wolff, F., Schönherr, N., Brohmann, B., Fritsche, U. W., & Heiskanen, E. (2010) · Research Repository (Delft University of Technology) · Cited by 1
Evaluating criminal justice interventions in the field of domestic violence: a realist approach
Taylor, H. A. (2014) · Cited by 1
Addressing pedagogical solitude : a realist evaluation of organisation development at a German higher education institution
Vogel, M. P. (2014) · IOE EPrints · Cited by 1
Exploring Evaluation in Practice from the Perspective of Public Health and Health Professionals: a Qualitative Field Study
Siebert, P. (2015) · White Rose eTheses Online (University of Leeds, The University of Sheffield, University of York)
Evaluating Local Partnership Incentive Policies
Sorrentino, M., Spano, A., & Bellò, B. (2011) · International Journal of Electronic Government Research · doi:10.4018/jegr.2011100102
Multi-agency collaboration in local governace: partnership or pragmatism? An exploratory case study
Cunneen, J. M. (2012) · University of Limerick Institutional Repository (University of Limerick)
Leadership in theory-based evaluation: an exploration of the feasibility and added-value of incorporating a focus on leadership in programme evaluation
Ozan, J. (2014) · ARAN (University of Galway Research Repository) (Ollscoil na Gaillimhe – University of Galway) · doi:10.13025/16003
Partnerships in the development and management of marine nature-based tourism : an analysis of effectiveness
Kelly, C. (2009) · PEARL (University of Plymouth) · doi:10.24382/2495
Successful rehabilitation: the experience of charities working with short sentenced offenders (less than 12 months) with substance misuse problems after discharge from prison
Atangana, B. M. (2015) · University of Birmingham Institutional Research Archive (University of Birmingham)
Designing a Mixed-Method Impact Evaluation for a Mobile Phone Application for Nutrition Service Delivery in Indonesia
Barnett, I., & Befani, B. (2014)
'Planets aligning' and 'lightbulb moments' : a realist evaluation of how OD interventions do and do not work
Crawford‐Docherty, A. (2015) · University of Birmingham Institutional Research Archive (University of Birmingham)
Involving radiographers in mammography image interpretation and reporting in symptomatic breast clinics: a realist evaluation.
Culpan, A.-M. (2015) · White Rose eTheses Online (University of Leeds, The University of Sheffield, University of York)
Sustainable development as social equity: Policy contradictions and their impact on higher education
Monnapula-Mapesela (2014) · South African Journal of Higher Education · doi:10.20853/28-3-360
Understanding how Ontario's Full-Day Early Learning Kindergarten works for families: Building a program theory based on parents' voices
Arimura, T. N. (2015) · TSpace (University of Toronto)
Sharing the learning from community action research
Bleach, J. (2016) · Routledge eBooks · doi:10.4324/9781315689364-9
Methodological Approach of the GEF IEO’s Climate Change Mitigation Impact Evaluation: Assessing Progress in Market Change for Reduction of CO2 Emissions
Zazueta, A. E., & Negi, N. K. (2017) · Springer eBooks · doi:10.1007/978-3-319-43702-6_9
Evaluating Healthcare Improvements
Maxwell, E. (2017) · Routledge eBooks · doi:10.1201/9781315151823-10
From Toronto First Duty Vision to Policy Reality: Scaling Up, Watering Down in the Provincial Implementation of Full-day Kindergarten at the Bruce/WoodGreen Demonstration Site
Levy, E. B. (2016) · TSpace (University of Toronto)
Planificación y evaluación de redes de desarrollo social en contextos complejos
del Cambio, T., Rodríguez-Bilella, P., & Tapella, E. (2016) · Dialnet (Universidad de la Rioja)
Translational Research: Bridging the Chasm Between New Knowledge and Useful Knowledge
Kemp, L. (2018) · Springer eBooks · doi:10.1007/978-981-10-2779-6_72-1
Measuring Progress Towards Sustainability: A View of the Main Approaches to Evaluation
Child, K. (2019) · Natural resource management in transition · doi:10.1007/978-3-319-14877-9_16
A theory-based evaluation of South Africa’s education policy
Lentsa, N. (2019) · SUNScholar (Stellenbosch University)
Exploring the factors that influence the public health impact of changes to the traditional housing officer’s role: insights from a logic modelling approach
Blank, L., Holding, E., Jordan, H., Ferrari, E., & Goyder, E. (2020) · Journal of Public Health · doi:10.1007/s10389-020-01217-y
Primary health care service delivery by international actors in humanitarian emergencies
Yapa, C. (2020) · ANU Open Research (Australian National University) · doi:10.25911/5e9ecbfcc4e09
[Fiber-reinforced composite in fixed prosthodontics].
Pilo, R., Rass, Z. A., & Shmidt, A. (2010) · PubMed
Conceptualising, measuring and valuing the impact of Health Technology Assessment
Grieve, E. (2020) · Enlighten: Theses (The University of Glasgow) · doi:10.5525/gla.thesis.81864
Introduction
Theeboom, M., Schaillée, H., Brosens, D., Willems, S. J. T., Lauwerier, E., Roose, R., & Bradt, L. (2021) · Routledge eBooks · doi:10.4324/9780429340635-2
Nurse practitioners and pharmacist prescribers in primary health care: A realist evaluation of the New Zealand experience
Officer, T. (2018) · Open Access Victoria University of Wellington | Te Herenga Waka (Figshare) · doi:10.26686/wgtn.17068688
Nurse practitioners and pharmacist prescribers in primary health care: A realist evaluation of the New Zealand experience
Officer, T. (2018) · doi:10.26686/wgtn.17068688.v1
Evaluating Healthcare Improvements
(2017) · Routledge eBooks · doi:10.1201/9781315151823-11
Evaluating Local Partnership Incentive Policies
Sorrentino, M., Spano, A., & Bellò, B. (2012) · IGI Global eBooks · doi:10.4018/978-1-4666-2458-0.ch018
Introduction
Duffy, D. N. (2017) · Palgrave Macmillan UK eBooks · doi:10.1057/978-1-137-54513-8_1
Realistic Evaluation and the 5Is: A Systematic Approach for Evaluating Security Interventions
Newton, A. (2022) · Springer eBooks · doi:10.1007/978-3-030-91735-7_24
A Strategy for Collaborative Leadership at Mt. Sinai Seventh-day Adventist Church in Orlando, Florida
Davis, H. L. (2021) · doi:10.32597/dmin/789/
Superheroes, Super Chickens or Real People Enacting Change?
Meharg, S. (2023) · Springer eBooks · doi:10.1007/978-3-031-36433-4_2
Avaliação de políticas e programas baseada na teoria: reflexões iniciais
Costa, D. M., & Magalhães, R. (2023) · Revista Brasileira de Avaliação · doi:10.4322/rbaval202312034
Bibliography
Byrne, D. (2011) · doi:10.51952/9781847424525.bm001
Onderzoek Experiment gesloten coffeeshopketen: Rapportage nulmeting 2022: Study in support of the Controlled Cannabis Supply Chain Experiment: Baseline report 2022
Mennes, R., Hoorens, S., van Laar, M., Monshouwer, K., Andree, R., Oomen, P., Pardal, M., Leenders, E., Schoonbeek, I., van der Lee, E., et al. (2024) · RAND Corporation eBooks · doi:10.7249/rra2735-2
Accounting for Social Value in Urban Security: Social Return on Investment of SURE
Jashari, A., Autero, A., & Simão, M. D. M. B. (2024) · Springer eBooks · doi:10.1007/978-981-97-2196-2_13
Realist Research and Evaluation Designs for Integrated Care Initiatives
Eastwood, J. G., de Souza, D., & Mukumbang, F. C. (2025) · Springer eBooks · doi:10.1007/978-3-031-25376-8_37-1
Balancing Affordability and Profitability in Urban Public Transport: Implications from Singapore and Hong Kong
Xu, K., Maemura, Y., & Ozawa, K. (2025) · Lecture notes in business information processing · doi:10.1007/978-3-031-95221-0_11
Rehabilitation of child inmates in North Kivu Province, Democratic Republic of Congo
MUKENDI, A. M. N. (2025) · doi:10.51415/10321/6091
Realist Research, Design and Evaluation for Integrated Care Initiatives
Eastwood, J. G., de Souza, D., & Mukumbang, F. C. (2025) · Springer eBooks · doi:10.1007/978-3-031-25376-8_37-2
Tailoring a complexity-aware theory of change for out-of-school children education program: reflections on an evaluation of Korea–Qatar innovation initiative
Hong, M. S., Kim, G., & Chun, Y. J. (2025) · Asia Pacific Education Review · doi:10.1007/s12564-025-10069-8
Professional and survivor perspectives on a co-located early domestic abuse intervention in a police station: A qualitative study
Wang, E. Z., Carter, G., Ross, J., Chapman, R., Healey, T., & Whelan, M. (2025) · Criminology & Criminal Justice · doi:10.1177/17488958251370315
Realist Research, Design, and Evaluation for Integrated Care Initiatives
Eastwood, J. G., de Souza, D., & Mukumbang, F. C. (2025) · Springer eBooks · doi:10.1007/978-3-031-96286-8_37
From thinking to ticking: has theory of change lost its theoretical grounding?
Wong, B. (2025) · Teaching in Higher Education · doi:10.1080/13562517.2025.2582744 · Cited by 1
Additional file 1 of Combining the theory of change and realist evaluation approaches to elicit an initial program theory of the MomConnect program in South Africa
M Kabongo, E., Mukumbang, F. C., Delobelle, P., & Nicol, E. (2020) · Figshare · doi:10.6084/m9.figshare.13294738
Additional file 3 of A critical realist evaluation of an integrated care project for vulnerable families in Sydney, Australia
Tennant, E., Miller, E., Costantino, K., De Souza, D., Coupland, H., Fotheringham, P., & Eastwood, J. (2020) · Figshare · doi:10.6084/m9.figshare.13173785
Additional file 1 of A critical realist evaluation of an integrated care project for vulnerable families in Sydney, Australia
Tennant, E., Miller, E., Costantino, K., De Souza, D., Coupland, H., Fotheringham, P., & Eastwood, J. (2020) · Figshare · doi:10.6084/m9.figshare.13173779
Additional file 2 of How and under what circumstances do quality improvement collaboratives lead to better outcomes? A systematic review
Zamboni, K., Baker, U., Tyagi, M., Schellenberg, J., Hill, Z. E., & Hanson, C. (2020) · Figshare · doi:10.6084/m9.figshare.12246539
Additional file 3 of How and under what circumstances do quality improvement collaboratives lead to better outcomes? A systematic review
Zamboni, K., Baker, U., Tyagi, M., Schellenberg, J., Hill, Z. E., & Hanson, C. (2020) · Figshare · doi:10.6084/m9.figshare.12246545
Additional file 4 of A critical realist evaluation of an integrated care project for vulnerable families in Sydney, Australia
Tennant, E., Miller, E., Costantino, K., De Souza, D., Coupland, H., Fotheringham, P., & Eastwood, J. (2020) · Figshare · doi:10.6084/m9.figshare.13173788
Additional file 2 of A critical realist evaluation of an integrated care project for vulnerable families in Sydney, Australia
Tennant, E., Miller, E., Costantino, K., De Souza, D., Coupland, H., Fotheringham, P., & Eastwood, J. (2020) · Figshare · doi:10.6084/m9.figshare.13173782
Additional file 1 of How and under what circumstances do quality improvement collaboratives lead to better outcomes? A systematic review
Zamboni, K., Baker, U., Tyagi, M., Schellenberg, J., Hill, Z. E., & Hanson, C. (2020) · Figshare · doi:10.6084/m9.figshare.12246527
Understanding the contextual and causal factors shaping the work of receptionists in general practice: a realist review protocol
Hoverd, E., Brown, M. E. L., Burford, B. C., Chen, K.-L., Erfani, G., Hassan, S., Montgomery, A., Lievesley, M. A., Norton, J., Owen-Boukra, E., et al. (2025) · BMJ Open · doi:10.1136/bmjopen-2025-110991
Performance analysis of the tourism sector : empirical studies
Kongmanwatana, P. (2017) · doi:10.70675/0c3602c5z93d7z441dzb7dbz4c1b23f86325
Les pratiques parentales comme outil de prévention : l'adaptation française de programmes de parentalité américains scientifiquement fondés
Delawarde, C. (2015) · theses.fr (ABES) · doi:10.70675/682d5680zfe32z4f14zb9f7z0f9a78b40240
La teoria del cambiamento in pratica: riflessioni e adattamenti dalla valutazione del progetto CoMix
Parente, G., & Cinotti, G. (2026) · RIV Rassegna Italiana di Valutazione · doi:10.3280/riv2026oa22394
Evaluating the impact of knowledge brokering practices: Learning from embedded impact research at the Wales Centre for Public Policy
Smith, F., Durrant, H., & Downe, J. (2026) · Research Evaluation · doi:10.1093/reseval/rvag022
Cultivating belonging and agency amid instability: examining youth capability formation in El Salvador
Kocsis, E., Garcia-Barrios, J., Ayala, A. M., Wyngaarden, S., & Dodd, W. (2026) · International Journal of Adolescence and Youth · doi:10.1080/02673843.2026.2670396
Outcome-based measurement for developmental services: A human capabilities-oriented framework
Carminati, M., & Mariani, L. (2026) · Evaluation · doi:10.1177/13563890261434567
Innovaciones metodológicas para la investigación educativa
Hernández‐Fernández, J., Gómez, J. A. C., Figueroa, H. M. R., Páez, D. A., Aké, L. P., Coutiño, J. E., Martínez, Z. G., León, R. L., & Rangel, J. T. (2026) · Universidad Autónoma de Aguascalientes eBooks · doi:10.33064/uaa/978-968-9752-20-2
Del cuidado a la evaluación: medición de intervenciones complejas en salud pública, aporte desde enfermería
Rondón, G. M., Chaquir, M. S., Mesa, S. A. M., & Bergeron, D. A. (2026) · Corporación Universitaria Adventista eBooks · doi:10.35997/978/628/96443-9-5-4
Redes protectoras comunitarias co-construidas para la promoción del involucramiento parental y entornos de paz
Reyes, C. R. M., & Rivera-Montoya, Y. (2026) · Corporación Universitaria Adventista eBooks · doi:10.35997/978/628/96443-9-5-3
Theory of Change and Logic Model
Wang, L. (2026) · Springer eBooks · doi:10.1007/978-3-319-99675-2_9684-1
Unpacking policy instruments through a mechanistic analysis: school desegregation policies in Barcelona
Zancajo, A., Jover, A., Quilabert, E., & Pagès, M. (2026) · Journal of Education Policy · doi:10.1080/02680939.2026.2743590
Relational contexts, generative mechanisms: How social network analysis can strengthen realist evaluation practice
Dershem, L. D. (2026) · Evaluation · doi:10.1177/13563890261491349

Authors: Blamey, A., & Mackenzie, M.
Affiliations: National Health Service Scotland (GB)
University of Glasgow (GB)
ORCID: Blamey, Avril
Mackenzie, Mhairi
Venue: Evaluation
Publisher: SAGE Publications
Published: 2007-10
Volume: 13
Issue: 4
Pages: 439-455
ISSN: 1356-3890 (ISSN-L)
1461-7153
DOI: 10.1177/1356389007082129
OpenAlex: W2145892273
Cited by: 383
References: 27
Citations by year: 2026: 13 · 2025: 16 · 2024: 20 · 2023: 18 · 2022: 26 · 2021: 23 · 2020: 41 · 2019: 45 · 2018: 21 · 2017: 26 · 2016: 34 · 2015: 20 · 2014: 15 · 2013: 14 · 2012: 23
FWCI: 9.03
Type: journal article
Language: en
Open access: closed
Licence: journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations: Evaluation (publishedVersion)
Topics: Social Sciences › Public Administration › Evaluation and Performance Assessment
Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
Keywords: theory of change, realist evaluation, theory-based evaluation, program outcomes, knowledge production, evaluator practice, evaluation framework

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Theories of Change and Realistic Evaluation: Peas in a Pod or Apples and Oranges?

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks