Cited by 383Evaluation and Performance AssessmentAdvanced Causal Inference TechniquesHealth Policy Implementation Science

The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.

Theories of Change and Realistic Evaluation: Peas in a Pod or Apples and Oranges?

Blamey, Avril, Mackenzie, Mhairi·2007·Evaluation

DOI 10.1177/1356389007082129

Open this paper in CoChat — free account

Abstract

Two proponents of theory-based approaches to evaluation that have found favour in the UK in recent years are Theories of Change and Realistic Evaluation. In this article we share our evolving views on the points of connection and digression between the approaches based on our reading of the theory-based evaluation literature and our practice experience. We provide a background to the two approaches that emphasizes the importance of programme context in understanding how complex programmes lead to changes in outcomes.We then explore some of the differences in how `theory' is conceptualized and used within the two approaches and consider how knowledge is generated and cumulated in subtly different ways depending on the approach that is taken. Finally, we offer our thoughts on what this means for evaluators on the ground seeking an appropriate framework for their practice.

Integrity signals

Registry

Crossref · 10.1177/1356389007082129

Cites

27 of 27 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Evidence-based Policy
Pawson, R. (2006) · doi:10.4135/9781849209120 · Cited by 1,791
Theory-driven evaluations
Chen, H.-T. (1990) · Medical Entomology and Zoology · Cited by 1,227
Evaluation : methods for studying programs and policies
Weiss, C. H. (1997) · Cited by 931
Evidence-based policy: the promise of ‘realist synthesis’
Pawson, R. (2002) · Evaluation · doi:10.1177/135638902401462448 · Cited by 729
What works?Evidence-based policy and practice in public services
Davies, H., Nutley, S., & Smith, P. C. (2000) · Policy Press eBooks · doi:10.1332/policypress/9781861341914.001.0001 · Cited by 558
Applying a Theory of Change Approach to the Evaluation of Comprehensive Community Initiatives: Progress, Prospects, and Problems
Kubisch, J. P. C. A. A. C. (1998) · Cited by 461
Evidence-based Policy: In Search of a Method
Pawson, R. (2002) · Evaluation · doi:10.1177/1358902002008002512 · Cited by 403
Theory-Based Evaluation and Types of Complexity
Stame, N. (2004) · Evaluation · doi:10.1177/1356389004043135 · Cited by 383
Conceptualising successful partnerships
Dowling, B., Powell, M. A., & Glendinning, C. (2004) · Health & Social Care in the Community · doi:10.1111/j.1365-2524.2004.00500.x · Cited by 348
Evidence, Understanding and Complexity: Evaluation in Non-Linear Systems
Barnes, M., Matka, E., & Sullivan, H. (2003) · Evaluation · doi:10.1177/13563890030093003 · Cited by 208

Show all 27 references

Research works printed but not linked: 8

Auspos, P., 2004, Building Knowledge about Community Change: Moving beyond Evaluations
Chen, H.T., 1990, Evaluation
Connell, J.P., 1995, New Approaches to Evaluating Community Initiatives, vol. 1, Concepts, Methods and Contexts
Dowling, B., 2004, Community, 12, 309
Fulbright-Anderson, K., 1998, New Approaches to Evaluating Community Initiatives, vol. 2, Theory, Measurement, and Analysis
Gambone, M., 1998, Challenges of Measurement in Community Change Initiatives
Mackenzie, M., 2006, Policy, 2, 211
Pawson, R., 1997, Evaluation

Sorted by citations

Items 101–200 of 381

Complexity and Community Context: Learning from the Evaluation Design of a National Community Empowerment Programme
South, J., Button, D., Quick, A., Bagnall, A., Trigwell, J., Woodward, J., Coan, S., & Southby, K. (2019) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17010091 · Cited by 26
Embedding compassionate care in local NHS practice: developing a conceptual model through realistic evaluation
MacArthur, J., Wilkinson, H., Gray, M. A., & Matthews-Smith, G. (2017) · Journal of Research in Nursing · doi:10.1177/1744987116678901 · Cited by 25
Implementation, Mechanisms of Effect and Context of an Integrated Care Intervention for Vulnerable Families in Central Sydney Australia: A Research and Evaluation Protocol
Eastwood, J. G., Woolfenden, S. R., Miller, E., Shaw, M., Garg, P., Liu, H., de Souza, D., & Ettema, R. G. A. (2019) · International Journal of Integrated Care · doi:10.5334/ijic.4217 · Cited by 26
Integrated Child and Family Hub models for detecting and responding to family adversity: protocol for a mixed-methods evaluation in two sites
Hall, T., Goldfeld, S. R., Loftus, H., Honisett, S., Liu, H., de Souza, D., Bailey, C., Reupert, A., Yap, M. B. H., Eapen, V., et al. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-055431 · Cited by 26
Realistic evaluation as a volunteer tourism supply chain methodology
Eckardt, C., Font, X., & Kimbu, A. N. (2019) · Journal of Sustainable Tourism · doi:10.1080/09669582.2019.1696350 · Cited by 24
A critical realist evaluation of an integrated care project for vulnerable families in Sydney, Australia
Tennant, E., Miller, E., Costantino, K., de Souza, D., Coupland, H., Fotheringham, P., & Eastwood, J. G. (2020) · BMC Health Services Research · doi:10.1186/s12913-020-05818-x · Cited by 24
A utilisation focussed and viable systems approach for evaluating technology supported learning
Hart, D., & Paucar‐Caceres, A. (2016) · European Journal of Operational Research · doi:10.1016/j.ejor.2016.10.056 · Cited by 24
Failing better: The stochastic art of evaluating community-led environmental action programs
Dunkley, R., & Franklin, A. (2016) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2016.11.005 · Cited by 24
Implementation and effectiveness of free health insurance for the poor pregnant women in Tanzania: A mixed methods evaluation
Kuwawenaruwa, A., Ramsey, K., Binyaruka, P., Baraka, J., Manzi, F., & Borghi, J. (2019) · Social Science & Medicine · doi:10.1016/j.socscimed.2019.02.005 · Cited by 24
A realist evaluation approach to explaining the role of context in the impact of a complex eHealth intervention for improving prevention of cardiovascular disease
Coorey, G., Peiris, D., Neubeck, L., & Redfern, J. (2020) · BMC Health Services Research · doi:10.1186/s12913-020-05597-5 · Cited by 29
Towards an evidence base of theory-driven evaluations: Some questions for proponents of theory-driven evaluation
Sridharan, S., & Nakaima, A. (2012) · Evaluation · doi:10.1177/1356389012453289 · Cited by 23
Facilitators and barriers to informed choice in self-directed support for young people with disability in transition
Mitchell, F. (2014) · Health & Social Care in the Community · doi:10.1111/hsc.12137 · Cited by 22
A critical review of energy behaviour change: The influence of context
Heiskanen, E., Matschoss, K., Laakso, S., & Apajalahti, E. (2019) · Elsevier eBooks · doi:10.1016/b978-0-12-818567-4.00015-6 · Cited by 24
A guide to qualitative attribution methods for evaluation in conservation
Cheek, J. Z., Eklund, J., Merten, N., Brooks, J. S., & Miller, D. C. (2023) · Conservation Biology · doi:10.1111/cobi.14071 · Cited by 21
Capturing Transgressive Learning in Communities Spiraling towards Sustainability
Macintyre, T., Tassone, V. C., & Wals, A. E. J. (2020) · Sustainability · doi:10.3390/su12124873 · Cited by 26
Sustainable occupational safety and health interventions: A study on the factors for an effective design
Vitrano, G., Micheli, G. J. L., Guglielmi, A., de Merich, D., Pellicci, M., Urso, D., & Ipsen, C. (2023) · Safety Science · doi:10.1016/j.ssci.2023.106249 · Cited by 27
Reducing the time-lag between onset of chest pain and seeking professional medical help: a theory-based review
Baxter, S. K., & Allmark, P. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-15 · Cited by 21
The power of the context map: Designing realistic outcome evaluation strategies and other unanticipated benefits
Renger, R. F., Foltysova, J., Becker, K., & Souvannasacd, E. (2015) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2015.04.003 · Cited by 22
Perceived neighborhood ethnic diversity and social outcomes: Context-dependent effects within a postindustrial city undergoing regeneration
Kearns, A., & Whitley, E. (2017) · Journal of Urban Affairs · doi:10.1080/07352166.2017.1343632 · Cited by 21
A Critical Realist Translational Social Epidemiology Protocol for Concretising and Contextualising a “Theory of Neighbourhood Context, Stress, Depression, and the Developmental Origins of Health and Disease (DOHaD)”, Sydney Australia
Eastwood, J., Kemp, L., Garg, P., Tyler, I., & Souza, D. E. D. (2019) · International Journal of Integrated Care · doi:10.5334/ijic.3962 · Cited by 16
Evaluating the impacts of plantations and associated forestry operations in Africa—methods and indicators
Ingram, V. J., van der Werf, E., Kikulwe, E., & Wesseler, J. (2016) · The International Forestry Review · doi:10.1505/146554816818206087 · Cited by 21
Using programme theory to strengthen research protocol and intervention design within an RCT of a walking intervention
Blamey, A., MacMillan, F., Fitzsimons, C. F., Shaw, R., & Mutrie, N. (2013) · Evaluation · doi:10.1177/1356389012470681 · Cited by 20
Self-citation
Attributing Development Impact
Copestake, J., Morsink, M. E. B., & Remnant, F. (2019) · Practical Action Publishing eBooks · doi:10.3362/9781780447469 · Cited by 20
Improving Process Evaluations of Health Behavior Interventions
Morgan‐Trimmer, S. (2013) · Evaluation & the Health Professions · doi:10.1177/0163278713497363 · Cited by 20
Contribution analysis as an approach to enable public managers to demonstrate public value
Connolly, J. (2016) · International Journal of Public Sector Management · doi:10.1108/ijpsm-12-2015-0225 · Cited by 21
Asset Based Community Development: Co-Designing an Asset-Based Evaluation Study for Community Research
South, J., Coan, S., Woodward, J., Bagnall, A., & Rippon, S. (2024) · SAGE Open · doi:10.1177/21582440241240836 · Cited by 19
Eliciting Context-Mechanism-Outcome configurations: Experiences from a realist evaluation investigating the impact of robotic surgery on teamwork in the operating theatre
Alvarado, N., Honey, S., Greenhalgh, J., Pearman, A. D., Dowding, D., Cope, A., Long, A., Jayne, D. G., Gill, A., Kotzé, A., et al. (2017) · Evaluation · doi:10.1177/1356389017732172 · Cited by 20
The art and science of non-evaluation evaluation
Jones, L. (2018) · Journal of Health Services Research & Policy · doi:10.1177/1355819618779614 · Cited by 19
Ethnography and evaluation: temporalities of complex systems and methodological complexity
Reynolds, J., & Lewis, S. (2019) · Anthropology and Medicine · doi:10.1080/13648470.2018.1507106 · Cited by 20
Improving the early presentation of cancer symptoms in disadvantaged communities: putting local people in control
Lyon, D., Knowles, J., Slater, B., & Kennedy, R. (2009) · British Journal of Cancer · doi:10.1038/sj.bjc.6605390 · Cited by 19
How and why are Theory of Change and Realist Evaluation used in food security contexts? A scoping review
Lâm, S., Dodd, W., Wyngaarden, S., Skinner, K. A., Papadopoulos, A., & Harper, S. L. (2021) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2021.102008 · Cited by 18
The Reciprocal Relationship between Implementation Theory and Program Theory in Assisting Program Design and Decision-Making
Renger, R. F., Bartel, G., & Foltysova, J. (2013) · Canadian Journal of Program Evaluation · doi:10.3138/cjpe.028.002 · Cited by 18
Spatial justice on the horizon? A combined Theory of Change scenario tool to assess place-based interventions
Piras, S., Tobiasz‐Lis, P., Currie, M. J. B., Dmochowska‐Dudek, K., Duckett, D. G., & Copus, A. (2021) · European Planning Studies · doi:10.1080/09654313.2021.1928057 · Cited by 18
‘Missing out’: Reflections on the positioning of ethnographic research within an evaluative framing
Reynolds, J. (2016) · Ethnography · doi:10.1177/1466138116664106 · Cited by 17
Using contribution analysis to evaluate large-scale, transformation change processes
Junge, K., Cullen, J., & Iacopini, G. (2020) · Evaluation · doi:10.1177/1356389020912270 · Cited by 19
Features of human papillomavirus vaccination education strategies in low- and middle-income countries: a scoping review
Marfo, E. A., King, K. D., Adjei, C. A., & MacDonald, S. E. (2022) · Public Health · doi:10.1016/j.puhe.2022.09.013 · Cited by 16
Towards a System Theoretical Understanding of the Parasport Context
Patatas, J. M., Bosscher, V. D., Cocq, S. D., Jacobs, S., & Legg, D. (2019) · Journal of Global Sport Management · doi:10.1080/24704067.2019.1604078 · Cited by 29
Evaluating the impact of the Academic Enrichment Programme on widening access to selective universities: Application of the Theory of Change framework
Barkat, S. (2019) · British Educational Research Journal · doi:10.1002/berj.3556 · Cited by 17
Designing centralized waiting lists for attachment to a primary care provider: Considerations from a logic analysis
Breton, M., Smithman, M. A., Kreindler, S. A., Jbilou, J., Wong, S. T., Marshall, E. G., Sasseville, M., Sutherland, J. M., Crooks, V. A., Shaw, J., et al. (2021) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2021.101962 · Cited by 17
Getting beyond outcomes: a realist approach to help understand the impact of a nutritional intervention during smoking cessation
Mackenzie, M., Koshy, P., Leslie, W. S., Lean, M. E. J., & Hankey, C. R. (2009) · European Journal of Clinical Nutrition · doi:10.1038/ejcn.2009.38 · Cited by 18
Self-citation
Assumptions in theories of change
Mayne, J. W. (2023) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2023.102276 · Cited by 16
Measuring the Performance of Partnerships: Why, What, How, When?
Kelly, C. (2012) · Geography Compass · doi:10.1111/j.1749-8198.2012.00476.x · Cited by 16
The Challenges of Promoting Social Inclusion through Sport: The Experience of a Sport-Based Initiative in Italy
D’Angelo, C., Corvino, C., & Gozzoli, C. (2021) · Societies · doi:10.3390/soc11020044 · Cited by 16
Evaluation of iLead, a generic implementation leadership intervention: mixed-method preintervention–postintervention design
Richter, A., Lornudd, C., Schwarz, U. V. T., Lundmark, R., Mosson, R., Skoger, U. E., Hirvikoski, T., & Hasson, H. (2020) · BMJ Open · doi:10.1136/bmjopen-2019-033227 · Cited by 16
Self‐directed support and disabled young people in transition (part 1)
Mitchell, F. (2012) · Journal of Integrated Care · doi:10.1108/14769011211202292 · Cited by 15
Theories of Change in Rural Policy Evaluation
Maye, D., Enticott, G., & Naylor, R. K. (2019) · Sociologia Ruralis · doi:10.1111/soru.12269 · Cited by 15
Going for gold: A prospective assessment of the economic impacts of the Commonwealth Games 2014 on the East End of Glasgow
Clark, J. D., & Kearns, A. (2016) · Environment and Planning C Government and Policy · doi:10.1177/0263774x15624923 · Cited by 15
Groundwater governance under climate change in India: lessons based on evaluation of World Bank interventions
Shiferaw, B. A., Reddy, V. R., & Sharma, B. R. (2023) · International Journal of Water Resources Development · doi:10.1080/07900627.2023.2207694 · Cited by 14
Additionality: A Useful Way to Construct the Counterfactual Qualitatively?
Hind, J. (2010) · Evaluation Journal of Australasia · doi:10.1177/1035719x1001000105 · Cited by 14
Unpacking the Black Box: A realist evaluation of performance management for social services
Tan, H. T. R., & Harvey, G. (2015) · Public Management Review · doi:10.1080/14719037.2015.1112422 · Cited by 14
Contemporary Mental Health Program Implementation and Evaluation
Wand, T., White, K., & Patching, J. (2010) · Issues in Mental Health Nursing · doi:10.3109/01612840.2010.503008 · Cited by 14
Employing the teacher-learner cycle in realistic evaluation: A case study of the social benefits of young people’s playing fields
Nanninga, M., & Glebbeek, A. C. (2011) · Evaluation · doi:10.1177/1356389010393586 · Cited by 14
An evaluation of the economic and business investment impact of an integrated package of public transport improvements funded by a Workplace Parking Levy
Dale, S., Frost, M., Ison, S., Nettleship, K., & Warren, P. (2017) · Transportation Research Part A Policy and Practice · doi:10.1016/j.tra.2017.04.034 · Cited by 14
Love Shouldn’t Hurt – E le Sauā le Alofa : Co-designing a theory of change for preventing violence against women in Samoa
Mannell, J., Tevaga, P., Heinrich, S., Fruean, S., Chang, S. L., Lowe, H., Brown, L. J., Vaczy, C., Tanielu, H., Cowley-Malcolm, E. T., et al. (2023) · Global Public Health · doi:10.1080/17441692.2023.2201632 · Cited by 13
Successfully developing advanced practitioner roles: policy and practice mechanisms
Officer, T. N., Cumming, J., & McBride‐Henry, K. (2018) · Journal of Health Organization and Management · doi:10.1108/jhom-02-2018-0064 · Cited by 16
Embracing complexity in social epidemiology
Stronks, K., & Nicolaou, M. (2018) · The Lancet Public Health · doi:10.1016/s2468-2667(18)30137-3 · Cited by 12
Overcoming non-take-up of rights: A realist evaluation of Integrated Rights-Practices
Boost, D., Raeymaeckers, P., Hermans, K., & Elloukmani, S. (2020) · Journal of Social Work · doi:10.1177/1468017320948332 · Cited by 13
In or out?: Exploring selection processes of farmers in cocoa sustainability standards and certification programmes in Ghana
Skalidou, D. (2019) · UEA Digital Repository (University of East Anglia) · doi:10.13140/rg.2.2.28002.58560 · Cited by 15
Exploring the Potential of Theory-Based Evaluation to Strengthen Marine Spatial Planning PracticePreprint
Zuercher, R., Motzer, N., Ban, N. C., Flannery, W., Guerry, A. D., Magris, R. A., Mahajan, S. L., Spalding, A. K., Stelzenmüller, V., & Kramer, J. G. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4297861 · Cited by 13
Realist approaches in energy research to support faster and fairer climate action
Fell, M. J., Roelich, K. E., & Middlemiss, L. (2022) · Nature Energy · doi:10.1038/s41560-022-01093-8 · Cited by 18
Applying Big Data visualization to detect trends in 30 years of performance reports
Raveh, E., Ofek, Y., Bekkerman, R., & Cohen, H. (2020) · Evaluation · doi:10.1177/1356389020905322 · Cited by 12
Towards a Program Theory for Family-Focused Practice in Adult Mental Health Care Settings: An International Interview Study With Program Leaders
Bauer, A., Best, S., Malley, J., Christiansen, H., Goodyear, M. J., Zechmeister‐Koss, I., & Paul, J. L. (2021) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2021.741225 · Cited by 13
COVID‐19 and hospice community palliative care in New Zealand: A qualitative study
Frey, R. A., & Balmer, D. (2022) · Health & Social Care in the Community · doi:10.1111/hsc.13810 · Cited by 12
Evaluating relative success of donor-funded collaborative research projects
Bartlett, A. G. (2016) · Research Evaluation · doi:10.1093/reseval/rvw009 · Cited by 12
Identifying factors that influence the success of forestry research projects implemented in developing countries: case study results from Vietnam
Bartlett, T., Kanowski, P. J., van Kerkhoff, L. E., & Byron, N. (2017) · Forestry An International Journal of Forest Research · doi:10.1093/forestry/cpw067 · Cited by 12
Using process tracing to evaluate unique events: The case of EXPO Milano 2015
Busetti, S., & Dente, B. (2017) · Evaluation · doi:10.1177/1356389017716738 · Cited by 13
Approach to Assessment of Policy Effectiveness
Environment, U. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108627146.016 · Cited by 12
Enabling equality of access in higher education for underrepresented groups: a realist ‘small step’ approach to evaluating widening participation
Pickering, N. (2021) · Research in Post-Compulsory Education · doi:10.1080/13596748.2021.1873410 · Cited by 13
Theories of change in anti-corruption work: A tool for programme design and evaluation
Johnsøn, J. (2012) · BIBSYS Brage (BIBSYS (Norway)) · Cited by 12
Assessing the early impact of Multi Agency Safeguarding Hubs (MASH) in London
Crockett, R. A., Gilchrist, G., Davies, J., Henshall, A., Hoggart, L., Chandler, V., Sims, D., & Webb, J. (2013) · Cited by 11
What Was the Programme Theory of New Labour'S Health System Reforms?
Millar, R. W., Powell, M. A., & Dixon, A. (2012) · Journal of Health Services Research & Policy · doi:10.1258/jhsrp.2011.010189 · Cited by 11
Evaluation protocol of the implementation of a learning healthcare system in clinical practice: the Connected Health Cities programme in the north of England
Steels, S., & van Staa, T. P. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-025484 · Cited by 11
Toward a Model of Situations and Their Context
Aunger, R. V. (2020) · Review of General Psychology · doi:10.1177/1089268020931767 · Cited by 11
Developing New Methods for Person-Centred Approaches to Adjudicate Context–Mechanism–Outcome Configurations in Realist Evaluation
Teeling, S. P., Dewing, J., & Baldie, D. J. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19042370 · Cited by 11
Refining Program Theory for a Place-Based Integrated Care Initiative in Sydney, Australia
Eastwood, J. G., Barmaky, S., Hansen, S., Millere, E., Ratcliff, S., Fotheringham, P., Coupland, H., & de Souza, D. (2020) · International Journal of Integrated Care · doi:10.5334/ijic.5422 · Cited by 11
Qualitative evaluation of the Safety and Improvement in Primary Care (SIPC) pilot collaborative in Scotland: perceptions and experiences of participating care teams
Bowie, P., Halley, L., Blamey, A., Gillies, J., & Houston, N. (2016) · BMJ Open · doi:10.1136/bmjopen-2015-009526 · Cited by 11
Self-citation
Self‐directed support and disabled young people in transition (part 2)
Mitchell, F. (2012) · Journal of Integrated Care · doi:10.1108/14769011211255258 · Cited by 11
A worked example of initial theory-building: PARTNERS2 collaborative care for people who have experienced psychosis in England
Gwernan‐Jones, R., Britten, N., Allard, J., Baker, E., Gill, L., Lloyd, H. M., Rawcliffe, T., Sayers, R., Plappert, H., Gibson, J., et al. (2019) · Evaluation · doi:10.1177/1356389019850199 · Cited by 11
Exploring the contextual assumptions, interventions and outcomes of digital advance care planning systems: A theory of change approach to understand implementation and evaluation
Bradshaw, A., Allsop, M. J., Birtwistle, J. C., Evans, C., Relton, S. D., Richards, S. H., Twiddy, M., Foy, R., Martin, P. M., Yardley, S. J., et al. (2024) · Palliative Medicine · doi:10.1177/02692163241280134 · Cited by 11
Theorizing how interventions work in evaluation: Process-tracing methods and theorizing process theories of change
Garland, G. C., & Beach, D. (2023) · Evaluation · doi:10.1177/13563890231201876 · Cited by 13
An examination of evaluation users’ preferences for program- and actor-oriented theories of change
Ofek, Y. (2017) · Evaluation · doi:10.1177/1356389017699544 · Cited by 10
El arte del muestreo cualitativo y su importancia para la evaluación y la investigación de políticas públicas: una aproximación realista
Parra, J. (2019) · OPERA · doi:10.18601/16578651.n25.07 · Cited by 8
Identifying the factors that influence teacher practice change in a single case study
Forrest, R. H.-J., Lowe, R., Potts, M. A., & Poyser, C. (2019) · Educational Psychology in Practice · doi:10.1080/02667363.2019.1623761 · Cited by 10
Network analysis of energy transition arena experiments
Matschoss, K., Repo, P., & Lukkarinen, J. P. (2020) · Environmental Innovation and Societal Transitions · doi:10.1016/j.eist.2020.03.003 · Cited by 10
Contextual factors influencing the South African elite sporting system: an ‘open system’ approach
Jacobs, S., Bosscher, V. D., Venter, R. E., Patatas, J. M., & Scheerder, J. (2021) · International Journal of Sport Policy and Politics · doi:10.1080/19406940.2021.1951327 · Cited by 10
Community case management to accelerate access to healthcare in Mali: a realist process evaluation nested within a cluster randomized trial
Whidden, C., Cissé, A., Cole, F., Doumbia, S., Guindo, A., Karambé, Y., Treleaven, E., Liu, J. X., Tolo, O., Guindo, L., et al. (2024) · Health Policy and Planning · doi:10.1093/heapol/czae066 · Cited by 9
Using Contribution Analysis to evaluate small & medium enterprise support policy
Buckley, A. P. (2016) · Evaluation · doi:10.1177/1356389016638625 · Cited by 21
The impact of a sustained oral language professional learning program on Australian early years’ teachers’ knowledge, practice and beliefs: a mixed-methods exploration
Stark, H. L., Eadie, P. A., Snow, P. C., & Goldfeld, S. R. (2019) · Professional Development in Education · doi:10.1080/19415257.2019.1603170 · Cited by 9
Building community capacity to stimulate physical activity and dietary behavior in Dutch secondary schools: Evaluation of the FLASH intervention using the REAIM framework
van Dongen, B. M., de Vries, I. M., Ridder, M. A. M., de Boer, M. R., Steenhuis, I. H., & Renders, C. M. (2022) · Frontiers in Public Health · doi:10.3389/fpubh.2022.926465 · Cited by 10
Introducing a new model of emergency department-based mental health care
Wand, T., White, K., Patching, J., Dixon, J., & Green, T. (2010) · Nurse Researcher · doi:10.7748/nr2010.10.18.1.35.c8046 · Cited by 9
Measuring gender in R&I – theories, methods, and experience
Palmen, R. L., Schmidt, E. K., Striebing, C., Reidl, S., Bührer, S., & Groó, D. (2019) · Interdisciplinary Science Reviews · doi:10.1080/03080188.2019.1603873 · Cited by 9
Theory-based evaluation, logic modelling and the experience of SA non-governmental organisations
Wildschut, L. (2014) · SUNScholar (Stellenbosch University) · Cited by 9
A conceptual framework to describe and evaluate a socially accountable learning health system: Development and application in a northern, rural, and remote setting
Wood, B., Attema, G., Ross, B. M., & Cameron, E. (2022) · The International Journal of Health Planning and Management · doi:10.1002/hpm.3555 · Cited by 8
Risk communication: lessons from an ethnographic, pragmatic, and Canadian regulatory perspective
Bhuller, Y., & Trevithick‐Sutton, C. C. (2024) · Frontiers in Communication · doi:10.3389/fcomm.2024.1235055 · Cited by 8
The impact of curriculum content in fostering inclusive engineering: data from a national evaluation of the use of EWB projects in first year engineering.
Jolly, L., Crosthwaite, C., Brodie, L., Kavanagh, L., & Buys, L. R. (2011) · University of Southern Queensland ePrints (University of Southern Queensland) · Cited by 8
Moving on from logical frameworks to find the ‘missing middle’ in international development programmes
Floate, H. J., Durham, J., & Marks, G. C. (2018) · Journal of Development Effectiveness · doi:10.1080/19439342.2018.1551921 · Cited by 10
Social impact measurement in social housing: a theory-based investigation into the context, mechanisms and outcomes of implementation
Jones, A., & Valero-Silva, N. (2021) · Qualitative Research in Accounting & Management · doi:10.1108/qram-01-2019-0023 · Cited by 8
Exploring the design of a sport for employability program: A case study
Commers, T., Theeboom, M., & Coalter, F. (2022) · Frontiers in Sports and Active Living · doi:10.3389/fspor.2022.942479 · Cited by 8
Mixed Methods: A Paradigm for Holistic Evaluation of Health IT.
Scott, P. (2016) · PubMed · Cited by 8
Knowledge to Practice or Knowledge of Practice? A Comparison of Two Approaches to Bringing Science to Service
Duffee, D. E. (2009) · Handbooks of sociology and social research · doi:10.1007/978-1-4419-0245-0_18 · Cited by 7

Authors: Blamey, A., & Mackenzie, M.
Affiliations: National Health Service Scotland (GB)
University of Glasgow (GB)
ORCID: Blamey, Avril
Mackenzie, Mhairi
Venue: Evaluation
Publisher: SAGE Publications
Published: 2007-10
Volume: 13
Issue: 4
Pages: 439-455
ISSN: 1356-3890 (ISSN-L)
1461-7153
DOI: 10.1177/1356389007082129
OpenAlex: W2145892273
Cited by: 383
References: 27
Citations by year: 2026: 13 · 2025: 16 · 2024: 20 · 2023: 18 · 2022: 26 · 2021: 23 · 2020: 41 · 2019: 45 · 2018: 21 · 2017: 26 · 2016: 34 · 2015: 20 · 2014: 15 · 2013: 14 · 2012: 23
FWCI: 9.03
Type: journal article
Language: en
Open access: closed
Licence: journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations: Evaluation (publishedVersion)
Topics: Social Sciences › Public Administration › Evaluation and Performance Assessment
Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
Keywords: theory of change, realist evaluation, theory-based evaluation, program outcomes, knowledge production, evaluator practice, evaluation framework

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Theories of Change and Realistic Evaluation: Peas in a Pod or Apples and Oranges?

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks