The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Evidence, Understanding and Complexity: Evaluation in Non-Linear Systems
Open accessAbstract
This article discusses the challenges associated with the evaluation of complex policy initiatives, focusing on one element of the national evaluation of Health Action Zones in England: Building Capacity for Collaboration. It describes the multiple dimensions of complexity that characterize HAZs and considers the limitations of the Theory of Change approach in encompassing the diverse change processes that HAZs seek to promote. Drawing on social constructionist perspectives and from both complexity theory and new institutional theory, the authors propose that evaluators need not only to be able to work with change theories generated within such complex programmes, but also to apply `higher level' theory to an understanding of the way such programmes develop. They argue that the role of evaluators in `telling the story' is an important part of the evaluation challenge in such contexts.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Barnes et al., 128 for example, also caution against interpreting context as a purely external factor, arguing that context is shaped by actors as much as it constrains their activities.”
From ReseArch with Patient and Public invOlvement: a RealisT evaluation – the RAPPORT study (2015) · cites this paper as [128]
Citations
Cites
Institutions, Institutional Change and Economic Performance
North, D. C. (1990) · doi:10.1017/cbo9780511808678 · Cited by 32,691
Evaluation in Complex Policy Systems
Sanderson, I. (2000) · Evaluation · doi:10.1177/13563890022209415 · Cited by 237
Strong theory, flexible methods: Evaluating complex community-based initiatives
Judge, K., & Bauld, L. (2001) · Critical Public Health · doi:10.1080/09581590010028237 · Cited by 135
The well-connected community: networking to the edge of chaos
Gilchrist, A. M. (2000) · Community Development Journal · doi:10.1093/cdj/35.3.264 · Cited by 114
‘With a Little Help From Our Friends’: Public-Private Partnerships as Institutions and Instruments
Peters, B. G. (1998) · Palgrave Macmillan UK eBooks · doi:10.1007/978-1-349-14408-2_2 · Cited by 112
Knowledge, Complexity, and Understanding
Cilliers, P. (2000) · Emergence · doi:10.1207/s15327000em0204_03 · Cited by 85
Building Collaborative Capacity through `Theories of Change'
Sullivan, H. T., Barnes, M., & Matka, E. (2002) · Evaluation · doi:10.1177/1358902002008002514 · Cited by 85
Self-citationFrom Programme Theory to Constructivism
Dahler‐Larsen, P. (2001) · Evaluation · doi:10.1177/13563890122209711 · Cited by 83
Change in public service management: New institutions and new managerial regimes
Lowndes, V. (1997) · Local Government Studies · doi:10.1080/03003939708433864 · Cited by 54
Concept Mapping in Policy Evaluation
Knox, C. G. (1995) · Evaluation · doi:10.1177/135638909500100105 · Cited by 21
Building capacity for collaboration in English Health Action Zones
Barnes, M., & Sullivan, H. T. (2002) · doi:10.46692/9781847425492.006 · Cited by 2
Self-citation
Research works printed but not linked: 9
- Bauld, L and K. Judge (2002) `Introduction: The Development of Health Action Zones', in L. Bauld and K. Judge (eds) Learning from Health Action Zones. Chichester: Aeneas Press .
- Berger, P. L. and T. Luckmann (1973) The Social Construction of Reality. Harmondsworth: Penguin .
- Glendinning, G., M. Powell and K. Rummery, eds (2002) Partnerships under New Labour: a Third Way Approach to Delivering Welfare. Bristol: Policy Press .
- Immergut, E. (1992) Health Politics: Interests and Institutions in Western Europe. Cambridge: Cambridge University Press .
- Judge, K., M. Barnes, L. Bauld, M. Benzeval, A. Killoran, R. Robinson, R. Wigglesworth and H. Zeilig (1999) Health Action Zones: Learning to Make a Difference, Findings from a Preliminary Review of Health Action Zones and Proposals for a National Evaluation, PSSRU Discussion Paper 1815. Canterbury: University of Kent .
- Kauffman, S. (1995) At Home in the Universe. London: Penguin .
- March, J. and J. Olsen (1989) Rediscovering Institutions. New York: Free Press .
- Travers, T. (1993) `Professionals and Local Government Reform - Not So Much Villains as Saviours', in G. Stoker (ed.) The Future of Professionalism in Local Government, pp. 37-48. Luton: LGMB .
- Williamson, O. E. (1985) The Economic Institutions of Capitalism. New York: Free Press .
Cited by
Sorted by citations
Using Programme Theory to Evaluate Complicated and Complex Aspects of Interventions
Rogers, P. J. (2008) · Evaluation · doi:10.1177/1356389007084674 · Cited by 999
Lessons from Complex Interventions to Improve Health
Hawe, P. (2015) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-031912-114421 · Cited by 607
Realist synthesis - an introduction
Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2004) · UCL Discovery (University College London) · Cited by 570
Marchal, B., van Belle, S., van Olmen, J., Hoerée, T., & Kegels, G. (2012) · Evaluation · doi:10.1177/1356389012442444 · Cited by 476
Theories of Change and Realistic Evaluation: Peas in a Pod or Apples and Oranges?
Blamey, A., & Mackenzie, M. (2007) · Evaluation · doi:10.1177/1356389007082129 · Cited by 383
Metadata
- Authors
- Barnes, M., Matka, E., & Sullivan, H.
- Affiliations
- University of Birmingham (GB)
- University of the West of England (GB)
- Corresponding author
- Barnes, Marian
- Matka, Elizabeth
- Sullivan, Helen
- ORCID
- Sullivan, Helen
- Venue
- Evaluation
- Publisher
- SAGE Publications
- Published
- 2003-07
- Volume
- 9
- Issue
- 3
- Pages
- 265-284
- ISSN
- 1356-3890 (ISSN-L)
- 1461-7153
- OpenAlex
- W2056268972
- Cited by
- 208
- References
- 11
- Citations by year
- 2026: 5 · 2025: 1 · 2024: 4 · 2023: 9 · 2022: 5 · 2021: 8 · 2020: 13 · 2019: 9 · 2018: 13 · 2017: 11 · 2016: 16 · 2015: 14 · 2014: 7 · 2013: 15 · 2012: 11
- FWCI
- 9.56
- Type
- journal article
- Language
- en
- Open access
- green
- eprints.uwe.ac.uk
- Locations
- Evaluation (publishedVersion)
- UWE Research Repository (UWE Bristol) (submittedVersion, cc-by)
- University of Birmingham Research Portal (University of Birmingham) (submittedVersion)
- University of Brighton Repository (University of Brighton) (submittedVersion)
- Topics
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Social Sciences › Public Administration › Public Policy and Administration Research
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Keywords
- Health Action Zones, theory of change, complexity theory, new institutionalism, social constructionism, evaluator role, program development, evidence-based policy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
