Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 41 of the 42 references it cites were found in a registry or an index.

Using Programme Theory to Evaluate Complicated and Complex Aspects of Interventions

Rogers, Patricia J. · 2008 · Evaluation

Abstract

This article proposes ways to use programme theory for evaluating aspects of programmes that are complicated or complex. It argues that there are useful distinctions to be drawn between aspects that are complicated and those that are complex, and provides examples of programme theory evaluations that have usefully represented and address both of these. While complexity has been defined in varied ways in previous discussions of evaluation theory and practice, this article draws on Glouberman and Zimmerman's conceptualization of the differences between what is complicated (multiple components) and what is complex (emergent). Complicated programme theory may be used to represent interventions with multiple components, multiple agencies, multiple simultaneous causal strands and/or multiple alternative causal strands. Complex programme theory may be used to represent recursive causality (with reinforcing loops), disproportionate relationships (where at critical levels, a small change can make a big difference — a `tipping point') and emergent outcomes.

Overview

Integrity signals

Registry

Crossref · 10.1177/1356389007084674

Cites

41 of 41 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Citations

Cites

Show all 42 references

Research works printed but not linked: 27

  1. Arnkil, R., Paper presented at the 2002 Conference of the European Evaluation Society
  2. Bakewell, O., 2005, The Use and Abuse of the Logical Framework Approach
  3. Collaborative Institute for Research, Consulting and Learning in Evaluation (CIRCLE), 2006, Third newsletter
  4. Douthwaite, B., paper presented at the INRM Workshop
  5. Eoyang, G., 1998, Evaluation in Complex Adaptive System
  6. Eoyang, G., 1998, Life Sciences
  7. Funnell, S., 1997, Evaluation News and Comment, 6, 5
  8. Giuliani, R., 2002, Leadership
  9. Glouberman, S., 2001, Towards a New Perspective on Health Policy
  10. Glouberman, S., Commission on the Future of Health Care in Canada, Discussion Paper 8
  11. Gregory, R.J., 1995, `Accountability, Responsibility, and Corruption: Managing the “Public Production Process”'
  12. Kankare, I., paper presented at the European Evaluation Society conference
  13. Nagarajan, N., 1997, Evaluating EU Expenditure Programmes: A Guide
  14. 10.1177/109821409401500312 · doi:10.1177/109821409401500312 · Paper page
  15. Patton, M.Q., paper presented at the 2003 conference of the Australasian Evaluation Society
  16. Pawson, R., 1997, Realistic Evaluation
  17. Perrin, B., 2003, Implementing the Vision: Addressing the Challenges of Results-Based Management
  18. Pinnegar, S., 2006, Are Complex Programs the Best Response to Complex Policy Issues? City Futures Research Centre Issues paper. Kensington, NSW
  19. Potter, P., paper presented at the 2004 Conference of the European Evaluation Society
  20. Regine, B., Complexity Science in Human Terms: A Relational Model of Business
  21. Rogers, P.J., 2004, Evaluation, 232
  22. Sibthorpe, B., 2004, Complex Adaptive Systems: A Different Way of Thinking about Health Care Systems. A Brief Synopsis of Selected Literature for Initial Work Program — Stream 1
  23. Sparks, D., 2003, NSDC's Theory of Change
  24. Weiss, C.H. (1995) `Nothing as Practical as a Good Theory: Exploring Theory-Based Evaluation for Comprehensive Community Initiatives for Children and Families', in J. P. Connell , A. C. Kubisch , L. B. Schorr and C. H. Weiss (eds) New Approaches to Evaluating Community Initiatives, pp. 65—9. Washington, DC: Aspen Institute .
  25. Wholey, Joseph S., 2003, Studies, 3, 6
  26. W. K. Kellogg Foundation, 2004, Logic Model Development Guide
  27. World Bank, 2004, Pages from World Bank History: The Fight Against Riverblindness

Cited by

See all 999

Metadata

Authors
Rogers, P. J.
Affiliations
RMIT University (AU)
Corresponding author
Rogers, Patricia J.
Venue
Evaluation
Published
2008-01
Volume
14
Issue
1
Pages
29-48
ISSN
  • 1356-3890 (ISSN-L)
  • 1461-7153
OpenAlex
W2067154398
Cited by
999
References
42
Citations by year
2026: 53 · 2025: 69 · 2024: 43 · 2023: 59 · 2022: 99 · 2021: 89 · 2020: 101 · 2019: 62 · 2018: 72 · 2017: 53 · 2016: 64 · 2015: 53 · 2014: 46 · 2013: 37 · 2012: 41
FWCI
29.65
Type
journal article
Language
en
Open access
closed
Licence
journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations
  • Evaluation (publishedVersion)
  • RMIT Research Repository (RMIT University Library) (submittedVersion)
  • Figshare (submittedVersion)
Topics
  • Social Sciences › Public Administration › Evaluation and Performance Assessment
  • Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
  • Social Sciences › Public Administration › Public Policy and Administration Research
Keywords
program theory, complex interventions, program evaluation, emergent outcomes, tipping points

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Using Programme Theory to Evaluate Complicated and Complex Aspects of Interventions. https://app.cochat.ai/papers/10.1177/1356389007084674
The paper
Rogers, P. J. (2008). Using Programme Theory to Evaluate Complicated and Complex Aspects of Interventions. Evaluation. https://doi.org/10.1177/1356389007084674

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.