How Can Theory-Based Evaluation Make Greater Headway?
The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
The idea of theory-based evaluation (TBE) is plausible and cogent, and it promises to bring greater explanatory power to evaluation. However, problems beset its use, including inadequate theories about pathways to desired outcomes in many program areas, confusion between theories of implementation and theories of programmatic action, difficulties in eliciting or constructing usable theories, measurement error, complexities in analysis, and others. This article explores the problems, describes the nature of potential benefits, and suggests that the benefits are significant enough to warrant continued effort to overcome the obstacles and advance the feasibility of TBE.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1963) · Medical Entomology and Zoology · Cited by 15,085
Organizational Learning: A Theory of Action Perspective
Argyris, C., & Schön, D. A. (1997) · Reis · doi:10.2307/40183951 · Cited by 11,113
(1969) · Virtual Defense Library (Ministerio de Defensa) · Cited by 10,735
Ambiguity and Choice in Organizations.
Perrow, C., March, J. G., & Olsen, J. P. (1977) · Contemporary Sociology · doi:10.2307/2064777 · Cited by 2,704
Process Analysis: Estimating Mediation in Treatment Evaluations
Judd, C. M., & Kenny, D. A. (1981) · Evaluation Review · doi:10.1177/0193841x8100500502 · Cited by 2,442
Organizational learning II: Theory, method and practice
Marraffa, M. (1998) · Iris (Roma Tre University) · Cited by 2,309
Chen, H.-T. (1990) · Medical Entomology and Zoology · Cited by 1,227
Performance models for antisocial boys.
Patterson, G. R. (1986) · American Psychologist · doi:10.1037//0003-066x.41.4.432 · Cited by 1,040
Toward Reform of Program Evaluation
Gowin, D. B., Millman, J., Cronbach, L. J., Ambron, S. R., Dornbusch, S. M., Hess, R. D., Hornik, R. C., Phillips, D. C., Walker, D. F., & Weiner, S. S. (1981) · Educational Evaluation and Policy Analysis · doi:10.2307/1163707 · Cited by 801
Evaluation Research: Methods of Assessing Program Effectiveness.
Rieker, P. P., & Weiss, C. H. (1975) · Social Forces · doi:10.2307/2576100 · Cited by 678
Self-citationJournal of Community Psychology
(2006) · doi:10.1002/(issn)1520-6629 · Cited by 676
Lipsey, M. W. (1991) · Evaluation and Program Planning · doi:10.1016/0149-7189(91)90027-e · Cited by 584
Evaluating With Sense: The Theory-Driven Approach
Chen, H.-T., & Rossi, P. H. (1983) · Evaluation Review · doi:10.1177/0193841x8300700301 · Cited by 424
Where politics and evaluation research meet
Weiss, C. H. (1993) · Evaluation Practice · doi:10.1016/0886-1633(93)90046-r · Cited by 347
Self-citationUsing program theory in evaluation
Bickman, L. (1987) · Jossey-Bass eBooks · Cited by 260
Educational environments and effects : evaluation, policy, and productivity
Walberg, H. J. (1979) · McCutchan Pub Corp eBooks · Cited by 237
Pattern Matching, Validity, and Conceptualization in Program Evaluation
Trochim, W. M. K. (1985) · Evaluation Review · doi:10.1177/0193841x8500900503 · Cited by 201
Conceptual models for health education research and practice
Earp, J. A., & Ennett, S. T. (1991) · Health Education Research · doi:10.1093/her/6.2.163 · Cited by 181
March, J. G. (1972) · Review of Educational Research · doi:10.2307/1169894 · Cited by 168
Linking empirically based theory and evaluation: The family bereavement program
Sandler, I. N., West, S. G., Baca, L., Pillow, D. R., Gersten, J. C., Rogosch, F., Virdin, L., Beals, J., Reynolds, K. D., Kallgren, C., et al. (1992) · American Journal of Community Psychology · doi:10.1007/bf00937756 · Cited by 161
The Social Psychology of Organizing, 2d ed.
Wicker, A. W., & Weick, K. E. (1980) · Administrative Science Quarterly · doi:10.2307/2392295 · Cited by 153
Evaluation Research: Methods of Assessing Program Effectiveness.
Rothbart, G. S., Weiss, C. H., Rossi, P. H., & Williams, W. L. (1975) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2062250 · Cited by 130
Self-citationHow Shall We Study Comprehensive, Collaborative Services for Children and Families?
Knapp, M. S. (1995) · Educational Researcher · doi:10.3102/0013189x024004005 · Cited by 114
Driving toward theory in program evaluation: More models to choose from
Lipsey, M. W., & Pollard, J. A. (1989) · Evaluation and Program Planning · doi:10.1016/0149-7189(89)90048-7 · Cited by 112
Program theory and implementation theory: Implications for evaluators
Scheirer, M. A. (1987) · New Directions for Program Evaluation · doi:10.1002/ev.1446 · Cited by 95
Using Theory to Improve Program and Policy Evaluations.
Sabatier, P. A., Chen, H.-T., & Rossi, P. H. (1994) · Contemporary Sociology · doi:10.2307/2076456 · Cited by 91
Bickman, L. (1990) · New Directions for Program Evaluation · Cited by 77
McGraw, S. A., Sellers, D. E., Johnson, C. C., Stone, E. J., Bachman, K. J., Bebchuk, J., Luepker, R. V., & Edmundson, E. W. (1996) · Evaluation Review · doi:10.1177/0193841x9602000304 · Cited by 75
From program theory to tests of program theory
Mark, M. M. (1990) · New Directions for Program Evaluation · doi:10.1002/ev.1553 · Cited by 40
Using path analysis to develop and evaluate program theory and impact
Smith, N. L. (1990) · New Directions for Program Evaluation · doi:10.1002/ev.1554 · Cited by 27
Holder, H. D., Saltz, R. F., Treno, A. J., Grube, J. W., & Voas, R. B. (1997) · Evaluation Review · doi:10.1177/0193841x9702100202 · Cited by 23
Linking program theory and social science theory
Riggin, L. J. C. (1990) · New Directions for Program Evaluation · doi:10.1002/ev.1558 · Cited by 9
Cited by
MacKinnon, D. P., Fairchild, A. J., & Fritz, M. S. (2007) · Annual Review of Psychology · doi:10.1146/annurev.psych.58.110405.085542 · Cited by 5,688
“Researchers from many fields have stressed the importance of assessing mediation in treatment and prevention research (Baranowski et al. 1998; Donaldson 2001; Judd & Kenny 1981a,b; Kraemer et al. 2002; MacKinnon 1994; Shadish 1996; Weiss 1997).”
BackgroundUnpacking black boxes: mechanisms and theory building in evaluation
Astbury, B., & Leeuw, F. L. (2010) · American Journal of Evaluation · doi:10.1177/1098214010371972 · Cited by 850
A Systematic Review of Theory-Driven Evaluation Practice From 1990 to 2009
Coryn, C. L. S., Noakes, L. A., Westine, C. D., & Schröter, D. C. (2011) · American Journal of Evaluation · doi:10.1177/1098214010389321 · Cited by 531
“In earlier conceptualizations, numerous theorists, including Weiss (1997a, 1997b, 1998) and Wholey (1979), among others, tended to favor linear models to describe program theories.”
BackgroundInfluentialIntegrating Mediators and Moderators in Research Design
MacKinnon, D. P. (2011) · Research on Social Work Practice · doi:10.1177/1049731511414148 · Cited by 415
Contribution analysis: Coming of age?
Mayne, J. (2012) · Evaluation · doi:10.1177/1356389012451663 · Cited by 387
Metadata
- Authors
- Weiss, C. H.
- Venue
- Evaluation Review
- Publisher
- SAGE Publications
- Published
- 1997-08
- Volume
- 21
- Issue
- 4
- Pages
- 501-524
- ISSN
- 0145-4692 (ISSN-L)
- 0193-841X
- 1552-3926
- OpenAlex
- W1971303900
- Cited by
- 483
- References
- 32
- FWCI
- 14.13
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.