Research on Evaluation Use: A Review of the Empirical Literature From 1986 to 2005
The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
This paper reviews empirical research on the use of evaluation from 1986 to 2005 using Cousins and Leithwood’s 1986 framework for categorizing empirical studies of evaluation use conducted since that time. The literature review located 41 empirical studies of evaluation use conducted between 1986 and 2005 that met minimum quality standards. The Cousins and Leithwood framework allowed a comparison over time. After initially grouping these studies according to Cousins and Leithwood’s two categories and twelve characteristics, one additional category and one new characteristic were added to their framework. The new category is stakeholder involvement, and the new characteristic is evaluator competence (under the category of evaluation implementation). Findings point to the importance of stakeholder involvement in facilitating evaluation use and suggest that engagement, interaction, and communication between evaluation clients and evaluators is critical to the meaningful use of evaluations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2014) · The SAGE Encyclopedia of Action Research · doi:10.4135/9781446294406.n148 · Cited by 7,250
Neufeld, A., & Ryan, A. G. (1988) · Canadian Journal of Program Evaluation · doi:10.3138/cjpe.3.006 · Cited by 5,913
Utilization-Focused Evaluation
(2018) · The SAGE Encyclopedia of Educational Research, Measurement, and Evaluation · doi:10.4135/9781506326139.n729 · Cited by 2,308
Evaluation : An Integrated Framework for Understanding, Guiding, and Improving Policies and Programs
Mark, M. M., Henry, G. T., & Julnes, G. (2000) · Cited by 578
Utilization-focused evaluation
Westbrook, L. (1998) · Library & Information Science Research · doi:10.1016/s0740-8188(98)90032-9 · Cited by 374
Research On the Utilization of Evaluations
Leviton, L. C., & Hughes, E. F. X. (1981) · Evaluation Review · doi:10.1177/0193841x8100500405 · Cited by 358
Current Empirical Research on Evaluation Utilization
Cousins, J. B., & Leithwood, K. A. (1986) · Review of Educational Research · doi:10.2307/1170319 · Cited by 339
Beyond Use: Understanding Evaluation's Influence on Attitudes and Actions
HENRY, G. (2003) · The American Journal of Evaluation · doi:10.1016/s1098-2140(03)00056-0 · Cited by 326
The Mechanisms and Outcomes of Evaluation Influence
Mark, M. M., & Henry, G. T. (2004) · Evaluation · doi:10.1177/1356389004042326 · Cited by 307
Reconceptualizing evaluation use: An integrated theory of influence
Kirkhart, K. E. (2000) · New Directions for Evaluation · doi:10.1002/ev.1188 · Cited by 300
An Alternate Route to Policy Influence: How Evaluations Affect D.A.R.E.
Weiss, C. H., Murphy-Graham, E. E., & Birkeland, S. E. (2005) · American Journal of Evaluation · doi:10.1177/1098214004273337 · Cited by 247
Evaluation use: Theory, research, and practice since 1986
Shulha, L. M., & Cousins, J. B. (1997) · Evaluation Practice · doi:10.1016/s0886-1633(97)90027-1 · Cited by 238
American Journal of Evaluation
Wingate, L. (2005) · Journal of MultiDisciplinary Evaluation · doi:10.56645/jmde.v2i3.113 · Cited by 211
Alkin, M. C., & Taut, S. M. (2002) · Studies In Educational Evaluation · doi:10.1016/s0191-491x(03)90001-0 · Cited by 171
Toward an Agenda for Research on Evaluation
Henry, G. T., & Mark, M. M. (2003) · New Directions for Evaluation · doi:10.1002/ev.77 · Cited by 136
Stakeholder participation in evaluation design: Is it worth the effort?
Greene, J. C. (1987) · Evaluation and Program Planning · doi:10.1016/0149-7189(87)90010-3 · Cited by 112
Current and Developing Conceptions of Use: Evaluation Use TIG Survey Results
Preskill, H. S., & Caracelli, V. J. (1997) · Evaluation Practice · doi:10.1016/s0886-1633(97)90028-3 · Cited by 109
Stakeholders as partners in evaluation: A stakeholder-collaborative approach
Ayers, T. (1987) · Evaluation and Program Planning · doi:10.1016/0149-7189(87)90038-3 · Cited by 87
A Review of the Research Literature on Teacher Recruitment and Retention
Guarino, C. M., Santibáñez, L., Daley, G. A., & Brewer, D. J. (2004) · Cited by 80
Reported Influence of Evaluation Data on Decision Makers’ Actions
Christie, C. A. (2007) · American Journal of Evaluation · doi:10.1177/1098214006298065 · Cited by 72
Can Evaluation Help an Organization to Learn?
Forss, K., Cracknell, B. E., & Samset, K. (1994) · Evaluation Review · doi:10.1177/0193841x9401800503 · Cited by 69
The mediating effect of participation efficacy on evaluation use
Turnbull, B. (1999) · Evaluation and Program Planning · doi:10.1016/s0149-7189(99)00012-9 · Cited by 54
Hofstetter, C. H., & Alkin, M. C. (2003) · Springer eBooks · doi:10.1007/978-94-010-0309-4_14 · Cited by 51
Pinning a Wave to the Shore: Conceptualizing Evaluation Use in School Systems
King, J. A., & Pechman, E. M. (1984) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737006003241 · Cited by 41
Self-citationThe utilization of training program evaluation in corporate universities
Bober, C. F., & Bartlett, K. R. (2004) · Human Resource Development Quarterly · doi:10.1002/hrdq.1111 · Cited by 37
Factors Influencing the Use of Health Evaluation Research in Congress
Boyer, J. F., & Langbein, L. I. (1991) · Evaluation Review · doi:10.1177/0193841x9101500501 · Cited by 29
Assessing Evaluation Performance and Use
Kirkhart, K. E., Morgan, R. O., & Jm, S. (1991) · Evaluation Review · doi:10.1177/0193841x9101500406 · Cited by 4
Cited by
A Systematic Review of Theory-Driven Evaluation Practice From 1990 to 2009
Coryn, C. L. S., Noakes, L. A., Westine, C. D., & Schröter, D. C. (2011) · American Journal of Evaluation · doi:10.1177/1098214010389321 · Cited by 531
Toward More “Evidence‐Informed” Policy Making?
Head, B. W. (2016) · Public Administration Review · doi:10.1111/puar.12475 · Cited by 453
Fishman, B. J., Penuel, W. R., Allen, A.-R., Cheng, B. H., & Sabelli, N. (2013) · Teachers College Record: The Voice of Scholarship in Education · doi:10.1177/016146811311501415 · Cited by 418
Using Science as Evidence in Public Policy
(2012) · National Academies Press eBooks · doi:10.17226/13460 · Cited by 254
Metrics Matter: How Properties and Perceptions of Data Shape Teachers’ Instructional Responses
Farrell, C. C., & Marsh, J. A. (2016) · Educational Administration Quarterly · doi:10.1177/0013161x16638429 · Cited by 54
Metadata
- Authors
- Johnson, K., Greenseid, L. O., Toal, S. A., King, J. A., Lawrenz, F., & Volkov, B.
- Venue
- American Journal of Evaluation
- Publisher
- SAGE Publications
- Published
- 2009-08-05
- Volume
- 30
- Issue
- 3
- Pages
- 377-410
- ISSN
- 1098-2140 (ISSN-L)
- 1557-0878
- OpenAlex
- W2097751135
- Cited by
- 272
- References
- 27
- FWCI
- 17.59
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.