The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Have We Learned Anything New About the Use of Evaluation?
Abstract
“Use of evaluation” used to mean the use of results for making program decisions. Now we are aware of its larger dimensions. Many aspects of evaluation can be used-ideas and insights, signals that are sent by the very fact of evaluating, the processes of learning through cooperation with evaluation, the choice of outcome indicators that herald success, even the study design. “Use” encompasses a broad array of effects by multiple classes of users. The paper highlights the importance of considering further potential collective users-the program organization, client groups, and civil society.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The results of the data analysis have undermined certain myths, which Weiss (1998) refers to as the enlightenment function.”
From Data teams for school improvement (2016) · cites this paper as Weiss (1998)
Citations
Cites
Agendas, Alternatives, and Public Policies
Perry, J. L., & Kingdon, J. W. (1985) · Journal of Policy Analysis and Management · doi:10.2307/3323801 · Cited by 11,238
(1987) · Cited by 6,910
Policy Change and Learning: An Advocacy Coalition Approach
Roberts, A. S., Sabatier, P., & Jenkins‐Smith, H. C. (1994) · Canadian Public Policy · doi:10.2307/3551961 · Cited by 3,599
Organizational Learning II: Theory, Method, and Practice.
Greenwood, D. J., Argyris, C., & Schön, D. A. (1997) · Industrial and Labor Relations Review · doi:10.2307/2525281 · Cited by 3,455
Information in Organizations as Signal and Symbol
Feldman, M. S., & March, J. G. (1981) · Administrative Science Quarterly · doi:10.2307/2392467 · Cited by 1,724
Utilization-focused evaluation : the new century text
Patton, M. Q. (1997) · Cited by 1,469
Knowledge Creep and Decision Accretion
Weiss, C. H. (1980) · Knowledge · doi:10.1177/107554708000100303 · Cited by 669
Self-citationSystematic Thinking for Social Action
Tullock, G., & Rivlin, A. M. (1972) · Journal of money credit and banking · doi:10.2307/1991056 · Cited by 367
Professional evaluation: social impact and political consequences
(1993) · Choice Reviews Online · doi:10.5860/choice.31-1583 · Cited by 289
The New American Political System
Williams, P. M. (1979) · International Affairs · doi:10.2307/2616385 · Cited by 275
Research works printed but not linked: 7
- Alkin, M. C., 1990, Debates on evaluation
- Breslau, D., Theory and Society
- Huberman, M., 1989, Knowledge in Society: The International Journal of Knowledge Transfer, 2, 6
- Senge, P. M., The fifth discipline: The art and practice of the learning organizations
- Shadish, W. R., 1997, EVALTALK message
- Shulha, L. M., American Evaluation Association meeting
- Weiss, C. H., 1967, House of Representatives committee on government operations, The use of social research in federal domestic programs, 426
Cited by
Sorted by citations
Items 101–200 of 383
A Historical Perspective on the Evolution of Evaluative Thinking
Patton, M. (2018) · New Directions for Evaluation · doi:10.1002/ev.20325 · Cited by 30
Pinning it down? Measuring innovation for sustainability transitions
Krlev, G., & Terstriep, J. (2022) · Environmental Innovation and Societal Transitions · doi:10.1016/j.eist.2022.11.005 · Cited by 30
Thomas, V. G. (2004) · New Directions for Evaluation · doi:10.1002/ev.104 · Cited by 30
Archibald, T., Neubauer, L. C., & Brookfield, S. (2018) · New Directions for Evaluation · doi:10.1002/ev.20319 · Cited by 34
Mansell, P., Philbin, S. P., & Konstantinou, E. (2020) · Sustainability · doi:10.3390/su12197998 · Cited by 29
The use of performance feedback in school improvement in Louisiana
Schildkamp, K., & Visscher, A. J. (2010) · Teaching and Teacher Education · doi:10.1016/j.tate.2010.04.004 · Cited by 29
Pierre, T. L. S., & Kaltreider, D. L. (2004) · American Journal of Evaluation · doi:10.1177/109821400402500405 · Cited by 29
Teacher education research and education policy-makers: an Australian perspective
White, S. (2016) · Journal of Education for Teaching International Research and Pedagogy · doi:10.1080/02607476.2016.1145369 · Cited by 27
Cagliero, R., Licciardo, F., & Legnini, M. (2021) · Sustainability · doi:10.3390/su13105528 · Cited by 27
Owen, R., & Vedanthachari, L. N. (2022) · IEEE Transactions on Engineering Management · doi:10.1109/tem.2022.3153319 · Cited by 27
Why Is Administrative Simplification So Complicated?
OECD (2010) · Cutting red tape · doi:10.1787/9789264089754-en · Cited by 27
Improving evidence use: a systematic scoping review of local models of knowledge mobilisation
Durrant, H., Havers, R., Downe, J., & Martin, S. J. (2023) · Evidence & Policy · doi:10.1332/174426421x16905563871215 · Cited by 26
Aveling, E., Zegeye, D. T., & Silverman, M. A. (2016) · BMC Health Services Research · doi:10.1186/s12913-016-1639-4 · Cited by 26
What Do We Know About the Demand for Evaluation? Insights From the Parliamentary Arena
Bundi, P. (2016) · American Journal of Evaluation · doi:10.1177/1098214015621788 · Cited by 26
Involving patient in the early stages of health technology assessment (HTA): a study protocol
Gagnon, M., Candas, B., Desmartis, M., Gagnon, J., Roche, D. L., Rhainds, M., Coulombe, M., Dipankui, M. T., & Légaré, F. (2014) · BMC Health Services Research · doi:10.1186/1472-6963-14-273 · Cited by 25
Evaluation of Active Living Research
Gutman, M. A., Barker, D. C., Samples-Smart, F., & Morley, C. (2009) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2008.10.009 · Cited by 25
Larsson, M., & Hanberger, A. (2016) · Evaluation · doi:10.1177/1356389016638751 · Cited by 24
D’Ostie-Racine, L., Dagenais, C., & Ridde, V. (2012) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2012.07.002 · Cited by 24
Hansson, F., Norn, M.-T., & Vad, T. B. (2014) · Evaluation · doi:10.1177/1356389014529835 · Cited by 24
The Institutional Arrangements for Connecting Evidence and Policy: the Case of Drug Misuse
Nutley, S., Walter, I., & Bland, N. (2002) · Public Policy and Administration · doi:10.1177/095207670201700306 · Cited by 24
Gagnon, M., Gagnon, J., St‐Pierre, M., Gauvin, F., Piron, F., Rhainds, M., Coulombe, M., Lepage‐Savary, D., Desmartis, M., Dipankui, M. T., et al. (2012) · BMC Health Services Research · doi:10.1186/1472-6963-12-14 · Cited by 23
Teirlinck, P., Delanghe, H., Padilla, P., & Verbeek, A. (2012) · Science and Public Policy · doi:10.1093/scipol/scs123 · Cited by 22
The Status of Program Evaluation Expectations in State School Counselor Certification Requirements
Trevisan, M. S. (2000) · American Journal of Evaluation · doi:10.1016/s1098-2140(00)00051-5 · Cited by 23
Díez, M.-Á., Ramírez, B. I., & Zaldúa, E. M. (2016) · Environmental Policy and Governance · doi:10.1002/eet.1711 · Cited by 22
Ensaio teórico sobre as avaliações de políticas públicas
Oliveira, L., & Passador, C. S. (2019) · Cadernos EBAPE BR · doi:10.1590/1679-395169657 · Cited by 22
Environmental science and public policy in Executive government: Insights from Australia and Canada
Lalor, B. M., & Hickey, G. M. (2013) · Science and Public Policy · doi:10.1093/scipol/sct022 · Cited by 22
Addressing health inequalities in the United Kingdom: a case study
Oliver, A., & Nutbeam, D. (2003) · Journal of Public Health · doi:10.1093/pubmed/fdg091 · Cited by 22
Anthony, B. P., & Shestackova, E. (2015) · Environmental Management · doi:10.1007/s00267-015-0495-z · Cited by 21
Gooding, K. (2017) · Health Research Policy and Systems · doi:10.1186/s12961-017-0199-3 · Cited by 21
Kalyal, H. J. (2019) · Police Practice and Research · doi:10.1080/15614263.2019.1608548 · Cited by 22
Frey, K., & Widmer, T. (2011) · American Journal of Evaluation · doi:10.1177/1098214011401902 · Cited by 21
Varieties of accountability: How attributes of policy fields shape parliamentary oversight
Bundi, P. (2017) · Governance · doi:10.1111/gove.12282 · Cited by 21
When the Boat Gets Missed: Response to M.F. Smith
Cousins, J. B., & Earl, L. M. (1999) · American Journal of Evaluation · doi:10.1016/s1098-2140(99)00015-6 · Cited by 20
Kupiec, T., Celińska-Janowicz, D., & Pattyn, V. (2023) · Evaluation · doi:10.1177/13563890231185164 · Cited by 20
HIV/AIDS talk: Implications for prevention intervention and evaluation
Hopson, R., Lucas, K. J., & Peterson, J. A. (2000) · New Directions for Evaluation · doi:10.1002/ev.1170 · Cited by 20
Bunn, F., & Kendall, S. A. (2011) · Journal of research in nursing · doi:10.1177/1744987110392627 · Cited by 21
Hopson, R. (1999) · American Journal of Evaluation · doi:10.1016/s1098-2140(99)00032-6 · Cited by 20
Knowledge for policy-making in times of uncertainty: the case of autonomous vehicle model results
Curtis, C., McLeod, S., Hultén, J., Pettersson, F., Paulsson, A., & Sørensen, C. H. (2020) · Transport Reviews · doi:10.1080/01441647.2020.1857885 · Cited by 19
Public Policies on Gender Equality
Parejo, V. H., & Radulovic, B. L. (2023) · Springer textbooks in law · doi:10.1007/978-3-031-14360-1_12 · Cited by 19
Gao, J. (2012) · Australian Journal of Public Administration · doi:10.1111/j.1467-8500.2012.00760.x · Cited by 19
Boezeman, D., Leroy, P., Maas, R., & Kruitwagen, S. (2010) · Ecological Economics · doi:10.1016/j.ecolecon.2010.04.013 · Cited by 19
Enhancing the value of adaptation reporting as a driver for action: lessons from the UK
Street, R., & Jude, S. (2019) · Climate Policy · doi:10.1080/14693062.2019.1652141 · Cited by 19
Use and Misuse of Indicators in Spatial Planning: The Example of Land Take
Decoville, A. (2017) · Planning Practice and Research · doi:10.1080/02697459.2017.1378981 · Cited by 19
Managing the politics of evaluation to achieve impact
Mohan, R., & Sullivan, K. (2006) · New Directions for Evaluation · doi:10.1002/ev.204 · Cited by 19
Evaluating Local Economic and Employment Development
OECD (2004) · Local economic and employment development · doi:10.1787/9789264017092-en · Cited by 18
Figueiró, A. C., Hartz, Z., Samico, I., & Cesse, E. Â. P. (2012) · Cadernos de Saúde Pública · doi:10.1590/s0102-311x2012001100009 · Cited by 18
Parliamentarians’ strategies for policy evaluations
Bundi, P. (2017) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2017.02.003 · Cited by 21
“Expectations to Change” (E2C)
Adams, A. E., Nnawulezi, N. A., & Vandenberg, L. (2014) · American Journal of Evaluation · doi:10.1177/1098214014553787 · Cited by 18
Evaluation for learning: A cross-case analysis of evaluator strategies
DeLuca, C., Poth, C., & Searle, M. J. (2009) · Studies In Educational Evaluation · doi:10.1016/j.stueduc.2009.12.005 · Cited by 19
Sandin, S., Neij, L., & Mickwitz, P. (2019) · Energy Sustainability and Society · doi:10.1186/s13705-019-0203-6 · Cited by 22
Strengthening and measuring monitoring and evaluation capacity in selected African programmes
Masvaure, S., & Fish, T. E. (2022) · African Evaluation Journal · doi:10.4102/aej.v10i1.635 · Cited by 17
Explaining use and non-use of policy evaluations in a mature evaluation setting
Pattyn, V., & Bouterse, M. (2020) · Humanities and Social Sciences Communications · doi:10.1057/s41599-020-00575-y · Cited by 25
Minassians, H. P. (2015) · International Review of Public Administration · doi:10.1080/12294659.2015.1088689 · Cited by 17
Improving the Use of Data for HIV Prevention Decision Making: Lessons Learned
Jenkins, R. A., Averbach, A. R., Robbins, A. S., Cranston, K., Amaro, H. D. L. A., Morrill, A. C., Blake, S. M., Logan, J. A., Batchelor, K., Freeman, A., et al. (2005) · AIDS and Behavior · doi:10.1007/s10461-005-3947-8 · Cited by 17
Use and impact of external evaluation feedback in schools
Ólafsdóttir, B., Jónasson, J. T., & Sigurðardóttir, A. K. (2022) · Studies In Educational Evaluation · doi:10.1016/j.stueduc.2022.101181 · Cited by 16
Understanding the use and usability of research evaluation studies1,2
Milzow, K., Reinhardt, A., Söderberg, S., & Zinöcker, K. (2018) · Research Evaluation · doi:10.1093/reseval/rvy040 · Cited by 16
Maximizing conservation evaluation utilization
Jacobson, C. L., Carter, B., Hockings, M. T., & Kelman, J. (2011) · Evaluation · doi:10.1177/1356389010389903 · Cited by 16
Framing the role of Decision Support in the case of Stockholm Congestion Charging Trial
Gudmundsson, H., Ericsson, E., Hugosson, M. B., & Rosqvist, L. S. (2008) · Transportation Research Part A Policy and Practice · doi:10.1016/j.tra.2008.09.003 · Cited by 16
What can practitioners learn from theorists’ logic models?
Gargani, J. (2012) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2012.03.020 · Cited by 16
Policy evaluation and democracy: Do they fit?
Sager, F. (2017) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2017.08.004 · Cited by 16
Jankauskas, V., & Eckhard, S. (2019) · Politische Vierteljahresschrift · doi:10.1007/s11615-019-00189-3 · Cited by 16
Lumino, R., & Gambardella, D. (2020) · Evaluation · doi:10.1177/1356389019901304 · Cited by 15
Loeffler, E. (2020) · Springer eBooks · doi:10.1007/978-3-030-55509-2_3 · Cited by 18
Evaluation as a moral practice: The case of virtue ethics.
Taggart, G., & Zenor, J. (2022) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2022.102140 · Cited by 14
Innovation, embeddedness and policy: evidence from life sciences in three UK regions
Kasabov, E., & Delbridge, R. (2008) · Technology Analysis and Strategic Management · doi:10.1080/09537320801931671 · Cited by 15
Useful to whom? Evaluation utilisation theory and boundaries for programme evaluation scope
Onyura, B. (2020) · Medical Education · doi:10.1111/medu.14281 · Cited by 14
Decision Making for HIV Prevention Planning: Organizational Considerations and Influencing Factors
Jenkins, R. A., & Carey, J. W. (2005) · AIDS and Behavior · doi:10.1007/s10461-005-3941-8 · Cited by 14
Campbell, R., Fehler‐Cabral, G., Pierce, S. J., Sharma, D. B., Shaw, J., Horsford, S. R., & Feeney, H. (2020) · American Journal of Community Psychology · doi:10.1002/ajcp.12428 · Cited by 13
Community Development Financial Institution (CDFI) program evaluation: a luxury but not a necessity?
McCall, J., & Hoyman, M. (2021) · Community Development · doi:10.1080/15575330.2021.1976807 · Cited by 13
Assessing the organizational impact of patient involvement: a first STEPP
Kreindler, S. A., & Struthers, A. (2016) · International Journal of Health Care Quality Assurance · doi:10.1108/ijhcqa-01-2015-0013 · Cited by 13
Natow, R. S. (2020) · Education Policy Analysis Archives · doi:10.14507/epaa.28.5048 · Cited by 17
Beyond “best practices”: Centering equity in teacher preparation evaluation
Cochran‐Smith, M., & Reagan, E. M. (2022) · Education Policy Analysis Archives · doi:10.14507/epaa.30.7040 · Cited by 13
Toward an “Age of Imposed Use”? Evidence-Based Crime Policy in a Law and Social Science Context
Zane, S. N., & Welsh, B. C. (2017) · Criminal Justice Policy Review · doi:10.1177/0887403417694068 · Cited by 13
The Game of Knowledge Brokering
Olejniczak, K. (2017) · American Journal of Evaluation · doi:10.1177/1098214017716326 · Cited by 14
Boezeman, D. (2015) · Futures · doi:10.1016/j.futures.2015.07.008 · Cited by 13
Conceptualizing learning in the public sector: the importance of context
Jarvie, W., & Stewart, J. (2017) · International Journal of Public Sector Management · doi:10.1108/ijpsm-08-2016-0137 · Cited by 12
Cavalcante, P. L. C., & Ribeiro, B. B. (2012) · Revista de Administração Pública · doi:10.1590/s0034-76122012000600003 · Cited by 12
Manejo de estresse ocupacional na perspectiva da área de avaliação de programas
Murta, S. G., Laros, J. A., & Tróccoli, B. T. (2005) · Estudos de Psicologia (Natal) · doi:10.1590/s1413-294x2005000200002 · Cited by 12
Exploring the concept of research utilization: Implications for evidence-based crime prevention
Cherney, A. (2009) · Crime Prevention and Community Safety · doi:10.1057/cpcs.2009.4 · Cited by 12
Teacher–researcher relationships and collaborations in research
Cowie, B., Otrel-Cass, K., Moreland, J., Jones, A., Cooper, B., & Taylor, M. (2015) · Waikato journal of education · doi:10.15663/wje.v20i3.239 · Cited by 12
Jenkins, R. A., Robbins, A. S., Cranston, K., Batchelor, K., Freeman, A., Averbach, A. R., Amaro, H. D. L. A., Morrill, A. C., Blake, S. M., Logan, J. A., et al. (2005) · AIDS and Behavior · doi:10.1007/s10461-005-3944-5 · Cited by 12
Bamzai‐Dodson, A., & McPherson, R. A. (2022) · Sustainability · doi:10.3390/su142114026 · Cited by 11
Mapping Evaluation Use: A Scoping Review of Extant Literature (2005–2022)
Searle, M. J., Cooper, A., Worthington, P., Hughes, J., Gokiert, R., & Poth, C. (2024) · American Journal of Evaluation · doi:10.1177/10982140241234841 · Cited by 11
The Role of Decision Support in the Implementation of “Sustainable Transport” Plans
Gudmundsson, H., Ericsson, E., Tight, M., Lawler, M., Envall, P., Figueroa, M. J., & Evanth, K. (2012) · European Planning Studies · doi:10.1080/09654313.2012.650903 · Cited by 11
Fostering student teachers’ research-based knowledge of effective feedback
Bock, T., Thomm, E., Bauer, J., & Gold, B. (2024) · European Journal of Teacher Education · doi:10.1080/02619768.2024.2338841 · Cited by 17
The relationship between involvement in and use of evaluation in multi-site evaluations
Roseland, D., Lawrenz, F. P., & Thao, M. (2014) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2014.10.003 · Cited by 11
Turning Innovation into Evidence‐based Policies: Lessons Learned from Free Commune Experiments
Askim, J., Hjelmar, U., & Pedersen, L. H. (2018) · Scandinavian Political Studies · doi:10.1111/1467-9477.12130 · Cited by 11
Using the 2018 AEA Evaluator Competencies for Effective Program Evaluation Practice
Stevahn, L., Berger, D. E., Tucker, S. A., & Rodell, A. (2020) · New Directions for Evaluation · doi:10.1002/ev.20434 · Cited by 11
Computer-based feedback in formative assessment
der Kleij, F. M. V. (2013) · doi:10.3990/1.9789036535809 · Cited by 11
Let's walk before we can run: the uncertain demand from policymakers for trials
John, P. C. (2020) · Behavioural Public Policy · doi:10.1017/bpp.2020.27 · Cited by 9
Stathis, P., & Jacobson, C. L. (2009) · Springer eBooks · doi:10.1007/978-1-4020-9632-7_17 · Cited by 10
Beyond the literal: Metaphors and why they matter
Kaminsky, A. (2000) · New Directions for Evaluation · doi:10.1002/ev.1173 · Cited by 10
Nutley, S., & Davies, H. T. O. (1999) · Public Policy and Administration · doi:10.1177/095207679901400404 · Cited by 10
Cole, M. (2023) · Evaluation Journal of Australasia · doi:10.1177/1035719x231163932 · Cited by 9
Who Needs Goals? A Case Study of a Goal-Free Evaluation
Youker, B. W., Zielinski, A., Hunter, O., & Bayer, N. (2016) · Journal of MultiDisciplinary Evaluation · doi:10.56645/jmde.v12i27.448 · Cited by 9
Evaluation Practices and Impact: Overload?
Hansen, H. F., Aarrevaara, T., Geschwind, L., & Stensaker, B. (2019) · Springer eBooks · doi:10.1007/978-3-030-11738-2_8 · Cited by 9
From evidence to values-based decision making in African parliaments
Mapitsa, C. B., Ali, A. J., & Khumalo, L. (2020) · Evaluation Journal of Australasia · doi:10.1177/1035719x20918370 · Cited by 9
Uso das avaliações de larga escala na formulação de políticas públicas educacionais
Basso, F. V., Ferreira, R. R., & de Oliveira, A. S. (2021) · Ensaio Avaliação e Políticas Públicas em Educação · doi:10.1590/s0104-40362021002902436 · Cited by 9
Einleitung: Begriffe und Anwendungsperspektiven
Jonas, K. J., & Beelmann, A. (2009) · VS Verlag für Sozialwissenschaften eBooks · doi:10.1007/978-3-531-91621-7_1 · Cited by 9
Evaluation of Active Living Research
Barker, D. C., & Gutman, M. A. (2014) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2013.10.003 · Cited by 9
Metadata
- Authors
- Weiss, C. H.
- Affiliations
- Harvard University (US)
- Corresponding author
- Weiss, Carol H.
- Venue
- American Journal of Evaluation
- Publisher
- SAGE Publications
- Published
- 1998-03
- Volume
- 19
- Issue
- 1
- Pages
- 21-33
- ISSN
- 1098-2140 (ISSN-L)
- 1557-0878
- OpenAlex
- W4245760083
- Cited by
- 384
- References
- 20
- Citations by year
- 2026: 8 · 2025: 12 · 2024: 14 · 2023: 18 · 2022: 20 · 2021: 18 · 2020: 31 · 2019: 17 · 2018: 17 · 2017: 25 · 2016: 21 · 2015: 17 · 2014: 18 · 2013: 12 · 2012: 20
- FWCI
- 7.98
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- American Journal of Evaluation (publishedVersion)
- Topics
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Social Sciences › Public Administration › Public Policy and Administration Research
- Social Sciences › Economics, Econometrics and Finance › Finance › Community Development and Social Impact
- Keywords
- program evaluation, program decision-making, outcome indicators, research design, learning from evaluation, civil society, program organization, client groups
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review