Cited by 384Evaluation and Performance AssessmentPublic Policy and Administration ResearchCommunity Development and Social Impact

The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.

Have We Learned Anything New About the Use of Evaluation?

Weiss, Carol H.·1998·American Journal of Evaluation

DOI 10.1177/109821409801900103

Open this paper in CoChat — free account

Abstract

“Use of evaluation” used to mean the use of results for making program decisions. Now we are aware of its larger dimensions. Many aspects of evaluation can be used-ideas and insights, signals that are sent by the very fact of evaluating, the processes of learning through cooperation with evaluation, the choice of outcome indicators that herald success, even the study design. “Use” encompasses a broad array of effects by multiple classes of users. The paper highlights the importance of considering further potential collective users-the program organization, client groups, and civil society.

Integrity signals

Registry

Crossref · 10.1177/109821409801900103

Cites

20 of 20 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Agendas, Alternatives, and Public Policies
Perry, J. L., & Kingdon, J. W. (1985) · Journal of Policy Analysis and Management · doi:10.2307/3323801 · Cited by 11,238
Untitled work
(1987) · Cited by 6,910
Policy Change and Learning: An Advocacy Coalition Approach
Roberts, A. S., Sabatier, P., & Jenkins‐Smith, H. C. (1994) · Canadian Public Policy · doi:10.2307/3551961 · Cited by 3,599
Organizational Learning II: Theory, Method, and Practice.
Greenwood, D. J., Argyris, C., & Schön, D. A. (1997) · Industrial and Labor Relations Review · doi:10.2307/2525281 · Cited by 3,455
Information in Organizations as Signal and Symbol
Feldman, M. S., & March, J. G. (1981) · Administrative Science Quarterly · doi:10.2307/2392467 · Cited by 1,724
Utilization-focused evaluation : the new century text
Patton, M. Q. (1997) · Cited by 1,469
Knowledge Creep and Decision Accretion
Weiss, C. H. (1980) · Knowledge · doi:10.1177/107554708000100303 · Cited by 669
Self-citation
Systematic Thinking for Social Action
Tullock, G., & Rivlin, A. M. (1972) · Journal of money credit and banking · doi:10.2307/1991056 · Cited by 367
Professional evaluation: social impact and political consequences
(1993) · Choice Reviews Online · doi:10.5860/choice.31-1583 · Cited by 289
The New American Political System
Williams, P. M. (1979) · International Affairs · doi:10.2307/2616385 · Cited by 275

Show all 20 references

Research works printed but not linked: 7

Alkin, M. C., 1990, Debates on evaluation
Breslau, D., Theory and Society
Huberman, M., 1989, Knowledge in Society: The International Journal of Knowledge Transfer, 2, 6
Senge, P. M., The fifth discipline: The art and practice of the learning organizations
Shadish, W. R., 1997, EVALTALK message
Shulha, L. M., American Evaluation Association meeting
Weiss, C. H., 1967, House of Representatives committee on government operations, The use of social research in federal domestic programs, 426

Sorted by citations

Items 301–383 of 383

A New Framework for Monitoring and Evaluating Health Impact Assessment: Capitalising on a French Case Study with the Literature in Evaluation
Jabot, F., Romagon, J., & Dardier, G. (2024) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph21091240 · Cited by 1
New Roles for Evaluation at the Detroit Institute of Arts
Sikora, M., Fischer, D., Serrell, B., Perry, D., & Morris, K. (2009) · Curator The Museum Journal · doi:10.1111/j.2151-6952.2009.tb00332.x · Cited by 1
The Evaluation of the Implementation of Sustainability Norms
Pülzl, H., & Wydra, D. (2011) · International Journal of Social Ecology and Sustainable Development · doi:10.4018/jsesd.2011010103 · Cited by 1
Il dilemma della politica: incrementalismo, possibilismo e teoria della complessità
Marra, M. (2016) · RIV Rassegna Italiana di Valutazione · doi:10.3280/riv2015-062010 · Cited by 1
Governance Structures and the “(De)Politicization” of Performance Measures
Minassians, H. P., & Roy, R. K. (2017) · System dynamics for performance management · doi:10.1007/978-3-319-57018-1_6 · Cited by 1
Changing Bureaucrats and Politicians: The Transformative Potential of an Experimental Public AdministrationPreprint
John, P. C. (2014) · SSRN Electronic Journal · doi:10.2139/ssrn.2475337 · Cited by 1
Políticas públicas sociais: avaliação e integração entre assistência social e saúde pública no estado de São Paulo
Oliveira, L. (2019) · doi:10.11606/t.96.2019.tde-08042019-093527 · Cited by 1
Editors' notes
Caracelli, V. J., & Preskill, H. S. (2000) · New Directions for Evaluation · doi:10.1002/ev.1187 · Cited by 1
Utility
Patton, M. Q. (2005) · Encyclopedia of Social Measurement · doi:10.1016/b0-12-369398-5/00188-2 · Cited by 1
Modeling Ordinal Item Responses via Binary GLMMs and Alternative Link Functions: An Application to Measurement of a Perceived Service Quality
Muggeo, V. M. R., & Aiello, F. (2010) · Contributions to statistics · doi:10.1007/978-3-7908-2375-2_9
Negotiating and Planning an Evaluation: An Example from a Youth Services Work for the Dole Program Activity
Scott, T., & Darlington, Y. (2011) · Evaluation Journal of Australasia · doi:10.1177/1035719x1101100105
Desenvolvimento local e gestão municipal: um estudo sobre as políticas para atração de empresas no município de Araxá-MG
Silva, G. A. B. E. (2009) · doi:10.11606/d.96.2009.tde-03052010-134451
An exploratory syudy on ENADE evaluation report utilization and its impact on undergraduate accounting program performance in Brazil
de Freitas, S. C. (2012) · doi:10.11606/t.12.2012.tde-15012013-134543
Uso de la evaluación en un contexto de múltiples agentes: el caso del plan de desarrollo rural del país vasco en el marco de la Unión Europea
López, M. Á. D., Izquierdo, B., & Zaldúa, E. M. (2010) · Gestión y Análisis de Políticas Públicas · doi:10.24965/gapp.v0i4.441
A New Analytical Approach on Continuous Improvement Evaluation-A National Presentation Case
Chen, C. L. (2008) · International Journal of Emerging Technologies in Learning (iJET) · doi:10.3991/ijet.v3i4.250
Spending review: governance senza capacitŕ di governo. Dell'assenza di tecnostrutture pubbliche in grado di presidiare i processi di riforma amministrativa
Vecchi, G. (2013) · RIV Rassegna Italiana di Valutazione · doi:10.3280/riv2012-053007
‘Who you know and what you have to Say’: An Alternative Look at Knowledge Mobilisation Theory
Brown, C. (2014) · International Journal of Market Research · doi:10.2501/ijmr-2014-034
Monitoramento para avaliação do desempenho regulatório do Instituto Nacional de Metrologia, Qualidade e Tecnologia
Silva, D. A. V. S., & Fonseca, M. V. D. A. (2015) · Revista de Administração Pública · doi:10.1590/0034-7612132083
A construção de um sistema nacional de informações em segurança pública: os desafios de implementação de uma agenda
Vasconcelos, A. M. N. (2015) · doi:10.26512/2015.11.t.19672
Avaliação de políticas no setor público : o que explica a decisão de avaliar (ou não) resultados em políticas públicas de fomento à ciência, tecnologia e inovação em saúde?
de Queiroz, L. D. F. N. (2016) · doi:10.26512/2016.03.t.19872
The Role of Health Economics in Decision‐Making
Phillips, C. J. (2005) · doi:10.1002/9780470755228.ch6
A meta-avaliação como instrumento para a qualificação da avaliação de políticas públicas de saúde
de Almeida, C. A. L. (2016) · doi:10.11606/t.6.2016.tde-17032016-140138
A developing context: Evaluation and FedNor's evolving institutional context
Sharaput, M. (2016) · Canadian Public Administration · doi:10.1111/capa.12195
What Lies Behind?
Jelinčić, D. A. (2017) · Springer eBooks · doi:10.1007/978-3-319-52721-5_2
Impacto social e due diligence: o aprendizado no começo da caminhada
Resende, A. A. M. (2017) · doi:10.11606/d.12.2017.tde-16012017-161138
Evaluating the Impact of National and State Policies on School-Based Counseling Practices and Student Outcomes
Trevisan, M. S. (2017) · Springer eBooks · doi:10.1007/978-3-319-58179-8_12
Avaliação de políticas públicas como indutora de aprendizagem: percepção de gestores estaduais do Programa Bolsa Família
Monteiro, D. A. A., & Ribeiro, E. M. (2017) · RACE - Revista de Administração Contabilidade e Economia · doi:10.18593/race.v0i0.13821
AVALIAÇÃO EM LARGA ESCALA NA EDUCAÇÃO BÁSICA: UMA DISCUSSÃO SOBRE USO DOS RESULTADOS PARA MELHORIA DA EDUCAÇÃO
Santos, J. B. D. (2018) · Revista Temas em Educação · doi:10.22478/ufpb.2359-7003.2017v26n1.25931
The Effect of Teacher Beliefs and Self-Efficacy on Environmental Education Program Implementation
Mullens, A. (2016) · doi:10.31390/gradschool_dissertations.4388
Welke factoren bevorderen of belemmeren het gebruik van beleidsevaluaties?
Bouterse, M., & Pattyn, V. (2018) · Beleidsonderzoek Online · doi:10.5553/bo/221335502018000003001
A Study Of Collaborative Skills Of Graduates Of A National, Faith-Based, Leadership Development Program
Kooreman, E. (2018) · doi:10.32597/dissertations/1655
Improving "Data-Based Policy Evaluation" in South Korea
조현구 (2018) · Studies in Humanities and Social Sciences · doi:10.17939/hushss.2018..61.006
Theories of Change and Programme Logic
Cloete, F., & Auriacombe, C. J. (2014) · African Sun Media eBooks · doi:10.18820/9781920689513/03
Monitoring the crime prevention policy in Minas Gerais
Maia, T. P., & de Assis, M. A. (2020) · Revista de Administração Pública · doi:10.1590/0034-761220190058x
A Case Study of Liberal Arts Classes for the Development of Evaluative Thinking in University Students
Park, S.-Y. (2020) · The Korean Association of General Education · doi:10.46392/kjge.2020.14.3.97
EDUCAÇÃO DE JOVENS E ADULTOS A DISTÂNCIA: AVALIAÇÃO DO PROGRAMA CURRICULAR DO SESI DA BAHIA
Freitas, G. M. D. O., Ferreira, M. D. C. A., da Silva, F. D. P. S., & Matta, A. E. R. (2020) · Práxis Educacional · doi:10.22481/praxisedu.v16i42.7353
Achieving Evaluation Influence Through Elaboration Likelihood Model-informed Evaluation Product Designs
Rykaczewska, A. (2021) · doi:10.5642/cguetd/225
Ingressei no Ensino Superior, e agora?
Lima, W. A. S., Alves, L. M. S., & Canela, D. C. D. S. (2022) · Revista Agenda Política · doi:10.31990/agenda.2021.2.10
Avaliação dos efeitos da implantação do Programa Equipe de Saúde da Família Ribeirinha na Amazônia Legal
Kafer, M. C. (2016) · doi:10.26512/2016.12.d.22660
Дигиталне технологије и правни оквир културне политике у Србији
Стојановић, А. (2021) · Institut za pozorište, film, radio i televiziju; Fakultet dramskih umetnosti; CLIO eBooks · doi:10.18485/fdu_dhkum.2021.ch3
Evaluation in the United States of America
Donaldson, S. I., Donaldson, S. I., & Renger, J. A. (2022) · Springer eBooks · doi:10.1007/978-3-030-81139-6_12
How Researchers Can Better Inform Education Policy
(2017) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-78743-640-420171010
The Evaluation of the Implementation of Sustainability Norms
Pülzl, H., & Wydra, D. (2012) · IGI Global eBooks · doi:10.4018/978-1-4666-0882-5.ch502
The Evaluation of the Implementation of Sustainability Norms
Pülzl, H., & Wydra, D. (2013) · IGI Global eBooks · doi:10.4018/978-1-4666-3613-2.ch003
Driving Sustainability through Engineering Management and Systems Engineering
(2021) · MDPI eBooks · doi:10.3390/books978-3-0365-1531-1
Pourquoi la simplification administrative est-elle si compliquée?
OCDE (2011) · Eliminer la paperasserie · doi:10.1787/9789264089778-fr
A Critical Systems View of Power-Ethics Interactions in Information Systems Evaluation
Córdoba‐Pachón, J. (2009) · IGI Global eBooks · doi:10.4018/978-1-60566-022-6.ch046
Éliminer la paperasserie
OECD (2009) · Eliminer la paperasserie · doi:10.1787/19976712
Bibliographie
(2012) · Les Presses de l'Université de Montréal eBooks · doi:10.4000/books.pum.6033
The Evaluation of the Implementation of Sustainability Norms
Pülzl, H., & Wydra, D. (2013) · IGI Global eBooks · doi:10.4018/978-1-4666-0882-5.ch5.2
Evaluación y toma de decisiones diálogos entre políticos y académicos para fortalecer la democracia
Neirotti, N., & Jaramillo, A. (2020) · Ediciones de la UNLa eBooks · doi:10.18294/rdi.2022.177353
EL USO DE LA EVIDENCIA EVALUATIVA EN EL CONGRESO MEXICANO
Rodríguez, B., & de México, U. N. A. (2022) · Polis. Investigación y Análisis Sociopolítico y Psicosocial · doi:10.24275/uam/izt/dcsh/polis/2022v18n1/lopez
Desafios da formulação de uma política pública municipal de educação: um estudo de caso em uma cidade de pequeno porte do interior paulista
Negreiros, L. A. F. (2022) · doi:10.11606/d.96.2022.tde-01122022-155022
Evaluation politics in international organizations
Jankauskas, V., & Eckhard, S. (2023) · doi:10.1093/oso/9780192855206.003.0003
Political evaluation use in international organizations
Jankauskas, V., & Eckhard, S. (2023) · doi:10.1093/oso/9780192855206.003.0007
Conclusion
Jankauskas, V., & Eckhard, S. (2023) · doi:10.1093/oso/9780192855206.003.0008
Introduction
Jankauskas, V., & Eckhard, S. (2023) · doi:10.1093/oso/9780192855206.003.0001
EFFECT OF MONITORING AND EVALUATION PLANNING ON SUCCESS OF RURAL WATER CHLORINATION PROJECTS, A CASE OF CHLORINE DISPENSERS PROJECT IN WESTERN; KENYA
WAKOLI, S. A., KADIMA, J. M., & MIROGA, D. J. (2022) · Strategic Journal of Business & Change Management · doi:10.61426/sjbcm.v9i2.2273
Political bias in evidence for policymaking and the knowledge work of civil servants: the case of the ongoing digitalization of the Norwegian school
Høydal, Ø. S. (2023) · Scandinavian Journal of Educational Research · doi:10.1080/00313831.2023.2264862
A Road Less Traveled for Designing Rigorous Studies to Identify Effective Technology-Based Reading Interventions
Turner, H., & Durodoye, R. (2023) · Technology Knowledge and Learning · doi:10.1007/s10758-023-09695-1
Connecting Evaluation and Strategy: How Agricultural Research Institutions Use Evaluation Results in R&D ManagementPreprint
Pinto, D. M., & Bin, A. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4862755
References
(2024) · Edward Elgar Publishing eBooks · doi:10.4337/9781035321483.00018
Programme evaluation in action: theory to practice from an Asian educational context
Lee, S. M. M., & Liu, W. C. (2024) · Asia Pacific Journal of Education · doi:10.1080/02188791.2024.2355306
Institutionalized Policy Evaluation within the Democratic System: Why? When? How?
Fumagalli, C. (2025) · Journal of Applied Philosophy · doi:10.1111/japp.12796
Integrated popular reporting as a dialogic tool for measuring value creation or destruction through social impact assessment: The Eurovision Song Contest
Secinaro, S. F., Degregori, G., Brescia, V., & Biancone, P. (2025) · Corporate Governance and Organizational Behavior Review · doi:10.22495/cgobrv9i1p4
Evaluation Use and Factors Affecting Evaluation Use in the Context of the Brazilian Graduate Evaluation System
da Silva, E. M. O., & Paixão, R. B. (2025) · American Journal of Evaluation · doi:10.1177/10982140251358200
Improving survey-based data collection for more effective domestic retrofit evaluations: perspectives from occupants and surveyors
Bhorkar, S., Glew, D., & Fletcher, M. (2025) · Building Research & Information · doi:10.1080/09613218.2025.2540848
How Do Institutions Evidence Effectiveness via Evaluation?
Austen, L., Crockford, J., & McCaig, C. (2025) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-83549-954-220251007
Linking Evaluation and Education
Schwandt, T. A. (2000) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-60752-862-320251011
A Framework for Partnerships
Sheldon, S. B. (2011) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-61735-670-420251018
Step 6 Post-Harvest Support for Use
(2018) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-64113-394-4-20251008
Additional file 1 of Centering Indigenous knowledge in suicide prevention: a critical scoping review
Sjoblom, E., Ghidei, W., Leslie, M., James, A., Bartel, R., Campbell, S., & Montesanti, S. R. (2024) · Figshare · doi:10.6084/m9.figshare.26555642
Additional file 3 of Centering Indigenous knowledge in suicide prevention: a critical scoping review
Sjoblom, E., Ghidei, W., Leslie, M., James, A., Bartel, R., Campbell, S., & Montesanti, S. R. (2024) · Figshare · doi:10.6084/m9.figshare.26555648
Additional file 2 of Centering Indigenous knowledge in suicide prevention: a critical scoping review
Sjoblom, E., Ghidei, W., Leslie, M., James, A., Bartel, R., Campbell, S., & Montesanti, S. R. (2024) · Figshare · doi:10.6084/m9.figshare.26555645
FIGURE 4 in Two new species of Platymantis (Anura: Ranidae) from New Britain
Kraus, F., & Allison, A. (2007) · INFM-OAR (INFN Catania) · doi:10.5281/zenodo.176944
Control Design on a Non-minimum Phase Nonlinear System by Output Redefinition and Particle Swarm Optimization Method
Ahmadin, A., Fatmawati, F., Winarko, E., & Windarto, W. (2025) · Statistics Optimization & Information Computing · doi:10.19139/soic-2310-5070-2436
Explore, explain, evaluate and predict: Purposeful research
Park, J. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-26629-4.00260-4
The FrEEIA readiness assessment tool: an evidence-informed pro-equity readiness assessment tool adapted in Aotearoa New Zealand for the implementation of health interventions
Veenstra, N., Gustafson, P. E., Lambert, M. V., Kremer, L. J., O'Loughlin, H., Bartholomew, K., Carswell, P., Ratima, M. M., Fusheini, A., Priest, P. C., et al. (2026) · Frontiers in Health Services · doi:10.3389/frhs.2026.1733685
Curriculum theory and practice: examining academy managers’ experiences of curriculum development and enactment in UK rugby academies
Moran, J. J., Craig, M., & Collins, D. (2026) · Sports Coaching Review · doi:10.1080/21640629.2026.2657071
Towards trust-based performance evaluation in Swedish social services
Hasselblad, A. (2026) · Nordic Social Work Research · doi:10.1080/2156857x.2026.2677882
Data-Informed Educational Research and Evidence-Based Decision Making in Modern Education Systems
Sharma, S. (2026) · IGI Global eBooks · doi:10.4018/979-8-2600-2606-9.ch012
It Does Matter. A New Framework on the Influence of Policy Evaluation
Bundi, P., & Pattyn, V. (2026) · Policy Studies Journal · doi:10.1111/psj.70149
Who Is Nudge+ Done to and by Whom?
Banerjee, S., & John, P. C. (2026) · Springer eBooks · doi:10.1007/978-3-032-13261-1_7

Authors: Weiss, C. H.
Affiliations: Harvard University (US)
Corresponding author: Weiss, Carol H.
Venue: American Journal of Evaluation
Publisher: SAGE Publications
Published: 1998-03
Volume: 19
Issue: 1
Pages: 21-33
ISSN: 1098-2140 (ISSN-L)
1557-0878
DOI: 10.1177/109821409801900103
OpenAlex: W4245760083
Cited by: 384
References: 20
Citations by year: 2026: 8 · 2025: 12 · 2024: 14 · 2023: 18 · 2022: 20 · 2021: 18 · 2020: 31 · 2019: 17 · 2018: 17 · 2017: 25 · 2016: 21 · 2015: 17 · 2014: 18 · 2013: 12 · 2012: 20
FWCI: 7.98
Type: journal article
Language: en
Open access: closed
Licence: journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations: American Journal of Evaluation (publishedVersion)
Topics: Social Sciences › Public Administration › Evaluation and Performance Assessment
Social Sciences › Public Administration › Public Policy and Administration Research
Social Sciences › Economics, Econometrics and Finance › Finance › Community Development and Social Impact
Keywords: program evaluation, program decision-making, outcome indicators, research design, learning from evaluation, civil society, program organization, client groups

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Have We Learned Anything New About the Use of Evaluation?

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks