The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Have We Learned Anything New About the Use of Evaluation?
Abstract
“Use of evaluation” used to mean the use of results for making program decisions. Now we are aware of its larger dimensions. Many aspects of evaluation can be used-ideas and insights, signals that are sent by the very fact of evaluating, the processes of learning through cooperation with evaluation, the choice of outcome indicators that herald success, even the study design. “Use” encompasses a broad array of effects by multiple classes of users. The paper highlights the importance of considering further potential collective users-the program organization, client groups, and civil society.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The results of the data analysis have undermined certain myths, which Weiss (1998) refers to as the enlightenment function.”
From Data teams for school improvement (2016) · cites this paper as Weiss (1998)
Citations
Cites
Agendas, Alternatives, and Public Policies
Perry, J. L., & Kingdon, J. W. (1985) · Journal of Policy Analysis and Management · doi:10.2307/3323801 · Cited by 11,238
(1987) · Cited by 6,910
Policy Change and Learning: An Advocacy Coalition Approach
Roberts, A. S., Sabatier, P., & Jenkins‐Smith, H. C. (1994) · Canadian Public Policy · doi:10.2307/3551961 · Cited by 3,599
Organizational Learning II: Theory, Method, and Practice.
Greenwood, D. J., Argyris, C., & Schön, D. A. (1997) · Industrial and Labor Relations Review · doi:10.2307/2525281 · Cited by 3,455
Information in Organizations as Signal and Symbol
Feldman, M. S., & March, J. G. (1981) · Administrative Science Quarterly · doi:10.2307/2392467 · Cited by 1,724
Utilization-focused evaluation : the new century text
Patton, M. Q. (1997) · Cited by 1,469
Knowledge Creep and Decision Accretion
Weiss, C. H. (1980) · Knowledge · doi:10.1177/107554708000100303 · Cited by 669
Self-citationSystematic Thinking for Social Action
Tullock, G., & Rivlin, A. M. (1972) · Journal of money credit and banking · doi:10.2307/1991056 · Cited by 367
Professional evaluation: social impact and political consequences
(1993) · Choice Reviews Online · doi:10.5860/choice.31-1583 · Cited by 289
The New American Political System
Williams, P. M. (1979) · International Affairs · doi:10.2307/2616385 · Cited by 275
Research works printed but not linked: 7
- Alkin, M. C., 1990, Debates on evaluation
- Breslau, D., Theory and Society
- Huberman, M., 1989, Knowledge in Society: The International Journal of Knowledge Transfer, 2, 6
- Senge, P. M., The fifth discipline: The art and practice of the learning organizations
- Shadish, W. R., 1997, EVALTALK message
- Shulha, L. M., American Evaluation Association meeting
- Weiss, C. H., 1967, House of Representatives committee on government operations, The use of social research in federal domestic programs, 426
Cited by
Sorted by citations
Items 201–300 of 383
Children Should Be Seen and Heard? Children and Young People’s Participation in the UK
Tisdall, E. K. M. (2014) · Palgrave Macmillan UK eBooks · doi:10.1057/9781137316547_10 · Cited by 10
Teacher-researcher relationships and collaborations in research
Cowie, B., Otrel-Cass, K., Moreland, J., Jones, A., Bell, B. F., & Taylor, M. (2010) · Waikato journal of education · doi:10.15663/wje.v15i2.114 · Cited by 9
Introduction. The End of Isolation
Poe, M., Inoue, A. B., & Elliot, N. (2018) · The WAC Clearinghouse; University Press of Colorado eBooks · doi:10.37514/per-b.2018.0155.1.3 · Cited by 8
Using evidence: how social research could be better used to improve public service performance
Davies, H. T. O., Nutley, S., & Walter, I. (2010) · Cambridge University Press eBooks · doi:10.1017/cbo9780511762000.011 · Cited by 8
Bibri, S. E. (2018) · The urban book series · doi:10.1007/978-3-319-73981-6_5 · Cited by 9
Egger, C., & Ophoff, J. G. (2020) · Edition ZfE · doi:10.1007/978-3-658-22460-8_4 · Cited by 8
Policy dialogue with Indian parliamentarians
Babu, S. C., & ERGENEMAN, A. (2005) · Journal of International Communication · doi:10.1080/13216597.2005.9751982 · Cited by 8
Toward a Social Ecological View of Evaluation Use
Conner, R. (1998) · American Journal of Evaluation · doi:10.1016/s1098-2140(99)80201-x · Cited by 8
The Governance of Public Policy Evaluation Systems: Policy Effectiveness and Accountability
Filgueiras, F. D. B., & de Queiroz, L. D. F. N. (2021) · Organizações & Sociedade · doi:10.1590/1984-92302021v28n9609en · Cited by 11
Evaluation in the Polycrisis Epoch
Patton, M. Q. (2024) · The political economy of Greek growth up to 2030 · doi:10.1007/978-3-031-60721-9_2 · Cited by 7
Die Nutzung von Evaluationen in den Schweizer Parlamenten
Eberli, D. (2019) · doi:10.33058/seismo.30726 · Cited by 7
Unpacking the effects of star architecture projects
Alaily-Mattar, N., Bartmański, D., Dreher, J., Koch, M. R., Löw, M., Pape, T., & Thierstein, A. (2021) · International Journal of Architectural Research Archnet-IJAR · doi:10.1108/arch-05-2020-0092 · Cited by 7
Does evaluation quality enhance evaluation use?
Bundi, P., Frey, K., & Widmer, T. (2021) · Evidence & Policy · doi:10.1332/174426421x16141794148067 · Cited by 9
Using Evaluation to Support Organizational Learning in E-Government System
Kasimin, H., Aman, A. B., & Noor, Z. M. (2013) · International Journal of Electronic Government Research · doi:10.4018/jegr.2013010103 · Cited by 7
Torres, H. D. G., Gomes, S., Pávez, T., & Fusaro, E. R. (2010) · Dados · doi:10.1590/s0011-52582010000100005 · Cited by 7
Vecchi, G. (2017) · System dynamics for performance management · doi:10.1007/978-3-319-57018-1_17 · Cited by 7
Campbell, R., & Fehler‐Cabral, G. (2017) · American Journal of Community Psychology · doi:10.1002/ajcp.12176 · Cited by 7
Avaliação dos usos e influências de pesquisas sobre prevenção e controle da anemia em crianças
Couto, P. D. C., & Figueiró, A. C. (2019) · Saúde em Debate · doi:10.1590/0103-11042019s208 · Cited by 7
Lima, W. A. S., & Mendes, V. L. P. S. (2020) · Avaliação Revista da Avaliação da Educação Superior (Campinas) · doi:10.1590/s1414-407720200001000011 · Cited by 7
Considerations for Measuring the Impact of Policy-Relevant Research
Collado, M., Gerlach, L. B., Ticse, C., & Hempstead, K. (2017) · The Foundation Review · doi:10.9707/1944-5660.1386 · Cited by 6
Paulson, E. N., & Campbell, N. J. (2018) · The Canadian Journal for the Scholarship of Teaching and Learning · doi:10.5206/cjsotl-rcacea.2018.3.4 · Cited by 7
Using environmental evaluation systems and their contribution to sustainable development
LARSSON, M. R. (2021) · Evaluation · doi:10.1177/13563890211018411 · Cited by 6
Boots, K., & Midford, R. (2007) · Substance Use & Misuse · doi:10.1080/10826080701723887 · Cited by 6
Evaluative feedback delivery and the factors that affect success
Azzam, T., & Whyte, C. E. (2017) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2017.11.005 · Cited by 6
Boezeman, D., & de Coninck, H. (2018) · Sustainable Earth Reviews · doi:10.1186/s42055-018-0007-0 · Cited by 7
Weitzman, B. C., & Silver, D. (2013) · American Journal of Evaluation · doi:10.1177/1098214012461628 · Cited by 6
Della‐Piana, C. K. (2020) · IEEE Lasers and Electro-Optics Society Annual Meeting (LEOS) · doi:10.18260/1-2--12229 · Cited by 6
Real World Evaluation Strategies
Ridde, V., & Robert, É. (2014) · doi:10.1093/obo/9780199756797-0140 · Cited by 6
Artificial Intelligence and Public Policy
Filgueiras, F. D. B. (2025) · Cambridge University Press eBooks · doi:10.1017/9781009572248 · Cited by 5
The organisation of evaluations: the influence of the ministry of finance on evaluation systems
Andersen, N. A., & Pattyn, V. (2025) · Evidence & Policy · doi:10.1332/17442648y2025d000000045 · Cited by 5
Immonen, S., & Cooksy, L. J. (2019) · Outlook on Agriculture · doi:10.1177/0030727019850835 · Cited by 5
Evaluating social policies: Do methodological approaches determine the policy impact?
Høydal, Ø. S., & Tøge, A. G. (2021) · Social Policy and Administration · doi:10.1111/spol.12682 · Cited by 5
Theory building from qualitative evaluation
Guenther, J., Falk, I. H., & Cole, M. J. (2023) · Evaluation · doi:10.1177/13563890231196603 · Cited by 5
Reclaiming logic modeling for evaluation: a theory of action framework
Woodland, R. H., & Mazur, R. (2024) · American Journal of Evaluation · doi:10.1177/10982140231224495 · Cited by 5
Learning agendas: Motivation, engagement, and potential
Newcomer, K. E., Olejniczak, K., & Hart, N. R. (2022) · New Directions for Evaluation · doi:10.1002/ev.20495 · Cited by 5
Hordósy, R. (2016) · International Journal of Research & Method in Education · doi:10.1080/1743727x.2016.1144740 · Cited by 5
D’Ostie-Racine, L., Dagenais, C., & Ridde, V. (2019) · Systemic Practice and Action Research · doi:10.1007/s11213-019-09504-w · Cited by 5
Where local and national evaluators meet: Unintended threats to ethical evaluation practice
Rodi, M. S., & Paget, K. D. (2007) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2007.06.005 · Cited by 5
Les enjeux de l'évaluation de la performance : Dépasser les mythes
Thiebaut, G., Champagne, F., & Contandriopoulos, A. (2015) · Canadian Public Administration · doi:10.1111/capa.12105 · Cited by 4
Deane, K. L., Dutton, H. D., & Bullen, P. (2019) · Evaluation · doi:10.1177/1356389019850201 · Cited by 4
Using a logic model to evaluate rater training for EAP writing assessment
O'Connell, J. (2022) · Journal of English for Academic Purposes · doi:10.1016/j.jeap.2022.101160 · Cited by 4
Embedding evaluation in non-profit organisations: Lessons from evaluation advocates
Rogers, A. F., & Gullickson, A. M. (2023) · Evaluation Journal of Australasia · doi:10.1177/1035719x231179256 · Cited by 4
Use of Performance Information as an Organizational Routine in Management Control
Liu, X., & Dooren, W. V. (2013) · Performance Improvement Journal · doi:10.1002/pfi.21379 · Cited by 4
Changing How Government Works: The Transformative Potential of an Experimental Public Management*
John, P. C. (2017) · Cambridge University Press eBooks · doi:10.1017/9781316676912.024 · Cited by 4
Acesso à informação, política digital e sustentabilidade ambiental no Brasil
Rothberg, D. (2018) · Revista FAMECOS · doi:10.15448/1980-3729.2018.3.28376 · Cited by 4
Estudos em Políticas Públicas e a COVID-19: Indicativos de uma agenda de pesquisa
Brasil, F. G. (2020) · Interseções Revista de Estudos Interdisciplinares · doi:10.12957/irei.2020.56785 · Cited by 4
Sandin, S., & Benner, M. (2021) · Research Evaluation · doi:10.1093/reseval/rvab031 · Cited by 4
Conditions for outcomes evaluation in public policies: a debate on the role of institutionality
de Queiroz, L. D. F. N., & Capelari, M. G. M. (2020) · Revista de Administração Pública · doi:10.1590/0034-761220190258x · Cited by 4
Worlds apart or coproduction? Investigating the relationship between knowledge users and producers
Høydal, Ø. S. (2020) · Evaluation · doi:10.1177/1356389020931880 · Cited by 4
After The Innovation: Outcomes From the Texas Behavioral Data Project
Batchelor, K., Robbins, A. S., Freeman, A., Dudley, T., & Phillips, N. (2005) · AIDS and Behavior · doi:10.1007/s10461-005-3946-8 · Cited by 4
Taking What Action for Change? Dare Evaluation Build a New Social Order?
King, J. A. (2016) · Visitor Studies · doi:10.1080/10645578.2016.1144022 · Cited by 4
Quek, C. G. (2016) · Education innovation series · doi:10.1007/978-981-10-2697-3_14 · Cited by 4
Policy evaluation and democracy: Do they fit?
Sager, F. (2017) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2017.08.005 · Cited by 3
Using systematic reviews to inform environmental policy-making
Miljand, M., & Eckerberg, K. (2022) · Evaluation · doi:10.1177/13563890221076540 · Cited by 3
Evaluating commodification and commodifying evaluation
Stafford, B., Roberts, S., & Jas, P. (2023) · Public Money & Management · doi:10.1080/09540962.2023.2240640 · Cited by 3
Development and preliminary validation of the evaluation use scale for evaluation systems (EUS-ES)
Paixão, R. B., & Rodriguez, M. C. (2023) · Educational Research and Evaluation · doi:10.1080/13803611.2023.2261904 · Cited by 3
Felten, H., Keuzenkamp, S., & de Wit, J. B. F. (2024) · The Journal of Sex Research · doi:10.1080/00224499.2024.2331275 · Cited by 3
Shand, R., Leach, S. M., Hollands, F. M., Yan, B., Dossett, D., Chang, F., & Pan, Y. (2024) · Peabody Journal of Education · doi:10.1080/0161956x.2024.2357039 · Cited by 3
de Almeida, C. A. L., & Tanaka, O. Y. (2017) · Cadernos de Saúde Pública · doi:10.1590/0102-311x00105615 · Cited by 3
Beahm, L. A., & Bradshaw, C. P. (2023) · Issues in clinical child psychology · doi:10.1007/978-3-031-20006-9_33 · Cited by 3
Hein, A., & Taut, S. M. (2016) · Revista Iberoamericana de Evaluación Educativa · doi:10.15366/riee2010.3.2.009 · Cited by 3
Education Policy and Education Practice Nexuses
Prøitz, T. S., Aasen, P., & Wermke, W. (2023) · Policy implications of research in education · doi:10.1007/978-3-031-36970-4_1 · Cited by 3
Campbell, R., Townsend, S. M., Shaw, J., Karim, N., & Markowitz, J. R. (2015) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2015.04.005 · Cited by 3
Evaluationsansätze und ihre Effekte: Erfahrungen aus verschiedenen Politikfeldern
Widmer, T. (2008) · VS Verlag für Sozialwissenschaften eBooks · doi:10.1007/978-3-531-90863-2_16 · Cited by 3
Pecora, P. J., Maldonado, A., Dumont, K. A., Weaver, C., & O’Brien, K. (2025) · Journal of Public Child Welfare · doi:10.1080/15548732.2025.2538016 · Cited by 2
Bunn, F. (2010) · Injury Prevention · doi:10.1136/ip.2010.027136 · Cited by 2
de Queiroz, L. D. F. N., & Capelari, M. G. M. (2020) · Revista de Administração Pública · doi:10.1590/0034-761220190258 · Cited by 2
Gadais, T., & Bardocz-Bencsik, M. (2022) · PLoS ONE · doi:10.1371/journal.pone.0267785 · Cited by 4
Evaluating ‘Health in All Policies’ in Norwegian Municipalities
Synnevåg, E. S. (2022) · Societies · doi:10.3390/soc12030092 · Cited by 2
A Review of South Africa’s Outcome-Based Approach
Matlala, L. S. (2025) · Administratio publica. · doi:10.61967/adminpub.2025.33.2.3 · Cited by 2
Bordón, A. M. (1970) · Revista Latinoamericana de Estudios Educativos · doi:10.48102/rlee.2018.48.2.55 · Cited by 2
Ma, J., & Vieira, D. M. (2020) · Revista de Administração Pública · doi:10.1590/0034-761220190381x · Cited by 10
The Evaluation Profession and the Government
Datta, L. (2003) · Springer eBooks · doi:10.1007/978-94-010-0309-4_21 · Cited by 2
Squires, D., Canney, G. F., & Trevisan, M. S. (2004) · Education Policy Analysis Archives · doi:10.14507/epaa.v12n62.2004 · Cited by 2
Cognitive Constructs in the Context of Positive Psychology
Robitschek, C., Sirles, D., & Hardin, E. E. (2014) · Cross-cultural advancements in positive psychology · doi:10.1007/978-94-017-8654-6_6 · Cited by 2
Can government‐supported evaluation and policy research be independent?
Reingold, D. A. (2008) · Journal of Policy Analysis and Management · doi:10.1002/pam.20384 · Cited by 2
Gestaltungsraum Hochschullehre
Bonillo, M. (2015) · Budrich UniPress eBooks · doi:10.3224/86388714 · Cited by 2
Maximising Evaluation Influence in an International Development Donor Agency
Tennant, S. (2010) · Evaluation Journal of Australasia · doi:10.1177/1035719x1001000203 · Cited by 2
Utilização do monitoramento da Política de Prevenção à Criminalidade de Minas Gerais
Maia, T. P., & de Assis, M. A. (2020) · Revista de Administração Pública · doi:10.1590/0034-761220190058 · Cited by 2
O Uso das evidências nas políticas brasileiras de ciência, tecnologia e inovação
Schmidt, F. D. H., Bin, A., Pinheiro, L. V., & Negri, F. D. (2022) · Instituto de Pesquisa Econômica Aplicada (Ipea) eBooks · doi:10.38116/978-65-5635-032-5/capitulo25 · Cited by 2
A Protocol for Participatory Data Use
Buckley, J., Postlewaite, E. L., Archibald, T., Linver, M. R., & Urban, J. B. (2024) · American Journal of Evaluation · doi:10.1177/10982140241234835 · Cited by 2
Developing Evaluation Questions: Beyond the Technical Issues
de Salazar, L., & Hall, M. E. (2008) · Springer eBooks · doi:10.1007/978-0-387-79733-5_4 · Cited by 2
Studiengangentwicklung entlang zu differenzierender Bedarfe
Klages, B., & Bonillo, M. (2015) · Verlag Barbara Budrich eBooks · doi:10.2307/j.ctvbkjxh3.14 · Cited by 2
Priority training needs of school district assessment coordinators in Washington State
Trevisan, M. S. (2000) · Studies In Educational Evaluation · doi:10.1016/s0191-491x(00)00017-1 · Cited by 2
Reflecting on ‘what works’ in education research‐policy/practice relationships
Webb, S., & Ibarz, T. (2006) · Journal of Vocational Education and Training · doi:10.1080/13636820600811943 · Cited by 2
(2005) · doi:10.4135/9781412983907.n681 · Cited by 2
Savignon, A. B., Meneguzzo, M., Kuhlmann, S., & Cepiku, D. (2021) · International Journal of Public Sector Management · doi:10.1108/ijpsm-03-2021-0057 · Cited by 2
Thomas, V. G. (2010) · Elsevier eBooks · doi:10.1016/b978-0-08-044894-7.01606-7 · Cited by 2
Zucatto, L. C., Francisco, N. A., Severo, A. M., & Lamberty, C. (2021) · Revista de Administração Contabilidade e Economia da Fundace · doi:10.13059/racef.v12i1.664 · Cited by 1
Pinto, D. M., & Bin, A. (2025) · Revista de Economia e Sociologia Rural · doi:10.1590/1806-9479.2025.290629 · Cited by 1
Farrell, C. C., Resnick, A. F., White, T., Arce-Trigatti, P., Penuel, W. R., & Botchway, K. (2025) · Frontiers in Education · doi:10.3389/feduc.2025.1669123 · Cited by 1
Sieling‐Monas, S. M., Salado‐Rasmussen, J., & Bonfils, I. S. (2026) · European Journal of Social Work · doi:10.1080/13691457.2026.2711917 · Cited by 1
Answers in Search of a Question
Williams, D. W. (2011) · Public Administration Review · doi:10.1111/j.1540-6210.2010.02322.x · Cited by 1
Old Pursuit, New Methods: Promising Benefits amid Familiar Challenges
Yang, K. (2016) · Public Administration Review · doi:10.1111/puar.12607 · Cited by 1
Análise das políticas para atração de empresas: o caso de Araxá (MG)
Silva, G. A. B. E., Martinelli, D. P., Passador, C. S., & Passador, J. L. (2015) · Cadernos Gestão Pública e Cidadania · doi:10.12660/cgpc.v20n67.46518 · Cited by 1
Evaluation Issues In The Renewal Of Engineering Education: Lessons From Nsf Funded Projects
Huang, Y. M., & Trevisan, M. S. (2020) · IEEE Lasers and Electro-Optics Society Annual Meeting (LEOS) · doi:10.18260/1-2--12962 · Cited by 1
Nutzung von Evaluationsergebnissen
Sager, F., Hadorn, S., Balthasar, A., & Mavrot, C. (2021) · Springer eBooks · doi:10.1007/978-3-658-32490-2_10 · Cited by 1
Hurley, M. H., & Hanley, D. (2010) · CRC Press eBooks · doi:10.1201/b15808-7 · Cited by 1
Reflections on the Intersections Between Collaboration and Use in Evaluation Practice
Acree, J., Tovey, T. L. S., & Petrulis, R. (2023) · American Journal of Evaluation · doi:10.1177/10982140231213530 · Cited by 1
Metadata
- Authors
- Weiss, C. H.
- Affiliations
- Harvard University (US)
- Corresponding author
- Weiss, Carol H.
- Venue
- American Journal of Evaluation
- Publisher
- SAGE Publications
- Published
- 1998-03
- Volume
- 19
- Issue
- 1
- Pages
- 21-33
- ISSN
- 1098-2140 (ISSN-L)
- 1557-0878
- OpenAlex
- W4245760083
- Cited by
- 384
- References
- 20
- Citations by year
- 2026: 8 · 2025: 12 · 2024: 14 · 2023: 18 · 2022: 20 · 2021: 18 · 2020: 31 · 2019: 17 · 2018: 17 · 2017: 25 · 2016: 21 · 2015: 17 · 2014: 18 · 2013: 12 · 2012: 20
- FWCI
- 7.98
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- American Journal of Evaluation (publishedVersion)
- Topics
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Social Sciences › Public Administration › Public Policy and Administration Research
- Social Sciences › Economics, Econometrics and Finance › Finance › Community Development and Social Impact
- Keywords
- program evaluation, program decision-making, outcome indicators, research design, learning from evaluation, civil society, program organization, client groups
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review