The DOI matches its Crossref record; 28 of the 31 references it cites were found in a registry or an index.
The Methodology of Metaevaluation as Reflected in Metaevaluations by the Western Michigan University Evaluation Center
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The critical feedback survey was a pen-andpaper survey designed to collect specific data to evaluate the checklist based on Stufflebeam's (2000) eight criteria for evaluating a checklist including applicability to the full range of intended uses ,clarity, comprehensiveness, concreteness, ease of use, fairness, parsimony, and pertinence to the content area.”
From Developing an English Language Textbook Evaluative Checklist (2013) · cites this paper as Stufflebeam's (2000)
Citations
Cites
The standards for educational and psychological testing.
Eignor, D. R. (2013) · APA handbook of testing and assessment in psychology, Vol. 1: Test theory and testing and assessment in industrial and organizational psychology. · doi:10.1037/14047-013 · Cited by 6,988
Experimental and quasi-experimental designs for research on teaching
Campbell, D. T. (1963) · Medical Entomology and Zoology · Cited by 1,541
Standards for educational and psychological testing: (500832009-001)
(1985) · PsycEXTRA Dataset · doi:10.1037/e500832009-001 · Cited by 1,480
The External Validity of Experiments
Bracht, G. H., & Glass, G. V. (1968) · American Educational Research Journal · doi:10.2307/1161993 · Cited by 602
Handbook of teacher evaluation
Millman, J. (1981) · Sage eBooks · Cited by 345
Doty, P., Boutwell, J., Snodgrass, M., & Bourne, A. M. (1990) · Bulletin of the American Academy of Arts and Sciences · doi:10.2307/3824344 · Cited by 338
Spalding, W. B. (1963) · Journal of Teacher Education · doi:10.1177/002248716301400317 · Cited by 330
Guiding Principles for Evaluators
(2018) · Sage eBooks · doi:10.4135/9781506326139.n297 · Cited by 243
The Program Evaluation Standards
(2005) · Encyclopedia of Evaluation · doi:10.4135/9781412950558.n446 · Cited by 218
No Simple Answer: Critique of the Follow Through Evaluation
House, E., Glass, G., McLean, L., & Walker, D. (1978) · Harvard Educational Review · doi:10.17763/haer.48.2.j2167r4594027x87 · Cited by 207
Research works printed but not linked: 9
- Glass, G.V. (1974). Excellence: A paradox. Speech presented at the second annual meeting of the Pacific Northwest Research and Evaluation Conference sponsored by the Washington Educational Research Association.
- Joint Committee on Standards for Educational Evaluation (1988). The personnel evaluation standards. Newbury Park, CA: Sage.
- Krathwohl, D.R. (1972). Functions for experimental schools evaluation and their organization. In G. V Glass, M. L. Byers, & B. R. Worthen (Eds.), Recommendations for the evaluation of experimental schools projects of the U.S. Office of Education (pp. 174-194). Report of the Experimental Schools Evaluation Working Conference, Estes Park, CO, December 1971. Boulder, CO: University of Colorado Laboratory of Educational Research.
- National Center for Education Statistics. (1991). SEDCAR (Standards for Education Data Collection and Reporting). Rockville, MD: Westat, Inc.
- Schnee, R. (1977). Ethical standards for evaluators: The problem. CEDR Quarterly, 10(1), 3.
- Scriven, M.S. (1975). Bias and bias control in evaluation. Kalamazoo, MI: Western Michigan University Evaluation Center.
- Shepard, L.A. (1977). A checklist for evaluating large-scale assessment programs. Occasional Paper Series, Paper No. 9. Kalamazoo, MI: Western Michigan University Evaluation Center.
- Stufflebeam, D.L. (1974). Meta-evaluation. Occasional Paper Series, Paper No. 3. Kalamazoo, MI: Western Michigan University Evaluation Center.
- Stufflebeam, D.L., Foley, W.J., Gephart, W.J., Guba, E.G., Hammond, R.L., Merriman, H.O., & Provus, M. (1971a). Educational evaluation and decision making. Itasca, IL: F. E. Peacock.
Cited by
A Comprehensive Framework for Evaluation in Design Science Research
Venable, J., Pries-Heje, J., & Baskerville, R. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-29863-9_31 · Cited by 461
“The central purpose of DSR evaluation then is to rigorously demonstrate the utility of the artifact being evaluated (known as the " evaluand " (Stufflebeam 2000)).”
Yılmaz, K. (2021) · MANAS Sosyal Araştırmalar Dergisi · doi:10.33206/mjss.791537 · Cited by 222
“…ise bir değerlendirmenin tamamlanmasının ardından gerçekleştirilmekte ve izleyicilerin bir değerlendirmenin güçlü ve zayıf yönlerini görmelerine ve iyi değerlendirme uygulamalarının standartlarına göre değerine karar vermelerine yardımcı olabilmektedir (Stufflebeam, 2000, s. 95; 2001, s. 183).”
Developing an English Language Textbook Evaluative Checklist
An Assistant Professor at Al Imam Muhammad Bin Saud Islamic University, C. O. L. A. T., & Mohamed, M. (2013) · IOSR Journal of Research & Method in Education (IOSRJRME) · doi:10.9790/7388-0135570 · Cited by 96
Evaluation Checklists: Practical Tools for Guiding and Judging Evaluations
Stufflebeam, D. (2001) · American Journal of Evaluation · doi:10.1177/109821400102200107 · Cited by 74
“My checklists are supported by the Joint Committee (1988, 1994) personnel and program evaluation standards, by writings on metaevaluation (Stufflebeam, 2000), and by my recentAJEarticle titled “Lessons in contracting for evaluations” (Stufflebeam, 2001).”
MethodSelf-citationImproving policy understanding by means of secondary analyses of policy evaluation
Edler, J., Ebersberger, B., & Lo, V. (2008) · Research Evaluation · doi:10.3152/095820208x331667 · Cited by 29
“Modifying an approach of Stufflebeam (2000) for the assessment of evaluations, for each criterion an ideal benchmark is defined, against which each evaluation can be scored.”
MethodA Meta‐Evaluation of 11 School‐Based Smoking Prevention Programs
Tingle, L. R., DeSimone, M., & Covington, B. P. (2003) · Journal of School Health · doi:10.1111/j.1746-1561.2003.tb03574.x · Cited by 23
The Importance of Assessment Literacy: Formative and Summative Assessment Instruments and Techniques
Córdova, K. E. G. (2020) · Intelligent systems reference library · doi:10.1007/978-981-15-9908-8_1 · Cited by 23
Making evaluations matter: a practical guide for evaluators
Kusters, C. (2011) · Socio-Environmental Systems Modeling · Cited by 17
New perspective on the black box of internal auditing and organisational change
Kidron, A., Ofek, Y., & Cohen, H. (2016) · Managerial Auditing Journal · doi:10.1108/maj-07-2015-1220 · Cited by 18
Evaluación de un Modelo Educativo Universitario: Una Perspectiva desde los Actores
Olivos, T. M., Meneses, M. E., Menéses, E. E. S., & Orozco, M. M. F. (2016) · Revista Iberoamericana de Evaluación Educativa · doi:10.15366/riee2016.9.2.002 · Cited by 13
Firme, T. P., & Letichevsky, A. C. (2010) · Revista Meta Avaliação · doi:10.22347/2175-2753v2i5.79 · Cited by 9
How to Conduct a Metaevaluation?: A Metaevaluation Practice
Kerimoğlu, E., Ülker, M. N. Ö., & Berk, Ş. (2023) · Canadian Journal of Program Evaluation · doi:10.3138/cjpe.71619 · Cited by 8
Magno, C. (2009) · SSRN Electronic Journal · Cited by 7
Letichevsky, A. C., Vellasco, M. M. B. R., & Tanscheit, R. (2007) · Ensaio Avaliação e Políticas Públicas em Educação · doi:10.1590/s0104-40362007000300009 · Cited by 6
Review of literature on evaluation methods relevant to extension
Martin, A., Gündel, S., Apenteng, E., & Pound, B. (2011) · Greenwich Academic Literature Archive (University of Greenwich) · Cited by 4
Improving policy understanding by means of secondary analyses of policy evaluationPreprint
Ebersberger, B., Edler, J., & Lo, V. (2006) · RePEc: Research Papers in Economics · doi:10.24406/publica-fhg-293154 · Cited by 5
Proposta de instrumento de meta-avaliação da autoavaliação institucional na educação superior
Zimmermann, M. M. D. S., & Alves, L. (2022) · Avaliação Revista da Avaliação da Educação Superior (Campinas) · doi:10.1590/s1414-40772022000300006 · Cited by 4
Chianchana, C. (2021) · Cypriot Journal of Educational Sciences · doi:10.18844/cjes.v16i4.6010 · Cited by 3
“Meta-evaluation is the process of delineating, obtaining, and applying descriptive and judgmental information about the utility, feasibility, propriety, and accuracy of a guide for the evaluation, as well as public reporting of its strengths and weaknesses (Stufflebeam, 2000).”
MethodUsing responsive evaluation to change Thai tourist police volunteer programs
Liptapallop, W. (2008) · Victoria University Research Repository (Victoria University) · Cited by 3
Project Evaluation in Development Cooperation: A Meta-Evaluative Case Study in Tanzania
Cars, M. (2006) · KTH Publication Database DiVA (KTH Royal Institute of Technology) · Cited by 2
The meta-evaluation of revolving funds evaluation in Thailand
Tongchiw, T. (2013) · NRCT Data Center · doi:10.14457/nida.the.2013.17 · Cited by 2
Instrumentos de avaliação cognitiva no ensino odontológico: reflexões sobre uma experiência
Lopes, A. G., Gregório, L. N., Júnior, A. M. L. F., Martins, M. T., de Oliveira, R. G., Aguilar-da-Silva, R. H., & de Oliveira, F. A. M. (2020) · Revista da ABENO · doi:10.30979/rev.abeno.v19i3.852 · Cited by 1
CIPP Program Değerlendirme Modeli ile Yapılan Çalışmaların Meta Değerlendirmesi
Ünal, M., & ÖZASLAN, D. (2023) · Özgür Yayınları eBooks · doi:10.58830/ozgur.pub171.c854 · Cited by 1
IT maturity self-assessment: does a quantitative survey get it right?
Malmros, J., & Eckerstein, J. (2015) · Lund University Publications Student Papers (Lund University) · Cited by 1
Legislative Program Evaluation Conducted by State Legislatures in the United States
Risley, J. S. (2008) · ScholarWorks - WMU (Western Michigan University) · Cited by 1
METHODOLOGICAL CONSIDERATIONS AND RECOMMENDATIONS FOR FUTURE RESEARCH
Thompson, M., Ponte, E., Paek, P. L., & Goe, L. (2004) · ETS Research Report Series · doi:10.1002/j.2333-8504.2004.tb01960.x
A Fuzzy Inference System for Meta-Evaluation
Letichevsky, A. C., Vellasco, M. M. B. R., & Tanscheit, R. (2007) · International Conference on Intelligent Systems Design and Applications (ISDA) · doi:10.1109/isda.2007.93
Analysis of the Peer-Reviewed Process Used In the Accreditation of New Programmes in Zimbabwe
Garwe, E. C. (2015) · International Journal of Learning and Development · doi:10.5296/ijld.v5i3.8472 · Cited by 1
“Even when assessing similar programmes, Stufflebeam (2000) emphasises the need to consider the context for each programme.”
BackgroundThe Ten Commandments, Constitutional Amendments, and Other Evaluation Checklists
Stufflebeam, D. L. (2000)
Self-citation"Best Tradition": CREATE, JCSEE and the Program Evaluation Standards
Klinger, C., & Klinger, D. A. (2023) · Journal of MultiDisciplinary Evaluation · doi:10.56645/jmde.v19i43.833
Developing an English Language Textbook Evaluative ChecklistPreprint
Mahmoud, M. M. A. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5376683
Validation of a specific checklist for service cardiopulmonary resuscitation: shockable rhythms
Alcântara, R. B., Piuzana, E. D. F., Sternick, E. B., Ibiapina, C. D. C., Neto, A. S., & Almeida, A. M. (2025) · Revista Brasileira de Educação Médica · doi:10.1590/1981-5271v49.3-2023-0307
Amboy-Biller, L. R. (2022) · Digital Commons - University of South Florida (University of South Florida)
Ehrhardt, G. (2010) · Americanae (AECID Library)
Metadata
- Authors
- Stufflebeam, D. L.
- Affiliations
- Western Michigan University (US)
- Corresponding author
- Stufflebeam, Daniel L.
- Venue
- Journal of Personnel Evaluation in Education
- Published
- 2000-03
- Volume
- 14
- Issue
- 1
- Pages
- 95-125
- ISSN
- 0920-525X (ISSN-L)
- 1573-0425
- OpenAlex
- W144123253
- Cited by
- 32
- References
- 31
- Citations by year
- 2025: 2 · 2023: 3 · 2022: 2 · 2021: 2 · 2020: 2 · 2016: 2 · 2015: 2 · 2013: 1 · 2012: 1
- FWCI
- 1.75
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Journal of Personnel Evaluation in Education (publishedVersion)
- Funders
- National Academy of Education
- Topics
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Social Sciences › Political Science and International Relations › Education and Public Policy
- Social Sciences › Psychology › Applied Psychology › Human Resource Development and Performance Evaluation
- Keywords
- meta-evaluation, evaluation methodology, assessment quality, evaluation planning, evaluation reporting
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.