The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Program evaluation models and related theories: AMEE Guide No. 67
Open accessAbstract
This Guide reviews theories of science that have influenced the development of common educational evaluation models. Educators can be more confident when choosing an appropriate evaluation model if they first consider the model's theoretical basis against their program's complexity and their own evaluation needs. Reductionism, system theory, and (most recently) complexity theory have inspired the development of models commonly applied in evaluation studies today. This Guide describes experimental and quasi-experimental models, Kirkpatrick's four-level model, the Logic Model, and the CIPP (Context/Input/Process/Product) model in the context of the theories that influenced their development and that limit or support their ability to do what educators need. The goal of this Guide is for educators to become more competent and confident in being able to design educational program evaluations that support intentional program improvement while adequately documenting or describing the changes and outcomes-intended and unintended-associated with their programs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2014) · The SAGE Encyclopedia of Action Research · doi:10.4135/9781446294406.n148 · Cited by 7,250
Neufeld, A., & Ryan, A. G. (1988) · Canadian Journal of Program Evaluation · doi:10.3138/cjpe.3.006 · Cited by 5,913
General System Theory: Foundations, Development, Applications
Edmonds, E. A., & von Bertalanffy, L. (1977) · Leonardo · doi:10.2307/1573450 · Cited by 3,674
Developmental Evaluation: Applying Complexity Concepts to Enhance Innovation and Use
Patton, M. Q. (2010) · Cited by 1,740
The History and Status of General Systems Theory.
Von Bertalanffy, L. (1972) · Academy of Management Journal · doi:10.2307/255139 · Cited by 1,409
The flawed four‐level evaluation model
Holton, E. F. (1996) · Human Resource Development Quarterly · doi:10.1002/hrdq.3920070103 · Cited by 960
Evaluation Theory, Models, and Applications
Stufflebeam, D. L., & Coryn, C. L. S. (2007) · Cited by 631
A critical analysis of evaluation practice: the Kirkpatrick model and the principle of beneficence
Bates, R. (2004) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2004.04.011 · Cited by 623
Foundations of Program Evaluation: Theories of Practice.
Chen, H.-T., Shadish, W. R., Cook, T. D., & Leviton, L. C. (1992) · Contemporary Sociology · doi:10.2307/2074800 · Cited by 534
Foundations of program evaluation. Theories of practice
Bond, J. (1992) · International Journal of Nursing Studies · doi:10.1016/0020-7489(92)90034-e · Cited by 447
International Handbook of Research in Medical Education
(2002) · Springer International Handbooks of Education · doi:10.1007/978-94-010-0462-6 · Cited by 330
Program Theory-Driven Evaluation Science: Strategies and Applications
Donaldson, S. I. (2007) · Cited by 216
Program Theory-Driven Evaluation Science
Donaldson, S. I. (2007) · Routledge eBooks · doi:10.4324/9780203809730 · Cited by 202
Evaluation Theory, Models, & Applications
Wiersma, W. (2009) · Journal of MultiDisciplinary Evaluation · doi:10.56645/jmde.v6i11.197 · Cited by 192
Logic Modeling Methods in Program Evaluation
Schröter, D. C., & Urschel, J. L. (2008) · Journal of MultiDisciplinary Evaluation · doi:10.56645/jmde.v5i9.170 · Cited by 173
Twelve tips for evaluating educational programs
Cook, D. A. (2010) · Medical Teacher · doi:10.3109/01421590903480121 · Cited by 164
Practical Guide to the Evaluation of Clinical Competence
Huh, S. (2022) · Korean Medical Education Review · doi:10.17496/kmer.2022.24.2.176 · Cited by 161
Logic Modeling Methods in Program Evaluation
Frechtling, J. A. (2007) · Medical Entomology and Zoology · Cited by 131
AMEE Education Guide no. 29: Evaluating educational programmes
Goldie, J. (2006) · Medical Teacher · doi:10.1080/01421590500271282 · Cited by 122
Responsive evaluation: Its meaning and special contribution to health promotion
Abma, T. (2005) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2005.04.003 · Cited by 112
A Conceptual Model for Program Evaluation in Graduate Medical Education
Musick, D. W. (2006) · Academic Medicine · doi:10.1097/00001888-200608000-00015 · Cited by 74
Complexity and the health care professions
Doll, W. E., Jr., & Trueit, D. (2010) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2010.01497.x · Cited by 67
Durning, S. J., Hemmer, P. A., & Pangaro, L. N. (2007) · Teaching and Learning in Medicine · doi:10.1080/10401330701366796 · Cited by 62
Self-citationComplexity and health professions education
Mennin, S. P. (2010) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2010.01502.x · Cited by 47
Effects of comprehensive educational reforms on academic success in a diverse student body
Lieberman, S. A., AINSWORTH, M. A., Asimakis, G. K., Thomas, L., Cain, L. D., Mancuso, M. G., Rabek, J. P., Zhang, N., & FRYE, A. W. (2010) · Medical Education · doi:10.1111/j.1365-2923.2010.03770.x · Cited by 27
Self-citationPoza, M. (2002) · PubMed · Cited by 23
Cited by
Twelve Tips for programmatic assessment
Van Der Vleuten, C. P. M., Schuwirth, L. W. T., Driessen, E. W., Govaerts, M. J. B., & Heeneman, S. (2015) · Medical Teacher · doi:10.3109/0142159x.2014.973388 · Cited by 333
Feedback for learners in medical education: What is known? A scoping review.
Bing-You, R., Hayes, V., Varaklis, K., Trowbridge, R., Kemp, H., & McKelvy, D. (2017) · Academic Medicine · doi:10.1097/acm.0000000000001578 · Cited by 256
Luo, X., Gao, L., Li, J., Lin, Y., Zhao, J., & Li, Q. (2020) · Psycho-Oncology · doi:10.1002/pon.5278 · Cited by 67
The Effects of Training on Instructor Beliefs about and Attitudes toward Online Teaching
Brinkley-Etzkorn, K. E. (2020) · American Journal of Distance Education · doi:10.1080/08923647.2020.1692553 · Cited by 37
Thomae, A. V., Witt, C. M., & Barth, J. (2024) · JMIR Medical Education · doi:10.2196/50545 · Cited by 36
Metadata
- Authors
- Frye, A. W., & Hemmer, P. A.
- Venue
- Medical Teacher
- Publisher
- Informa UK Limited
- Published
- 2012-04-19
- Volume
- 34
- Issue
- 5
- Pages
- e288-e299
- ISSN
- 0142-159X (ISSN-L)
- 1466-187X
- OpenAlex
- W2161170577
- Cited by
- 640
- References
- 26
- FWCI
- 17.51
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.