The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Program evaluation models and related theories: AMEE Guide No. 67
Open accessAbstract
This Guide reviews theories of science that have influenced the development of common educational evaluation models. Educators can be more confident when choosing an appropriate evaluation model if they first consider the model's theoretical basis against their program's complexity and their own evaluation needs. Reductionism, system theory, and (most recently) complexity theory have inspired the development of models commonly applied in evaluation studies today. This Guide describes experimental and quasi-experimental models, Kirkpatrick's four-level model, the Logic Model, and the CIPP (Context/Input/Process/Product) model in the context of the theories that influenced their development and that limit or support their ability to do what educators need. The goal of this Guide is for educators to become more competent and confident in being able to design educational program evaluations that support intentional program improvement while adequately documenting or describing the changes and outcomes-intended and unintended-associated with their programs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2014) · The SAGE Encyclopedia of Action Research · doi:10.4135/9781446294406.n148 · Cited by 7,250
Neufeld, A., & Ryan, A. G. (1988) · Canadian Journal of Program Evaluation · doi:10.3138/cjpe.3.006 · Cited by 5,913
General System Theory: Foundations, Development, Applications
Edmonds, E. A., & von Bertalanffy, L. (1977) · Leonardo · doi:10.2307/1573450 · Cited by 3,674
Developmental Evaluation: Applying Complexity Concepts to Enhance Innovation and Use
Patton, M. Q. (2010) · Cited by 1,740
The History and Status of General Systems Theory.
Von Bertalanffy, L. (1972) · Academy of Management Journal · doi:10.2307/255139 · Cited by 1,409
The flawed four‐level evaluation model
Holton, E. F. (1996) · Human Resource Development Quarterly · doi:10.1002/hrdq.3920070103 · Cited by 960
Evaluation Theory, Models, and Applications
Stufflebeam, D. L., & Coryn, C. L. S. (2007) · Cited by 631
A critical analysis of evaluation practice: the Kirkpatrick model and the principle of beneficence
Bates, R. (2004) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2004.04.011 · Cited by 623
Foundations of Program Evaluation: Theories of Practice.
Chen, H.-T., Shadish, W. R., Cook, T. D., & Leviton, L. C. (1992) · Contemporary Sociology · doi:10.2307/2074800 · Cited by 534
Foundations of program evaluation. Theories of practice
Bond, J. (1992) · International Journal of Nursing Studies · doi:10.1016/0020-7489(92)90034-e · Cited by 447
Cited by
Twelve Tips for programmatic assessment
Van Der Vleuten, C. P. M., Schuwirth, L. W. T., Driessen, E. W., Govaerts, M. J. B., & Heeneman, S. (2015) · Medical Teacher · doi:10.3109/0142159x.2014.973388 · Cited by 333
Feedback for learners in medical education: What is known? A scoping review.
Bing-You, R., Hayes, V., Varaklis, K., Trowbridge, R., Kemp, H., & McKelvy, D. (2017) · Academic Medicine · doi:10.1097/acm.0000000000001578 · Cited by 256
Luo, X., Gao, L., Li, J., Lin, Y., Zhao, J., & Li, Q. (2020) · Psycho-Oncology · doi:10.1002/pon.5278 · Cited by 67
The Effects of Training on Instructor Beliefs about and Attitudes toward Online Teaching
Brinkley-Etzkorn, K. E. (2020) · American Journal of Distance Education · doi:10.1080/08923647.2020.1692553 · Cited by 37
Thomae, A. V., Witt, C. M., & Barth, J. (2024) · JMIR Medical Education · doi:10.2196/50545 · Cited by 36
Metadata
- Authors
- Frye, A. W., & Hemmer, P. A.
- Venue
- Medical Teacher
- Publisher
- Informa UK Limited
- Published
- 2012-04-19
- Volume
- 34
- Issue
- 5
- Pages
- e288-e299
- ISSN
- 0142-159X (ISSN-L)
- 1466-187X
- OpenAlex
- W2161170577
- Cited by
- 640
- References
- 26
- FWCI
- 17.51
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Program evaluation models and related theories: AMEE Guide No. 67. https://app.cochat.ai/papers/10.3109/0142159x.2012.668637
- The paper
- Frye, A. W., & Hemmer, P. A. (2012). Program evaluation models and related theories: AMEE Guide No. 67. Medical Teacher. https://doi.org/10.3109/0142159x.2012.668637
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
