A META‐ANALYSIS OF THE RELATIONS AMONG TRAINING CRITERIA
Abstract
An augmented framework for training criteria based on Kirkpatrick's (1959a, 1959b, 1960a, 1960b) model divides training reactions into affective and utility reactions, and learning into post‐training measures of learning, retention, and behavior/skill demonstration. A total of 34 studies yielding 115 correlations were analyzed meta‐analytically. Results included substantial reliabilities across training criteria and reasonable convergence among subdivisions of criteria within a larger level. Utility‐type reaction measures were more strongly related to learning or on‐the‐job performance (transfer) than affective‐type reaction measures. Moreover, utility‐type reaction measures were stronger correlates of transfer than were measures of immediate or retained learning. These latter findings support recent concurrent thinking regarding use of reactions in training (e.g., Warr & Bunce, 1995). Implications for choosing and developing training criteria are discussed.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The ADDIE model was valuable as a source of information extraction by providing good teaching practices and enhancing the work of both educational designers and educators.
“Finally, the ADDIE model was valuable as a source of information extraction by providing good teaching practices and enhancing the work of both educational designers and educators (e.g., Alliger et al. [74]; Dong [75]; and Johnson-Barlow and Lehnen [2]).”
From A Comparative Study of the ADDIE Instructional Design Model in Distance Education (2022) · cites this paper as Alliger et al. [74]
Cites
Attitude-behavior relations: A theoretical analysis and review of empirical research
Ajzen, I., & Fishbein, M. (1977) · Psychological Bulletin · doi:10.1037/0033-2909.84.5.888 · Cited by 7,611 · see citing works
Kraiger, K., Ford, J. K., & Salas, E. (1993) · Journal of Applied Psychology · doi:10.1037/0021-9010.78.2.311 · Cited by 1,831 · see citing works
Harrison, J. K. (1992) · Journal of Applied Psychology · doi:10.1037/0021-9010.77.6.952 · Cited by 145 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
The science of training: a decade of progress
Salas, E., & Cannon-Bowers, J. A. (2001) · Annual Review of Psychology · doi:10.1146/annurev.psych.52.1.471 · Cited by 1,703 · see citing works
Transfer of Training: A Meta-Analytic Review
Blume, B. D., Ford, J. K., Baldwin, T. T., & Huang, J. L. (2010) · Journal of Management · doi:10.1177/0149206309352880 · Cited by 1,477 · see citing works
Teamwork in healthcare: Key discoveries enabling safer, high-quality care.
Rosen, M. A., DiazGranados, D., Dietz, A. S., Benishek, L. E., Thompson, D., Pronovost, P. J., & Weaver, S. J. (2018) · American Psychologist · doi:10.1037/amp0000298 · Cited by 1,283 · see citing works
A critical analysis of evaluation practice: the Kirkpatrick model and the principle of beneficence
Bates, R. (2004) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2004.04.011 · Cited by 623 · see citing works
Jones, R. J., Woods, S. A., & Guillaume, Y. R. F. (2016) · Journal of Occupational and Organizational Psychology · doi:10.1111/joop.12119 · Cited by 614 · see citing works
The influence of technology on the future of human resource management
Stone, D. L., Deadrick, D. L., Lukaszewski, K. M., & Johnson, R. (2015) · Human Resource Management Review · doi:10.1016/j.hrmr.2015.01.002 · Cited by 618 · see citing works
Wandersman, A., Chien, V. H., & Katz, J. (2012) · American Journal of Community Psychology · doi:10.1007/s10464-012-9509-7 · Cited by 422 · see citing works
A Comparative Study of the ADDIE Instructional Design Model in Distance Education
Spatioti, A. G., Kazanidis, I., & Pange, J. (2022) · Information · doi:10.3390/info13090402 · Cited by 279 · see citing works
An Evaluation of Gamified Training: Using Narrative to Improve Reactions and Learning
Armstrong, M. B., & Landers, R. N. (2017) · Simulation & Gaming · doi:10.1177/1046878117703749 · Cited by 158 · see citing works
Virtual training: Making reality work?
Bertram, J., Moskaliuk, J., & Cress, U. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2014.10.032 · Cited by 137 · see citing works
Police Training in Sexual Assault Response: Process, Outcomes, and Elements of Change
Lonsway, K. A., Welch, S., & Fitzgerald, L. F. (2001) · Criminal Justice and Behavior · doi:10.1177/009385480102800602 · Cited by 124 · see citing works
FORMATIVE EVALUATION: AN INTEGRATIVE PRACTICE MODEL AND CASE STUDY
BROWN, K. G., & GERHARDT, M. W. (2002) · Personnel Psychology · doi:10.1111/j.1744-6570.2002.tb00137.x · Cited by 86 · see citing works
Fulton, L. V., Ivanitskaya, L. V., Bastian, N. D., Erofeev, D. A., & Mendez, F. A. (2013) · Learning and Instruction · doi:10.1016/j.learninstruc.2012.09.001 · Cited by 24 · see citing works
Engel, R. S., Isaza, G. T., Motz, R. T., McManus, H. D., & Corsaro, N. (2022) · Police Quarterly · doi:10.1177/10986111211049834 · Cited by 14 · see citing works
- Authors
- ALLIGER, G. M., TANNENBAUM, S. I., BENNETT, W., TRAVER, H., & SHOTLAND, A.
- Affiliations
- University at Albany, State University of New York (US)
- Corresponding author
- ALLIGER, GEORGE M.
- Venue
- Personnel Psychology
- Publisher
- Wiley
- Published
- 1997-06
- Volume
- 50
- Issue
- 2
- Pages
- 341-358
- ISSN
- 0031-5826 (ISSN-L)
- 1744-6570
- OpenAlex
- W1995790159
- Cited by
- 948
- References
- 3
- Citations by year
- 2026: 24 · 2025: 21 · 2024: 25 · 2023: 18 · 2022: 31 · 2021: 35 · 2020: 36 · 2019: 37 · 2018: 43 · 2017: 52 · 2016: 43 · 2015: 52 · 2014: 46 · 2013: 71 · 2012: 51
- FWCI
- 19.10
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Personnel Psychology (publishedVersion)
- Topics
- Social Sciences › Psychology › Applied Psychology › Human Resource Development and Performance Evaluation
- Social Sciences › Education › Evaluation of Teaching Practices
- Social Sciences › Decision Sciences › Management Science and Operations Research › Evaluation and Performance Assessment
- Keywords
- Kirkpatrick model, training evaluation criteria, affective reactions, transfer of learning, retention, employee performance, training reactions, training effectiveness
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
