The DOI matches its Crossref record; 92 of the 92 references it cites were found in a registry or an index.
An Integrated Model of Training Evaluation and Effectiveness
Open accessAbstract
A decade of training evaluation and training effectiveness research was reviewed to construct an integrated model of training evaluation and effectiveness. This model integrates four prior evaluation models and results of 10 years of training effectiveness research. It is the first to be constructed using a set of strict criteria and to investigate the evaluation and effectiveness relationships with an evaluation measure proposed several years ago, post training attitudes. Evaluation measures found to be related to posttraining attitudes were cognitive learning, training performance, and transfer performance. Training effectiveness variables found to be related to posttraining attitudes were pretraining self-efficacy, experience, posttraining mastery orientation, learning principles, and post-training interventions. Overall, 10 training effectiveness variables were found to consistently influence training outcomes. Results also reveal that reaction measures and training motivation are two areas needing further development and research. These findings as well as other areas requiring research attention are discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Handbook of Industrial and Organizational Psychology.
Hammer, T. H., Anderson, J., Gurdon, M., Jick, T., Petit, A., Stern, R., Schwartz, H., Vardi, Y., & Dunnette, M. D. (1977) · Administrative Science Quarterly · doi:10.2307/2391755 · Cited by 11,945
(1979) · Medical Entomology and Zoology · Cited by 11,252
Quasi-experimentation: Design and analysis issues for field settings
Shrout, P. E. (1980) · Evaluation and Program Planning · doi:10.1016/0149-7189(80)90063-4 · Cited by 6,010
Handbook of industrial and organizational psychology
(1993) · Choice Reviews Online · doi:10.5860/choice.30-5278 · Cited by 5,339
TRANSFER OF TRAINING: A REVIEW AND DIRECTIONS FOR FUTURE RESEARCH
BALDWIN, T. T., & FORD, J. K. (1988) · Personnel Psychology · doi:10.1111/j.1744-6570.1988.tb00632.x · Cited by 3,307
Kraiger, K., Ford, J. K., & Salas, E. (1993) · Journal of Applied Psychology · doi:10.1037/0021-9010.78.2.311 · Cited by 1,831 · cited 3×
“Kraiger et al. (1993) and Kraiger (2002) provided additional methods for evaluating training; however, few studies (e.g., Bell & Kozlowski, 2002) have shared their terminology or used the measurement suggestions offered by the authors.”
BackgroundMethodThe science of training: a decade of progress
Salas, E., & Cannon-Bowers, J. A. (2001) · Annual Review of Psychology · doi:10.1146/annurev.psych.52.1.471 · Cited by 1,703
Self-citationThe flawed four‐level evaluation model
Holton, E. F. (1996) · Human Resource Development Quarterly · doi:10.1002/hrdq.3920070103 · Cited by 960
A META‐ANALYSIS OF THE RELATIONS AMONG TRAINING CRITERIA
ALLIGER, G. M., TANNENBAUM, S. I., BENNETT, W., TRAVER, H., & SHOTLAND, A. (1997) · Personnel Psychology · doi:10.1111/j.1744-6570.1997.tb00911.x · Cited by 948
TRAINING AND DEVELOPMENT HANDBOOK.
Craig, R. L., & Bittel, L. R. (1967) · CERN Document Server (European Organization for Nuclear Research) · Cited by 926
Reeves, M. (1993) · Cited by 903
Development of a generalized learning transfer system inventory
Holton III, E. F., Bates, R. A., & Ruona, W. E. A. (2000) · Human Resource Development Quarterly · doi:10.1002/1532-1096(200024)11:4<333::aid-hrdq2>3.0.co;2-p · Cited by 879
Applying trained skills on the job: The importance of the work environment.
Tracey, J. B., Tannenbaum, S. I., & Kavanagh, M. J. (1995) · Journal of Applied Psychology · doi:10.1037//0021-9010.80.2.239 · Cited by 825
Ford, J. K., Smith, E. M., Weissbein, D. A., Gully, S. M., & Salas, E. (1998) · Journal of Applied Psychology · doi:10.1037//0021-9010.83.2.218 · Cited by 785
Self-citationThe relationship between organizational transfer climate and positive transfer of training
Rouiller, J. Z., & Goldstein, I. L. (1993) · Human Resource Development Quarterly · doi:10.1002/hrdq.3920040408 · Cited by 770
Facteau, J. D., Dobbins, G. H., Russell, J. E. A., Ladd, R. T., & Kudisch, J. D. (1995) · Journal of Management · doi:10.1016/0149-2063(95)90031-4 · Cited by 716
Exploring the Performance Benefits of Group Training: Transactive Memory or Improved Communication?
Moreland, R. L., & Myaskovsky, L. (2000) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.2000.2891 · Cited by 633
Saks, A. M. (1995) · Journal of Applied Psychology · doi:10.1037//0021-9010.80.2.211 · Cited by 595
Colquitt, J. A., & Simmering, M. J. (1998) · Journal of Applied Psychology · doi:10.1037//0021-9010.83.4.654 · Cited by 554
Training in Work Organizations
Goldstein, I. L. (1980) · Annual Review of Psychology · doi:10.1146/annurev.ps.31.020180.001305 · Cited by 538
Goal orientation and goal content as predictors of performance in a training program.
Brett, J. F., & Vandewalle, D. (1999) · Journal of Applied Psychology · doi:10.1037//0021-9010.84.6.863 · Cited by 470
Improving Training Effectiveness in Work Organizations
(2014) · Psychology Press eBooks · doi:10.4324/9781315806662 · Cited by 444
Methods of Research in Social Psychology.
Singleton, R., Carlsmith, J. M., Ellsworth, P. C., & Aronson, E. (1977) · Contemporary Sociology · doi:10.2307/2064798 · Cited by 437
Transfer of Training : Action-Packed Strategies to Ensure High Payoff from Training Investments
Broad, M. L., & Newstrom, J. W. (1992) · Medical Entomology and Zoology · Cited by 426
Transfer of skill from a computer game trainer to flight
Gopher, D., Well, M., & Bareket, T. (1994) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/001872089403600301 · Cited by 421 · cited 2×
“The final training characteristic that was related to transfer performance is high difficulty, which is a training manipulation that requires trainees to learn tasks more difficult than those in the environment where skills will be transferred (Bell & Kozlowski, 2002; Burke, 1997; Doane, Alderton, Sohn, & Pellegrino,…”
BackgroundDIFFERENTIAL EFFECTS OF LEARNER EFFORT AND GOAL ORIENTATION ON TWO LEARNING OUTCOMES
FISHER, S. L., & FORD, J. K. (1998) · Personnel Psychology · doi:10.1111/j.1744-6570.1998.tb00731.x · Cited by 405
Methods of research in social psychology
Carlsmith, M. (1976) · Medical Entomology and Zoology · Cited by 384
MATHIEU, J. E., MARTINEAU, J. W., & TANNENBAUM, S. I. (1993) · Personnel Psychology · doi:10.1111/j.1744-6570.1993.tb00870.x · Cited by 368
Pretraining context effects: Training assignment as feedback.
Quiñones, M. A. (1995) · Journal of Applied Psychology · doi:10.1037//0021-9010.80.2.226 · Cited by 347
Effects of conceptions of ability on anxiety, self-efficacy, and learning in training.
Martocchio, J. J. (1994) · Journal of Applied Psychology · doi:10.1037//0021-9010.79.6.819 · Cited by 344
Martocchio, J. J., & Judge, T. A. (1997) · Journal of Applied Psychology · doi:10.1037//0021-9010.82.5.764 · Cited by 334
Enhancing continuous learning: Diagnostic findings from multiple companies
Tannenbaum, S. I. (1997) · Human Resource Management · doi:10.1002/(sici)1099-050x(199724)36:4<437::aid-hrm7>3.0.co;2-w · Cited by 332
A FIELD SURVEY OF FACTORS AFFECTING THE ADOPTION AND PERCEIVED SUCCESS OF DIVERSITY TRAINING
RYNES, S., & ROSEN, B. (1995) · Personnel Psychology · doi:10.1111/j.1744-6570.1995.tb01756.x · Cited by 330
Tracey, J. B., Hinkin, T. R., Tannenbaum, S., & Mathieu, J. E. (2001) · Human Resource Development Quarterly · doi:10.1002/1532-1096(200101/02)12:1<5::aid-hrdq2>3.0.co;2-j · Cited by 327
STEVENS, C. K., & GIST, M. E. (1997) · Personnel Psychology · doi:10.1111/j.1744-6570.1997.tb01490.x · Cited by 300
Borgman, C. L. (1986) · International Journal of Man-Machine Studies · doi:10.1016/s0020-7373(86)80039-6 · Cited by 297
TRAINEE CHARACTERISTICS AND THE OUTCOMES OF OPEN LEARNING
WARR, P., & BUNCE, D. (1995) · Personnel Psychology · doi:10.1111/j.1744-6570.1995.tb01761.x · Cited by 293
The Impact of Cross-Training on Team Functioning: An Empirical Investigation
Volpe, C. E., Cannon-Bowers, J. A., Salas, E., & Spector, P. E. (1996) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872096778940741 · Cited by 286
Self-citationBELL, B. S., & KOZLOWSKI, S. W. J. (2002) · Personnel Psychology · doi:10.1111/j.1744-6570.2002.tb00111.x · Cited by 271
Predicting three levels of training outcome
Warr, P., Allan, C., & Birdi, K. (1999) · Journal of Occupational and Organizational Psychology · doi:10.1348/096317999166725 · Cited by 258
Self-management training for improving job performance: A field experiment involving salespeople.
Frayne, C. A., & Geringer, J. M. (2000) · Journal of Applied Psychology · doi:10.1037//0021-9010.85.3.361 · Cited by 257
Naquin, S. S., & Holton, E. F. (2002) · Human Resource Development Quarterly · doi:10.1002/hrdq.1038 · Cited by 228
Creating an effective training environment for enhancing telework
VENKATESH, V., & SPEIER, C. (2000) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1999.0367 · Cited by 212
Do Computer-Based Games Facilitate Knowledge Acquisition and Retention?
Ricci, K. E., Salas, E., & Cannon-Bowers, J. A. (1996) · Military Psychology · doi:10.1207/s15327876mp0804_3 · Cited by 211
Self-citationComputer training, frequency of usage and burnout: the moderating role of computer self-efficacy
Salanova, M., Grau, R., Cifré, E., & Llorens, S. (2000) · Computers in Human Behavior · doi:10.1016/s0747-5632(00)00028-5 · Cited by 207
Cannon-Bowers, J. A., Salas, E., Tannenbaum, S. I., & Mathieu, J. E. (1995) · Military Psychology · doi:10.1207/s15327876mp0703_1 · Cited by 206
Self-citationTurning work into play: Implications for microcomputer software training
Webster, J. (1993) · Journal of Management · doi:10.1016/0149-2063(93)90049-s · Cited by 196
STEWART, G. L., CARSON, K. P., & CARDY, R. L. (1996) · Personnel Psychology · doi:10.1111/j.1744-6570.1996.tb01795.x · Cited by 195
Improving Learning Transfer in Organizations
Holton, E. F., Baldwin, T. T., & Holton, E. E. (2007) · Cited by 192
Posttraining interventions to enhance transfer: The moderating effects of work environments
Richman‐Hirsch, W. L. (2001) · Human Resource Development Quarterly · doi:10.1002/hrdq.2 · Cited by 180
Gully, S. M., Payne, S. C., Koles, K. L. K., & Whiteman, J.-A. K. (2002) · Journal of Applied Psychology · doi:10.1037//0021-9010.87.1.143 · Cited by 177
TRAINING TEAM PERFORMANCE‐RELATED ASSERTIVENESS
Smith‐Jentsch, K. A., Salas, E., & BAKER, D. P. (1996) · Personnel Psychology · doi:10.1111/j.1744-6570.1996.tb02454.x · Cited by 157
Self-citationRole of ability and prior knowledge in complex training performance.
Ree, M., Carretta, T., & Teachout, M. S. (1995) · Journal of Applied Psychology · doi:10.1037/0021-9010.80.6.721 · Cited by 157
Making transfer happen: an action perspective on learning transfer systems
Holton, E. F. (2003) · Cited by 157
The impact of feedback and self‐efficacy on performance in training
Karl, K. A., O’Leary-Kelly, A. M., & Martocchio, J. J. (1993) · Journal of Organizational Behavior · doi:10.1002/job.4030140409 · Cited by 150
Tesluk, P. E., Farr, J. L., Mathieu, J. E., & Vance, R. J. (1995) · Personnel Psychology · doi:10.1111/j.1744-6570.1995.tb01773.x · Cited by 148
DISPOSITIONAL INFLUENCES ON TRANSFER OF LEARNING IN MULTISTAGE TRAINING PROGRAMS
Herold, D. M., Davis, W., Fedor, D. B., & Parsons, C. K. (2002) · Personnel Psychology · doi:10.1111/j.1744-6570.2002.tb00132.x · Cited by 138
Morin, L., & Latham, G. P. (2000) · Applied Psychology · doi:10.1111/1464-0597.00032 · Cited by 138
The Differential Effects of Software Training Previews on Training Outcomes
Webster, J., & Martocchio, J. J. (1995) · Journal of Management · doi:10.1177/014920639502100409 · Cited by 126
Clements, M. P. (2005) · Palgrave Macmillan UK eBooks · doi:10.1057/9780230596146_6 · Cited by 124
THE EFFECT OF A MASTERY PRACTICE DESIGN ON LEARNING AND TRANSFER IN BEHAVIOR MODELING TRAINING
May, G. L., & Kahnweiler, W. M. (2000) · Personnel Psychology · doi:10.1111/j.1744-6570.2000.tb00205.x · Cited by 123
Training Older Adults to Use Automatic Teller Machines
Rogers, W. A., Fisk, A. D., Mead, S. E., Walker, N., & Cabrera, E. F. (1996) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872096778701935 · Cited by 118
Cole, N. D., & Latham, G. P. (1997) · Journal of Applied Psychology · doi:10.1037/0021-9010.82.5.699 · Cited by 109
Can pretraining experiences explain individual differences in learning?
Smith‐Jentsch, K. A., Jentsch, F. G., Payne, S. C., & Salas, E. (1996) · Journal of Applied Psychology · doi:10.1037/0021-9010.81.1.110 · Cited by 106
Self-citationSimon, S. J., & Werner, J. M. (1996) · Journal of Applied Psychology · doi:10.1037/0021-9010.81.6.648 · Cited by 105
PERFORMANCE FEEDBACK EFFECTS IN TRAINING: THE ROLE OF PERCEIVED CONTROLLABILITY
Martocchio, J. J., & Dulebohn, J. H. (1994) · Personnel Psychology · doi:10.1111/j.1744-6570.1994.tb01729.x · Cited by 103
Ferguson, E., Sanders, A., O'Hehir, F., & James, D. K. (2000) · Journal of Occupational and Organizational Psychology · doi:10.1348/096317900167056 · Cited by 103
Environmental factors and the effectiveness of workforce diversity training
Hanover, J. M. B., & Cellar, D. F. (1998) · Human Resource Development Quarterly · doi:10.1002/hrdq.3920090203 · Cited by 99
Cellar, D. F., Miller, M. L., Doverspike, D., & Klawsky, J. D. (1996) · Journal of Applied Psychology · doi:10.1037/0021-9010.81.6.694 · Cited by 98
Rozell, E. J., & Gardner, W. L. (1999) · Computers in Human Behavior · doi:10.1016/s0747-5632(98)00030-2 · Cited by 97
Improving positive transfer: A test of relapse prevention training on transfer outcomes
Burke, L. A. (1997) · Human Resource Development Quarterly · doi:10.1002/hrdq.3920080204 · Cited by 89
Measuring Skill Acquisition and Retention with an ATM Simulator: The Need for Age-Specific Training
Mead, S. E., & Fisk, A. D. (1998) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872098779591313 · Cited by 87
Dyck, J. L., & Smither, J. A.-A. (1996) · Computers in Human Behavior · doi:10.1016/0747-5632(95)00022-4 · Cited by 77
Gist, M. E., & Stevens, C. K. (1998) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1998.2787 · Cited by 74
Effects of training on computer-mediated communication in single or mixed gender small task groups
Savicki, V., Kelley, M., & Ammon, B. (2002) · Computers in Human Behavior · doi:10.1016/s0747-5632(01)00048-6 · Cited by 71
Effectiveness of Simulation Training on Transfer of Statistical Concepts
Lane, D. M., & Tang, Z. (2000) · Journal of Educational Computing Research · doi:10.2190/w9gw-5m9c-uqvt-1e0r · Cited by 71
Factors That Influence Training Effectiveness: A Conceptual Model And Longitudinal Analysis
Tannenbaum, S. I., Cannon‐Bowers, J. A., Salas, E., et al. (1993) · PsycEXTRA Dataset · doi:10.1037/e534182006-001 · Cited by 68
Self-citationAcquisition and transfer of skilled performance: Are visual discrimination skills stimulus specific?
Doane, S. M., Alderton, D. L., Sohn, Y. W., & Pellegrino, J. W. (1996) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037//0096-1523.22.5.1218 · Cited by 68
Augmenting behavior‐modeling training: Testing the effects of pre‐ and post‐training interventions
Werner, J. M., O’Leary-Kelly, A. M., Baldwin, T. T., & Wexley, K. N. (1994) · Human Resource Development Quarterly · doi:10.1002/hrdq.3920050207 · Cited by 63
A cross-level units-of-analysis approach to individual differences in skill acquisition.
Eyring, J. D., Johnson, D. S., & Francis, D. J. (1993) · Journal of Applied Psychology · doi:10.1037/0021-9010.78.5.805 · Cited by 63
Cognitive and Personality Predictors of Training Performance
Driskell, J. E., Hogan, J. C., Salas, E., & Hoskin, B. (1994) · Military Psychology · doi:10.1207/s15327876mp0601_2 · Cited by 52
Self-citationUtility of a Brief Self-Efficacy Scale in Clinical Training Program Evaluation
Lorenz, R. A., Gregory, R., & Davis, D. (2000) · Evaluation & the Health Professions · doi:10.1177/016327870002300204 · Cited by 42
The role of processing strategies in the acquisition and transfer of a cognitive skill.
Doane, S. M., Sohn, Y. W., & Schreiber, B. T. (1999) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/0096-1523.25.5.1390 · Cited by 42
Matching training methods and factors of cognitive ability: A means to improve training outcomes
Carter, S. D. (2002) · Human Resource Development Quarterly · doi:10.1002/hrdq.1014 · Cited by 41
The development of self-efficacy during aviation training
Davis, W. D., Fedor, D. B., Parsons, C. K., & Herold, D. M. (2000) · Journal of Organizational Behavior · doi:10.1002/1099-1379(200012)21:8<857::aid-job55>3.0.co;2-d · Cited by 40
Goal orientation and practice condition as predictors of training results
Hertenstein, E. J. (2001) · Human Resource Development Quarterly · doi:10.1002/hrdq.1005 · Cited by 38
Training Concurrent Multistep Procedural Tasks
Peck, A. C., & Detweiler, M. C. (2000) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872000779698150 · Cited by 36
Parchman, S. W., Ellis, J. A., Christinaz, D., & Vogel, M. (2000) · Military Psychology · doi:10.1207/s15327876mp1201_4 · Cited by 35
Arthur, W., Young, B., Jordan, J. A., & Shebilske, W. (1996) · Hum. Factors · doi:10.1518/001872096778940732 · Cited by 33
Alternating Task Modules in Isochronal Distributed Training of Complex Tasks
Goettl, B. P., Yadrick, R. M., Connolly-Gomez, C., Regian, J. W., & Shebilske, W. L. (1996) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/001872089606380213 · Cited by 20
Technical education transfer: perceptions of employee computer technology self-efficacy
Decker, C. A. (1999) · Computers in Human Behavior · doi:10.1016/s0747-5632(99)00015-1 · Cited by 18
Hanisch, K. A., & Hulin, C. L. (1994) · Personnel Psychology · doi:10.1111/j.1744-6570.1994.tb01575.x · Cited by 9
Cited by
Transfer of Training: A Meta-Analytic Review
Blume, B. D., Ford, J. K., Baldwin, T. T., & Huang, J. L. (2010) · Journal of Management · doi:10.1177/0149206309352880 · Cited by 1,477
Training Transfer: An Integrative Literature Review
Burke, L. A., & Hutchins, H. M. (2007) · Human Resource Development Review · doi:10.1177/1534484307303035 · Cited by 1,299
Velada, R., Caetano, A., Michel, J. W., Lyons, B. D., & Kavanagh, M. J. (2007) · International Journal of Training and Development · doi:10.1111/j.1468-2419.2007.00286.x · Cited by 404
A study of best practices in training transfer and proposed model of transfer
Burke, L. A., & Hutchins, H. M. (2008) · Human Resource Development Quarterly · doi:10.1002/hrdq.1230 · Cited by 351
A systematic review of the effectiveness of occupational health and safety training
Robson, L. S., Stephenson, C. M., Schulte, P. A., Amick, B. C. I., Irvin, E. L., Eggerth, D. E., Chan, S., Bielecky, A. R., Wang, A. M., Heidotting, T. L., et al. (2012) · Scandinavian Journal of Work, Environment & Health · doi:10.5271/sjweh.3259 · Cited by 296
Metadata
- Authors
- Alvarez, K., Salas, E., & Garofano, C. M.
- Venue
- Human Resource Development Review
- Publisher
- SAGE Publications
- Published
- 2004-12
- Volume
- 3
- Issue
- 4
- Pages
- 385-416
- ISSN
- 1534-4843 (ISSN-L)
- 1552-6712
- OpenAlex
- W2004320599
- Cited by
- 420
- References
- 92
- FWCI
- 5.44
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.