FORMATIVE EVALUATION: AN INTEGRATIVE PRACTICE MODEL AND CASE STUDY

BROWN, KENNETH G.; GERHARDT, MEGAN W.

doi:10.1111/j.1744-6570.2002.tb00137.x

Cited by 86Human Resource Development and Performance EvaluationEvaluation and Performance AssessmentVocational Education and Training

FORMATIVE EVALUATION: AN INTEGRATIVE PRACTICE MODEL AND CASE STUDY

BROWN, KENNETH G., GERHARDT, MEGAN W.·2002·Personnel Psychology

DOI 10.1111/j.1744-6570.2002.tb00137.x

Open this paper in CoChat — free account

Abstract

Training evaluation research and practice has been dominated by a focus on outcomes of completed training programs, or on methods used to assess these outcomes. This focus has largely neglected formative evaluation, which involves evaluating training during design and development. The purpose of this paper is to review existing models of formative evaluation and suggest an integrative practice model that is specifically targeted at improving training delivered in work organizations.

Integrity signals

Registry

Crossref · 10.1111/j.1744-6570.2002.tb00137.x

Cites

71 of 71 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

A participatory approach may also strengthen commitment among the intended users.
“This participatory approach may also facilitate commitment among targeted users.34”
From The role of formative evaluation in implementation research and the QUERI experience (2006) · cites this paper as [34]

The impact of human resource management practices on turnover, productivity, and corporate financial performance
HUSELID, M. A. (1995) · Academy of Management Journal · doi:10.2307/256741 · Cited by 9,342 · see citing works
Motivational processes affecting learning.
Dweck, C. S. (1986) · American Psychologist · doi:10.1037/0003-066x.41.10.1040 · Cited by 6,971 · see citing works
Safety climate in industrial organizations: Theoretical and applied implications.
Zohar, D. M. (1980) · Journal of Applied Psychology · doi:10.1037/0021-9010.65.1.96 · Cited by 2,687 · see citing works
Usability inspection methods
Nielsen, J. (1995) · Conference companion on Human factors in computing systems - CHI '95 · doi:10.1145/223355.223730 · Cited by 2,620 · see citing works
The Systematic Design of Instruction
Chang, S. L. (2006) · Educational Technology Research and Development · doi:10.1007/s11423-006-9606-0 · Cited by 2,601 · see citing works
Distance education : a systems view
Moore, M. G., & Kearsley, G. (1996) · Medical Entomology and Zoology · Cited by 2,598 · see citing works
Application of cognitive, skill-based, and affective theories of learning outcomes to new methods of training evaluation.
Kraiger, K., Ford, J. K., & Salas, E. (1993) · Journal of Applied Psychology · doi:10.1037/0021-9010.78.2.311 · Cited by 1,831 · see citing works
The science of training: a decade of progress
Salas, E., & Cannon-Bowers, J. A. (2001) · Annual Review of Psychology · doi:10.1146/annurev.psych.52.1.471 · Cited by 1,703 · see citing works
New Conceptualizations of Practice: Common Principles in Three Paradigms Suggest New Concepts for Training
Schmidt, R. A., & Bjork, R. A. (1992) · Psychological Science · doi:10.1111/j.1467-9280.1992.tb00029.x · Cited by 1,582 · see citing works
Goal Orientation in Organizational Research: A Conceptual and Empirical Foundation
Button, S. B., Mathieu, J. E., & Zajac, D. M. (1996) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1996.0063 · Cited by 1,217 · see citing works
Instructional-design Theories and Models
Reigeluth, C. M. (2013) · Routledge eBooks · doi:10.4324/9781410603784 · Cited by 1,075 · see citing works
Training and Development in Work Organizations
Tannenbaum, S. I., & YUKL, G. A. (1992) · Annual Review of Psychology · doi:10.1146/annurev.ps.43.020192.002151 · Cited by 1,023 · see citing works
The flawed four‐level evaluation model
Holton, E. F. (1996) · Human Resource Development Quarterly · doi:10.1002/hrdq.3920070103 · Cited by 965 · see citing works
A META‐ANALYSIS OF THE RELATIONS AMONG TRAINING CRITERIA
ALLIGER, G. M., TANNENBAUM, S. I., BENNETT, W., TRAVER, H., & SHOTLAND, A. (1997) · Personnel Psychology · doi:10.1111/j.1744-6570.1997.tb00911.x · Cited by 948 · see citing works
Evaluation: A Systematic Approach.
Patton, M. Q., Rossi, P. H., Freeman, H. E., & Wright, S. R. (1981) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2066947 · Cited by 933 · see citing works
TRAINING AND DEVELOPMENT HANDBOOK.
Craig, R. L., & Bittel, L. R. (1967) · McGraw-Hill eBooks · Cited by 929 · see citing works
Applying trained skills on the job: The importance of the work environment.
Tracey, J. B., Tannenbaum, S. I., & Kavanagh, M. J. (1995) · Journal of Applied Psychology · doi:10.1037/0021-9010.80.2.239 · Cited by 826 · see citing works
The relationship between organizational transfer climate and positive transfer of training
Rouiller, J. Z., & Goldstein, I. L. (1993) · Human Resource Development Quarterly · doi:10.1002/hrdq.3920040408 · Cited by 771 · see citing works
Conscientiousness, goal orientation, and motivation to learn during the learning process: A longitudinal study.
Colquitt, J. A., & Simmering, M. J. (1998) · Journal of Applied Psychology · doi:10.1037/0021-9010.83.4.654 · Cited by 549 · see citing works
Cost-Justifying Usability
Bias, R. G. (2005) · Elsevier eBooks · doi:10.1016/b978-012095811-5/50022-5 · Cited by 519 · see citing works
Effects of Training Goals and Goal Orientation Traits on Multidimensional Training Outcomes and Performance Adaptability
Kozlowski, S. W. J., Gully, S. M., Brown, K. G., Eduardo Salas, A., Smith, E. M., & Nason, E. (2001) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.2000.2930 · Cited by 481 · see citing works
Self-citation
Rapid prototyping: An alternative instructional design strategy
Tripp, S. D., & Bichelmeyer, B. A. (1990) · Educational Technology Research and Development · doi:10.1007/bf02298246 · Cited by 454 · see citing works
Improving Training Effectiveness in Work Organizations
(2014) · Psychology Press eBooks · doi:10.4324/9781315806662 · Cited by 444 · see citing works
Transfer of Training : Action-Packed Strategies to Ensure High Payoff from Training Investments
Broad, M. L., & Newstrom, J. W. (1992) · Medical Entomology and Zoology · Cited by 426 · see citing works
DIFFERENTIAL EFFECTS OF LEARNER EFFORT AND GOAL ORIENTATION ON TWO LEARNING OUTCOMES
Fisher, S. L., & Ford, J. K. (1998) · Personnel Psychology · doi:10.1111/j.1744-6570.1998.tb00731.x · Cited by 406 · see citing works
Research in Personnel and Human Resources Management
(2008) · Research in personnel and human resources management · doi:10.1016/s0742-7301(08)27013-1 · Cited by 376 · see citing works
Using computers to deliver training: Which employees learn and why?
Brown, K. (2001) · Personnel Psychology · doi:10.1111/j.1744-6570.2001.tb00093.x · Cited by 363 · see citing works
Self-citation
Relationship between conscientiousness and learning in employee training: Mediating influences of self-deception and self-efficacy.
Martocchio, J. J., & Judge, T. A. (1997) · Journal of Applied Psychology · doi:10.1037/0021-9010.82.5.764 · Cited by 335 · see citing works
TRAINEE CHARACTERISTICS AND THE OUTCOMES OF OPEN LEARNING
Warr, P. B., & Bunce, D. J. (1995) · Personnel Psychology · doi:10.1111/j.1744-6570.1995.tb01761.x · Cited by 293 · see citing works
Personality and the goal-striving process: The influence of achievement goal patterns, goal level, and mental focus on performance and enjoyment.
Lee, F. K., Sheldon, K. M., & Turban, D. B. (2003) · Journal of Applied Psychology · doi:10.1037/0021-9010.88.2.256 · Cited by 293 · see citing works
Training in Organizations
SIOP (2002) · PsycEXTRA Dataset · doi:10.1037/e553002012-001 · Cited by 277 · see citing works
Staffing Policy as a Strategic Response: A Typology of Career Systems
Sonnenfeld, J. A., & Peiperl, M. A. (1988) · Academy of Management Review · doi:10.5465/amr.1988.4307437 · Cited by 239 · see citing works
Turn Signals Are The Facial Expressions Of Automobiles
Norman, D. A. (1993) · Medical Entomology and Zoology · Cited by 176 · see citing works
Employee training and development
Cohen, E. R. (2014) · Greenleaf Publishing eBooks · doi:10.9774/gleaf.978-1-907643-30-9_10 · Cited by 153 · see citing works
AN INVESTIGATION OF THE EFFECT AND ECONOMIC UTILITY OF CORPORATE‐WIDE TRAINING
Morrow, C. C., JARRETT, M. Q., & Rupinski, M. T. (1997) · Personnel Psychology · doi:10.1111/j.1744-6570.1997.tb00902.x · Cited by 142 · see citing works
BEYOND FORMAL EXPERIMENTAL DESIGN: TOWARDS AN EXPANDED VIEW OF THE TRAINING EVALUATION PROCESS
Sackett, P. R., & Mullen, E. J. (1993) · Personnel Psychology · doi:10.1111/j.1744-6570.1993.tb00887.x · Cited by 137 · see citing works
Training for Impact: How to Link Training to Business Needs and Measure the Results
Robinson, D. G., & Robinson, J. C. (2008) · Medical Entomology and Zoology · Cited by 133 · see citing works
Achieving Results from Training.
Steffy, B. D., & Brinkerhoff, R. O. (1989) · Industrial and Labor Relations Review · doi:10.2307/2523373 · Cited by 113 · see citing works
Computer training through behavior modeling, self-paced, and instructional approaches: A field experiment.
Simon, S. J., & Werner, J. M. (1996) · Journal of Applied Psychology · doi:10.1037/0021-9010.81.6.648 · Cited by 105 · see citing works
Distance Training: How Innovative Organizations are Using Technology to Maximize Learning and Meet Business Objectives
Schreiber, D. A., & Berge, Z. L. (1998) · Cited by 84 · see citing works
Determining a Strategy for Evaluating Training: Operating within Organizational Constraints
Tannenbaum, S. I., & Woods, S. B. (1992) · Human Resource Planning · Cited by 81 · see citing works
Staffing Policy as a Strategic Response: A Typology of Career Systems
Sonnenfeld, J. A., & Peiperl, M. A. (1988) · Academy of Management Review · doi:10.2307/258377 · Cited by 81 · see citing works
The evolution of learning strategies in organizations: From employee development to business redefinition
Baldwin, T. T., Danielson, C., & Wiggenhorn, W. (1997) · Academy of Management Perspectives · doi:10.5465/ame.1997.9712024838 · Cited by 76 · see citing works
A model for understanding formative evaluation in instructional design
Weston, C., McAlpine, L., & Bordonaro, T. (1995) · Educational Technology Research and Development · doi:10.1007/bf02300454 · Cited by 75 · see citing works
INTRODUCING NEW METHODS FOR CONDUCTING TRAINING EVALUATION AND FOR LINKING TRAINING EVALUATION TO PROGRAM REDESIGN
Ford, J. K., & Wroten, S. P. (1984) · Personnel Psychology · doi:10.1111/j.1744-6570.1984.tb00531.x · Cited by 68 · see citing works
Context-Sensitive Instructional Design Models: A Response to Design Research, Studies, and Criticism
Tessmer, M. A., & Wedman, J. F. (2008) · Performance Improvement Quarterly · doi:10.1111/j.1937-8327.1995.tb00685.x · Cited by 61 · see citing works
APPLYING UTILITY CONCEPTS TO A TRAINING PROGRAM IN SUPERVISORY SKILLS: A TIME-BASED APPROACH.
Mathieu, J. E., & Leonard, R. L. (1987) · Academy of Management Journal · doi:10.2307/256277 · Cited by 61 · see citing works
Accuracy decomposition and team decision making: Testing theoretical boundary conditions.
Hollenbeck, J. R., Colquitt, J. A., Ilgen, D. R., LePine, J. A., & Hedlund, J. (1998) · Journal of Applied Psychology · doi:10.1037/0021-9010.83.3.494 · Cited by 59 · see citing works
Business Strategy Links with Staffing and Training Practices
Raghuram, S., & Arvey, R. D. (1994) · Human Resource Planning · Cited by 59 · see citing works
Maintaining Professional Competence: Approaches to Career Enhancement, Vitality, and Success Throughout a Work Life.
Hybels, R. C., Willis, S. L., & Dubin, S. S. (1991) · Industrial and Labor Relations Review · doi:10.2307/2524722 · Cited by 55 · see citing works
A quantitative needs assessment technique for cross-cultural work adjustment training
Selmer, J. (2000) · Human Resource Development Quarterly · doi:10.1002/1532-1096(200023)11:3 · Cited by 50 · see citing works
Formative Evaluation Alternatives
Tessmer, M. A. (2008) · Performance Improvement Quarterly · doi:10.1111/j.1937-8327.1994.tb00613.x · Cited by 46 · see citing works
Enhancing continuous learning: Diagnostic findings from multiple companies
Tannenbaum, S. I. (1997) · Human Resource Management · doi:10.1002/(sici)1099-050x(199724)36:4 · Cited by 44 · see citing works
Designing Management Training and Development for Competitive Advantage: Lessons from the Best
Olian, J. D., Durham, C. C., Kristoff, A. L., et al. (1998) · Human Resource Planning · Cited by 34 · see citing works
Stakeholder involvement in strategic HRD aligning: the impact on HRD effectiveness
Wognum, I., & Lam, J. F. (2000) · International Journal of Training and Development · doi:10.1111/1468-2419.00099 · Cited by 33 · see citing works
How to conduct a formative evaluation
Beyer, B. K. (1995) · Cited by 28 · see citing works
Developing human resources
Wexley, K. N., & Hinrichs, J. R. (1991) · Medical Entomology and Zoology · Cited by 28 · see citing works
Assessing the subsequent effect of a formative evaluation on a program
Brown, J., & Kiernan, N. E. (2001) · Evaluation and Program Planning · doi:10.1016/s0149-7189(01)00004-0 · Cited by 28 · see citing works
Rapid Prototyping in the Instructional Design Process
Nixon, E. K., & Lee, D. (2001) · Performance Improvement Quarterly · doi:10.1111/j.1937-8327.2001.tb00220.x · Cited by 23 · see citing works
Organizational barriers to implementing a rational model of training.
Dipboye, R. L. (1997) · American Psychological Association eBooks · doi:10.1037/10260-002 · Cited by 23 · see citing works
Concurrent Formative Evaluation: Guidelines and Implications for Multimedia Designers.
Northrup, P. T. (1995) · Educational Technology archive · Cited by 19 · see citing works
The influence of participants in formative evaluation on the improvement of learning from written instructional materials
Weston, C., Maistre, C. L., McAlpine, L., et al. (1997) · Instructional Science · doi:10.1023/a:1003073923764 · Cited by 19 · see citing works
Systematic Pilot Testing as a Step in the Instructional Design Process of Corporate Training and Development
White, B. S., & Branch, R. M. (2008) · Performance Improvement Quarterly · doi:10.1111/j.1937-8327.2001.tb00219.x · Cited by 19 · see citing works
Differences in expert practice: a case from formative evaluation
Saroyan, A. (1993) · Instructional Science · doi:10.1007/bf00118558 · Cited by 18 · see citing works
Formative evaluation: Developmental testing and expert review
Geis, G. L. (1987) · NSPI Journal · doi:10.1002/pfi.4160260402 · Cited by 13 · see citing works
The priorities established among data sources when instructional designers revise written materials
Maistre, K. L., & Weston, C. (1996) · Educational Technology Research and Development · doi:10.1007/bf02300326 · Cited by 12 · see citing works
Evaluating computer‐based training for repurposing to multimedia: A case study
Tessmer, M. A., & Jonassen, D. H. (1994) · NSPI Journal · doi:10.1002/pfi.4160330703 · Cited by 9 · see citing works
A comparison of student feedback obtained from three methods of formative evaluation of instructional materials
Medley-Mark, V., & Weston, C. (1988) · Instructional Science · doi:10.1007/bf00121231 · Cited by 9 · see citing works
Cognitive Style FD/FI as a Learner Selection Criterion in Formative Evaluations A Qualitative Analysis
Chinien, C. A., & Boutin, F. (2008) · Performance Improvement Quarterly · doi:10.1111/j.1937-8327.1992.tb00543.x · Cited by 8 · see citing works
The Effects of Student Formative Evaluation of Instruction on Teacher Behavior
Sherman, T. M. (1978) · Journal of Educational Technology Systems · doi:10.2190/cq31-7j5x-cndf-gv52 · Cited by 5 · see citing works
Formative Evaluation of Computer Courseware: An Experimental Comparison of Two Methods
Byrum, D. (1992) · Journal of Educational Computing Research · doi:10.2190/1w7x-mxnh-9eur-9fbr · Cited by 5 · see citing works

Flagged first, then by citations

Sorted by citations

The role of formative evaluation in implementation research and the QUERI experience
Stetler, C. B., Legro, M. W., Wallace, C. M., Bowman, C., Guihan, M., Hagedorn, H., Kimmel, B., Sharp, N. D., & Smith, J. L. (2006) · Journal of General Internal Medicine · doi:10.1007/s11606-006-0267-9 · Cited by 642 · see citing works

Authors: BROWN, K. G., & GERHARDT, M. W.
Affiliations: University of Iowa (US)
Corresponding author: BROWN, KENNETH G.
ORCID: BROWN, KENNETH G.
GERHARDT, MEGAN W.
Venue: Personnel Psychology
Publisher: Wiley
Published: 2002-12
Volume: 55
Issue: 4
Pages: 951-983
ISSN: 0031-5826 (ISSN-L)
1744-6570
DOI: 10.1111/j.1744-6570.2002.tb00137.x
OpenAlex: W2050082885
Cited by: 86
References: 71
Citations by year: 2026: 1 · 2024: 2 · 2023: 3 · 2022: 7 · 2021: 5 · 2020: 7 · 2019: 2 · 2018: 5 · 2017: 7 · 2016: 5 · 2015: 3 · 2014: 1 · 2013: 4 · 2012: 5
FWCI: 2.41
Type: journal article
Language: en
Open access: closed
Licence: onlinelibrary.wiley.com/termsAndConditions#vor (vor, 1467 d)
Locations: Personnel Psychology (publishedVersion)
Topics: Social Sciences › Psychology › Applied Psychology › Human Resource Development and Performance Evaluation
Social Sciences › Decision Sciences › Management Science and Operations Research › Evaluation and Performance Assessment
Social Sciences › Education › Vocational Education and Training
Keywords: formative assessment, training evaluation, training program design, employee training, training outcomes

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

FORMATIVE EVALUATION: AN INTEGRATIVE PRACTICE MODEL AND CASE STUDY

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Cites

Cited by

Related

Record

About these checks