The DOI matches its Crossref record; 91 of the 91 references it cites were found in a registry or an index.
The effectiveness of managerial leadership development programs: A meta‐analysis of studies from 1982 to 2001
Abstract
Eighty‐three studies from 1982 to 2001 with formal training interventions were integrated via meta‐analytic techniques to determine the effectiveness of interventions in their enhancement of performance, knowledge, and expertise at the individual, team or group, or organizational level. The studies were separated by research design, with the outcome measure of the intervention as the unit of analysis. The effect size for knowledge outcomes ranged from .96 to 1.37; expertise outcomes from .35 to 1.01; and system outcomes averaged .39. Interventions with knowledge outcomes were found to be more effective than in the Burke and Day (1986) meta‐analysis, with the most effective interventions using a single group pretest‐posttest research design. Methodological and conceptual differences in Burke and Day's meta‐analysis on the effectiveness of managerial training make historical comparisons risky. The data suggest that practitioners can attain substantial improvements in both knowledge and skills if sufficient front‐end analysis is conducted to assure that the right development is offered to the right leaders.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Leadership and Performance beyond Expectations
Longshore, J. M., & Bass, B. M. (1987) · The Academy of Management Review · doi:10.2307/258081 · Cited by 12,412
Handbook of Industrial and Organizational Psychology.
Hammer, T. H., Anderson, J., Gurdon, M., Jick, T., Petit, A., Stern, R., Schwartz, H., Vardi, Y., & Dunnette, M. D. (1977) · Administrative Science Quarterly · doi:10.2307/2391755 · Cited by 11,945
HUSELID, M. A. (1995) · Academy of Management Journal · doi:10.2307/256741 · Cited by 9,342
(2000) · Cited by 9,198
Handbook of industrial and organizational psychology
(1993) · Choice Reviews Online · doi:10.5860/choice.30-5278 · Cited by 5,339
Evaluating Training Programs : The Four Levels
Kirkpatrick, D. L. (2009) · Cited by 4,720
Meta-analysis in social research
(1982) · Evaluation and Program Planning · doi:10.1016/0149-7189(82)90011-8 · Cited by 3,853
Hunter, J., & Schmidt, F. (2004) · doi:10.4135/9781412985031 · Cited by 3,023
(1990) · Free Press , Collier Macmillan eBooks · Cited by 2,859
Self-determination in a work organization.
Deci, E. L., Connell, J. P., & Ryan, R. M. (1989) · Journal of Applied Psychology · doi:10.1037//0021-9010.74.4.580 · Cited by 2,064
Lipsey, M. W., & Wilson, D. B. (1993) · American Psychologist · doi:10.1037/0003-066x.48.12.1181 · Cited by 2,033
IMPACT OF TRANSFORMATIONAL LEADERSHIP ON FOLLOWER DEVELOPMENT AND PERFORMANCE: A FIELD EXPERIMENT.
Dvir, T., Eden, D., Avolio, B. J., & Shamir, B. (2002) · Academy of Management Journal · doi:10.2307/3069307 · Cited by 1,906
Transformational leadership: industrial, military, and educational impact
(1998) · Choice Reviews Online · doi:10.5860/choice.35-4579 · Cited by 1,860
The Social Scientific Study of Leadership: Quo Vadis?
House, R. J., & Aditya, R. N. (1997) · Journal of Management · doi:10.1016/s0149-2063(97)90037-4 · Cited by 1,810
Friedman, T. L. (1999) · Cited by 1,764
Managerial Leadership: A Review of Theory and Research
Yukl, G. (1989) · Journal of Management · doi:10.1177/014920638901500207 · Cited by 1,648
Managerial Behavior, Performance, and Effectiveness.
Miljus, R. C., Campbell, J. P., Dunnette, M. D., Lawler, E. E., & Weick, K. E. (1971) · Industrial and Labor Relations Review · doi:10.2307/2521540 · Cited by 1,507
Barling, J., Weber, T., & Kelloway, E. K. (1996) · Journal of Applied Psychology · doi:10.1037/0021-9010.81.6.827 · Cited by 1,315
Parker, S. K. (1998) · Journal of Applied Psychology · doi:10.1037//0021-9010.83.6.835 · Cited by 1,242
Scandura, T. A., & Graen, G. B. (1984) · Journal of Applied Psychology · doi:10.1037//0021-9010.69.3.428 · Cited by 1,228
Meta-Analysis: Cumulating Research Findings across Studies
Feldman, J. M., Hunter, J. E., Schmidt, F. L., & Jackson, G. B. (1984) · The Academy of Management Review · doi:10.2307/258247 · Cited by 1,199
Full Leadership Development: Building the Vital Forces in Organizations
(2000) · The Journal of Academic Librarianship · doi:10.1016/s0099-1333(99)00131-7 · Cited by 1,109
Graen, G., Novak, M. A., & Sommerkamp, P. (1982) · Organizational Behavior and Human Performance · doi:10.1016/0030-5073(82)90236-7 · Cited by 1,064
The flawed four‐level evaluation model
Holton, E. F. (1996) · Human Resource Development Quarterly · doi:10.1002/hrdq.3920070103 · Cited by 960
Self-citationThe Center for Creative Leadership handbook of leadership development
Velsor, E. V., McCauley, C. D., Ruderman, M. N., & Ryan, J. R. (2010) · Cited by 956
A META‐ANALYSIS OF THE RELATIONS AMONG TRAINING CRITERIA
ALLIGER, G. M., TANNENBAUM, S. I., BENNETT, W., TRAVER, H., & SHOTLAND, A. (1997) · Personnel Psychology · doi:10.1111/j.1744-6570.1997.tb00911.x · Cited by 948
Applying trained skills on the job: The importance of the work environment.
Tracey, J. B., Tannenbaum, S. I., & Kavanagh, M. J. (1995) · Journal of Applied Psychology · doi:10.1037//0021-9010.80.2.239 · Cited by 825
Meta-Analysis: Cumulating Research Findings across Studies
Hunter, J. E., Schmidt, F. L., & Jackson, G. B. (1986) · Educational Researcher · doi:10.2307/1175263 · Cited by 792
KIRKPATRICK'S LEVELS OF TRAINING CRITERIA: THIRTY YEARS LATER
ALLIGER, G. M., & JANAK, E. A. (1989) · Personnel Psychology · doi:10.1111/j.1744-6570.1989.tb00661.x · Cited by 722
Designing Effective Work Groups.
Kramer, R. M., & Goodman, P. S. (1987) · Administrative Science Quarterly · doi:10.2307/2392888 · Cited by 703
Theory and research on leadership in organizations.
YUKL, G. A., & Fleet, D. D. V. (1992) · Cited by 623
Teamwork: What Must Go Right/What Can Go Wrong
Larson, C. E., & LaFasto, F. M. J. (1989) · Medical Entomology and Zoology · Cited by 593
Taxonomic efforts in the description of leader behavior: A synthesis and functional interpretation
Fleishman, E. A., Mumford, M. D., Zaccaro, S. J., Levin, K. Y., Korotkin, A. L., & Hein, M. B. (1991) · The Leadership Quarterly · doi:10.1016/1048-9843(91)90016-u · Cited by 580
A cumulative study of the effectiveness of managerial training.
Burke, M. J., & Day, R. R. (1986) · Journal of Applied Psychology · doi:10.1037//0021-9010.71.2.232 · Cited by 511
A Critical, Objective Review of Performance Feedback
Balcazar, F., Hopkins, B. L., & Suarez, Y. (1985) · Journal of Organizational Behavior Management · doi:10.1300/j075v07n03_05 · Cited by 392
Research on Leadership Selection and Training: One View of the Future
Fiedler, F. E. (1996) · Administrative Science Quarterly · doi:10.2307/2393716 · Cited by 378
Measuring human resources: An overview of practice and a prescription for results
Ulrich, D. (1997) · Human Resource Management · doi:10.1002/(sici)1099-050x(199723)36:3<303::aid-hrm3>3.0.co;2-# · Cited by 369
(1986) · Cited by 347
Leadership Complexity and Development of the leaderplex Model
Hooijberg, R., (Jerry) Hunt, J. G., & Dodge, G. E. (1997) · Journal of Management · doi:10.1177/014920639702300305 · Cited by 339
INTERCULTURAL TRAINING FOR MANAGERS: A COMPARISON OF DOCUMENTARY AND INTERPERSONAL METHODS.
Earley, P. C. (1987) · Academy of Management Journal · doi:10.2307/256155 · Cited by 303
The fidelity‐adaptation debate: Implications for the implementation of public sector social programs
Blakely, C. H., Mayer, J. P., Gottschalk, R. G., Schmitt, N., Davidson, W. S., Roitman, D. B., & Emshoff, J. G. (1987) · American Journal of Community Psychology · doi:10.1007/bf00922697 · Cited by 297
TRAINEE CHARACTERISTICS AND THE OUTCOMES OF OPEN LEARNING
WARR, P., & BUNCE, D. (1995) · Personnel Psychology · doi:10.1111/j.1744-6570.1995.tb01761.x · Cited by 293
Rummler, G. A., & Brache, A. P. (1995) · Cited by 287
The Making of Leaders: A Review of the Research in Leadership Development and Education
Brungardt, C. (1996) · Journal of Leadership Studies · doi:10.1177/107179199700300309 · Cited by 277
Kelly, E. P. (1999) · Journal of Leadership Studies · doi:10.1177/107179199900500317 · Cited by 235
Tziner, A., Haccoun, R. R., & Kadish, A. (1991) · Journal of Occupational Psychology · doi:10.1111/j.2044-8325.1991.tb00551.x · Cited by 207
Impact of experimental design on effect size: Findings from the research literature on training.
Carlson, K. D., & Schmidt, F. L. (1999) · Journal of Applied Psychology · doi:10.1037//0021-9010.84.6.851 · Cited by 202
Validity Generalization: A Critical Review
Strube, M., & Murphy, K. R. (2004) · Academy of Management Review · doi:10.5465/amr.2004.12736129 · Cited by 183
Validity Generalization: A Critical Review
Strube, M., & Murphy, K. R. (2004) · Academy of Management Review · doi:10.2307/20159040 · Cited by 152
Harrison, J. K. (1992) · Journal of Applied Psychology · doi:10.1037/0021-9010.77.6.952 · Cited by 145
Operational Definitions of Expertise and Competence
Herling, R. W. (2000) · Advances in Developing Human Resources · doi:10.1177/152342230000200103 · Cited by 144
PERFORMANCE APPRAISAL BEHAVIORS: SUPERVISOR PERCEPTIONS AND SUBORDINATE REACTIONS
Dorfman, P. W., Stephan, W. G., & Loveland, J. P. (1986) · Personnel Psychology · doi:10.1111/j.1744-6570.1986.tb00954.x · Cited by 134
DeNisi, A. S., & Peters, L. H. (1996) · Journal of Applied Psychology · doi:10.1037/0021-9010.81.6.717 · Cited by 111
Implanting pygmalion leadership style through workshop training
Eden, D., Geller, D., Gewirtz, A. H., Gordon-Terner, R., Inbar, I., Liberman, M., Pass, Y., Salomon-Segev, I., & Shalit, M. (2000) · The Leadership Quarterly · doi:10.1016/s1048-9843(00)00042-4 · Cited by 109
Human resource orientation and corporate performance
Lam, L. W., & White, L. P. (1998) · Human Resource Development Quarterly · doi:10.1002/hrdq.3920090406 · Cited by 100
THE EFFECT OF A MASTERY PRACTICE DESIGN ON LEARNING AND TRANSFER IN BEHAVIOR MODELING TRAINING
May, G. L., & Kahnweiler, W. M. (2000) · Personnel Psychology · doi:10.1111/j.1744-6570.2000.tb00205.x · Cited by 90
Clark, K. E. (1992) · Cited by 83
Testing the Hierarchy Theory of Training Evaluation: An Expanded Role for Trainee Reactions
Clement, R. W. (1982) · Public Personnel Management · doi:10.1177/009102608201100210 · Cited by 69
Impact of Training On Leadership Development
Sogunro, O. A. (1997) · Evaluation Review · doi:10.1177/0193841x9702100605 · Cited by 68
Organizational Performance: The Future Focus of Leadership Development Programs
Collins, D. B. (2001) · Journal of Leadership Studies · doi:10.1177/107179190100700404 · Cited by 67
Self-citationTrainee Satisfaction and Training Impact: Issues in Training Evaluation
Faerman, S. R., & Ban, C. (1993) · Public Productivity & Management Review · doi:10.2307/3380872 · Cited by 67
Testing Moderator Variable Hypotheses Meta-Analytically
Aguinis, H., & Pierce, C. A. (1998) · Journal of Management · doi:10.1016/s0149-2063(99)80074-9 · Cited by 65
Haccoun, R. R., & HAMTIAUX, T. (1994) · Personnel Psychology · doi:10.1111/j.1744-6570.1994.tb01739.x · Cited by 55
Ivancevich, J. M. (1982) · Journal of Applied Psychology · doi:10.1037/0021-9010.67.5.581 · Cited by 53
Swanson, R. A. (1998) · Human Resource Development Quarterly · doi:10.1002/hrdq.3920090307 · Cited by 51
QUESTIONING THE EFFECTIVENESS OF BEHAVIOR MODELING TRAINING IN AN INDUSTRIAL SETTING1
Russell, J. S., Wexley, K. N., & Hunter, J. E. (1984) · Personnel Psychology · doi:10.1111/j.1744-6570.1984.tb00523.x · Cited by 50
Performance Domains and Their Boundaries
Holton, E. F. (1999) · Advances in Developing Human Resources · doi:10.1177/152342239900100103 · Cited by 48
Self-citationThe evaluation of training activities: A complex issue involving different stakes
Dionne, P. (1996) · Human Resource Development Quarterly · doi:10.1002/hrdq.3920070308 · Cited by 48
A study of the impact of training in a management development program based on 360 feedback
Rosti, R. T., & Shipper, F. M. (1998) · Journal of Managerial Psychology · doi:10.1108/02683949810369147 · Cited by 47
The Quality of Group Decisions, Group Verbal Behavior, and Intervention
Innami, I. (1994) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1994.1092 · Cited by 45
Maurer, S. D., & Fay, C. H. (1988) · Personnel Psychology · doi:10.1111/j.1744-6570.1988.tb02388.x · Cited by 43
Management Development Through Job Experiences: An Annotated Bibliography
McCauley, C. D., & Brutus, S. (1997) · Cited by 41
DAVIS, B. L., & Mount, M. K. (1984) · Personnel Psychology · doi:10.1111/j.1744-6570.1984.tb00521.x · Cited by 37
Newstrom, J. W. (1995) · Human Resource Development Quarterly · doi:10.1002/hrdq.3920060310 · Cited by 34
A test of vision training and potential antecedents to leaders' visioning ability
Thoms, P., & Greenberger, D. B. (1998) · Human Resource Development Quarterly · doi:10.1002/hrdq.3920090102 · Cited by 30
Leadership Education at the Great Divide: Crossing into the Twenty-First Century
Klenke, K. (1993) · Journal of Leadership Studies · doi:10.1177/107179199300100110 · Cited by 27
Preliminary Validation and Training of Supervisory Interactional Skills
Clark, H. B. “., Wood, R. P., Kuehnel, T. G., Flanagan, S. G., Mosk, M. M., & Northrup, J. T. (1985) · Journal of Organizational Behavior Management · doi:10.1300/j075v07n01_07 · Cited by 25
EAP Referral Training and Supervisor's Beliefs About Troubled Workers
Gerstein, L. H., Eichenhofer, D. J., Bayer, G. A., Valutis, W., & Jankowski, J. (1989) · Employee Assistance Quarterly · doi:10.1300/j022v04n04_02 · Cited by 24
Lawrence, H. V., & Wiswell, A. K. (1993) · Human Resource Development Quarterly · doi:10.1002/hrdq.3920040204 · Cited by 22
The influence of management training upon organizational climate: An exploratory study
Moxnes, P., & Eilertsen, D. (1991) · Journal of Organizational Behavior · doi:10.1002/job.4030120505 · Cited by 20
Evaluation Practices of Instructional Designers and Organizational Supports and Barriers
Moller, L. A., & Mallin, P. (2008) · Performance Improvement Quarterly · doi:10.1111/j.1937-8327.1996.tb00740.x · Cited by 20
Investigation of Interpersonal Management Training for Educational Administrators
Smith, R. M., Montello, P. A., & White, P. (1992) · The Journal of Educational Research · doi:10.1080/00220671.1992.9941122 · Cited by 17
The Development and the Evaluation of a Behaviour-Modelling Training Programme for Supervisors
Birkenbach, X. C., Kamfer, L., & ter Morshuizen, J. D. (1985) · South African Journal of Psychology · doi:10.1177/008124638501500102 · Cited by 15
Management training: Justify costs or say goodbye.
Urban, T., Ferris, G. R., Crowe, D. F., & Miller, R. (1985) · Training and development journal · Cited by 13
A Method for Evaluating Corporation Training Seminars
Bruwelheide, L. R., & Duncan, P. K. (1985) · Journal of Organizational Behavior Management · doi:10.1300/j075v07n01_06 · Cited by 12
Management development through job experiences
(1994) · PsycEXTRA Dataset · doi:10.1037/e573022011-010 · Cited by 12
Participation and evaluative outcomes in management training
Thoms, P., & Klein, H. J. (1994) · Human Resource Development Quarterly · doi:10.1002/hrdq.3920050105 · Cited by 9
Bayley, E. W. (1988) · Scholarly Commons (University of Pennsylvania) · Cited by 6
Examination of a cooperative learning supervision training and development model
Niska, J. M. (1991) · doi:10.31274/rtd-180813-9508 · Cited by 5
The use of the measurement of continuous improvement model for training program evaluation
Tesoro, F. (1993) · NSPI Journal · doi:10.1002/pfi.4170320504 · Cited by 5
The effects of a leadership training program on supervisory learning and performance
Savan, M. (1984) · University Microfilms International eBooks · Cited by 4
Cited by
Estimating effect sizes from pretest-posttest-control group designs
Morris, S. B. (2008) · Organizational Research Methods · doi:10.1177/1094428106291059 · Cited by 2,133
Martin, B. C., McNally, J. J., & Kay, M. J. (2013) · Journal of Business Venturing · doi:10.1016/j.jbusvent.2012.03.002 · Cited by 1,565
“We compared these results to those found in meta-analyses examining management training in general (e.g., Burke & Day, 1986; Morrow, Jarrett, & Rupinski, 1997; Collins & Holton, 2004), which showed medium effect sizes.”
ResultBenefits of Training and Development for Individuals and Teams, Organizations, and Society
Aguinis, H., & Kraiger, K. (2009) · Annual Review of Psychology · doi:10.1146/annurev.psych.60.110707.163505 · Cited by 1,453
The Science of Training and Development in Organizations: What Matters in Practice
Salas, E., Tannenbaum, S. I., Kraiger, K., & Smith-Jentsch, K. A. (2012) · Psychological Science in the Public Interest · doi:10.1177/1529100612436661 · Cited by 1,104
Enhancing the Effectiveness of Team Science
(2015) · National Academies Press eBooks · doi:10.17226/19007 · Cited by 620
Metadata
- Authors
- Collins, D. B., & Holton, E. F.
- Venue
- Human Resource Development Quarterly
- Publisher
- Wiley
- Published
- 2004-06
- Volume
- 15
- Issue
- 2
- Pages
- 217-248
- ISSN
- 1044-8004 (ISSN-L)
- 1532-1096
- OpenAlex
- W2059828393
- Cited by
- 505
- References
- 91
- FWCI
- 12.86
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.