The DOI matches its Crossref record; 193 of the 193 references it cites were found in a registry or an index.
Experimental designs in management and leadership research: Strengths, limitations, and recommendations for improving publishability
Abstract
Despite the renewed interest in the use of experimental designs in the fields of leadership and management over the past few decades, these designs are still relatively underutilized. Although there are several potential reasons for this, chief among them is misunderstanding the value of these designs. The purpose of this article is to review the role of laboratory, field, and quasi-experimental designs in management and leadership research. We first discuss the primary goals of experimental studies. Next, we examine the characteristics of experimental designs and how to distinguish laboratory, field, and quasi-experiments from one another and from non-experimental studies. Following these discussions, we provide examples of each type of experimental design and discuss their relative strengths and limitations. Finally, we discuss steps that researchers can take to increase the probability of having articles reporting experiments accepted by leadership and management journals.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Podsakoff, P. M., MacKenzie, S. B., Lee, J.-Y., & Podsakoff, N. P. (2003) · Journal of Applied Psychology · doi:10.1037/0021-9010.88.5.879 · Cited by 82,194
Self-citationThe central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
A Paradigm for Developing Better Measures of Marketing Constructs
Churchill, G. A. (1979) · Journal of Marketing Research · doi:10.1177/002224377901600110 · Cited by 16,549
Sources of method bias in social science research and recommendations on how to control it
Podsakoff, P. M., MacKenzie, S. B., & Podsakoff, N. P. (2012) · Annual Review of Psychology · doi:10.1146/annurev-psych-120710-100452 · Cited by 15,744
Self-citation(1963) · Medical Entomology and Zoology · Cited by 15,085
The Practice of Social Research
Neustadtl, A., & Babbie, E. (1989) · Teaching Sociology · doi:10.2307/1318433 · Cited by 14,398
(2002) · Cited by 13,211
The Handbook of Social Psychology
Gravatt, A. E., Lindzey, G., & Aronson, F. (1969) · The Family Coordinator · doi:10.2307/582242 · Cited by 12,517
Handbook of Industrial and Organizational Psychology.
Hammer, T. H., Anderson, J., Gurdon, M., Jick, T., Petit, A., Stern, R., Schwartz, H., Vardi, Y., & Dunnette, M. D. (1977) · Administrative Science Quarterly · doi:10.2307/2391755 · Cited by 11,945
(1979) · Medical Entomology and Zoology · Cited by 11,252
Research in Organizational Behavior.
Grimes, A. J., Cummings, L. L., & Staw, B. M. (1986) · Administrative Science Quarterly · doi:10.2307/2392975 · Cited by 10,899
The Practice of Social Research.
Williams, D. G., & Babbie, E. R. (1976) · Contemporary Sociology · doi:10.2307/2062956 · Cited by 7,194
MacKinnon, D. P., Fairchild, A. J., & Fritz, M. S. (2007) · Annual Review of Psychology · doi:10.1146/annurev.psych.58.110405.085542 · Cited by 5,688
Podsakoff, P. M., MacKenzie, S. B., Moorman, R. H., & Fetter, R. (1990) · The Leadership Quarterly · doi:10.1016/1048-9843(90)90009-7 · Cited by 5,628
Self-citationIntroduction to Statistical Mediation Analysis
MacKinnon, D. P. (2012) · doi:10.4324/9780203809556 · Cited by 5,618
Matching Methods for Causal Inference: A Review and a Look Forward
Stuart, E. A. (2010) · Statistical Science · doi:10.1214/09-sts313 · Cited by 5,478
CAUSALITY: MODELS, REASONING AND INFERENCE
Hitchcock, C. (2001) · The Philosophical Review · doi:10.1215/00318108-110-4-639 · Cited by 4,741
(2004) · Choice Reviews Online · doi:10.5860/choice.41-3182 · Cited by 4,690
Causation, Prediction, and Search
Spirtes, P., Glymour, C., & Scheines, R. (1993) · Lecture Notes in Statistics · doi:10.1007/978-1-4612-2748-9 · Cited by 4,617
Kennedy, P. (1979) · Cited by 4,340
Transformational and Transactional Leadership: A Meta-Analytic Test of Their Relative Validity.
Judge, T. A., & Piccolo, R. F. (2004) · Journal of Applied Psychology · doi:10.1037/0021-9010.89.5.755 · Cited by 4,170
Orne, M. T. (1962) · American Psychologist · doi:10.1037/h0043424 · Cited by 4,041
Essentials of Behavioral Research: Methods and Data Analysis
Rosenthal, R., & Rosnow, R. L. (1984) · Cited by 3,925
Personality and leadership: A qualitative and quantitative review
Judge, T. A., Bono, J. E., Ilies, R., & Gerhardt, M. W. (2002) · Journal of Applied Psychology · doi:10.1037/0021-9010.87.4.765 · Cited by 3,190
MacKenzie, S. B., Podsakoff, P. M., & Podsakoff, N. P. (2011) · MIS Quarterly · doi:10.2307/23044045 · Cited by 3,165
Self-citationCausality: models, reasoning, and inference
(2000) · Choice Reviews Online · doi:10.5860/choice.38-1494a · Cited by 2,873
Spencer, S. J., Zanna, M. P., & Fong, G. T. (2005) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.89.6.845 · Cited by 2,452
On making causal claims: A review and recommendations
Antonakis, J., Bendahan, S., Jacquart, P., & Lalive, R. (2010) · The Leadership Quarterly · doi:10.1016/j.leaqua.2010.10.010 · Cited by 2,441
Zhang, X., & Bartol, K. M. (2010) · Academy of Management Journal · doi:10.5465/amj.2010.48037118 · Cited by 2,363
Sears, D. O. (1986) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.51.3.515 · Cited by 2,119
Harrison, G. W., & List, J. A. (2004) · Journal of Economic Literature · doi:10.1257/0022051043004577 · Cited by 2,099
International encyclopedia of the social & behavioral sciences
(2006) · Choice Reviews Online · doi:10.5860/choice.43sup-0452 · Cited by 1,947
IMPACT OF TRANSFORMATIONAL LEADERSHIP ON FOLLOWER DEVELOPMENT AND PERFORMANCE: A FIELD EXPERIMENT.
Dvir, T., Eden, D., Avolio, B. J., & Shamir, B. (2002) · Academy of Management Journal · doi:10.2307/3069307 · Cited by 1,906
Borsboom, D., Mellenbergh, G. J., & van Heerden, J. (2004) · Psychological Review · doi:10.1037/0033-295x.111.4.1061 · Cited by 1,674
Baumeister, R. F., Vohs, K. D., & Funder, D. C. (2007) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2007.00051.x · Cited by 1,629
Kenny, D. A. (1979) · Medical Entomology and Zoology · Cited by 1,376
The Explanation of Social Behaviour.
Ryan, A., Harre, R., & Secord, P. F. (1973) · The Philosophical Quarterly · doi:10.2307/2218075 · Cited by 1,376
DERUE, D. S., NAHRGANG, J. D., WELLMAN, N., & HUMPHREY, S. E. (2011) · Personnel Psychology · doi:10.1111/j.1744-6570.2010.01201.x · Cited by 1,356
van Knippenberg, D., & Sitkin, S. B. (2013) · Academy of Management Annals · doi:10.5465/19416520.2013.759433 · Cited by 1,302
Peterson, R. A. (2001) · Journal of Consumer Research · doi:10.1086/323732 · Cited by 1,258
In defense of external invalidity.
Mook, D. G. (1983) · American Psychologist · doi:10.1037/0003-066x.38.4.379 · Cited by 1,212
From covariation to causation: A causal power theory.
Cheng, P. W. (1997) · Psychological Review · doi:10.1037//0033-295x.104.2.367 · Cited by 1,206
Artifact in behavioral research
Rosenthal, R., & Rosnow, R. L. (1969) · Medical Entomology and Zoology · Cited by 1,186
RESEARCH METHODOLOGY IN MANAGEMENT: CURRENT PRACTICES, TRENDS, AND IMPLICATIONS FOR FUTURE RESEARCH.
Scandura, T. A., & Williams, E. A. (2000) · Academy of Management Journal · doi:10.2307/1556348 · Cited by 1,186
Factors relevant to the validity of experiments in social settings.
Campbell, D. T. (1957) · Psychological Bulletin · doi:10.1037/h0040950 · Cited by 1,140
Cohen, P. (1980) · Evaluation and Program Planning · doi:10.1016/0149-7189(80)90009-9 · Cited by 1,112
Research Design in Social Research
de Vaus, D. (2001) · Medical Entomology and Zoology · Cited by 1,111
Lab Experiments Are a Major Source of Knowledge in the Social Sciences
Falk, A., & Heckman, J. J. (2009) · Science · doi:10.1126/science.1168244 · Cited by 1,033
Returns to Capital in Microenterprises: Evidence from a Field Experiment*
de Mel, S., McKenzie, D., & Woodruff, C. (2008) · Quarterly Journal of Economics · doi:10.1162/qjec.2008.123.4.1329 · Cited by 1,015
EDITOR'S COMMENTS: CONSTRUCT CLARITY IN THEORIES OF MANAGEMENT AND ORGANIZATION.
Suddaby, R. (2010) · Academy of Management Review · doi:10.5465/amr.2010.51141319 · Cited by 984
The SAGE Handbook of Applied Social Research Methods
Bickman, L., & Rog, D. (2009) · Sage eBooks · doi:10.4135/9781483348858 · Cited by 894
Interpretation of Educational Measurements
Freeman, F. S., & Kelley, T. L. (1928) · The American Journal of Psychology · doi:10.2307/1414476 · Cited by 877
Estimating and testing mediation and moderation in within-subject designs.
Judd, C. M., Kenny, D. A., & McClelland, G. H. (2001) · Psychological Methods · doi:10.1037/1082-989x.6.2.115 · Cited by 846
Organizational behavior: the state of the science
(1995) · Choice Reviews Online · doi:10.5860/choice.32-4589 · Cited by 807
Harder, V. S., Stuart, E. A., & Anthony, J. C. (2010) · Psychological Methods · doi:10.1037/a0019623 · Cited by 802
Research design in social research
Tierney, A. J. (2002) · International Journal of Nursing Studies · doi:10.1016/s0020-7489(01)00040-2 · Cited by 774
Checking the Success of Manipulations in Marketing Experiments
Perdue, B. C., & Summers, J. O. (1986) · Journal of Marketing Research · doi:10.1177/002224378602300401 · Cited by 740
Semadeni, M., Withers, M. C., & Trevis Certo, S. (2014) · Strategic Management Journal · doi:10.1002/smj.2136 · Cited by 739
Experimental practices in economics: A methodological challenge for psychologists?
Hertwig, R., & Ortmann, A. (2001) · Behavioral and Brain Sciences · doi:10.1017/s0140525x01004149 · Cited by 733
Generalizing From Laboratory to Field Settings.
Saxton, S. L., & Locke, E. A. (1987) · Contemporary Sociology · doi:10.2307/2069857 · Cited by 732
External validity is more than skin deep: Some answers to criticisms of laboratory experiments.
Berkowitz, L., & Donnerstein, E. (1982) · American Psychologist · doi:10.1037//0003-066x.37.3.245 · Cited by 713
Podsakoff, P. M., MacKenzie, S. B., & Podsakoff, N. P. (2016) · Organizational Research Methods · doi:10.1177/1094428115624965 · Cited by 712
Self-citationComparison of Multivariate Matching Methods: Structures, Distances, and Algorithms
Gu, X. S., & Rosenbaum, P. R. (1993) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.1993.10474623 · Cited by 702
Experimental practices in economics: A challenge for psychologists?: (683322011-032)
Hertwig, R., & Ortmann, A. (2000) · PsycEXTRA Dataset · doi:10.1037/e683322011-032 · Cited by 668
Allen, T. D., & Rush, M. C. (1998) · Journal of Applied Psychology · doi:10.1037//0021-9010.83.2.247 · Cited by 640
Intelligence and leadership: A quantitative review and test of theoretical propositions
Judge, T. A., Colbert, A. E., & Ilies, R. (2004) · Journal of Applied Psychology · doi:10.1037/0021-9010.89.3.542 · Cited by 611
Schaubroeck, J., Lam, S. S. K., & Cha, S. E. (2007) · Journal of Applied Psychology · doi:10.1037/0021-9010.92.4.1020 · Cited by 608
The Explanation of Social Behavior.
Wedow, S., Harre, R., & Secord, P. F. (1973) · Contemporary Sociology · doi:10.2307/2062451 · Cited by 594
A century of work teams in the Journal of Applied Psychology.
Mathieu, J. E., Hollenbeck, J. R., van Knippenberg, D., & Ilgen, D. R. (2017) · Journal of Applied Psychology · doi:10.1037/apl0000128 · Cited by 593
The "Science of the Sophomore" Revisited: From Conjecture to Empiricism
Gordon, M. E., Slade, L. A., & Schmitt, N. (1986) · The Academy of Management Review · doi:10.2307/258340 · Cited by 574
Maynes, T. D., & Podsakoff, P. M. (2014) · Journal of Applied Psychology · doi:10.1037/a0034284 · Cited by 560
Self-citationA laboratory study of charismatic leadership
Howell, J. M., & Frost, P. J. (1989) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(89)90052-6 · Cited by 536
Experimentation in social psychology.
Aronson, E., Wilson, T. D., & Brewer, M. B. (1998) · Cited by 519
Research in the Psychological Laboratory: Truth or Triviality?
Anderson, C. A., Lindsay, J. J., & Bushman, B. J. (1999) · Current Directions in Psychological Science · doi:10.1111/1467-8721.00002 · Cited by 505
On doing better science: From thrill of discovery to policy implications
Antonakis, J. (2017) · The Leadership Quarterly · doi:10.1016/j.leaqua.2017.01.006 · Cited by 475
On the External Validity of Experiments in Consumer Research
Lynch, Jr. (1982) · Journal of Consumer Research · doi:10.1086/208919 · Cited by 469
Research Methods for Organizational Studies
Schwab, D. P. (2013) · Psychology Press eBooks · doi:10.4324/9781410611284 · Cited by 455
Wortman, C. B., Rosenthal, R., & Rosnow, R. L. (1976) · The American Journal of Psychology · doi:10.2307/1421418 · Cited by 430
The dangers of poor construct conceptualization
MacKenzie, S. B. (2003) · Journal of the Academy of Marketing Science · doi:10.1177/0092070303031003011 · Cited by 426
Detert, J. R., Treviño, L. K., Burris, E. R., & Andiappan, M. (2007) · Journal of Applied Psychology · doi:10.1037/0021-9010.92.4.993 · Cited by 417
Martin, S. L., Liao, H., & Campbell, E. M. (2013) · Academy of Management Journal · doi:10.5465/amj.2011.0113 · Cited by 417
Piece Rates, Fixed Wages and Incentives: Evidence from a Field Experiment
Shearer, B. (2004) · The Review of Economic Studies · doi:10.1111/0034-6527.00294 · Cited by 412
Incentives for Managers and Inequality among Workers: Evidence from a Firm-Level Experiment
Bandiera, O., Barankay, I., & Rasul, I. (2007) · The Quarterly Journal of Economics · doi:10.1162/qjec.122.2.729 · Cited by 377
The Oxford Handbook of Evidence-Based Management
(2012) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199763986.001.0001 · Cited by 374
Theory-Testing, Generalization, and the Problem of External Validity
Lucas, J. W. (2003) · Sociological Theory · doi:10.1111/1467-9558.00187 · Cited by 372
Weber, S. J., & Cook, T. D. (1972) · Psychological Bulletin · doi:10.1037/h0032351 · Cited by 369
6. Matching with Multiple Controls to Estimate Treatment Effects in Observational Studies
Smith, H. L. (1997) · Sociological Methodology · doi:10.1111/1467-9531.271030 · Cited by 368
Using the Propensity Score Method to Estimate Causal Effects: A Review and Practical Guide
Li, M. (2013) · Organizational Research Methods · doi:10.1177/1094428112447816 · Cited by 366
A sociological reader on complex organizations
Etzioni, A. (1969) · Cited by 365
Experimentally analyzing the impact of leader positivity on follower positivity and performance
Avey, J. B., Avolio, B. J., & Luthans, F. (2011) · The Leadership Quarterly · doi:10.1016/j.leaqua.2011.02.004 · Cited by 363
Latham, G. P., Erez, M., & Locke, E. A. (1988) · Journal of Applied Psychology · doi:10.1037//0021-9010.73.4.753 · Cited by 363
On doing relevant and rigorous experiments: Review and recommendations
Lonati, S., Quiroga, B. F., Zehnder, C., & Antonakis, J. (2018) · Journal of Operations Management · doi:10.1016/j.jom.2018.10.003 · Cited by 354
Designing experiments that generalize
Highhouse, S. (2009) · Organizational Research Methods · doi:10.1177/1094428107300396 · Cited by 353
The College Sophomore as Guinea Pig: Setting the Record Straight
Greenberg, J. (1987) · The Academy of Management Review · doi:10.2307/258001 · Cited by 350
Revisiting Truth or Triviality: The External Validity of Research in the Psychological Laboratory
Mitchell, G. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691611432343 · Cited by 343
Third parties’ reactions to the abusive supervision of coworkers
Mitchell, M. S., Vogel, R. M., & Folger, R. (2015) · Journal of Applied Psychology · doi:10.1037/apl0000002 · Cited by 337
Principles and Methods of Social Research
Crano, W. D., Brewer, M. B., Lac, A., Crano, W. D., & Brewer, M. B. (2005) · Psychology Press eBooks · doi:10.4324/9781410613134 · Cited by 337
Podsakoff, P. M., & Schriescheim, C. A. (1985) · Psychological Bulletin · doi:10.1037//0033-2909.97.3.387 · Cited by 337
Self-citationMeasuring the mind conceptual issues in contemporary psychometrics
Borsboom, D. (2005) · Cited by 332
Handbook of research methods in industrial and organizational psychology
(2002) · Choice Reviews Online · doi:10.5860/choice.40-1860 · Cited by 328
Leadership and expectations: Pygmalion effects and other self-fulfilling prophecies in organizations
Eden, D. (1992) · The Leadership Quarterly · doi:10.1016/1048-9843(92)90018-b · Cited by 320
Leadership Process Models: A Review and Synthesis
Fischer, T., Dietz, J., & Antonakis, J. (2017) · Journal of Management · doi:10.1177/0149206316682830 · Cited by 308
McNemar, Q. (1946) · Psychological Bulletin · doi:10.1037/h0060985 · Cited by 302
Grant, A. M., & Wall, T. D. (2009) · Organizational Research Methods · doi:10.1177/1094428108320737 · Cited by 284
Kenny, D. A. (2008) · Organizational Research Methods · doi:10.1177/1094428107308978 · Cited by 279
Henry, P. J. (2008) · Psychological Inquiry · doi:10.1080/10478400802049936 · Cited by 272
McCambridge, J., de Bruin, M., & Witton, J. (2012) · PLoS ONE · doi:10.1371/journal.pone.0039116 · Cited by 271
Dipboye, R. L., & Flanagan, M. F. (1979) · American Psychologist · doi:10.1037//0003-066x.34.2.141 · Cited by 259
Compeau, D., Marcolin, B., Kelley, H., & Higgins, C. (2012) · Information Systems Research · doi:10.1287/isre.1120.0423 · Cited by 256
The effects of visionary and crisis-responsive charisma on followers
Hunt, J. G., Boal, K. B., & Dodge, G. E. (1999) · The Leadership Quarterly · doi:10.1016/s1048-9843(99)00027-2 · Cited by 250
5 Demand Characteristics and the Concept of Quasi-Controls
Orne, M. T. (2009) · Artifacts in Behavioral Research · doi:10.1093/acprof:oso/9780195385540.003.0005 · Cited by 247
Applying mixed methods to leadership research: A review of current practices
Stentz, J. E., Clark, V. L. P., & Matkin, G. S. (2012) · The Leadership Quarterly · doi:10.1016/j.leaqua.2012.10.001 · Cited by 241
Demand Artifacts in Laboratory Experiments in Consumer Research
Sawyer, A. G. (1975) · Journal of Consumer Research · doi:10.1086/208604 · Cited by 241
Attention, researchers! It Is time to take a look at the real world
Kingstone, A., Smilek, D., Ristic, J., Kelland Friesen, C., & Eastwood, J. D. (2003) · Current Directions in Psychological Science · doi:10.1111/1467-8721.01255 · Cited by 236
Why Are Abusive Supervisors Abusive? A Dual-system Self-control Model
Liang, L. H., Lian, H., Brown, D. J., Ferris, D. L., Hanig, S., & Keeping, L. M. (2016) · Academy of Management Journal · doi:10.5465/amj.2014.0651 · Cited by 235
Sigall, H., & Mills, J. (1998) · Personality and Social Psychology Review · doi:10.1207/s15327957pspr0203_5 · Cited by 217
Giessner, S. R., van Knippenberg, D., & Sleebos, E. (2009) · The Leadership Quarterly · doi:10.1016/j.leaqua.2009.03.012 · Cited by 215
Camerer, C. F. (2011) · SSRN Electronic Journal · doi:10.2139/ssrn.1977749 · Cited by 210
The human subject in psychological research
Schultz, D. P. (1968) · PsycEXTRA Dataset · doi:10.1037/e515702009-001 · Cited by 209
The Renaissance of Field Experimentation in Evaluating Interventions
Shadish, W. R., & Cook, T. D. (2009) · Annual Review of Psychology · doi:10.1146/annurev.psych.60.110707.163544 · Cited by 208
Cooper, W. H., & Richardson, A. J. (1986) · Journal of Applied Psychology · doi:10.1037//0021-9010.71.2.179 · Cited by 202
A quasi-experimental study of after-event reviews and leadership development.
DeRue, D. S., Nahrgang, J. D., Hollenbeck, J. R., & Workman, K. (2012) · Journal of Applied Psychology · doi:10.1037/a0028244 · Cited by 200
Bandiera, O., Barankay, I., & Rasul, I. (2011) · Journal of Economic Perspectives · doi:10.1257/jep.25.3.63 · Cited by 195
The human subject in psychological research.
Schultz, D. P. (1969) · Psychological Bulletin · doi:10.1037/h0027880 · Cited by 194
Schriesheim, C. A., House, R. J., & Kerr, S. (1976) · Organizational Behavior and Human Performance · doi:10.1016/0030-5073(76)90043-x · Cited by 189
Big‐B versus Big‐O: what is organizational about organizational behavior?*
Heath, C., & Sitkin, S. B. (2001) · Journal of Organizational Behavior · doi:10.1002/job.77 · Cited by 187
Effects of organizational citizenship behaviors on selection decisions in employment interviews.
Podsakoff, N. P., Whiting, S. W., Podsakoff, P. M., & Mishra, P. (2010) · Journal of Applied Psychology · doi:10.1037/a0020948 · Cited by 183
Self-citationDeception in Experiments: Revisiting the Arguments in Its Defense
Hertwig, R., & Ortmann, A. (2008) · Ethics & Behavior · doi:10.1080/10508420701712990 · Cited by 181
The relative impact of complementary leader behaviors: Which matter most?
Piccolo, R. F., Bono, J. E., Heinitz, K., Rowold, J., Duehr, E., & Judge, T. A. (2012) · The Leadership Quarterly · doi:10.1016/j.leaqua.2011.12.008 · Cited by 180
Laboratory Experiments in the Social Sciences
(2014) · Elsevier eBooks · doi:10.1016/c2011-0-07562-2 · Cited by 179
The Costs of Deception: Evidence from Psychology
Ortmann, A., & Hertwig, R. (2002) · Experimental Economics · doi:10.1023/a:1020365204768 · Cited by 171
Quasi-Experimental Research Designs
Thyer, B. A. (2012) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195387384.001.0001 · Cited by 170
Field experiments in strategy research
Chatterji, A. K., Findley, M., Jensen, N. M., Meier, S., & Nielson, D. (2016) · Strategic Management Journal · doi:10.1002/smj.2449 · Cited by 168
Leader corruption depends on power and testosterone
Bendahan, S., Zehnder, C., Pralong, F. P., & Antonakis, J. (2015) · The Leadership Quarterly · doi:10.1016/j.leaqua.2014.07.010 · Cited by 168
In Defense of Experimental Consumer Psychology
Kardes, F. R. (1996) · Journal of Consumer Psychology · doi:10.1207/s15327663jcp0503_04 · Cited by 168
Field Experiments in Organizations
Eden, D. (2017) · Annual Review of Organizational Psychology and Organizational Behavior · doi:10.1146/annurev-orgpsych-041015-062400 · Cited by 167
Evaluating the performance of paper people.
Murphy, K. R., Herr, B. M., Lockhart, M. C., & Maguire, E. (1986) · Journal of Applied Psychology · doi:10.1037/0021-9010.71.4.654 · Cited by 166
From the Editors Publishing Laboratory Research in AMJ: A Question of When, Not If
Colquitt, J. A. (2008) · Academy of Management Journal · doi:10.5465/amr.2008.33664717 · Cited by 165
Evidence-Based Management: Foundations, Development, Controversies and Future
Rynes, S. L., & Bartunek, J. M. (2017) · Annual Review of Organizational Psychology and Organizational Behavior · doi:10.1146/annurev-orgpsych-032516-113306 · Cited by 154
Using Propensity Scores in Quasi-Experimental Designs
Holmes, W. M. (2014) · SAGE Publications Ltd eBooks · doi:10.4135/9781452270098 · Cited by 152
Dobbins, G. H., Lane, I. M., & Steiner, D. D. (1988) · Journal of Organizational Behavior · doi:10.1002/job.4030090308 · Cited by 152
Handbook of Experimental Economic Methodology
Harrison, G., Lau, M. I., & Rutström, E. E. (2015) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195328325.001.0001 · Cited by 149
Student Guinea Pigs: Porcine Predictors and Particularistic Phenomena
Gordon, M. E., Slade, L. A., & Schmitt, N. (1987) · Academy of Management Review · doi:10.5465/amr.1987.4306524 · Cited by 141
A field experiment testing frontline opinion leaders as change agents.
Lam, S. S. K., & Schaubroeck, J. M. (2000) · Journal of Applied Psychology · doi:10.1037/0021-9010.85.6.987 · Cited by 140
DIFFERENCES IN FACTOR STRUCTURE ACROSS THREE VERSIONS OF THE OHIO STATE LEADERSHIP SCALES1
Schriesheim, C. A., & Stogdill, R. M. (1975) · Personnel Psychology · doi:10.1111/j.1744-6570.1975.tb01380.x · Cited by 139
A Critical Appraisal of Demand Artifacts in Consumer Research
Shimp, T. A., Hyatt, E. M., & Snyder, D. J. (1991) · Journal of Consumer Research · doi:10.1086/209259 · Cited by 131
The unmeasured variables problem in path analysis.
James, L. R. (1980) · Journal of Applied Psychology · doi:10.1037/0021-9010.65.4.415 · Cited by 130
The Human Subject in the Psychology Experiment: Fact and Artifact
Kruglanski, A. W. (1975) · Advances in experimental social psychology · doi:10.1016/s0065-2601(08)60249-x · Cited by 128
From the Editors: Experimental designs in international business research
Zellmer-Bruhn, M. E., Caligiuri, P., & Thomas, D. C. (2016) · Journal of International Business Studies · doi:10.1057/jibs.2016.12 · Cited by 128
To deceive or not to deceive: The effect of deception on behavior in future laboratory experiments
Jamison, J., Karlan, D., & Schechter, L. (2008) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2008.09.002 · Cited by 126
External validity and the use of real people as subjects.
Oakes, W. F. (1972) · American Psychologist · doi:10.1037/h0033454 · Cited by 122
The utility of experimental research in the study of transformational/charismatic leadership
Brown, D. J., & Lord, R. G. (1999) · The Leadership Quarterly · doi:10.1016/s1048-9843(99)00029-6 · Cited by 122
The purposes of laboratory experimentation and the virtues of deliberate artificiality
Henshel, R. L. (1980) · Journal of Experimental Social Psychology · doi:10.1016/0022-1031(80)90052-9 · Cited by 121
Podsakoff, N. P., Podsakoff, P. M., MACKENZIE, S. B., & Klinger, R. L. (2012) · Journal of Applied Psychology · doi:10.1037/a0029570 · Cited by 121
Self-citationDóci, E., & Hofmans, J. (2015) · The Leadership Quarterly · doi:10.1016/j.leaqua.2015.02.008 · Cited by 116
Covert communication in the psychological experiment
Rosenthal, R. (1968) · PsycEXTRA Dataset · doi:10.1037/e535742008-002 · Cited by 114
Covert communication in the psychological experiment.
Rosenthal, R. (1967) · Psychological Bulletin · doi:10.1037/h0024529 · Cited by 112
Research methods in the social and behavioral sciences
Jones, R. A. (1985) · Medical Entomology and Zoology · Cited by 107
Construct Clarity in Theories of Management and Organization
Yaniv, E. (2011) · Academy of Management Review · doi:10.5465/amr.2010.0481 · Cited by 104
Laboratory Research: A Question of When, Not If.
Ilgen, D. R. (1985) · Defense Technical Information Center (DTIC) · Cited by 98
Envisioning Evidence-Based Management
Rousseau, D. M. (2012) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199763986.013.0001 · Cited by 96
Grant, A. M., & Hofmann, D. A. (2011) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2011.06.005 · Cited by 93
CAN GOOD CITIZENS LEAD THE WAY IN PROVIDING QUALITY SERVICE? A FIELD QUASI EXPERIMENT.
Hui, C., Lam, S. S. K., & Schaubroeck, J. M. (2001) · Academy of Management Journal · doi:10.2307/3069442 · Cited by 87
Manipulation checks: Advantage or disadvantage?
Kidd, R. F. (1976) · Cited by 84
Schwenk, C. R. (1982) · Strategic Management Journal · doi:10.1002/smj.4250030304 · Cited by 82
Situated Experiments in Organizations: Transplanting the Lab to the Field
Greenberg, J., & Tomlinson, E. C. (2004) · Journal of Management · doi:10.1016/j.jm.2003.11.001 · Cited by 72
Innovation with field experiments: Studying organizational behaviors in actual organizations
Hauser, O., Linos, E., & Rogers, T. (2017) · Research in Organizational Behavior · doi:10.1016/j.riob.2017.10.004 · Cited by 70
Goal setting in teams: The impact of learning and performance goals on process and performance
Nahrgang, J. D., DeRue, D. S., Hollenbeck, J. R., Spitzmüller, M., Jundt, D. K., & Ilgen, D. R. (2013) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2013.03.008 · Cited by 69
Trends in Research Design and Data Analytic Strategies in Organizational Research
Stone‐Romero, E. F., Weaver, A. E., & Glenar, J. L. (1995) · Journal of Management · doi:10.1016/0149-2063(95)90039-x · Cited by 68
Li, N., Zheng, X., Harris, T. B., Liu, X., & Kirkman, B. L. (2016) · Journal of Applied Psychology · doi:10.1037/apl0000101 · Cited by 67
Through the one-way mirror: The limits of experimental self-reflection.
Gadlin, H., & Ingle, G. M. (1975) · American Psychologist · doi:10.1037/0003-066x.30.10.1003 · Cited by 64
Austin, J. T., Scherbaum, C. A., & Mahlman, R. A. (2004) · Wiley eBooks · doi:10.1002/9780470756669.ch1 · Cited by 62
The Relative Validity and Usefulness of Various Empirical Research Designs
Stone‐Romero, E. F. (2004) · Wiley eBooks · doi:10.1002/9780470756669.ch4 · Cited by 61
Toward Experimental International Business: Unraveling fundamental causal linkages
van Witteloostuijn, A. C. (2015) · Cross Cultural Management An International Journal · doi:10.1108/ccm-06-2015-0075 · Cited by 60
Research design options for testing mediation models and their implications for facets of validity
Stone‐Romero, E. F., & Rosopa, P. J. (2010) · Journal of Managerial Psychology · doi:10.1108/02683941011075256 · Cited by 57
Shadish, W. R. (2011) · Research on Social Work Practice · doi:10.1177/1049731511403324 · Cited by 55
Unfulfilled Promise: Laboratory experiments in public management research
Anderson, D. M., & Edwards, B. (2014) · Public Management Review · doi:10.1080/14719037.2014.943272 · Cited by 55
Evaluating the College Sophomore Problem: The Case of Personality and Politics
Cooper, C. A., McCord, D., & Socha, A. (2010) · The Journal of Psychology · doi:10.1080/00223980.2010.528074 · Cited by 54
Bauman, C. W., Tost, L. P., & Ong, M. (2016) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2016.08.006 · Cited by 51
Regression Discontinuity Design
Cappelleri, J. C., & Trochim, W. M. K. (2015) · Elsevier eBooks · doi:10.1016/b978-0-08-097086-8.44049-3 · Cited by 50
Laboratory research in management: Misconceptions and missed opportunities
Griffin, R. W., & Kacmar, K. M. (1991) · Journal of Organizational Behavior · doi:10.1002/job.4030120405 · Cited by 50
Johnson, M. D., Hollenbeck, J. R., DeRue, D. S., Barnes, C. M., & Jundt, D. K. (2013) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2013.03.006 · Cited by 49
Self-Fulfilling Prophecies in Organizations
Stroh, L. K., Northcraft, G. B., Neale, M. A., Kern, (.-A. M., Langlands, (.-A. C., & Greenberg, J. (2003) · Psychology Press eBooks · doi:10.4324/9781410607379-10 · Cited by 49
Laboratory research on charismatic leadership
Wofford, J. C. (1999) · The Leadership Quarterly · doi:10.1016/s1048-9843(99)00028-4 · Cited by 48
Vanhove, A. J., & Harms, P. D. (2015) · Applied Psychology · doi:10.1111/apps.12046 · Cited by 46
Webster, M., & Sell, J. A. (2014) · Elsevier eBooks · doi:10.1016/b978-0-12-404681-8.00001-7 · Cited by 38
Dying for charisma: Leaders' inspirational appeal increases post-mortem
Steffens, N. K., Peters, K., Haslam, S. A., & van Dick, R. (2016) · The Leadership Quarterly · doi:10.1016/j.leaqua.2016.09.001 · Cited by 36
Implications of representativeness for generalizability of field and laboratory research findings.
Bass, A. R., & Firestone, I. J. (1980) · American Psychologist · doi:10.1037/0003-066x.35.5.463 · Cited by 35
Balancing Treatment and Control Groups in Quasi‐Experiments: An Introduction to Propensity Scoring
Connelly, B. S., Sackett, P. R., & Waters, S. D. (2012) · Personnel Psychology · doi:10.1111/peps.12020 · Cited by 34
Synthesizing results of multiple randomized experiments to establish causality in mediation testing
Eden, D., Stone‐Romero, E. F., & Rothstein, H. R. (2015) · Human Resource Management Review · doi:10.1016/j.hrmr.2015.02.001 · Cited by 30
The probability approach and nomothetic theory.
Postman, L. J. (1955) · Psychological Review · doi:10.1037/h0046284 · Cited by 24
Finding New Kinds of Needles in Haystacks: Experimentation in the Course of Abduction
Mueller, J. (2018) · Academy of Management Discoveries · doi:10.5465/amd.2018.0081 · Cited by 15
On the virtues of laboratory babies and student bath water: A reply to Dobbins, Lane, and Steiner
Slade, L. A., & Gordon, M. E. (1988) · Journal of Organizational Behavior · doi:10.1002/job.4030090409 · Cited by 12
Cited by
Hill, A. D., Johnson, S. G., Greco, L. M., O’Boyle, E. H., & Walter, S. L. (2021) · Journal of Management · doi:10.1177/0149206320960533 · Cited by 762
On doing relevant and rigorous experiments: Review and recommendations
Lonati, S., Quiroga, B. F., Zehnder, C., & Antonakis, J. (2018) · Journal of Operations Management · doi:10.1016/j.jom.2018.10.003 · Cited by 354
Cooper, B., Eva, N., Zarea Fazlelahi, F., Newman, A., Lee, A., & Obschonka, M. (2020) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2020.103472 · Cited by 339
Abusive supervision: A systematic review and fundamental rethink
Fischer, T., Tian, A. W., Lee, A., & Hughes, D. J. (2021) · The Leadership Quarterly · doi:10.1016/j.leaqua.2021.101540 · Cited by 318
Steffens, N. K., Munt, K. A., van Knippenberg, D., Platow, M. J., & Haslam, S. A. (2021) · Organizational Psychology Review · doi:10.1177/2041386620962569 · Cited by 267
Metadata
- Authors
- Podsakoff, P. M., & Podsakoff, N. P.
- Venue
- The Leadership Quarterly
- Publisher
- Elsevier BV
- Published
- 2019-02
- Volume
- 30
- Issue
- 1
- Pages
- 11-33
- ISSN
- 1048-9843 (ISSN-L)
- OpenAlex
- W2901476464
- Cited by
- 312
- References
- 193
- FWCI
- 14.19
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.