The DOI matches its Crossref record; 176 of the 176 references it cites were found in a registry or an index.
What You See Is What You Get? Enhancing Methodological Transparency in Management Research
Abstract
We review the literature on evidence-based best practices on how to enhance methodological transparency, which is the degree of detail and disclosure about the specific steps, decisions, and judgment calls made during a scientific study. We conceptualize lack of transparency as a “research performance problem” because it masks fraudulent acts, serious errors, and questionable research practices, and therefore precludes inferential and results reproducibility. Our recommendations for authors provide guidance on how to increase transparency at each stage of the research process: (1) theory, (2) design, (3) measurement, (4) analysis, and (5) reporting of results. We also offer recommendations for journal editors, reviewers, and publishers on how to motivate authors to be more transparent. We group these recommendations into the following categories: (1) manuscript submission forms requiring authors to certify they have taken actions to enhance transparency, (2) manuscript evaluation forms including additional items to encourage reviewers to assess the degree of transparency, and (3) review process improvements to enhance transparency. Taken together, our recommendations provide a resource for doctoral education and training; researchers conducting empirical studies; journal editors and reviewers evaluating submissions; and journals, publishers, and professional organizations interested in enhancing the credibility and trustworthiness of research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
5 retracted
Walumbwa, F. O., Luthans, F., Avey, J. B., & Oke, A. (2011) · Journal of Organizational Behavior · doi:10.1002/job.653 · Cited by 421
RetractedThe magic spell of language: Linguistic categories and their perceptual consequences.
Stapel, D. A., & Semin, G. R. (2007) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.93.1.23 · Cited by 74
RetractedRETRACTED: Externally commercializing technology assets: An examination of different process stages
Lichtenthaler, U. (2007) · Journal of Business Venturing · doi:10.1016/j.jbusvent.2007.06.002 · Cited by 71
RetractedHunton, J. E., & Rose, J. M. (2010) · Journal of Management Studies · doi:10.1111/j.1467-6486.2010.00934.x · Cited by 38
RetractedMin, J., & Mitsuhashi, H. (2011) · Journal of Management Studies · doi:10.1111/j.1467-6486.2011.01035.x · Cited by 30
RetractedStatistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Podsakoff, P. M., MacKenzie, S. B., Lee, J.-Y., & Podsakoff, N. P. (2003) · Journal of Applied Psychology · doi:10.1037/0021-9010.88.5.879 · Cited by 82,194
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Theory Building From Cases: Opportunities And Challenges
Eisenhardt, K. M., & Graebner, M. E. (2007) · Academy of Management Journal · doi:10.5465/amj.2007.24160888 · Cited by 16,670
Missing data: our view of the state of the art
Schafer, J. L., & Graham, J. W. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.2.147 · Cited by 11,638
Research in Organizational Behavior.
Grimes, A. J., Cummings, L. L., & Staw, B. M. (1986) · Administrative Science Quarterly · doi:10.2307/2392975 · Cited by 10,899
(1964) · Medical Entomology and Zoology · Cited by 10,439
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Principles and practice in reporting structural equation analyses.
McDonald, R. P., & Ho, M.-H. R. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.1.64 · Cited by 4,734
Answers to 20 questions about interrater reliability and interrater agreement
LeBreton, J. M., & Senter, J. L. (2008) · Organizational Research Methods · doi:10.1177/1094428106296642 · Cited by 3,608 · cited 1×
“…in the first place by making clear that the data usedwere part of a larger dataset (Min & Mitsuhashi, 2012), providing information regarding decisions to include certain variables (Lichtenthaler, 2008), and being explicit about the levels of inquiry and analysis (e.g., Walumbwa et al., 2011).”
BackgroundSurvey response rate levels and trends in organizational research
Baruch, Y., & Holtom, B. C. (2008) · Human Relations · doi:10.1177/0018726708094863 · Cited by 3,462
From the Editors: Common method variance in international business research
Chang, S.-J., van Witteloostuijn, A., & Eden, L. (2010) · Journal of International Business Studies · doi:10.1057/jibs.2009.88 · Cited by 3,352
Chan, D. K. (1998) · Journal of Applied Psychology · doi:10.1037//0021-9010.83.2.234 · Cited by 2,972
On making causal claims: A review and recommendations
Antonakis, J., Bendahan, S., Jacquart, P., & Lalive, R. (2010) · The Leadership Quarterly · doi:10.1016/j.leaqua.2010.10.010 · Cited by 2,441
Haans, R. F. J., Pieters, C., & He, Z. (2016) · Strategic Management Journal · doi:10.1002/smj.2399 · Cited by 2,417
What Reviewers Should Expect from Authors Regarding Common Method Bias in Organizational Research
Conway, J. M., & Lance, C. E. (2010) · Journal of Business and Psychology · doi:10.1007/s10869-010-9181-6 · Cited by 2,392
Hair, J. F., Sarstedt, M., Pieper, T. M., & Ringle, C. M. (2012) · Long Range Planning · doi:10.1016/j.lrp.2012.09.008 · Cited by 2,354
Reporting practices in confirmatory factor analysis: an overview and some recommendations
Jackson, D. L., Gillaspy, J. A., & Purc-Stephenson, R. (2009) · Psychological Methods · doi:10.1037/a0014694 · Cited by 2,242
Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling
John, L. K., Loewenstein, G., & Prelec, D. (2012) · Psychological Science · doi:10.1177/0956797611430953 · Cited by 2,239
Becker, T. E. (2005) · Organizational Research Methods · doi:10.1177/1094428105278021 · Cited by 2,219
Amabile, T. M., Barsade, S. G., Mueller, J. S., & Staw, B. M. (2005) · Administrative Science Quarterly · doi:10.2189/asqu.2005.50.3.367 · Cited by 2,208
What passes as a rigorous case study?
Gibbert, M., Ruigrok, W., & Wicki, B. (2008) · Strategic Management Journal · doi:10.1002/smj.722 · Cited by 1,929
On the nature and direction of relationships between constructs and measures.
Edwards, J. R., & Bagozzi, R. P. (2000) · Psychological Methods · doi:10.1037//1082-989x.5.2.155 · Cited by 1,745
A Critical Review and Best‐Practice Recommendations for Control Variable Usage
Bernerth, J. B., & Aguinis, H. (2016) · Personnel Psychology · doi:10.1111/peps.12103 · Cited by 1,731 · cited 7×
“In addition, some authors may include control variables simply because they suspect that reviewers and editors expect such practice (Bernerth & Aguinis, 2016).”
BackgroundInfluentialSelf-citationOn the folly of rewarding A, while hoping for B
Kerr, S. (1975) · Academy of Management Journal · doi:10.2307/255378 · Cited by 1,585
Qualitative Research and the Academy of Management Journal
Gephart, R. P. (2004) · Academy of Management Journal · doi:10.5465/amj.2004.14438580 · Cited by 1,520
The use of logit and probit models in strategic management research: Critical issues
Hoetker, G. (2007) · Strategic Management Journal · doi:10.1002/smj.582 · Cited by 1,519
Longitudinal Research: The Theory, Design, and Analysis of Change
Ployhart, R. E., & Vandenberg, R. J. (2010) · Journal of Management · doi:10.1177/0149206309352110 · Cited by 1,496
From Micro to Meso: Critical Steps in Conceptualizing and Conducting Multilevel Research
Klein, K. J., & Kozlowski, S. W. J. (2000) · Organizational Research Methods · doi:10.1177/109442810033001 · Cited by 1,471
The Social Processes of Organizational Sensemaking
Maitlis, S. (2005) · Academy of Management Journal · doi:10.5465/amj.2005.15993111 · Cited by 1,451
Best-practice recommendations for defining, identifying, and handling outliers
Aguinis, H., Gottfredson, R. K., & Joo, H. (2013) · Organizational Research Methods · doi:10.1177/1094428112470848 · Cited by 1,341
Self-citationAken, J. E. V. (2004) · Journal of Management Studies · doi:10.1111/j.1467-6486.2004.00430.x · Cited by 1,303
Nosek (2012) · doi:10.1177/1745691612459058 · Cited by 1,301
What does research reproducibility mean?
Goodman, S. N., Fanelli, D., & Ioannidis, J. P. A. (2016) · Science Translational Medicine · doi:10.1126/scitranslmed.aaf5027 · Cited by 1,293
Aguinis, H., Beaty, J. C., Boik, R. J., & Pierce, C. A. (2005) · Journal of Applied Psychology · doi:10.1037/0021-9010.90.1.94 · Cited by 1,216
Self-citationRESEARCH METHODOLOGY IN MANAGEMENT: CURRENT PRACTICES, TRENDS, AND IMPLICATIONS FOR FUTURE RESEARCH.
Scandura, T. A., & Williams, E. A. (2000) · Academy of Management Journal · doi:10.2307/1556348 · Cited by 1,186
Field, A. P., & Gillett, R. (2010) · British Journal of Mathematical and Statistical Psychology · doi:10.1348/000711010x502733 · Cited by 1,162
Building Theoretical and Empirical Bridges Across Levels: Multilevel Research in Management
Hitt, M. A., Beamish, P. W., Jackson, S. E., & Mathieu, J. E. (2007) · Academy of Management Journal · doi:10.5465/amj.2007.28166219 · Cited by 1,133
Entrepreneurship Theory and Practice
(1991) · Entrepreneurship Theory and Practice · doi:10.1177/104225879101500307 · Cited by 1,132
Null hypothesis significance testing: a review of an old and continuing controversy
Nickerson, R. S. (2000) · Psychological Methods · doi:10.1037/1082-989x.5.2.241 · Cited by 1,090
Clarifying conditions and decision points for mediational type inferences in Organizational Behavior
Mathieu, J. E., & Taylor, S. R. (2006) · Journal of Organizational Behavior · doi:10.1002/job.406 · Cited by 961
Blumberg, M., & Pringle, C. D. (1982) · The Academy of Management Review · doi:10.2307/257222 · Cited by 949
A Review and Evaluation of Exploratory Factor Analysis Practices in Organizational Research
Conway, J. M., & Huffcutt, A. I. (2003) · Organizational Research Methods · doi:10.1177/1094428103251541 · Cited by 938
12 Structural Equation Modeling in Management Research: A Guide for Improved Analysis
Williams, L. J., Vandenberg, R. J., & Edwards, J. R. (2009) · Academy of Management Annals · doi:10.1080/19416520903065683 · Cited by 900
The Field of Management's Devotion to Theory: Too Much of a Good Thing?
Hambrick, D. C. (2007) · Academy of Management Journal · doi:10.5465/amj.2007.28166119 · Cited by 877
Aken, V. J. J., & Joan, E. (2004) · SSRN Electronic Journal · Cited by 866
(2015) · Uptime · doi:10.1201/b18778-13 · Cited by 805
The rules of the game called psychological science
Bakker, M., van Dijk, A., & Wicherts, J. M. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612459060 · Cited by 800 · cited 3×
“Consequently, other researchers are unable to reach similar conclusions due to insufficient information (i.e., low transparency) of what happened in what we label the “research kitchen” (e.g., Bakker et al., 2012; Bergh et al., 2017a, 2017b; Cortina et al. 2017b).”
BackgroundWicherts, J. M., Veldkamp, C. L. S., Augusteijn, H. E. M., Bakker, M., van Aert, R. C. M., & van Assen, M. A. L. M. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.01832 · Cited by 754
Kidwell, M. C., Lazarević, L. B., Baranski, E., Hardwicke, T. E., Piechowski, S., Falkenberg, L.-S., Kennett, C., Slowik, A., Sonnleitner, C., Hess-Holden, C., et al. (2016) · PLOS Biology · doi:10.1371/journal.pbio.1002456 · Cited by 700
Qualitative Research in Management: A Decade of Progress
Bluhm, D. J., Harman, W., Lee, T. W., & Mitchell, T. R. (2011) · Journal of Management Studies · doi:10.1111/j.1467-6486.2010.00972.x · Cited by 601
Cautionary note on reporting eta-squared values from multifactor ANOVA designs.
Pierce, C. A., Block, R. A., & Aguinis, H. (2004) · Educational and Psychological Measurement · doi:10.1177/0013164404264848 · Cited by 584
Self-citationA review of research methods in IO/OB work-family research.
Casper, W. J., Eby, L. T., Bordeaux, C., Lockwood, A., & Lambert, D. (2007) · Journal of Applied Psychology · doi:10.1037/0021-9010.92.1.28 · Cited by 558
(2010) · British Journal of Management · doi:10.1111/(issn)1467-8551 · Cited by 549
A Review and Evaluation of Meta-Analysis Practices in Management Research
Geyskens, I., Krishnan, R., Steenkamp, J.-B. E. M., & Cunha, P. V. (2009) · Journal of Management · doi:10.1177/0149206308328501 · Cited by 536
Modularity, strategic flexibility, and firm performance: a study of the home appliance industry
Worren, N., Moore, K., & Cardona, P. (2002) · Strategic Management Journal · doi:10.1002/smj.276 · Cited by 528
Using Theory Elaboration to Make Theoretical Advancements
Fisher, G., & Aguinis, H. (2017) · Organizational Research Methods · doi:10.1177/1094428116689707 · Cited by 517
Self-citationThe prevalence of statistical reporting errors in psychology (1985–2013)
Nuijten, M. B., Hartgerink, C. H. J., van Assen, M. A. L. M., Epskamp, S., & Wicherts, J. M. (2016) · Behavior Research Methods · doi:10.3758/s13428-015-0664-2 · Cited by 510
The ‘‘what’’and ‘‘how’’of case study rigor: three strategies based on published work
Gibbert, M., & Ruigrok, W. (2010) · Organizational Research Methods · doi:10.1177/1094428109351319 · Cited by 506
Leadership and levels of analysis: A state-of-the-science review
Yammarino, F. J., Dionne, S. D., Uk Chun, J., & Dansereau, F. (2005) · The Leadership Quarterly · doi:10.1016/j.leaqua.2005.09.002 · Cited by 501
The Coming of Age for Qualitative Research: Embracing the Diversity of Qualitative Methods
Bansal, P. (., & Corley, K. (2011) · Academy of Management Journal · doi:10.5465/amj.2011.60262792 · Cited by 486
Use of Structure Coefficients in Published Multiple Regression Articles: Β Is Not Enough
Courville, T., & Thompson, B. (2001) · Educational and Psychological Measurement · doi:10.1177/00131640121971211 · Cited by 459
Issues of Research Design and Construct Measurement in Entrepreneurship Research: The past Decade
Chandler, G. N., & Lyon, D. W. (2001) · Entrepreneurship Theory and Practice · doi:10.1177/104225870102500407 · Cited by 435
Wicherts, J. M., Bakker, M., & Molenaar, D. (2011) · PLoS ONE · doi:10.1371/journal.pone.0026828 · Cited by 424
Consequences of Differentiated Leadership in Groups
Wu, J. B., Tsui, A. S., & Kinicki, A. J. (2010) · Academy of Management Journal · doi:10.5465/amj.2010.48037079 · Cited by 375
The (mis)reporting of statistical results in psychology journals
Bakker, M., & Wicherts, J. M. (2011) · Behavior Research Methods · doi:10.3758/s13428-011-0089-5 · Cited by 356
Bergh, D. D., Aguinis, H., Heavey, C., Ketchen, D. J., Boyd, B. K., Su, P., Lau, C. L. L., & Joo, H. (2016) · Strategic Management Journal · doi:10.1002/smj.2338 · Cited by 355
Self-citationConstruct measurement in strategic management research: illusion or reality?
Boyd, B. K., Gove, S., & Hitt, M. A. (2005) · Strategic Management Journal · doi:10.1002/smj.444 · Cited by 343
Publishing in AMJ—Part 2: Research Design
Bono, J. E., & McNamara, G. (2011) · Academy of Management Journal · doi:10.5465/amj.2011.64869103 · Cited by 310
Journal of Business and Psychology
(2013) · Journal of Business and Psychology · doi:10.1007/10869.1573-353x · Cited by 310
The analysis of repeated measures designs: A review
Keselman, H. J., Algina, J., & Kowalchuk, R. K. (2001) · British Journal of Mathematical and Statistical Psychology · doi:10.1348/000711001159357 · Cited by 306
Star Performers in Twenty‐First Century Organizations
Aguinis, H., & O'Boyle, E. (2014) · Personnel Psychology · doi:10.1111/peps.12054 · Cited by 305
Self-citationAn Ounce of Prevention Is Worth a Pound of Cure: Improving Research Quality Before Data Collection
Aguinis, H., & Vandenberg, R. J. (2014) · Annual Review of Organizational Psychology and Organizational Behavior · doi:10.1146/annurev-orgpsych-031413-091231 · Cited by 304
Self-citationTest of a model linking employee positive moods and task performance.
Tsai, W.-C., Chen, C.-C., & Liu, H.-L. (2007) · Journal of Applied Psychology · doi:10.1037/0021-9010.92.6.1570 · Cited by 303
What Is Method Variance and How Can We Cope With It? A Panel Discussion
Brannick, M. T., Chan, D., Conway, J. M., Lance, C. E., & Spector, P. E. (2010) · Organizational Research Methods · doi:10.1177/1094428109360993 · Cited by 296
The Etiology of the Multilevel Paradigm in Management Research
Mathieu, J. E., & Chen, G. (2011) · Journal of Management · doi:10.1177/0149206310364663 · Cited by 293
THE BEST AND THE REST: REVISITING THE NORM OF NORMALITY OF INDIVIDUAL PERFORMANCE
O’BOYLE JR., E., & AGUINIS, H. (2012) · Personnel Psychology · doi:10.1111/j.1744-6570.2011.01239.x · Cited by 275
Self-citationThe Industrial-Organizational Psychologist: (578882011-001)
(2009) · PsycEXTRA Dataset · doi:10.1037/e578882011-001 · Cited by 274
Methodological Wishes for the Next Decade and How to Make Wishes Come True
Aguinis, H., & Edwards, J. R. (2014) · Journal of Management Studies · doi:10.1111/joms.12058 · Cited by 267
Self-citationReliability Methods: A Note on the Frequency of Use of Various Types
Hogan, T. P., Benjamin, A., & Brezinski, K. L. (2000) · Educational and Psychological Measurement · doi:10.1177/00131640021970691 · Cited by 258
Data analytic methods for the analysis of multilevel questions
Castro, S. L. (2002) · The Leadership Quarterly · doi:10.1016/s1048-9843(01)00105-9 · Cited by 250
Scholarly Impact: A Pluralist Conceptualization
Aguinis, H., Shapiro, D. L., Antonacopoulou, E. P., & Cummings, T. G. (2014) · Academy of Management Learning & Education · doi:10.5465/amle.2014.0121 · Cited by 249
Self-citationSelf-Reported Limitations and Future Directions in Scholarly Reports: Analysis and Recommendations
Brutus, S., Aguinis, H., & Wassmer, U. (2013) · Journal of Management · doi:10.1177/0149206312455245 · Cited by 248
Self-citationGerber, A. S., & Malhotra, N. (2008) · Sociological Methods & Research · doi:10.1177/0049124108318973 · Cited by 246
The Chrysalis Effect: How Ugly Initial Results Metamorphosize Into Beautiful Articles
O’Boyle, E. H., Banks, G. C., & Gonzalez-Mulé, E. (2017) · Journal of Management · doi:10.1177/0149206314527133 · Cited by 246
Aguinis, H., Werner, S., Lanza Abbott, J., Angert, C., Park, J. H., & Kohlhausen, D. (2010) · Organizational Research Methods · doi:10.1177/1094428109333339 · Cited by 238
Self-citationWalking New Avenues in Management Research Methods and Theories: Bridging Micro and Macro Domains
Aguinis, H., Boyd, B. K., Pierce, C. A., & Short, J. C. (2011) · Journal of Management · doi:10.1177/0149206310382456 · Cited by 236
Self-citationEdwards, J. R., & Berry, J. W. (2010) · Organizational Research Methods · doi:10.1177/1094428110380467 · Cited by 226
Bettis, R. A., Ethiraj, S., Gambardella, A., Helfat, C., & Mitchell, W. (2016) · Strategic Management Journal · doi:10.1002/smj.2477 · Cited by 225
Management Science on the Credibility Bubble: Cardinal Sins and Various Misdemeanors.
BEDEIAN, A. G., TAYLOR, S. G., & MILLER, A. N. (2010) · Academy of Management Learning & Education · doi:10.5465/amle.2010.56659889 · Cited by 223
Harking, Sharking, and Tharking: Making the Case for Post Hoc Analysis of Scientific Data
Hollenbeck, J. R., & Wright, P. M. (2017) · Journal of Management · doi:10.1177/0149206316679487 · Cited by 220
Fan, X., & Thompson, B. (2001) · Educational and Psychological Measurement · doi:10.1177/0013164401614001 · Cited by 218
Network Theory of Organization: A Multilevel Approach
Moliterno, T. P., & Mahony, D. M. (2011) · Journal of Management · doi:10.1177/0149206310371692 · Cited by 214
Cuervo-Cazurra, A., Andersson, U., Brannen, M. Y., Nielsen, B. B., & Rebecca Reuber, A. (2016) · Journal of International Business Studies · doi:10.1057/s41267-016-0005-4 · Cited by 212
Aguinis, H., Pierce, C. A., Bosco, F. A., & Muslin, I. S. (2009) · Organizational Research Methods · doi:10.1177/1094428108322641 · Cited by 198
Self-citationBest‐practice recommendations for estimating interaction effects using meta‐analysis
Aguinis, H., Gottfredson, R. K., & Wright, T. A. (2011) · Journal of Organizational Behavior · doi:10.1002/job.719 · Cited by 198
Self-citationPower law distributions in entrepreneurship: Implications for theory and research
Crawford, G. C., Aguinis, H., Lichtenstein, B., Davidsson, P., & McKelvey, B. (2015) · Journal of Business Venturing · doi:10.1016/j.jbusvent.2015.01.001 · Cited by 195
Self-citationVan Iddekinge, C. H., Aguinis, H., Mackey, J. D., & DeOrtentiis, P. S. (2018) · Journal of Management · doi:10.1177/0149206317702220 · Cited by 195
Self-citationAiken, L. S., West, S. G., & Millsap, R. E. (2008) · American Psychologist · doi:10.1037/0003-066x.63.1.32 · Cited by 187
Bridging Scholarship in Management: Epistemological Reflections
Aram, J. D., & Salipante, P. F. (2003) · British Journal of Management · doi:10.1111/1467-8551.00374 · Cited by 187
Educational and psychological measurement
(1982) · Serials Review · doi:10.1016/0098-7913(82)90053-3 · Cited by 186
To prosper, organizational psychology should … overcome methodological barriers to progress
Edwards, J. R. (2008) · Journal of Organizational Behavior · doi:10.1002/job.529 · Cited by 185
Theory Pruning: Strategies to Reduce Our Dense Theoretical Landscape
Leavitt, K., Mitchell, T. R., & Peterson, J. (2010) · Organizational Research Methods · doi:10.1177/1094428109345156 · Cited by 185
Bergh, D. D., Sharp, B. M., Aguinis, H., & Li, M. (2017) · Strategic Organization · doi:10.1177/1476127017701076 · Cited by 182
Self-citationEditorial Essay: What Is Organizational Research For?
Davis, G. F. (2015) · Administrative Science Quarterly · doi:10.1177/0001839215585725 · Cited by 181
Replication Standards for Quantitative Social Science: Why Not Sociology?
Freese, J. (2007) · Sociological Methods & Research · doi:10.1177/0049124107306659 · Cited by 177
The search for asterisks: Compromised statistical tests and flawed theories
Bettis, R. A. (2012) · Strategic Management Journal · doi:10.1002/smj.975 · Cited by 173
Editorial: Evidence on Questionable Research Practices: The Good, the Bad, and the Ugly
Banks, G. C., Rogelberg, S. G., Woznyj, H. M., Landis, R. S., & Rupp, D. E. (2016) · Journal of Business and Psychology · doi:10.1007/s10869-016-9456-7 · Cited by 173
Apples and oranges (and pears, oh my!): the search for moderators in meta-analysis
Cortina, J. M. (2003) · Organizational Research Methods · doi:10.1177/1094428103257358 · Cited by 168
The folly of theorizing “A” but testing “B”
Schriesheim, C. A., Castro, S. L., Zhou, X. (., & Yammarino, F. J. (2001) · The Leadership Quarterly · doi:10.1016/s1048-9843(01)00095-9 · Cited by 168
Williams, H., Parker, S. K., & Turner, N. (2010) · Journal of Occupational and Organizational Psychology · doi:10.1348/096317910x502494 · Cited by 167
How Firms Respond to Financial Restatement: CEO Successors and External Reactions
Gomulya, D., & Boeker, W. (2014) · Academy of Management Journal · doi:10.5465/amj.2012.0491 · Cited by 165
Questions About Questionable Research Practices in the Field of Management: A Guest Commentary
Banks, G. C., O’Boyle, E. H., Pollack, J. M., White, C. D., Batchelor, J. H., Whelpley, C. E., Abston, K. A., Bennett, A. A., & Adkins, C. L. (2016) · Journal of Management · doi:10.1177/0149206315619011 · Cited by 163
Science’s reproducibility and replicability crisis: International business is not immune
Aguinis, H., Cascio, W. F., & Ramani, R. S. (2017) · Journal of International Business Studies · doi:10.1057/s41267-017-0081-0 · Cited by 162
Self-citationRevealed or Concealed? Transparency of Procedures, Decisions, and Judgment Calls in Meta-Analyses
Aytug, Z. G., Rothstein, H. R., Zhou, W., & Kern, M. C. (2011) · Organizational Research Methods · doi:10.1177/1094428111403495 · Cited by 161
Big Samples and Small Effects: Let's Not Trade Relevance and Rigor for Power
Combs, J. G. (2010) · Academy of Management Journal · doi:10.5465/amj.2010.48036305 · Cited by 161
Samples in applied psychology: Over a decade of research in review.
Shen, W., Kiger, T. B., Davies, S. E., Rasch, R. L., Simon, K. M., & Ones, D. S. (2011) · Journal of Applied Psychology · doi:10.1037/a0023322 · Cited by 160
Cafri, G., Kromrey, J. D., & Brannick, M. T. (2010) · Multivariate Behavioral Research · doi:10.1080/00273171003680187 · Cited by 156
Empirics in Family Business Research: Progress, Challenges, and the Path Ahead
Evert, R. E., Martin, J. A., McLeod, M. S., & Payne, G. T. (2015) · Family Business Review · doi:10.1177/0894486515593869 · Cited by 149
A 25-year perspective on levels of analysis in leadership research
Dionne, S. D., Gupta, A., Sotak, K. L., Shirreffs, K. A., Serban, A., Hao, C., Kim, D. H., & Yammarino, F. J. (2014) · The Leadership Quarterly · doi:10.1016/j.leaqua.2013.11.002 · Cited by 141 · cited 6×
“This recommendation applies tomost studies because explicit specification of the focal level of theory, measurement, and analysis is necessary for drawing similar inferences (Dionne et al., 2014; Yammarino, Dionne, Chun, & Dansereau, 2005).”
BackgroundMethodResultInfluentialGetting Through the Gate: Statistical and Methodological Issues Raised in the Reviewing Process
Green, J. P., Tonidandel, S., & Cortina, J. M. (2016) · Organizational Research Methods · doi:10.1177/1094428116631417 · Cited by 141
HARKing's Threat to Organizational Research: Evidence From Primary and Meta‐Analytic Sources
Bosco, F. A., Aguinis, H., Field, J. G., Pierce, C. A., & Dalton, D. R. (2015) · Personnel Psychology · doi:10.1111/peps.12111 · Cited by 140
Self-citationTaking Stock of Accounting Ethics Scholarship: A Review of the Journal Literature
Bampton, R., & Cowton, C. J. (2012) · Journal of Business Ethics · doi:10.1007/s10551-012-1341-3 · Cited by 136
Mistakes and How to Avoid Mistakes in Using Intercoder Reliability Indices
Feng, G. C. (2014) · Methodology · doi:10.1027/1614-2241/a000086 · Cited by 133
The Reporting of Nonresponse Analyses in Survey Research
Werner, S., Praxedes, M., & Kim, H. (2007) · Organizational Research Methods · doi:10.1177/1094428106292892 · Cited by 127
Organizational Ethics Research: A Systematic Review of Methods and Analytical Techniques
McLeod, M. S., Payne, G. T., & Evert, R. E. (2014) · Journal of Business Ethics · doi:10.1007/s10551-014-2436-9 · Cited by 119
SCIENTIFIC APOPHENIA IN STRATEGIC MANAGEMENT RESEARCH: SIGNIFICANCE TESTS & MISTAKEN INFERENCE
Goldfarb, B. D., & King, A. A. (2016) · Strategic Management Journal · doi:10.1002/smj.2459 · Cited by 116
Scientific Achievement and Editorial Board Membership
Bedeian, A. G., Fleet, D. D. V., & Hyman, H. H. (2007) · Organizational Research Methods · doi:10.1177/1094428107309312 · Cited by 112
Probability as certainty: Dichotomous thinking and the misuse ofp values
Hoekstra, R., Finch, S. J., Kiers, H. A. L., & Johnson, A. (2006) · Psychonomic Bulletin & Review · doi:10.3758/bf03213921 · Cited by 112
Tashman, P., & Rivera, J. E. (2015) · Strategic Management Journal · doi:10.1002/smj.2384 · Cited by 108
The Gray Zone: Questionable Research Practices in the Business School
Butler, N., Delaney, H., & Spoelstra, S. (2016) · Academy of Management Learning and Education · doi:10.5465/amle.2015.0201 · Cited by 106
VAN IDDEKINGE, C. H., & PLOYHART, R. E. (2008) · Personnel Psychology · doi:10.1111/j.1744-6570.2008.00133.x · Cited by 101
Rethinking Management Scholarship
George, G. (2014) · Academy of Management Journal · doi:10.5465/amj.2014.4001 · Cited by 100
Aguinis, H., O’Boyle, E. H., Gonzalez-Mule, E. N., & Joo, H. (2014) · Personnel Psychology · doi:10.1111/peps.12095 · Cited by 96
Self-citationCrook, T. R., Shook, C. L., Morris, M. L., et al. (2009) · Organizational Research Methods · doi:10.1177/1094428109334368 · Cited by 93
Publishing inAMJ—Part 5: Crafting the Methods and Results
Yan, Z., & Shaw, J. D. (2012) · Academy of Management Journal · doi:10.5465/amj.2012.4001 · Cited by 91
Honig, B., Lampel, J., Siegel, D. S., & Drnevich, P. L. (2013) · Journal of Management Studies · doi:10.1111/joms.12056 · Cited by 89
Sijtsma, K. (2015) · Psychometrika · doi:10.1007/s11336-015-9446-0 · Cited by 88
The Spirit of Science and Socially Responsible Scholarship
Tsui, A. S. (2013) · Management and Organization Review · doi:10.1111/more.12035 · Cited by 88
Greener, I. (2013) · doi:10.1007/978-1-137-28486-0_9 · Cited by 84
Twilight of dawn or of evening? A century of research methods in the Journal of Applied Psychology.
Cortina, J. M., Aguinis, H., & DeShon, R. P. (2017) · Journal of Applied Psychology · doi:10.1037/apl0000163 · Cited by 83
Self-citationZhu, H., & Yoshikawa, T. (2015) · Strategic Management Journal · doi:10.1002/smj.2408 · Cited by 81
A Call for Openness in Research Reporting: How to Turn Covert Practices Into Helpful Tools
Schwab, A., & Starbuck, W. H. (2016) · Academy of Management Learning and Education · doi:10.5465/amle.2016.0039 · Cited by 80
Degrees of Freedom in SEM: Are We Testing the Models That We Claim to Test?
Cortina, J. M., Green, J. P., Keeler, K. R., & Vandenberg, R. J. (2016) · Organizational Research Methods · doi:10.1177/1094428116676345 · Cited by 80
The Controversy over Null Hypothesis Significance Testing Revisited
Balluerka, N., Gómez, J., & Hidalgo, D. (2005) · Methodology · doi:10.1027/1614-1881.1.2.55 · Cited by 79
Are common language effect sizes easier to understand than traditional effect sizes?
Brooks, M. E., Dalal, D. K., & Nolan, K. P. (2013) · Journal of Applied Psychology · doi:10.1037/a0034745 · Cited by 77
Solutions to the Credibility Crisis in Management Science
Byington, E. K., & Felps, W. (2016) · Academy of Management Learning and Education · doi:10.5465/amle.2015.0035 · Cited by 73
Statistical significance criteria for the rWG and average deviation interrater agreement indices.
Smith‐Crowe, K., Burke, M. J., Cohen, A., & Doveh, E. (2013) · Journal of Applied Psychology · doi:10.1037/a0034556 · Cited by 68
Hubbard, R., & Ryan, P. A. (2000) · Educational and Psychological Measurement · doi:10.1177/0013164400605001 · Cited by 66
Encourage Playing with Data and Discourage Questionable Reporting Practices
Wigboldus, D. H. J., & Dotsch, R. (2015) · Psychometrika · doi:10.1007/s11336-015-9445-1 · Cited by 65
STATE OF SCIENCE IN INDUSTRIAL AND ORGANIZATIONAL PSYCHOLOGY: A REVIEW OF SELF‐REPORTED LIMITATIONS
Brutus, S., Gill, H., & Duniewicz, K. (2010) · Personnel Psychology · doi:10.1111/j.1744-6570.2010.01192.x · Cited by 60
Communicating Your Qualitative Research Better
Chenail, R. J. (2009) · Family Business Review · doi:10.1177/0894486509334795 · Cited by 58
Finch, S., Cumming, G., & Thomason, N. (2001) · Educational and Psychological Measurement · doi:10.1177/0013164401612001 · Cited by 52
A Systems-Based Approach to Fostering Robust Science in Industrial-Organizational Psychology
Grand, J. A., Rogelberg, S. G., Allen, T. D., Landis, R. S., Reynolds, D. H., Scott, J. C., Tonidandel, S., & Truxillo, D. M. (2018) · Industrial and Organizational Psychology · doi:10.1017/iop.2017.55 · Cited by 52
Publishing today is more difficult than ever
Ashkanasy, N. M. (2009) · Journal of Organizational Behavior · doi:10.1002/job.676 · Cited by 51
Treatments of Effect Sizes and Statistical Significance Tests in Textbooks
Capraro, R. M., & Capraro, M. M. (2002) · Educational and Psychological Measurement · doi:10.1177/001316402236877 · Cited by 49
Not all nonnormal distributions are created equal: Improved theoretical and measurement precision.
Joo, H., Aguinis, H., & Bradley, K. J. (2017) · Journal of Applied Psychology · doi:10.1037/apl0000214 · Cited by 46
Self-citationOvercoming Objections to Open-Source Social Science
Jeremy Freese, A. (2007) · Sociological Methods & Research · doi:10.1177/0049124107306665 · Cited by 45
Effect Size Reporting Practices in Published Articles
Alhija, F. N.-A., & Levy, A. (2008) · Educational and Psychological Measurement · doi:10.1177/0013164408315266 · Cited by 45
Misconduct, Marginality and Editorial Practices in Management, Business and Economics Journals
Karabağ, S. F., & Berggren, C. (2016) · PLoS ONE · doi:10.1371/journal.pone.0159492 · Cited by 42
Corley, K. G., & Schinoff, B. S. (2016) · Academy of Management Perspectives · doi:10.5465/amp.2015.0131 · Cited by 41
What Does Not Kill You (Sometimes) Makes You Stronger: Productivity Fluctuations of Journal Editors
Aguinis, H., de Bruin, G. P., Cunningham, D., Hall, N. L., Culpepper, S. A., & Gottfredson, R. K. (2010) · Academy of Management Learning and Education · doi:10.5465/amle.2010.56659885 · Cited by 31
Self-citationCools, E., Armstrong, S. J., & Verbrigghe, J. (2013) · European Journal of Work and Organizational Psychology · doi:10.1080/1359432x.2013.788245 · Cited by 28
Skew and heavy‐tail effects on firm performance
Makino, S., & Chan, C. M. S. (2016) · Strategic Management Journal · doi:10.1002/smj.2632 · Cited by 27
Bergh, D. D., Sharp, B. M., & Li, M. (2016) · Academy of Management Learning and Education · doi:10.5465/amle.2015.0406 · Cited by 26
Wright, P. M. (2016) · Journal of Management · doi:10.1177/0149206316643931 · Cited by 25
Replication Data Sets and Favored-Hypothesis Bias
Firebaugh, G. (2007) · Sociological Methods & Research · doi:10.1177/0049124107306663 · Cited by 19
The 2011 SIOP Graduate Program Benchmarking Survey Part 3: Curriculum and Competencies
Tett, R. P., Walser, B., Brown, C. G., Simonet, D. V., & Tonidandel, S. (2013) · PsycEXTRA Dataset · doi:10.1037/e559272013-007 · Cited by 17
Crafting a Successful Manuscript: Lessons from 131 Reviews
Rogelberg, S. G., Adelman, M., & Askay, D. A. (2009) · Journal of Business and Psychology · doi:10.1007/s10869-009-9116-2 · Cited by 15
Waldman, I. D., & Lilienfeld, S. O. (2015) · Psychometrika · doi:10.1007/s11336-015-9447-z · Cited by 13
When ab ≠ c – c′: Published errors in the reports of single-mediator models
Petrocelli, J. V., Clarkson, J. J., Whitmire, M. B., & Moon, P. E. (2012) · Behavior Research Methods · doi:10.3758/s13428-012-0262-5 · Cited by 12
Cited by
MTurk Research: Review and Recommendations
Aguinis, H., Villamor, I., & Ramani, R. S. (2021) · Journal of Management · doi:10.1177/0149206320969787 · Cited by 984
Self-citationBudhwar, P., Chowdhury, S., Wood, G., Aguinis, H., Bamber, G. J., Beltran, J. R., Boselie, P., Lee Cooke, F., Decker, S., DeNisi, A., et al. (2023) · Human Resource Management Journal · doi:10.1111/1748-8583.12524 · Cited by 908
Self-citationMeasurement Schmeasurement: Questionable Measurement Practices and How to Avoid Them
Flake, J. K., & Fried, E. I. (2020) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245920952393 · Cited by 969
Transparency and replicability in qualitative research: the case of interviews with elite informants
Aguinis, H., & Solarino, A. M. (2019) · Strategic Management Journal · doi:10.1002/smj.3015 · Cited by 791
Self-citationSingh, S. K., Del Giudice, M., Chiappetta Jabbour, C. J., Latan, H., & Sohal, A. S. (2022) · Business Strategy and the Environment · doi:10.1002/bse.2906 · Cited by 669
Metadata
- Authors
- Aguinis, H., Ramani, R. S., & Alabduljader, N.
- Venue
- Academy of Management Annals
- Publisher
- Academy of Management
- Published
- 2018-01
- Volume
- 12
- Issue
- 1
- Pages
- 83-110
- ISSN
- 1941-6067 (ISSN-L)
- 1941-6520
- OpenAlex
- W2754549406
- Cited by
- 463
- References
- 176
- FWCI
- 29.02
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.