Cited by 304Business Strategies and Management ResearchBusiness and Management StudiesDiverse Academic Research Areas

The DOI matches its Crossref record; 120 of the 123 references it cites were found in a registry or an index.

An Ounce of Prevention Is Worth a Pound of Cure: Improving Research Quality Before Data Collection

Open access

Aguinis, Herman, Vandenberg, Robert J.·2014·Annual Review of Organizational Psychology and Organizational Behavior

DOI 10.1146/annurev-orgpsych-031413-091231

Open this paper in CoChat — free account Open PDF

Abstract

We rely on classic as well as recently published sources to offer a review of theory, research design, and measurement issues that should be considered prior to conducting any empirical study. First, we examine theory-related issues that should be addressed before research design and measurement considerations. Specifically, we discuss how to make meaningful theoretical progress including the use of inductive and deductive approaches, address an important issue, and conduct research with a practical end in mind. Second, we offer recommendations regarding research design, including how to address the low statistical power challenge, design studies that strengthen inferences about causal relationships, and use control variables appropriately. Finally, we address measurement issues. Specifically, we discuss how to improve the link between underlying constructs and their observable indicators. Our review offers a checklist for use by researchers to improve research quality prior to data collection and by journal editors and reviewers to evaluate the quality of submitted manuscripts.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1146/annurev-orgpsych-031413-091231

Cites

120 of 120 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Statistical Power Analysis for the Behavioral Sciences
Muller, K. E., & Cohen, J. (1989) · Technometrics · doi:10.2307/1270020 · Cited by 99,603
Statistical power analysis for the behavioral sciences
Cohen, J. (1990) · Computers Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,417
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116
A Paradigm for Developing Better Measures of Marketing Constructs
Churchill, G. A. (1979) · Journal of Marketing Research · doi:10.1177/002224377901600110 · Cited by 16,549
Untitled work
(1963) · Medical Entomology and Zoology · Cited by 15,085
Untitled work
(2002) · Cited by 13,211
Untitled work
(1979) · Medical Entomology and Zoology · Cited by 11,252
Construct validity in psychological tests.
Cronbach, L. J., & Meehl, P. E. (1955) · Psychological Bulletin · doi:10.1037/h0040957 · Cited by 11,195
Statistical Methods for Research Workers
Fisher, R. A. (1945) · American Journal of Clinical Pathology · doi:10.1093/ajcp/15.11.552b · Cited by 10,883
Assessing construct validity in organizational research
Bagozzi, R. P., Yi, Y., & Phillips, L. W. (1991) · Administrative Science Quarterly · doi:10.2307/2393203 · Cited by 6,621
Quasi-experimentation: Design and analysis issues for field settings
Shrout, P. E. (1980) · Evaluation and Program Planning · doi:10.1016/0149-7189(80)90063-4 · Cited by 6,091
Handbook of industrial and organizational psychology
(1993) · Choice Reviews Online · doi:10.5860/choice.30-5278 · Cited by 5,483
Conjectures and Refutations: The Growth of Scientific Knowledge.
Hutchison, T. W., & Popper, K. R. (1964) · Economica · doi:10.2307/2551371 · Cited by 4,232
Conjectures and Refutations: The Growth of Scientific Knowledge.
HESSE, M. B., & Popper, K. R. (1965) · The Philosophical Quarterly · doi:10.2307/2218271 · Cited by 4,213
A Brief Tutorial on the Development of Measures for Use in Survey Questionnaires
Hinkin, T. R. (1998) · Organizational Research Methods · doi:10.1177/109442819800100106 · Cited by 4,095
The earth is round (p < .05).
Cohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
Potential Problems in the Statistical Control of Variables in Organizational Research: A Qualitative Analysis With Recommendations
Becker, T. E. (2005) · Organizational Research Methods · doi:10.1177/1094428105278021 · Cited by 2,308
Theory Construction as Disciplined Imagination
Weick, K. E. (1989) · Academy of Management Review · doi:10.5465/amr.1989.4308376 · Cited by 2,222
Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology.
Meehl, P. E. (1978) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.46.4.806 · Cited by 2,061
Barriers to the Advance of Organizational Science: Paradigm Development as a Dependent Variable
Pfeffer, J. (1993) · Academy of Management Review · doi:10.5465/amr.1993.9402210152 · Cited by 1,404
Statistical significance in psychological research.
Lykken, D. T. (1968) · Psychological bulletin · doi:10.1037/h0026141 · Cited by 1,363
Statistical Methods for Research Workers
Fisher, B. R. A. (1926) · Journal of Comparative Pathology and Therapeutics · doi:10.1016/s0368-1742(26)80018-9 · Cited by 1,297
Causal Analysis: Assumptions, Models, and Data
Schriesheim, C. A., James, L. R., Muliak, S. A., & Brett, J. M. (1984) · Academy of Management Review · doi:10.2307/258244 · Cited by 1,240
That's Interesting!: Towards a Phenomenology of Sociology and a Sociology of Phenomenology
Davis, M. S. (1971) · Philosophy of the Social Sciences · doi:10.1177/004839317100100211 · Cited by 1,219
A General Approach for Representing Constructs in Organizational Research
Bagozzi, R. P., & Edwards, J. R. (1998) · Organizational Research Methods · doi:10.1177/109442819800100104 · Cited by 1,217
Effect Size and Power in Assessing Moderating Effects of Categorical Variables Using Multiple Regression: A 30-Year Review.
Aguinis, H., Beaty, J. C., Boik, R. J., & Pierce, C. A. (2005) · Journal of Applied Psychology · doi:10.1037/0021-9010.90.1.94 · Cited by 1,216 · cited 1×
“Moreover, power is even lower when hypotheses involve more complex relationships such as interaction (Aguinis et al. 2005) and multilevel (Mathieu et al. 2012) effects.”
BackgroundSelf-citation
RESEARCH METHODOLOGY IN MANAGEMENT: CURRENT PRACTICES, TRENDS, AND IMPLICATIONS FOR FUTURE RESEARCH.
Scandura, T. A., & Williams, E. A. (2000) · Academy of Management Journal · doi:10.5465/1556348 · Cited by 1,187
Best-Practice Recommendations for Estimating Cross-Level Interaction Effects Using Multilevel Modeling
Aguinis, H., Gottfredson, R. K., & Culpepper, S. A. (2013) · Journal of Management · doi:10.1177/0149206313478188 · Cited by 1,185
Self-citation
The Too-Much-of-a-Good-Thing Effect in Management
Pierce, J. R., & Aguinis, H. (2011) · Journal of Management · doi:10.1177/0149206311410060 · Cited by 1,177
Self-citation
Methodological Urban Legends: The Misuse of Statistical Control Variables
Spector, P. E., & Brannick, M. T. (2011) · Organizational Research Methods · doi:10.1177/1094428110369842 · Cited by 1,146
Conjectures and Refutations
Popper, K. R., & Hudson, G. E. (1963) · Physics Today · doi:10.1063/1.3050617 · Cited by 1,071
Trends in Theory Building and Theory Testing: A Five-Decade Study of the Academy of Management Journal
Colquitt, J. A., & Muir, C. P. (2007) · Academy of Management Journal · doi:10.5465/amj.2007.28165855 · Cited by 1,065
12 Structural Equation Modeling in Management Research: A Guide for Improved Analysis
Williams, L. J., Vandenberg, R. J., & Edwards, J. R. (2009) · Academy of Management Annals · doi:10.5465/19416520903065683 · Cited by 960
Self-citation
The Field of Management's Devotion to Theory: Too Much of a Good Thing?
Hambrick, D. C. (2007) · Academy of Management Journal · doi:10.5465/amj.2007.28166119 · Cited by 892
Statistical procedures and the justification of knowledge in psychological science.
Rosnow, R. L., & Rosenthal, R. (1989) · American Psychologist · doi:10.1037/0003-066x.44.10.1276 · Cited by 863
Organizational behavior: the state of the science
(1995) · Choice Reviews Online · doi:10.5860/choice.32-4589 · Cited by 814
Statistical power analysis: a simple and general model for traditional and modern hypothesis tests
Murphy, K. R., & Myors, B. (1998) · Choice Reviews Online · doi:10.5860/choice.36-1020 · Cited by 797
The Illusion of Statistical Control
Carlson, K. D., & Wu, J. (2011) · Organizational Research Methods · doi:10.1177/1094428111428817 · Cited by 676
The Persistence of Underpowered Studies in Psychological Research: Causes, Consequences, and Remedies.
Maxwell, S. E. (2004) · Psychological Methods · doi:10.1037/1082-989x.9.2.147 · Cited by 655
Statistical procedures and the justification of knowledge in psychological science.
Rosnow, R. L., & Rosenthal, R. (1992) · American Psychological Association eBooks · doi:10.1037/10109-027 · Cited by 653
Construct Validation Using Computer-Aided Text Analysis (CATA): An Illustration Using Entrepreneurial Orientation
Short, J. C., Broberg, J. C., Cogliser, C. C., & Brigham, K. H. (2010) · Organizational Research Methods · doi:10.1177/1094428109335949 · Cited by 644
1993 Presidential Address: What if the Academy Actually Mattered?
Hambrick, D. C. (1994) · Academy of Management Review · doi:10.2307/258833 · Cited by 629
Prospects for Organization Theory in the Early Twenty-First Century: Institutional Fields and Mechanisms
Davis, G. F., & Marquis, C. (2005) · Organization Science · doi:10.1287/orsc.1050.0137 · Cited by 623
Falsification and the methodology of scientific research programmes
Lakatos, I. (1978) · Cambridge University Press eBooks · doi:10.1017/cbo9780511621123.003 · Cited by 620
What do data really mean? Research findings, meta-analysis, and cumulative knowledge in psychology.
Schmidt, F. L. (1992) · American Psychologist · doi:10.1037/0003-066x.47.10.1173 · Cited by 564 · cited 1×
“An important challenge faced by organizational science researchers is that measures of latent constructs are fallible (Schmidt 1992), and because they are only imperfect indicators of underlying constructs, observed relationships between constructs are usually smaller than the actual relationships.”
Background
Improving Construct Measurement In Management Research: Comments and a Quantitative Approach for Assessing the Theoretical Content Adequacy of Paper-and-Pencil Survey-Type Instruments
Schriesheim, C. A., Powers, K. J., Scandura, T. A., Gardiner, C. C., & Lankau, M. J. (1993) · Journal of Management · doi:10.1177/014920639301900208 · Cited by 558
Regression analysis for categorical moderators
(2005) · Choice Reviews Online · doi:10.5860/choice.42-2852 · Cited by 554
Understanding and estimating the power to detect cross-level interaction effects in multilevel modeling.
Mathieu, J. E., Aguinis, H., Culpepper, S., & Chen, G. (2012) · Journal of Applied Psychology · doi:10.1037/a0028380 · Cited by 534
Self-citation
HR Professionals' beliefs about effective human resource practices: correspondence between research and practice
Rynes, S. L., Colbert, A. E., & Brown, K. G. (2002) · Human Resource Management · doi:10.1002/hrm.10029 · Cited by 502
The Role of Change in the Relationship Between Commitment and Turnover: A Latent Growth Modeling Approach.
Bentein, K., Vandenberghe, C., Vandenberg, R. J., & Stinglhamber, F. (2005) · Journal of Applied Psychology · doi:10.1037/0021-9010.90.3.468 · Cited by 484
Self-citation
The Time Has Come
Kruschke, J. K., Aguinis, H., & Joo, H. (2012) · Organizational Research Methods · doi:10.1177/1094428112457829 · Cited by 478
Self-citation
Charismatic leadership viewed from above: the impact of proactive personality
Crant, J. M., & Bateman, T. S. (2000) · Journal of Organizational Behavior · doi:10.1002/(sici)1099-1379(200002)21:1 · Cited by 478
The Case for Inductive Theory Building†
Locke, E. A. (2007) · Journal of Management · doi:10.1177/0149206307307636 · Cited by 441
What makes management research interesting and why does it matter?
Bartunek, J. M., Rynes, S. L., & Ireland, R. D. (2006) · Academy of Management Journal · doi:10.5465/amj.2006.20785494 · Cited by 432
Perceived Causes and Solutions of the Translation Problem in Management Research
Shapiro, D. L., Kirkman, B. L., & Courtney, H. G. (2007) · Academy of Management Journal · doi:10.5465/amj.2007.24634433 · Cited by 426
The dangers of poor construct conceptualization
MacKenzie, S. B. (2003) · Journal of the Academy of Marketing Science · doi:10.1177/0092070303031003011 · Cited by 426
Research in industrial and organizational psychology from 1963 to 2007: Changes, choices, and trends.
Cascio, W. F., & Aguinis, H. (2008) · Journal of Applied Psychology · doi:10.1037/0021-9010.93.5.1062 · Cited by 365
Self-citation
Validity of personnel decisions: A conceptual analysis of the inferential and evidential bases.
Binning, J. F., & Barrett, G. V. (1989) · Journal of Applied Psychology · doi:10.1037/0021-9010.74.3.478 · Cited by 345
INDUCTIVE TOP-DOWN THEORIZING: A SOURCE OF NEW THEORIES OF ORGANIZATION.
Shepherd, D. A., & Sutcliffe, K. M. (2011) · Academy of Management Review · doi:10.5465/amr.2009.0157 · Cited by 317
Needed: A Ban on the Significance Test
Hunter, J. E. (1997) · Psychological Science · doi:10.1111/j.1467-9280.1997.tb00534.x · Cited by 314
Meta-Analytic Choices and Judgment Calls: Implications for Theory Building and Testing, Obtained Effect Sizes, and Scholarly Impact
Aguinis, H., Dalton, D. R., Bosco, F. A., Pierce, C. A., & Dalton, C. M. (2011) · Journal of Management · doi:10.1177/0149206310377113 · Cited by 302
Self-citation
The Neglected Science and Art of Quasi-Experimentation
Grant, A. M., & Wall, T. D. (2008) · Organizational Research Methods · doi:10.1177/1094428108320737 · Cited by 298
Control Variable Use and Reporting in Macro and Micro Management Research
Atinc, G. M., Simmering, M. J., & Kroll, M. J. (2011) · Organizational Research Methods · doi:10.1177/1094428110397773 · Cited by 268
A person-centered approach to the study of commitment
Meyer, J. P., Stanley, L. J., & Vandenberg, R. J. (2012) · Human Resource Management Review · doi:10.1016/j.hrmr.2012.07.007 · Cited by 250
Self-citation
Graduate training in statistics, methodology, and measurement in psychology: A survey of PhD programs in North America.
Aiken, L. S., West, S. G., SECHREST, L. B., Reno, R. R., Roediger, H. L., III, Scarr, S. W., Kazdin, A. E., & Sherman, S. J. (1990) · American Psychologist · doi:10.1037/0003-066x.45.6.721 · Cited by 249
Customer-Centric Science: Reporting Significant Research Results With Rigor, Relevance, and Practical Impact in Mind
Aguinis, H., Werner, S., Abbott, J., Angert, C., Park, J., & Kohlhausen, D. (2010) · Organizational Research Methods · doi:10.1177/1094428109333339 · Cited by 245
Self-citation
Research and Relevance: Implications of Pasteur'S Quadrant for Doctoral Programs and Faculty Development
Tushman, M. L., & O’Reilly, C. A. (2007) · Academy of Management Journal · doi:10.5465/amj.2007.26279169 · Cited by 244
A Modest Proposal: How We might change the Process and Product of Managerial Research
Pfeffer, J. (2007) · Academy of Management Journal · doi:10.5465/amj.2007.28166117 · Cited by 235
The Presence of Something or the Absence of Nothing: Increasing Theoretical Precision in Management Research
Edwards, J. R., & Berry, J. W. (2010) · Organizational Research Methods · doi:10.1177/1094428110380467 · Cited by 224
High school yearbooks: A reply to Schwarz.
Meehl, P. E. (1971) · Journal of Abnormal Psychology · doi:10.1037/h0030750 · Cited by 221
Using Computer-Aided Text Analysis to Elevate Constructs
McKenny, A. F., Short, J. C., & Payne, G. T. (2012) · Organizational Research Methods · doi:10.1177/1094428112459910 · Cited by 216
Building Organization Theory from First Principles: The Self-Enhancement Motive and Understanding Power and Influence
Pfeffer, J., & Fong, C. T. (2005) · Organization Science · doi:10.1287/orsc.1050.0132 · Cited by 213
Science and Ethics in Conducting, Analyzing, and Reporting Psychological Research
Rosenthal, R. (1994) · Psychological Science · doi:10.1111/j.1467-9280.1994.tb00646.x · Cited by 208
Do Theories of Organizations Progress?
Davis, G. F. (2010) · Organizational Research Methods · doi:10.1177/1094428110376995 · Cited by 204
First Decade of Organizational Research Methods
Aguinis, H., Pierce, C. A., Bosco, F. A., & Muslin, I. S. (2007) · Organizational Research Methods · doi:10.1177/1094428108322641 · Cited by 198
Self-citation
Doctoral training in statistics, measurement, and methodology in psychology: Replication and extension of Aiken, West, Sechrest, and Reno's (1990) survey of PhD programs in North America.
Aiken, L. S., West, S. G., & Millsap, R. E. (2008) · American Psychologist · doi:10.1037/0003-066x.63.1.32 · Cited by 187
To prosper, organizational psychology should … overcome methodological barriers to progress
Edwards, J. R. (2008) · Journal of Organizational Behavior · doi:10.1002/job.529 · Cited by 186
Theory Pruning: Strategies to Reduce Our Dense Theoretical Landscape
Leavitt, K., Mitchell, T. R., & Peterson, J. (2009) · Organizational Research Methods · doi:10.1177/1094428109345156 · Cited by 185
Taming Textual Data: The Contribution of Corpus Linguistics to Computer-Aided Text Analysis
Pollach, I. (2011) · Organizational Research Methods · doi:10.1177/1094428111417451 · Cited by 182
Commitment profiles and employee turnover
Stanley, L. J., Vandenberghe, C., Vandenberg, R. J., & Bentein, K. (2013) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2013.01.011 · Cited by 163
Self-citation
Research Methodology in Organizational Studies
Podsakoff, P. M., & Dalton, D. R. (1987) · Journal of Management · doi:10.1177/014920638701300213 · Cited by 161
Revival of test bias research in preemployment testing.
Aguinis, H., Culpepper, S. A., & Pierce, C. A. (2010) · Journal of Applied Psychology · doi:10.1037/a0018714 · Cited by 112
Self-citation
The Role of Editing in Knowledge Development: Consensus Shifting and Consensus Creation
Hollenbeck, J. R. (2008) · Palgrave Macmillan UK eBooks · doi:10.1057/9780230582590_2 · Cited by 109
A Sticky, Leveraging, and Scalable Strategy for High-Quality Connections Between Organizational Practice and Science
Rousseau, D. M. (2007) · Academy of Management Journal · doi:10.5465/amj.2007.27155539 · Cited by 108
Are we really measuring what we say we're measuring? Using video techniques to supplement traditional construct validation procedures.
Podsakoff, N. P., Podsakoff, P. M., MACKENZIE, S. B., & Klinger, R. L. (2012) · Journal of Applied Psychology · doi:10.1037/a0029570 · Cited by 104
The Multifaceted Nature of Measurement Artifacts and Its Implications for Estimating Construct-Level Relationships
Le, H., Schmidt, F. L., & Putka, D. J. (2007) · Organizational Research Methods · doi:10.1177/1094428107302900 · Cited by 102
Using Market Basket Analysis in Management Research
Aguinis, H., Forcum, L. E., & Joo, H. (2012) · Journal of Management · doi:10.1177/0149206312466147 · Cited by 97
Self-citation
Reconsidering Theoretical Progress in Organizational and Management Research
Edwards, J. R. (2010) · Organizational Research Methods · doi:10.1177/1094428110380468 · Cited by 95
More Statistical and Methodological Myths and Urban Legends
Lance, C. E. (2011) · Organizational Research Methods · doi:10.1177/1094428110391814 · Cited by 88
Competition and Scholarly Productivity in Management: Investigating Changes in Scholarship from 1988 to 2008
Certo, S. T., Sirmon, D. G., & Brymer, R. A. (2010) · Academy of Management Learning and Education · doi:10.5465/amle.2010.56659878 · Cited by 85
THE PERCEPTIONS AND USAGE OF STATISTICAL POWER IN APPLIED PSYCHOLOGY AND MANAGEMENT RESEARCH
Mone, M. A., Mueller, G. C., & MAULAND, W. (1996) · Personnel Psychology · doi:10.1111/j.1744-6570.1996.tb01793.x · Cited by 84
Performance management
Greener, I. (2013) · doi:10.1007/978-1-137-28486-0_9 · Cited by 84
An Additional Rating Method for Journal Articles in the Field of Management
Kacmar, K., & Whitfield, J. (2000) · Organizational Research Methods · doi:10.1177/109442810034005 · Cited by 81
A Design Science Approach to Evidence-Based Management
van Aken, J. E., & Romme, A. G. L. (2012) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199763986.013.0003 · Cited by 78
We need statistical thinking, not statistical rituals
Gigerenzer, G. (1998) · Behavioral and Brain Sciences · doi:10.1017/s0140525x98281167 · Cited by 77
Construct validation in organizational behavior research.
Edwards, J. R. (2003) · Research Explorer (The University of Manchester) · Cited by 73
How Can Significance Tests Be Deinstitutionalized?
Orlitzky, M. (2011) · Organizational Research Methods · doi:10.1177/1094428111428356 · Cited by 72
Pursuing Failure
Gray, P., & Cooper, W. H. (2009) · Organizational Research Methods · doi:10.1177/1094428109356114 · Cited by 71
Social-Role versus Structural Models of Gender and Influence Use in Organizations
Aguinis, H., & Adams, S. K. R. (1998) · Group & Organization Management · doi:10.1177/1059601198234005 · Cited by 70
Self-citation
Vita Contemplativa
Starbuck, W. H. (2004) · Organization Studies · doi:10.1177/0170840604046361 · Cited by 68
Rethinking the Control of Nuisance Variables in Theory Testing
Breaugh, J. A. (2005) · Journal of Business and Psychology · doi:10.1007/s10869-005-9009-y · Cited by 67
Constructs in Strategic Management
Boyd, B., Bergh, D. D., Ireland, R. D., & Ketchen, D. J. (2013) · Organizational Research Methods · doi:10.1177/1094428112471298 · Cited by 65
OPEN A NEW WINDOW IN RATIONAL RESEARCH PLANNING: ADJUST ALPHA TO MAXIMIZE STATISTICAL POWER
Cascio, W. F., & Zedeck, S. (1983) · Personnel Psychology · doi:10.1111/j.1744-6570.1983.tb02233.x · Cited by 62
EMBRACING THE SACRED IN OUR SECULAR SCHOLARLY WORLD.
Walsh, J. P. (2011) · Academy of Management Review · doi:10.5465/amr.2011.59330756 · Cited by 62
The practitioner‐researcher divide revisited: Strategic‐level bridges and the roles of IWO psychologists
Anderson, N. R. (2007) · Journal of Occupational and Organizational Psychology · doi:10.1348/096317907x187237 · Cited by 62
The relevance and irrelevance of psychological research: The example of prison crowding.
Ruback, R. B., & Innes, C. A. (1988) · American Psychologist · doi:10.1037/0003-066x.43.9.683 · Cited by 59
An Examination of G-Theory Methods for Modeling Multitrait–Multimethod Data
Woehr, D. J., Putka, D. J., & Bowler, M. C. (2011) · Organizational Research Methods · doi:10.1177/1094428111408616 · Cited by 54
Publishing today is more difficult than ever
Ashkanasy, N. M. (2009) · Journal of Organizational Behavior · doi:10.1002/job.676 · Cited by 51
Blending the science and practice of industrial and organizational psychology: Where are we and where are we going?
Dunnette, M. D. (1990) · Cited by 51
Construct Validity Issues in Organizational Behavior Research
Srone-Romero, E. F. (2013) · doi:10.4324/9780203763209-11 · Cited by 48
Measurement Malaise in Strategic Management Studies
Dalton, D. R., & Aguinis, H. (2013) · Organizational Research Methods · doi:10.1177/1094428112470846 · Cited by 30
Self-citation
Prospects for Organizational Theory in the Early 21st Century: Institutional Fields and Mechanisms
Davis, G. F., & Marquis, C. (2005) · eCommons (Cornell University) · Cited by 28
You and Your Research
Hamming, R. W., & Kaiser, J. F. (1986) · Calhoun: The Naval Postgraduate School Institutional Archive (Naval Postgraduate School) · Cited by 28
Why I Stopped Trying to Understand the Real WorldPreprint
Starbuck, W. H. (2004) · SSRN Electronic Journal · Cited by 24
(Un)Learning and (Mis)Education Through the Eyes of Bill Starbuck: An Interview With Pandora's Playmate.
Barnett, M. L. (2007) · Academy of Management Learning and Education · doi:10.5465/amle.2007.24401709 · Cited by 19
The 2011 SIOP Graduate Program Benchmarking Survey Part 3: Curriculum and Competencies
Tett, R. P., Walser, B., Brown, C. G., Simonet, D. V., & Tonidandel, S. (2013) · PsycEXTRA Dataset · doi:10.1037/e559272013-007 · Cited by 17
The Developmental Editor: Assessing and Directing Manuscript Contribution
Bergh, D. D. (2008) · Palgrave Macmillan UK eBooks · doi:10.1057/9780230582590_12 · Cited by 10
The Questions We Ask.
(2008) · Academy of Management Proceedings · doi:10.5465/ambpp.2008.34146321 · Cited by 9
Understanding Statistical Significance: A Conceptual History
Little, J. P. (2001) · Journal of Technical Writing and Communication · doi:10.2190/tul8-x9n5-n000-8lkv · Cited by 8
Making it happen: Designing research with implementation in mind
Mann, P. H. (1985) · Social Science Information Studies · doi:10.1016/0143-6236(85)90052-3 · Cited by 6

Research works printed but not linked: 19

Aguinis H, 2013, J. Manag., 39, 1799
Aguinis H, 2013, J. Manag., 39, 1490
Bosker RJ, 2003, PINT (Power IN Two-Level Designs): Estimating Standard Errors of Regression Coefficients in Hierarchical Linear Models for Power Calculations, Version 2.1
10.2307/3150876 · DOI · Paper page
Eby LT, 2009, Statistical and Methodological Myths and Urban Legends: Received Doctrine, Verity, and Fable in the Organizational and Social Sciences, 219
Edwards JR, 2003, Organizational Behavior: The State of the Science, 327
Fisher RA, 1938, Sankhyā: Indian J. Stat., 4, 14
Glaser BG, 1992, Basics of Grounded Theory Analysis: Emerging Versus Forcing
Locke EA, 2007, J. Manag., 33, 867
Nunnally JC, 1994, Psychometric Theory
Ployhart R, 2010, J. Manag., 36, 94
Ryan AM, Schmitt N, Spector P, Zedeck S, Rogelberg S, eds. 2014. Inductive research in organizations. Special issue, J. Bus. Psychol . In press
10.2307/1556348 · DOI
Schriesheim CA, 1993, J. Manag., 19, 385
10.5465/AMR.2011.59330952 · DOI
Simon H, 1996, The Sciences of the Artificial
Spybrook J, 2011, Optimal Design Plus Empirical Evidence: Documentation for the “Optimal Design” Software (Version 3.0)
Tett RP, 2013, Ind.-Organ. Psychol., 50, 69
10.1080/19416520903065683 · DOI

Sorted by citations

Best Practice Recommendations for Designing and Implementing Experimental Vignette Methodology Studies
Aguinis, H., & Bradley, K. J. (2014) · Organizational Research Methods · doi:10.1177/1094428114547952 · Cited by 2,317
Self-citation
A Critical Review and Best‐Practice Recommendations for Control Variable Usage
Bernerth, J. B., & Aguinis, H. (2016) · Personnel Psychology · doi:10.1111/peps.12103 · Cited by 1,731
Self-citation
Improving Our Understanding of Moderation and Mediation in Strategic Management Research
Aguinis, H., Edwards, J., & Bradley, K. J. (2017) · Organizational Research Methods · doi:10.1177/1094428115627498 · Cited by 791
Self-citation
Detecting Common Method Bias
Aguirre-Urreta, M. I., & Hu, J. (2019) · ACM SIGMIS Database the DATABASE for Advances in Information Systems · doi:10.1145/3330472.3330477 · Cited by 627
An inconvenient truth: Arbitrary distinctions between organizational, mechanical Turk, and other convenience samples
Landers, R. N., & Behrend, T. S. (2015) · Industrial and Organizational Psychology · doi:10.1017/iop.2015.13 · Cited by 714

See all 304

Authors: Aguinis, H., & Vandenberg, R. J.
Affiliations: Indiana University Bloomington (US)
University of Georgia (US)
ORCID: Aguinis, Herman
Vandenberg, Robert J.
Venue: Annual Review of Organizational Psychology and Organizational Behavior
Publisher: Annual Reviews
Published: 2014-03-21
Volume: 1
Issue: 1
Pages: 569-595
ISSN: 2327-0608 (ISSN-L)
2327-0616
DOI: 10.1146/annurev-orgpsych-031413-091231
OpenAlex: W2110082579
Cited by: 304
References: 123
Citations by year: 2026: 17 · 2025: 28 · 2024: 18 · 2023: 24 · 2022: 19 · 2021: 48 · 2020: 25 · 2019: 31 · 2018: 22 · 2017: 23 · 2016: 19 · 2015: 19 · 2014: 10
FWCI: 7.05
Type: journal article
Language: en
Open access: bronze
doi.org
Locations: Annual Review of Organizational Psychology and Organizational Behavior (publishedVersion)
Topics: Social Sciences › Business, Management and Accounting › Strategy and Management › Business Strategies and Management Research
Social Sciences › Business, Management and Accounting › Business and International Management › Business and Management Studies
Social Sciences › Education › Diverse Academic Research Areas
Keywords: research quality, research design, measurement, statistical power, causal inference, control variables, construct measurement, research checklist, manuscript review, theory development

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

An Ounce of Prevention Is Worth a Pound of Cure: Improving Research Quality Before Data Collection

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks