The DOI matches its Crossref record; 120 of the 123 references it cites were found in a registry or an index.
An Ounce of Prevention Is Worth a Pound of Cure: Improving Research Quality Before Data Collection
Open accessAbstract
We rely on classic as well as recently published sources to offer a review of theory, research design, and measurement issues that should be considered prior to conducting any empirical study. First, we examine theory-related issues that should be addressed before research design and measurement considerations. Specifically, we discuss how to make meaningful theoretical progress including the use of inductive and deductive approaches, address an important issue, and conduct research with a practical end in mind. Second, we offer recommendations regarding research design, including how to address the low statistical power challenge, design studies that strengthen inferences about causal relationships, and use control variables appropriately. Finally, we address measurement issues. Specifically, we discuss how to improve the link between underlying constructs and their observable indicators. Our review offers a checklist for use by researchers to improve research quality prior to data collection and by journal editors and reviewers to evaluate the quality of submitted manuscripts.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“By applying theoretical comparisons using a between-group analysis, the LPA methodology assumes the principles of a quasi-experimentation and allows stronger inferences about causality [36].”
From The Temporary Agency Worker’s Motivation Profile Analysis (2021) · cites this paper as [36]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. E., & Cohen, J. (1989) · Technometrics · doi:10.2307/1270020 · Cited by 99,603
Statistical power analysis for the behavioral sciences
Cohen, J. (1990) · Computers Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,417
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116
A Paradigm for Developing Better Measures of Marketing Constructs
Churchill, G. A. (1979) · Journal of Marketing Research · doi:10.1177/002224377901600110 · Cited by 16,549
(1963) · Medical Entomology and Zoology · Cited by 15,085
(2002) · Cited by 13,211
(1979) · Medical Entomology and Zoology · Cited by 11,252
Construct validity in psychological tests.
Cronbach, L. J., & Meehl, P. E. (1955) · Psychological Bulletin · doi:10.1037/h0040957 · Cited by 11,195
Statistical Methods for Research Workers
Fisher, R. A. (1945) · American Journal of Clinical Pathology · doi:10.1093/ajcp/15.11.552b · Cited by 10,883
Assessing construct validity in organizational research
Bagozzi, R. P., Yi, Y., & Phillips, L. W. (1991) · Administrative Science Quarterly · doi:10.2307/2393203 · Cited by 6,621
Flagged first, then by citations
3 of the 123 references couldn’t be matched to a known paper.
Research works printed but not linked: 19
- Aguinis H, 2013, J. Manag., 39, 1799
- Aguinis H, 2013, J. Manag., 39, 1490
- Bosker RJ, 2003, PINT (Power IN Two-Level Designs): Estimating Standard Errors of Regression Coefficients in Hierarchical Linear Models for Power Calculations, Version 2.1
- 10.2307/3150876 · DOI · Paper page
- Eby LT, 2009, Statistical and Methodological Myths and Urban Legends: Received Doctrine, Verity, and Fable in the Organizational and Social Sciences, 219
- Edwards JR, 2003, Organizational Behavior: The State of the Science, 327
- Fisher RA, 1938, Sankhyā: Indian J. Stat., 4, 14
- Glaser BG, 1992, Basics of Grounded Theory Analysis: Emerging Versus Forcing
- Locke EA, 2007, J. Manag., 33, 867
- Nunnally JC, 1994, Psychometric Theory
- Ployhart R, 2010, J. Manag., 36, 94
- Ryan AM, Schmitt N, Spector P, Zedeck S, Rogelberg S, eds. 2014. Inductive research in organizations. Special issue, J. Bus. Psychol . In press
- 10.2307/1556348 · DOI
- Schriesheim CA, 1993, J. Manag., 19, 385
- 10.5465/AMR.2011.59330952 · DOI
- Simon H, 1996, The Sciences of the Artificial
- Spybrook J, 2011, Optimal Design Plus Empirical Evidence: Documentation for the “Optimal Design” Software (Version 3.0)
- Tett RP, 2013, Ind.-Organ. Psychol., 50, 69
- 10.1080/19416520903065683 · DOI
Cited by
Sorted by citations
Aguinis, H., & Bradley, K. J. (2014) · Organizational Research Methods · doi:10.1177/1094428114547952 · Cited by 2,317
Self-citationA Critical Review and Best‐Practice Recommendations for Control Variable Usage
Bernerth, J. B., & Aguinis, H. (2016) · Personnel Psychology · doi:10.1111/peps.12103 · Cited by 1,731
Self-citationImproving Our Understanding of Moderation and Mediation in Strategic Management Research
Aguinis, H., Edwards, J., & Bradley, K. J. (2017) · Organizational Research Methods · doi:10.1177/1094428115627498 · Cited by 791
Self-citationAguirre-Urreta, M. I., & Hu, J. (2019) · ACM SIGMIS Database the DATABASE for Advances in Information Systems · doi:10.1145/3330472.3330477 · Cited by 627
Landers, R. N., & Behrend, T. S. (2015) · Industrial and Organizational Psychology · doi:10.1017/iop.2015.13 · Cited by 714
Metadata
- Authors
- Aguinis, H., & Vandenberg, R. J.
- Affiliations
- Indiana University Bloomington (US)
- University of Georgia (US)
- Venue
- Annual Review of Organizational Psychology and Organizational Behavior
- Publisher
- Annual Reviews
- Published
- 2014-03-21
- Volume
- 1
- Issue
- 1
- Pages
- 569-595
- ISSN
- 2327-0608 (ISSN-L)
- 2327-0616
- OpenAlex
- W2110082579
- Cited by
- 304
- References
- 123
- Citations by year
- 2026: 17 · 2025: 28 · 2024: 18 · 2023: 24 · 2022: 19 · 2021: 48 · 2020: 25 · 2019: 31 · 2018: 22 · 2017: 23 · 2016: 19 · 2015: 19 · 2014: 10
- FWCI
- 7.05
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Annual Review of Organizational Psychology and Organizational Behavior (publishedVersion)
- Topics
- Social Sciences › Business, Management and Accounting › Strategy and Management › Business Strategies and Management Research
- Social Sciences › Business, Management and Accounting › Business and International Management › Business and Management Studies
- Social Sciences › Education › Diverse Academic Research Areas
- Keywords
- research quality, research design, measurement, statistical power, causal inference, control variables, construct measurement, research checklist, manuscript review, theory development
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review