The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
To prosper, organizational psychology should … overcome methodological barriers to progress
Open accessAbstract
Progress in organizational psychology (OP) research depends on the rigor and quality of the methods we use. This paper identifies ten methodological barriers to progress and offers suggestions for overcoming the barriers, in part or whole. The barriers address how we derive hypotheses from theories, the nature and scope of the questions we pursue in our studies, the ways we address causality, the manner in which we draw samples and measure constructs, and how we conduct statistical tests and draw inferences from our research. The paper concludes with recommendations for integrating research methods into our ongoing development goals as scholars and framing methods as tools that help us achieve shared objectives in our field. Copyright © 2008 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Podsakoff, P. M., MacKenzie, S. B., Lee, J.-Y., & Podsakoff, N. P. (2003) · Journal of Applied Psychology · doi:10.1037/0021-9010.88.5.879 · Cited by 82,194
Causality: Models, Reasoning, and Inference
Pearl, J. (2009) · doi:10.1017/cbo9780511803161 · Cited by 11,653
Estimating causal effects of treatments in randomized and nonrandomized studies
Rubin, D. B. (1974) · Journal of Educational Psychology · doi:10.1037/h0037350 · Cited by 9,436
Ecological momentary assessment
Shiffman, S., Stone, A. A., & Hufford, M. R. (2008) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.3.022806.091415 · Cited by 6,454
Justice at the millennium: A meta-analytic review of 25 years of organizational justice research.
Colquitt, J. A., Conlon, D. E., Wesson, M. J., Porter, C. O. L. H., & Ng, K. Y. (2001) · Journal of Applied Psychology · doi:10.1037/0021-9010.86.3.425 · Cited by 5,942
Statistics and Causal Inference
Holland, P. W. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478354 · Cited by 5,293
The Psychology of Survey Response
Tourangeau, R., Rips, L. J., & Rasinski, K. (2000) · doi:10.1017/cbo9780511819322 · Cited by 4,734
Causation, Prediction, and Search
Spirtes, P., Glymour, C., & Scheines, R. (2001) · doi:10.7551/mitpress/1754.001.0001 · Cited by 4,521
Cohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
Protocol Analysis: Verbal Reports as Data
Ericsson, K. A., & Simon, H. A. (1993) · doi:10.7551/mitpress/5657.001.0001 · Cited by 3,537
Bias in cross-sectional analyses of longitudinal mediation
Maxwell, S. E., & Cole, D. A. (2007) · Psychological Methods · doi:10.1037/1082-989x.12.1.23 · Cited by 3,401 · cited 1×
“…estimates of the relation between the cause and effect, given that the correlation between measures collected at the same time generally differs from the correlation between measures separated by the time interval that corresponds to the causal effect (Maxwell & Cole, 2007; Mitchell & James, 2001).”
Hunter, J., & Schmidt, F. (2004) · doi:10.4135/9781412985031 · Cited by 3,023
Platt, J. R. (1964) · Science · doi:10.1126/science.146.3642.347 · Cited by 2,907
Self-reports: How the questions shape the answers.
Schwarz, N. (1999) · American Psychologist · doi:10.1037/0003-066x.54.2.93 · Cited by 2,846
Lack of method variance in self-reported affect and perceptions at work: reality or artifact?
Williams, L. J., Cote, J. A., & Buckley, M. R. (1989) · Journal of Applied Psychology · doi:10.1037/0021-9010.74.3.462 · Cited by 1,616
Statistical analysis of sets of congeneric tests
Jöreskog, K. G. (1971) · Psychometrika · doi:10.1007/bf02291393 · Cited by 1,481
The Difference Between “Significant” and “Not Significant” is not Itself Statistically Significant
Gelman, A., & Stern, H. (2006) · The American Statistician · doi:10.1198/000313006x152649 · Cited by 1,407 · cited 1×
“To complicate matters, effects classified as significant and nonsignificant are often themselves not significantly different from each another, as when the p-values for two tests are .04 and .06 (Gelman & Stern, 2006).”
Loehlin, J. C., & Beaujean, A. A. (2016) · doi:10.4324/9781315643199 · Cited by 1,381
Common methods bias: does common methods variance really bias results?
Doty, D. H., & Glick, W. H. (1998) · Organizational Research Methods · doi:10.1177/109442819814002 · Cited by 1,380 · cited 1×
“Moreover, bias due to commonmethod variance is a matter of degree and depends on the substantive nature of the constructs assessed by the measures (Crampton & Wagner, 1994; Doty & Glick, 1998; Spector, 2006; Williams, Cote, & Buckley, 1989).”
Hektner, J., Schmidt, J., & Csikszentmihalyi, M. (2007) · doi:10.4135/9781412984201 · Cited by 1,174
Measurement error in psychological research: Lessons from 26 research scenarios.
Schmidt, F. L., & Hunter, J. E. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.2.199 · Cited by 567 · cited 1×
“Address the effects of measurement error The importance of measurement error has long been recognized in OP research (Campbell, 1976; DeShon, 1998; Edwards, 2003; Schmidt & Hunter, 1996; Schwab, 1980).”
Testing Interaction Effects in LISREL: Examination and Illustration of Available Procedures
Cortina, J. M., Chen, G., & Dunlap, W. P. (2001) · Organizational Research Methods · doi:10.1177/109442810144002 · Cited by 512
Do frequency representations eliminate conjunction effects? An exercise in adversarial collaboration
Mellers, B., Hertwig, R., & Kahneman, D. (2001) · Psychological Science · doi:10.1111/1467-9280.00350 · Cited by 448
Risk Factors, Confounding, and the Illusion of Statistical Control
Christenfeld, N. J. S., Sloan, R. P., Carroll, D., & Greenland, S. (2004) · Psychosomatic Medicine · doi:10.1097/01.psy.0000140008.70959.41 · Cited by 260
Experiences of collaborative research
Kahneman, D. (2003) · American Psychologist · doi:10.1037/0003-066x.58.9.723 · Cited by 149
Mauro, R. (1990) · Psychological Bulletin · doi:10.1037/0033-2909.108.2.314 · Cited by 130
Cited by
Sources of method bias in social science research and recommendations on how to control it
Podsakoff, P. M., MacKenzie, S. B., & Podsakoff, N. P. (2012) · Annual Review of Psychology · doi:10.1146/annurev-psych-120710-100452 · Cited by 15,744
Common method bias in applied settings: The dilemma of researching in organizations
Jordan, P. J., & Troth, A. C. (2020) · Australian Journal of Management · doi:10.1177/0312896219871976 · Cited by 997
Becker, T. E., Atinc, G., Breaugh, J. A., Carlson, K. D., Edwards, J. R., & Spector, P. E. (2016) · Journal of Organizational Behavior · doi:10.1002/job.2053 · Cited by 989
Self-citation12 Structural Equation Modeling in Management Research: A Guide for Improved Analysis
Williams, L. J., Vandenberg, R. J., & Edwards, J. R. (2009) · Academy of Management Annals · doi:10.1080/19416520903065683 · Cited by 900
Self-citationReinholt, M., Pedersen, T., & Foss, N. J. (2011) · Academy of Management Journal · doi:10.5465/amj.2009.0007 · Cited by 548
Metadata
- Authors
- Edwards, J. R.
- Venue
- Journal of Organizational Behavior
- Publisher
- Wiley
- Published
- 2008-04-29
- Volume
- 29
- Issue
- 4
- Pages
- 469-491
- ISSN
- 0894-3796 (ISSN-L)
- 1099-1379
- OpenAlex
- W2124041327
- Cited by
- 185
- References
- 26
- FWCI
- 18.96
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.