The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
The Relative Validity of Inferences About Mediation as a Function of Research Design Characteristics
Abstract
Tests of assumed mediation models are common in the organizational sciences. However, the validity of inferences about mediation is a function of experimental design and the setting of a study. Regrettably, most tests of mediation have relied on the application of so-called ``causal modeling'' techniques to data from nonexperimental studies. As we demonstrate, inferences about the validity of assumed mediation models are highly suspect when they are based on the findings of nonexperimental research. One of the many reasons for this is the failure of the model being tested to be consistent with reality. Valid research-based inferences about mediation are possible. However, inferences from such tests are most likely to be valid when they are based on research that uses randomized experimental designs. Strategies for conducting research using these and other designs are described. Finally, we offer a set of conclusions and recommendations that stem from our analysis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Baron, R. M., & Kenny, D. A. (1986) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.51.6.1173 · Cited by 91,532
(1975) · PhilPapers (PhilPapers Foundation) · Cited by 36,737
(1980) · Medical Entomology and Zoology · Cited by 25,810
Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences
Cohen, P., Cohen, P., West, S. G., & Aiken, L. S. (2014) · Psychology Press eBooks · doi:10.4324/9781410606266 · Cited by 20,737
Structural Equations with Latent Variables.
Clogg, C. C., & Bollen, K. A. (1991) · Contemporary Sociology · doi:10.2307/2072165 · Cited by 17,442
Structural Equations with Latent Variables
Bollen, K. A. (1989) · Wiley series in probability and statistics · doi:10.1002/9781118619179 · Cited by 17,277
(2002) · Cited by 13,211
(1979) · Medical Entomology and Zoology · Cited by 11,252
Construct validity in psychological tests.
Cronbach, L. J., & Meehl, P. E. (1955) · Psychological Bulletin · doi:10.1037/h0040957 · Cited by 11,195 · cited 1×
“Ideally, the validity of each inference can be supported by evidence from appropriate construct validation studies (Cook & Campbell, 1979; Cronbach & Meehl, 1955; Guion, 2002; Shadish et al., 2002).”
Background(1964) · Medical Entomology and Zoology · Cited by 10,439
Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences
Kemp, F. (2003) · Journal of the Royal Statistical Society: Series D (The Statistician) · doi:10.1046/j.1467-9884.2003.t01-2-00383_4.x · Cited by 9,293
Motivation through the design of work: test of a theory
Hackman, J. R., & Oldham, G. R. (1976) · Organizational Behavior and Human Performance · doi:10.1016/0030-5073(76)90016-7 · Cited by 8,962 · cited 2×
“So, it appears that for this and other reasons, most tests of the Job Characteristics Model have used nonexperimental designs.”
MethodFoundations of Behavioral Research
Stockton, R., & Kerlinger, F. N. (1974) · American Educational Research Journal · doi:10.2307/1162206 · Cited by 7,347
Quasi-experimentation: Design and analysis issues for field settings
Shrout, P. E. (1980) · Evaluation and Program Planning · doi:10.1016/0149-7189(80)90063-4 · Cited by 6,010
Statistics and Causal Inference
Holland, P. W. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478354 · Cited by 5,293 · cited 3×
“…nonexperimental research, their inferences have little or no value in terms of understanding causal connections between variables (Bollen, 1989; Brannick, 1995; Cliff, 1987; Freedman, 1987; Holland, 1986; Kelloway, 1998; Ling, 1982; Millsap, 2002; Rogosa, 1987; Stone-Romero & Rosopa, 2004, 2005).”
BackgroundResult(1982) · Cited by 3,737
Using LISREL for Structural Equation Modeling: A Researcher′s Guide
Kelloway, E. K. (1998) · Cited by 2,790
Managerial Attitudes and Performance.
Alderfer, C. P., Porter, L. W., & Lawler, E. E. (1968) · Administrative Science Quarterly · doi:10.2307/2391269 · Cited by 2,209
Mediators, moderators, and tests for mediation.
James, L. R., & Brett, J. M. (1984) · Journal of Applied Psychology · doi:10.1037//0021-9010.69.2.307 · Cited by 1,627
Kenny, D. A. (1979) · Medical Entomology and Zoology · Cited by 1,376
Causal Inferences in Nonexperimental Research
Blalock, H. M. (1964) · Medical Entomology and Zoology · Cited by 1,276
Cohen, P. (1980) · Evaluation and Program Planning · doi:10.1016/0149-7189(80)90009-9 · Cited by 1,112
Clarifying conditions and decision points for mediational type inferences in Organizational Behavior
Mathieu, J. E., & Taylor, S. R. (2006) · Journal of Organizational Behavior · doi:10.1002/job.406 · Cited by 961 · cited 2×
“The Importance of Timing in the Measurement of Assumed Mediators and Effects In studies of assumed mediation models, it is critical that assumed mediators and effects be measured at appropriate times (Mathieu & Taylor, 2006; Shadish et al., 2002).”
BackgroundStewart, G. L., & Barrick, M. R. (2000) · Academy of Management Journal · doi:10.2307/1556372 · Cited by 786
External validity is more than skin deep: Some answers to criticisms of laboratory experiments.
Berkowitz, L., & Donnerstein, E. (1982) · American Psychologist · doi:10.1037//0003-066x.37.3.245 · Cited by 713
Managerial Attitudes and Performance.
Kumnick, M. D., Porter, L. W., & Lawler, E. E. (1969) · Industrial and Labor Relations Review · doi:10.2307/2521994 · Cited by 625
Hui, C., Lee, C., & Rousseau, D. M. (2004) · Journal of Applied Psychology · doi:10.1037/0021-9010.89.2.311 · Cited by 568
Heilman, M. E., & Chen, J. J. (2005) · Journal of Applied Psychology · doi:10.1037/0021-9010.90.3.431 · Cited by 541
Causal Models in the Social Sciences.
Henry, N. W., & Blalock, H. M. (1976) · Contemporary Sociology · doi:10.2307/2063121 · Cited by 472
Methods of Research in Social Psychology.
Singleton, R., Carlsmith, J. M., Ellsworth, P. C., & Aronson, E. (1977) · Contemporary Sociology · doi:10.2307/2064798 · Cited by 437
As Others See Us: A Case Study in Path Analysis
Freedman, D. A. (1987) · Journal of Educational Statistics · doi:10.2307/1164888 · Cited by 372
Critical comments on applying covariance structure modeling
Brannick, M. T. (1995) · Journal of Organizational Behavior · doi:10.1002/job.4030160303 · Cited by 350
Experimental and quasi-experimental designs
Costantini, M., & Higginson, I. J. (2007) · Research Methods in Palliative Care · doi:10.1093/acprof:oso/9780198530251.003.0006 · Cited by 337
Research methods in organizational behavior
Stone, E. F. (1978) · Medical Entomology and Zoology · Cited by 320
Higgins, C. A., & Judge, T. A. (2004) · Journal of Applied Psychology · doi:10.1037/0021-9010.89.4.622 · Cited by 288
Brown, S. P., Jones, E., & Leigh, T. W. (2005) · Journal of Applied Psychology · doi:10.1037/0021-9010.90.5.972 · Cited by 279
Causal Models in the Social Sciences.
Goldberger, A. S., & Blalock, H. M. (1972) · Journal of the American Statistical Association · doi:10.2307/2284668 · Cited by 265
Research on Human Behavior: A Systematic Guide to Method
Millman, J., Runkel, P. J., & McGrath, J. E. (1973) · American Educational Research Journal · doi:10.2307/1161667 · Cited by 258
Industrial Psychology: Its Theoretical and Social Foundations
Blum, M. L., & Naylor, J. C. (1968) · Medical Entomology and Zoology · Cited by 241
Brass, D. J., & Locke, E. A. (1987) · Administrative Science Quarterly · doi:10.2307/2392922 · Cited by 152
Logic: Techniques of Formal Reasoning.
López-Escobar, E. G. K., Kalish, D., & Montague, R. (1967) · The Philosophical Review · doi:10.2307/2183653 · Cited by 124
Meyer, J. P., & Gellatly, I. R. (1988) · Journal of Applied Psychology · doi:10.1037//0021-9010.73.3.410 · Cited by 117
INFERENCE PROBLEMS WITH HIERARCHICAL MULTIPLE REGRESSION-BASED TESTS OF MEDIATING EFFECTS
Stone‐Romero, E. F., & Rosopa, P. J. (2004) · Research in personnel and human resources management · doi:10.1016/s0742-7301(04)23006-7 · Cited by 87
Self-citationMorgan, G. A., Gliner, J. A., & Harmon, R. J. (2000) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-200006000-00020 · Cited by 80
Casual Models Do Not Support Scientific Conclusions: A Comment in Support of Freedman
Rogosa, D. (1987) · Journal of Educational Statistics · doi:10.3102/10769986012002185 · Cited by 79
The Relative Validity and Usefulness of Various Empirical Research Designs
Stone‐Romero, E. F. (2004) · Wiley eBooks · doi:10.1002/9780470756669.ch4 · Cited by 61
Self-citationLing, R. F., & Kenny, D. A. (1982) · Journal of the American Statistical Association · doi:10.2307/2287275 · Cited by 59
Construct Validity Issues in Organizational Behavior Research
Stone‐Romero, E. F. (2013) · doi:10.4324/9780203763209-11 · Cited by 48
Self-citationBulger, C. A., & Mellor, S. (1997) · Journal of Applied Psychology · doi:10.1037/0021-9010.82.6.935 · Cited by 41
Structural equation modeling: A user's guide.
Millsap, R. E. (2002) · Cited by 40
(2011) · SAGE Publications Ltd eBooks · doi:10.4135/9780857024633.d57 · Cited by 9
Comments on Professor Freedman's Paper
Cliff, N. (1987) · Journal of Educational Statistics · doi:10.2307/1164892 · Cited by 5
Cited by
Do Not Cross Me: Optimizing the Use of Cross-Sectional Designs
Spector, P. E. (2019) · Journal of Business and Psychology · doi:10.1007/s10869-018-09613-8 · Cited by 1,366
Work engagement and financial returns: a diary study on the role of job and personal resources
Xanthopoulou, D., Bakker, A. B., Demerouti, E., & Schaufeli, W. B. (2009) · Journal of Occupational and Organizational Psychology · doi:10.1348/096317908x285633 · Cited by 1,308
Testing Multilevel Mediation Using Hierarchical Linear Models: Problems and Solutions
Zhang, Z., Zyphur, M. J., & Preacher, K. J. (2009) · Organizational Research Methods · doi:10.1177/1094428108327450 · Cited by 1,093
Yes, but what’s the mechanism? (don’t expect an easy answer).
Bullock, J. G., Green, D. P., & Ha, S. E. (2010) · Journal of Personality and Social Psychology · doi:10.1037/a0018933 · Cited by 1,063
Improving Our Understanding of Moderation and Mediation in Strategic Management Research
Aguinis, H., Edwards, J. R., & Bradley, K. J. (2017) · Organizational Research Methods · doi:10.1177/1094428115627498 · Cited by 821
Metadata
- Authors
- Stone-Romero, E. F., & Rosopa, P. J.
- Venue
- Organizational Research Methods
- Publisher
- SAGE Publications
- Published
- 2007-07-23
- Volume
- 11
- Issue
- 2
- Pages
- 326-352
- ISSN
- 1094-4281 (ISSN-L)
- 1552-7425
- OpenAlex
- W2110213693
- Cited by
- 346
- References
- 52
- FWCI
- 13.21
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.