Bias in Cross-Sectional Analyses of Longitudinal Mediation: Partial and Complete Mediation Under an Autoregressive Model
Open accessThe DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Abstract
Maxwell and Cole (2007) showed that cross-sectional approaches to mediation typically generate substantially biased estimates of longitudinal parameters in the special case of complete mediation. However, their results did not apply to the more typical case of partial mediation. We extend their previous work by showing that substantial bias can also occur with partial mediation. In particular, cross-sectional analyses can imply the existence of a substantial indirect effect even when the true longitudinal indirect effect is zero. Thus, a variable that is found to be a strong mediator in a cross-sectional analysis may not be a mediator at all in a longitudinal analysis. In addition, we show that very different combinations of longitudinal parameter values can lead to essentially identical cross-sectional correlations, raising serious questions about the interpretability of cross-sectional mediation data. More generally, researchers are encouraged to consider a wide variety of possible mediation models beyond simple cross-sectional models, including but not restricted to autoregressive models of change.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Baron, R. M., & Kenny, D. A. (1986) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.51.6.1173 · Cited by 91,532
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,395
Preacher, K. J., & Hayes, A. F. (2008) · Behavior Research Methods · doi:10.3758/brm.40.3.879 · Cited by 34,117
SPSS and SAS procedures for estimating indirect effects in simple mediation models
Preacher, K. J., & Hayes, A. F. (2004) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03206553 · Cited by 17,383
(2002) · Cited by 13,211
Causality: Models, Reasoning, and Inference
Pearl, J. (2009) · doi:10.1017/cbo9780511803161 · Cited by 11,653
Mediation in experimental and nonexperimental studies: New procedures and recommendations.
Shrout, P. E., & Bolger, N. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.4.422 · Cited by 11,335
Estimating causal effects of treatments in randomized and nonrandomized studies
Rubin, D. B. (1974) · Journal of Educational Psychology · doi:10.1037/h0037350 · Cited by 9,436 · cited 1×
“In particular, Rubin’s causal model (Rubin, 1974; see also Shadish, 2010; West & Thoemmes, 2010) provides an alternative framework that has led to valuable insights about alternative approaches for studying causation in general and mediation in particular.”
BackgroundA comparison of methods to test mediation and other intervening variable effects
MacKinnon, D. P., Lockwood, C. M., Hoffman, J. M., West, S. G., & Sheets, V. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.1.83 · Cited by 9,406 · cited 1×
“As MacKinnon et al. (2002) emphasized, another important advantage of longitudinal designs is that they can yield information about temporal precedence, and thus allow examination of which variables are causes and which variables are effects.”
Background(2013) · Handbooks of Sociology and Social Research · doi:10.1007/978-94-007-6772-0 · Cited by 7,486
Casella, G., & Berger, R. (2024) · Chapman & Hall/CRC eBooks · doi:10.1201/9781003456285 · Cited by 5,711
MacKinnon, D. P., Fairchild, A. J., & Fritz, M. S. (2007) · Annual Review of Psychology · doi:10.1146/annurev.psych.58.110405.085542 · Cited by 5,688
Introduction to Statistical Mediation Analysis
MacKinnon, D. P. (2012) · doi:10.4324/9780203809556 · Cited by 5,618
A general approach to causal mediation analysis.
Imai, K., Keele, L., & Tingley, D. (2010) · Psychological Methods · doi:10.1037/a0020761 · Cited by 4,143
Cole, D. A., & Maxwell, S. E. (2003) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.112.4.558 · Cited by 3,605 · cited 2×
“As has been discussed elsewhere (e.g., Cole & Maxwell, 2003; Gollob & Reichardt, 1985, 1987, 1991), estimates of effects in longitudinal models can change greatly depending on the chosen time lag.”
BackgroundSelf-citationBias in cross-sectional analyses of longitudinal mediation
Maxwell, S. E., & Cole, D. A. (2007) · Psychological Methods · doi:10.1037/1082-989x.12.1.23 · Cited by 3,401 · cited 7×
“Maxwell and Cole (2007) showed that cross-sectional approaches to mediation typically generate substantially biased estimates of longitudinal parameters in the special case of complete mediation.”
BackgroundInfluentialSelf-citation(1998) · Cited by 2,713
Applications of Structural Equation Modeling in Psychological Research
MacCallum, R. C., & Austin, J. T. (2000) · Annual Review of Psychology · doi:10.1146/annurev.psych.51.1.201 · Cited by 2,623
Process Analysis: Estimating Mediation in Treatment Evaluations
Judd, C. M., & Kenny, D. A. (1981) · Evaluation Review · doi:10.1177/0193841x8100500502 · Cited by 2,442
Dantzer, R. (1990) · Neuropsychologia · doi:10.1016/0028-3932(90)90065-v · Cited by 2,354
Latent Variable Modeling of Differences and Changes with Longitudinal Data
McArdle, J. J. (2009) · Annual Review of Psychology · doi:10.1146/annurev.psych.60.110707.163612 · Cited by 1,952 · cited 2×
“McArdle (2009) provided an excellent review of a variety of latent variable models for studying change.”
BackgroundKraemer, H. C., Stice, E., Kazdin, A., Offord, D., & Kupfer, D. (2001) · American Journal of Psychiatry · doi:10.1176/appi.ajp.158.6.848 · Cited by 1,712
Bauer, D. J., Preacher, K. J., & Gil, K. M. (2006) · Psychological Methods · doi:10.1037/1082-989x.11.2.142 · Cited by 1,704
Principal Stratification in Causal Inference
Frangakis, C. E., & Rubin, D. B. (2002) · Biometrics · doi:10.1111/j.0006-341x.2002.00021.x · Cited by 1,511
Kenny, D. A. (1979) · Medical Entomology and Zoology · Cited by 1,376
Cohen, P. (1980) · Evaluation and Program Planning · doi:10.1016/0149-7189(80)90009-9 · Cited by 1,112
Mediation Models for Longitudinal Data in Developmental Research
Selig, J. P., & Preacher, K. J. (2009) · Research in Human Development · doi:10.1080/15427600902911247 · Cited by 804
(2001) · Probabilistic Risk Analysis · doi:10.1017/cbo9780511813597.005 · Cited by 714
Lower level mediation in multilevel models.
Kenny, D. A., Korchmaros, J. D., & Bolger, N. (2003) · Psychological Methods · doi:10.1037/1082-989x.8.2.115 · Cited by 687
Chmura Kraemer, H., Kiernan, M., Essex, M., & Kupfer, D. J. (2008) · Health Psychology · doi:10.1037/0278-6133.27.2(suppl.).s101 · Cited by 600
Taking Account of Time Lags in Causal Models
Gollob, H. F., & Reichardt, C. S. (1987) · Child Development · doi:10.2307/1130293 · Cited by 572 · cited 4×
“In fact, one perspective offered by Gollob and Reichardt (1987) is that there is no true lag but instead the observed causal effect may simply depend on the lag chosen in any given situation.”
BackgroundMethodInfluentialAn Alternative Framework for Defining Mediation
Collins, L. M., Graham, J. J., & Flaherty, B. P. (1998) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3302_5 · Cited by 420
Linear Causal Modeling with Structural Equations
Mulaik, S. A. (2009) · Chapman & Hall/CRC eBooks · doi:10.1201/9781439800393 · Cited by 278
Interpreting and estimating indirect effects assuming time lags really matter.
Gollob, H. F., & Reichardt, C. S. (1991) · Best methods for the analysis of change: Recent advances, unanswered questions, future directions. · doi:10.1037/10099-015 · Cited by 198
Tein, J.-Y., Sandler, I. N., MacKinnon, D. P., & Wolchik, S. A. (2004) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.72.4.617 · Cited by 186
Advances in Quasi-Experimental Design and Analysis
Trochim, W. M. K. (1986) · Cited by 145
Shadish, W. R. (2010) · Psychological Methods · doi:10.1037/a0015916 · Cited by 143
Campbell’s and Rubin’s perspectives on causal inference.
West, S. G., & Thoemmes, F. (2010) · Psychological Methods · doi:10.1037/a0015917 · Cited by 141
Causal inference in randomized experiments with mediational processes.
Jo, B. (2008) · Psychological Methods · doi:10.1037/a0014207 · Cited by 139
Handbook of Ethics in Quantitative Methodology
(2011) · Routledge eBooks · doi:10.4324/9780203840023 · Cited by 108
Boker, S. M. (2002) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3703_5 · Cited by 74
Statistical Methods for Risk-Outcome Research: Being Sensitive to Longitudinal Structure
Cole, D. A., & Maxwell, S. E. (2009) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-060508-130357 · Cited by 51
Self-citationContinuous time modeling of reciprocal relationships in the cross-lagged panel design
Oud, J. H. L. (2007) · Radboud Repository (Radboud University) · Cited by 35
Satisfying the constraints of causal modeling
Reichardt, C. S., & Gollob, H. F. (1986) · New Directions for Program Evaluation · doi:10.1002/ev.1436 · Cited by 34
Raykov, T., & Mels, G. (2007) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705510701575511 · Cited by 15
The Science and Ethics of Causal Modeling
Pearl, J. (2015) · Routledge eBooks · doi:10.4324/9780203840023.ch15 · Cited by 5
Cited by
An index and test of linear moderated mediation
Hayes, A. F. (2015) · Multivariate Behavioral Research · doi:10.1080/00273171.2014.962683 · Cited by 3,979
Exploring pathways linking greenspace to health: theoretical and methodological guidance
Markevych, I., Schoierer, J., Hartig, T., Chudnovsky, A., Hystad, P., Dzhambov, A. M., de Vries, S., Triguero-Mas, M., Brauer, M., Nieuwenhuijsen, M. J., et al. (2017) · Environmental Research · doi:10.1016/j.envres.2017.06.028 · Cited by 2,543
Mendelian randomisation for mediation analysis: current methods and challenges for implementation
Carter, A. R., Sanderson, E., Hammerton, G., Richmond, R. C., Davey Smith, G., Heron, J., Taylor, A. E., Davies, N. M., & Howe, L. D. (2021) · European Journal of Epidemiology · doi:10.1007/s10654-021-00757-1 · Cited by 1,215
“This approach is preferred even when time varying effects are not a focus of the analysis, as cross-sectional data does not reflect the implied temporality suggested by mediation analysis [57–59].”
ResultHayes, A. F., & Rockwood, N. J. (2020) · American Behavioral Scientist · doi:10.1177/0002764219859633 · Cited by 1,000
Advances in Mediation Analysis: A Survey and Synthesis of New Developments
Preacher, K. J. (2015) · Annual Review of Psychology · doi:10.1146/annurev-psych-010814-015258 · Cited by 793
Metadata
- Authors
- Maxwell, S. E., Cole, D. A., & Mitchell, M. A.
- Venue
- Multivariate Behavioral Research
- Publisher
- Informa UK Limited
- Published
- 2011-09-30
- Volume
- 46
- Issue
- 5
- Pages
- 816-841
- ISSN
- 0027-3171 (ISSN-L)
- 1532-7906
- OpenAlex
- W2119963803
- Cited by
- 1,338
- References
- 48
- FWCI
- 16.69
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.