From Data to Causes II: Comparing Approaches to Panel Data Analysis
Open accessThe DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
This article compares a general cross-lagged model (GCLM) to other panel data methods based on their coherence with a causal logic and pragmatic concerns regarding modeled dynamics and hypothesis testing. We examine three “static” models that do not incorporate temporal dynamics: random- and fixed-effects models that estimate contemporaneous relationships; and latent curve models. We then describe “dynamic” models that incorporate temporal dynamics in the form of lagged effects: cross-lagged models estimated in a structural equation model (SEM) or multilevel model (MLM) framework; Arellano-Bond dynamic panel data methods; and autoregressive latent trajectory models. We describe the implications of overlooking temporal dynamics in static models and show how even popular cross-lagged models fail to control for stable factors over time. We also show that Arellano-Bond and autoregressive latent trajectory models have various shortcomings. By contrasting these approaches, we clarify the benefits and drawbacks of common methods for modeling panel data, including the GCLM approach we propose. We conclude with a discussion of issues regarding causal inference, including difficulties in separating different types of time-invariant and time-varying effects over time.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Econometric Analysis of Panel Data
Baltagi, B. H. (2021) · Springer Texts in Business and Economics · doi:10.1007/978-3-030-53953-5 · Cited by 15,104
How to do Xtabond2: An Introduction to Difference and System GMM in Stata
Roodman, D. (2009) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0900900106 · Cited by 9,848
Biases in dynamic models with fixed effects
Nickell, S. (1981) · Econometrica · doi:10.2307/1911408 · Cited by 8,735
Hsiao, C. (2014) · doi:10.1017/cbo9781139839327 · Cited by 7,869
Hsiao, C. (2022) · doi:10.1017/9781009057745 · Cited by 7,869
Hsiao, C. (2003) · doi:10.1017/cbo9780511754203 · Cited by 7,869
Centering predictor variables in cross-sectional multilevel models: A new look at an old issue.
Enders, C. K., & Tofighi, D. (2007) · Psychological Methods · doi:10.1037/1082-989x.12.2.121 · Cited by 4,462
A critique of the cross-lagged panel model
Hamaker, E. L., Kuiper, R. M., & Grasman, R. P. P. P. (2015) · Psychological Methods · doi:10.1037/a0038889 · Cited by 4,005 · cited 5×
“…research has recognized all of the terms included in the GCLM in various ways (e.g., du Toit & Browne, 2001, 2007; Hamaker, Dolan, & Molenaar, 2002; Hamaker et al., 2015; Hamaker & Grasman, 2015), and therefore a GCLM can be seen as bringing these terms together in a coherent and easy-to-implement…”
BackgroundMethodInfluentialSelf-citationFixed Effects Regression Models
Allison, P. (2009) · doi:10.4135/9781412993869 · Cited by 3,999
Self-citationCole, D. A., & Maxwell, S. E. (2003) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.112.4.558 · Cited by 3,605 · cited 2×
“Although higher-order lags for AR and CL terms are possible (Cole & Maxwell, 2003; Little, 2013; Maxwell & Cole, 2007; Maxwell, Cole, & Mitchell, 2011), in practice researchers often default to an AR(1)CL(1) model (e.g., Eby, Butts, Hoffman, & Sauer, 2015; Maynard, Luciano, D’Innocenzo, Mathieu, &…”
BackgroundBias in cross-sectional analyses of longitudinal mediation
Maxwell, S. E., & Cole, D. A. (2007) · Psychological Methods · doi:10.1037/1082-989x.12.1.23 · Cited by 3,401 · cited 2×
“Although higher-order lags for AR and CL terms are possible (Cole & Maxwell, 2003; Little, 2013; Maxwell & Cole, 2007; Maxwell, Cole, & Mitchell, 2011), in practice researchers often default to an AR(1)CL(1) model (e.g., Eby, Butts, Hoffman, & Sauer, 2015; Maynard, Luciano, D’Innocenzo, Mathieu, &…”
BackgroundRelative Income, Happiness, and Utility: An Explanation for the Easterlin Paradox and Other Puzzles
Clark, A. E., Frijters, P., & Shields, M. A. (2008) · Journal of Economic Literature · doi:10.1257/jel.46.1.95 · Cited by 3,159
Estimating dynamic panel data models: a guide for macroeconomists
Judson, R. A., & Owen, A. L. (1999) · Economics Letters · doi:10.1016/s0165-1765(99)00130-5 · Cited by 2,171 · cited 1×
“1, it can be sizable at T ¼ 30 or even 100 when AR (and CL) terms are large (Hamaker & Grasman, 2015; Jongerling, Laurenceau, & Hamaker, 2015; Judson & Owen, 1999; Nerlove, Sevestre, & Balestra, 2008).”
Measurement of Linear Dependence and Feedback between Multiple Time Series
Geweke, J. (1982) · Journal of the American Statistical Association · doi:10.1080/01621459.1982.10477803 · Cited by 2,060
The disaggregation of within-person and between-person effects in longitudinal models of change
Curran, P. J., & Bauer, D. J. (2011) · Annual Review of Psychology · doi:10.1146/annurev.psych.093008.100356 · Cited by 2,056
Latent Variable Modeling of Differences and Changes with Longitudinal Data
McArdle, J. J. (2009) · Annual Review of Psychology · doi:10.1146/annurev.psych.60.110707.163612 · Cited by 1,952 · cited 2×
“We also note that there are other methods for analyzing panel data such as latent change score models (i.e., a model in differences; McArdle, 2001, 2009), but these can be seen as special cases of a GCLM (e.g., Voelkle & Oud, 2015).”
BackgroundMethodGranger, C. W. J. (1980) · Journal of Economic Dynamics and Control · doi:10.1016/0165-1889(80)90069-x · Cited by 1,746
Panel Data Models With Interactive Fixed Effects
(2009) · Econometrica · doi:10.3982/ecta6135 · Cited by 1,690
Bayesian structural equation modeling: A more flexible representation of substantive theory
Muthén, B., & Asparouhov, T. (2012) · Psychological Methods · doi:10.1037/a0026802 · Cited by 1,562 · cited 1×
“To solve this, we used a Bayes procedure with Markov Chain Monte Carlo estimation with “uninformative” or “diffuse” priors to approximate maximum-likelihood results (Muthén & Asparouhov, 2012; see Online Appendix C for more details).”
MethodA General Approach for Representing Constructs in Organizational Research
Bagozzi, R. P., & Edwards, J. R. (1998) · Organizational Research Methods · doi:10.1177/109442819800100104 · Cited by 1,217
Counterfactuals and Causal Inference: Methods and Principles for Social Research
Morgan, S. L., & Winship, C. (2014) · Cambridge University Press · doi:10.1017/cbo9781107587991 · Cited by 1,037
Panel Models in Sociological Research: Theory into Practice
Halaby, C. N. (2004) · Annual Review of Sociology · doi:10.1146/annurev.soc.30.012703.110629 · Cited by 946 · cited 2×
“This can be done in various ways (Halaby, 2004), classically with predictors to (dummy) code .”
BackgroundNezlek, J. B. (2001) · Personality and Social Psychology Bulletin · doi:10.1177/0146167201277001 · Cited by 676
Taking Account of Time Lags in Causal Models
Gollob, H. F., & Reichardt, C. S. (1987) · Child Development · doi:10.2307/1130293 · Cited by 572 · cited 1×
“If instantaneousness is accepted, it may be difficult to infer that xit and yit measure different things (or that one can be predictive of the other) because they are being modeled as immediately changing together (Gollob & Reichardt, 1987).”
BackgroundThe causal relation between job attitudes and performance: A meta-analysis of panel studies.
Riketta, M. (2008) · Journal of Applied Psychology · doi:10.1037/0021-9010.93.2.472 · Cited by 547 · cited 1×
“Like recommendations for MLMs with lagged effects (e.g., Hoffman, 2015; Nezlek, 2012a, 2012b), the problem of small T and Zi persists in even leading organizational journals (e.g., Eby et al., 2015; Maynard et al., 2014; Nohe et al., 2015; Riketta, 2008).”
BackgroundThe Fallacy of Formative Measurement
Edwards, J. R. (2011) · Organizational Research Methods · doi:10.1177/1094428110378369 · Cited by 495
Autoregressive Latent Trajectory (ALT) Models A Synthesis of Two Traditions
Bollen, K. A., & Curran, P. J. (2004) · Sociological Methods & Research · doi:10.1177/0049124103260222 · Cited by 447 · cited 1×
“The autoregressive latent trajectory (ALT) model combines cross-lagged and LCM methods (Bollen & Curran, 2004, 2006; Bollen & Zimmer, 2010; Curran & Bollen, 2001).”
MethodBeal, D. J. (2015) · Annual Review of Organizational Psychology and Organizational Behavior · doi:10.1146/annurev-orgpsych-032414-111335 · Cited by 436 · cited 2×
“This is often done because researchers believe that this centering presents no issues beyond those of static MLMs (e.g., Beal, 2015; Duckworth, Tsukayama, & May, 2010; Enders & Tofighi, 2007; see also Uy, Foo, & Aguinis, 2010).”
BackgroundMultilevel Modeling for Social and Personality Psychology
Nezlek, J. (2011) · doi:10.4135/9781446287996 · Cited by 262
Longitudinal data analysis using structural equation models.
McArdle, J. J., & Nesselroade, J. R. (2014) · doi:10.1037/14440-000 · Cited by 244
Duckworth, A. L., Tsukayama, E., & May, H. (2010) · Social Psychological and Personality Science · doi:10.1177/1948550609359707 · Cited by 234
Allen, P. G., & Fildes, R. (2001) · International Series in Operations Research & Management Science · doi:10.1007/978-0-306-47630-3_15 · Cited by 85 · cited 1×
“These models can be reparameterized as cross-lagged SEMs or panel vector autoregressive models (see Allen & Fildes, 2001; Arellano, 2003; Bai, 2013; Baltagi, 2013a, 2013b; McArdle & Nesselroade, 2014; MoralBenito, 2013; Usami, Hayes, & McArdle, 2015; Voelkle & Oud, 2015).”
Cited by
Three Extensions of the Random Intercept Cross-Lagged Panel Model
Mulder, J. D., & Hamaker, E. L. (2021) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2020.1784738 · Cited by 1,151
Self-citationTesting prospective effects in longitudinal research: Comparing seven competing cross-lagged models.
Orth, U., Clark, D. A., Donnellan, M. B., & Robins, R. W. (2021) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000358 · Cited by 801
Psychopathological networks: Theory, methods and practice
Bringmann, L. F., Albers, C., Bockting, C., Borsboom, D., Ceulemans, E., Cramer, A., Epskamp, S., Eronen, M. I., Hamaker, E., Kuppens, P., et al. (2022) · Behaviour Research and Therapy · doi:10.1016/j.brat.2021.104011 · Cited by 300
Self-citationA review on health and well‐being at work: More than stressors and strains
Sonnentag, S., Tay, L., & Nesher Shoshan, H. (2023) · Personnel Psychology · doi:10.1111/peps.12572 · Cited by 212
Self-citationSibling Constructs: What Are They, Why Do They Matter, and How Should You Handle Them?
Lawson, K. M., & Robins, R. W. (2021) · Personality and Social Psychology Review · doi:10.1177/10888683211047101 · Cited by 144
Metadata
- Authors
- Zyphur, M. J., Voelkle, M. C., Tay, L., Allison, P. D., Preacher, K. J., Zhang, Z., Hamaker, E. L., Shamsollahi, A., Pierides, D. C., Koval, P., & Diener, E.
- Venue
- Organizational Research Methods
- Publisher
- SAGE Publications
- Published
- 2019-05-24
- Volume
- 23
- Issue
- 4
- Pages
- 688-716
- ISSN
- 1094-4281 (ISSN-L)
- 1552-7425
- OpenAlex
- W2945760317
- Cited by
- 126
- References
- 32
- FWCI
- 15.90
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.