Longitudinal modeling in developmental neuroimaging research: Common challenges, and solutions from developmental psychology
Open accessThe DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
Abstract
Hypotheses about change over time are central to informing our understanding of development. Developmental neuroscience is at critical juncture: although the majority of longitudinal imaging studies have observations with two time points, researchers are increasingly obtaining three or more observations of the same individuals. The goals of the proposed manuscript are to draw upon the long history of methodological and applied literature on longitudinal statistical models to summarize common problems and issues that arise in their use. We also provide suggestions and solutions to improve the design, analysis and interpretation of longitudinal data, and discuss the importance of matching the theory of change with the appropriate statistical model used to test the theory. Researchers should articulate a clear theory of change and to design studies to capture that change and use appropriately sensitive measures to assess that change during development. Simulated data are used to demonstrate several common analytic approaches to longitudinal analyses. We provide the code for our simulations and figures in an online supplement to aid researchers in exploring and plotting their data. We provide brief examples of best practices for reporting such models. Finally, we clarify common misunderstandings in the application and interpretation of these analytic approaches.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788
Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A., & Wager, T. D. (2000) · Cognitive Psychology · doi:10.1006/cogp.1999.0734 · Cited by 15,798
Nylund, K. L., Asparouhov, T., & Muthén, B. O. (2007) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705510701575396 · Cited by 11,415
Toward an experimental ecology of human development.
Bronfenbrenner, U. (1977) · American Psychologist · doi:10.1037/0003-066x.32.7.513 · Cited by 10,853
Vandenberg, R. J., & Lance, C. E. (2000) · Organizational Research Methods · doi:10.1177/109442810031002 · Cited by 7,997
Marsh, H. W., Hau, K.-T., & Wen, Z. (2004) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem1103_2 · Cited by 6,691 · cited 2×
“Substantial research suggested that using strict cutoffs does not perform well under some circumstances (Marsh et al., 2004).”
BackgroundPekrun, R. (2006) · Educational Psychology Review · doi:10.1007/s10648-006-9029-9 · Cited by 5,566
Centering predictor variables in cross-sectional multilevel models: A new look at an old issue.
Enders, C. K., & Tofighi, D. (2007) · Psychological Methods · doi:10.1037/1082-989x.12.2.121 · Cited by 4,462
A critique of the cross-lagged panel model
Hamaker, E. L., Kuiper, R. M., & Grasman, R. P. P. P. (2015) · Psychological Methods · doi:10.1037/a0038889 · Cited by 4,005
Miyake, A., & Friedman, N. P. (2012) · Current Directions in Psychological Science · doi:10.1177/0963721411429458 · Cited by 3,944 · cited 1×
“However, subsequent psychometric evaluations cast doubt on the robustness of the originally proposed measurement model (Miyake and Friedman, 2012).”
BackgroundCole, D. A., & Maxwell, S. E. (2003) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.112.4.558 · Cited by 3,605
Analyzing developmental trajectories: A semiparametric, group-based approach.
Nagin, D. S. (1999) · Psychological Methods · doi:10.1037/1082-989x.4.2.139 · Cited by 2,346 · cited 1×
“Latent class growth models (LCGM; Nagin, 1999) extend LCMs by assuming that multiple discrete populations produced the sample data.”
BackgroundReporting practices in confirmatory factor analysis: an overview and some recommendations
Jackson, D. L., Gillaspy, J. A., & Purc-Stephenson, R. (2009) · Psychological Methods · doi:10.1037/a0014694 · Cited by 2,242
Inhibition and the right inferior frontal cortex: one decade on
Aron, A. R., Robbins, T. W., & Poldrack, R. A. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2013.12.003 · Cited by 2,166
The disaggregation of within-person and between-person effects in longitudinal models of change
Curran, P. J., & Bauer, D. J. (2011) · Annual Review of Psychology · doi:10.1146/annurev.psych.093008.100356 · Cited by 2,056
Latent Variable Modeling of Differences and Changes with Longitudinal Data
McArdle, J. J. (2009) · Annual Review of Psychology · doi:10.1146/annurev.psych.60.110707.163612 · Cited by 1,952 · cited 4×
“Latent change score models (LCS; Ferrer and McArdle, 2010; McArdle, 2009) are SEM-based extensions of the auto-regressive panel model that may be used to test auto-regressive, cross-lag models and growth curve models (described in more detail below), while allowing somewhat more dynamic questions…”
BackgroundMethodInfluentialMasten, A. S., & Cicchetti, D. (2010) · Development and Psychopathology · doi:10.1017/s0954579410000222 · Cited by 1,800
Using Generalized Estimating Equations for Longitudinal Data Analysis
Ballinger, G. A. (2004) · Organizational Research Methods · doi:10.1177/1094428104263672 · Cited by 1,567 · cited 1×
“(Ballinger, 2004; McNeish et al., 2016; Zeger et al., 1988) Latent curve models (LCMs) model the growth process (i.e., intercepts and slopes) as latent variables within an SEM framework (Bollen and Curran, 2006) and are similar to multilevel GCMs (Curran, 2003).”
MethodThe reliability paradox: Why robust cognitive tasks do not produce reliable individual differences
Hedge, C., Powell, G., & Sumner, P. (2018) · Behavior Research Methods · doi:10.3758/s13428-017-0935-1 · Cited by 1,457 · cited 2×
“ences in the magnitude of that response (Hedge et al., 2017).”
BackgroundPersonality Trait Change in Adulthood
Roberts, B. W., & Mroczek, D. (2008) · Current Directions in Psychological Science · doi:10.1111/j.1467-8721.2008.00543.x · Cited by 1,222
Ram, N., & Grimm, K. J. (2009) · International Journal of Behavioral Development · doi:10.1177/0165025409343765 · Cited by 1,143 · cited 3×
“Latent growth mixture models (LGMMs) extend the Nagin model by allowing the latent classes to have variability around the mean intercept and slopes (Ram and Grimm, 2009).”
InfluentialYes, but what’s the mechanism? (don’t expect an easy answer).
Bullock, J. G., Green, D. P., & Ha, S. E. (2010) · Journal of Personality and Social Psychology · doi:10.1037/a0018933 · Cited by 1,063
Tamnes, C. K., Herting, M. M., Goddings, A.-L., Meuwese, R., Blakemore, S.-J., Dahl, R. E., Güroğlu, B., Raznahan, A., Sowell, E. R., Crone, E. A., et al. (2017) · The Journal of Neuroscience · doi:10.1523/jneurosci.3302-16.2017 · Cited by 685
Self-citationBraams, B. R., van Duijvenvoorde, A. C. K., Peper, J. S., & Crone, E. A. (2015) · The Journal of Neuroscience · doi:10.1523/jneurosci.4764-14.2015 · Cited by 617
Mills, K. L., Goddings, A.-L., Herting, M. M., Meuwese, R., Blakemore, S.-J., Crone, E. A., Dahl, R. E., Güroğlu, B., Raznahan, A., Sowell, E. R., et al. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.07.044 · Cited by 600
Self-citationTaking Account of Time Lags in Causal Models
Gollob, H. F., & Reichardt, C. S. (1987) · Child Development · doi:10.2307/1130293 · Cited by 572
Developmental cognitive neuroscience using latent change score models: A tutorial and applications
Kievit, R. A., Brandmaier, A. M., Ziegler, G., van Harmelen, A.-L., de Mooij, S. M. M., Moutoussis, M., Goodyer, I. M., Bullmore, E., Jones, P. B., Fonagy, P., et al. (2018) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2017.11.007 · Cited by 516
Steinberg, L., Icenogle, G., Shulman, E. P., Breiner, K., Chein, J., Bacchini, D., Chang, L., Chaudhary, N., Giunta, L. D., Dodge, K. A., et al. (2018) · Developmental Science · doi:10.1111/desc.12532 · Cited by 514
One-year temporal stability of delay-discount rates
Kirby, K. N. (2009) · Psychonomic Bulletin & Review · doi:10.3758/pbr.16.3.457 · Cited by 487
Østby, Y., Tamnes, C. K., Fjell, A. M., Westlye, L. T., Due-Tønnessen, P., & Walhovd, K. B. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.1242-09.2009 · Cited by 480 · cited 1×
“Researchers should also use less biased approaches to test parameter significance such as likelihood ratio test/deviance tests (Agresti, 2002; Johnston and Dinardo, 1997), given the more standard Wald-Z test may be positively biased when samples are less than 100 (Pawitan, 2001).”
MethodAdvances in Analysis of Longitudinal Data
Gibbons, R. D., Hedeker, D., & DuToit, S. (2010) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.032408.153550 · Cited by 452
Delay discounting: Trait variable?
Odum, A. L. (2011) · Behavioural Processes · doi:10.1016/j.beproc.2011.02.007 · Cited by 449
Autoregressive Latent Trajectory (ALT) Models A Synthesis of Two Traditions
Bollen, K. A., & Curran, P. J. (2004) · Sociological Methods & Research · doi:10.1177/0049124103260222 · Cited by 447 · cited 2×
“, 2003), autoregressive latent trajectory (ALT) models (Bollen and Curran, 2004), or latent curves with structured residuals (Curran et al.”
BackgroundThe medial prefrontal cortex and the emergence of self-conscious emotion in adolescence
Somerville, L. H., Jones, R. M., Ruberry, E. J., Dyke, J. P., Glover, G., & Casey, B. J. (2013) · Psychological Science · doi:10.1177/0956797613475633 · Cited by 405
The Teenage Brain: The Stress Response and the Adolescent Brain
Romeo, R. D. (2013) · Current Directions in Psychological Science · doi:10.1177/0963721413475445 · Cited by 343 · cited 1×
“For example, neurodevelopmental theories attempt to explain developmental changes in risk taking and impulsivity based on the development of the pre-frontal cortex and subcortical structures including the striatum and amygdala (e.g., Casey and Caudle, 2013; Romeo, 2013).”
BackgroundHarden, K. P., & Tucker-Drob, E. M. (2011) · Developmental Psychology · doi:10.1037/a0023279 · Cited by 342
Developmental Trajectories of Anxiety and Depression in Early Adolescence
McLaughlin, K. A., & King, K. (2015) · Journal of Abnormal Child Psychology · doi:10.1007/s10802-014-9898-1 · Cited by 327
Self-citationLongitudinal Growth Curves of Brain Function Underlying Inhibitory Control through Adolescence
Ordaz, S. J., Foran, W., Velanova, K., & Luna, B. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.1741-13.2013 · Cited by 302 · cited 1×
“Cross-sectional studies can infer developmental change by measuring individuals with the same measure at specific ages (e.g., Ostby et al., 2009; Somerville et al., 2013), but inferences about age are confounded by cohort and period (Glenn, 1976), and certain examinations of change (e.g.,…”
BackgroundLongitudinal Modeling of Developmental Changes in Psychological Research
Ferrer, E., & McArdle, J. J. (2010) · Current Directions in Psychological Science · doi:10.1177/0963721410370300 · Cited by 293
Alternative Structural Models for Multivariate Longitudinal Data Analysis
Ferrer, E., & McArdle, J. (2003) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem1004_1 · Cited by 239
Reliability and plasticity of response inhibition and interference control
Wöstmann, N. M., Aichert, D. S., Costa, A., Rubia, K., Möller, H.-J., & Ettinger, U. (2013) · Brain and Cognition · doi:10.1016/j.bandc.2012.09.010 · Cited by 217
Weafer, J., Baggott, M. J., & de Wit, H. (2013) · Experimental and Clinical Psychopharmacology · doi:10.1037/a0033659 · Cited by 214
Salthouse, T. A. (2014) · Current Directions in Psychological Science · doi:10.1177/0963721414535212 · Cited by 174
Ritchie, S. J., Bates, T. C., & Plomin, R. (2015) · Child Development · doi:10.1111/cdev.12272 · Cited by 98
Cited by
Environmental influences on the pace of brain development
Tooley, U. A., Bassett, D. S., & Mackey, A. P. (2021) · Nature reviews. Neuroscience · doi:10.1038/s41583-021-00457-5 · Cited by 488
Studying individual differences in human adolescent brain development
Foulkes, L., & Blakemore, S.-J. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0078-4 · Cited by 413
Rogers, A. A., Padilla-Walker, L. M., McLean, R. D., & Hurst, J. L. (2020) · Journal of Youth and Adolescence · doi:10.1007/s10964-019-01070-7 · Cited by 105
Social contextual risk taking in adolescence
Kwon, S.-J., & Telzer, E. H. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-022-00060-0 · Cited by 32
Metadata
- Authors
- King, K. M., Littlefield, A. K., McCabe, C. J., Mills, K. L., Flournoy, J., & Chassin, L.
- Venue
- Developmental Cognitive Neuroscience
- Publisher
- Elsevier BV
- Published
- 2018-10
- Volume
- 33
- Pages
- 54-72
- ISSN
- 1878-9293 (ISSN-L)
- OpenAlex
- W2770925207
- Cited by
- 111
- References
- 44
- FWCI
- 7.35
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.