Description, prediction and causation: Methodological challenges of studying child and adolescent development
Open accessThe DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
Scientific research can be categorized into: a) descriptive research, with the main goal to summarize characteristics of a group (or person); b) predictive research, with the main goal to forecast future outcomes that can be used for screening, selection, or monitoring; and c) explanatory research, with the main goal to understand the underlying causal mechanism, which can then be used to develop interventions. Since each goal requires different research methods in terms of design, operationalization, model building and evaluation, it should form an important basis for decisions on how to set up and execute a study. To determine the extent to which developmental research is motivated by each goal and how this aligns with the research designs that are used, we evaluated 100 publications from the Consortium on Individual Development (CID). This analysis shows that the match between research goal and research design is not always optimal. We discuss alternative techniques, which are not yet part of the developmental scientist's standard toolbox, but that may help bridge some of the lurking gaps that developmental scientists encounter between their research design and their research goal. These include unsupervised and supervised machine learning, directed acyclical graphs, Mendelian randomization, and target trials.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Causality: Models, Reasoning, and Inference
Pearl, J. (2009) · doi:10.1017/cbo9780511803161 · Cited by 11,653
Testing for Weak Instruments in Linear IV Regression
Stock, J. H., & Yogo, M. (2005) · Identification and Inference for Econometric Models · doi:10.1017/cbo9780511614491.006 · Cited by 7,211
Bayesian model selection in social research
Raftery, A. E. (1995) · Sociological Methodology · doi:10.2307/271063 · Cited by 6,823
Population Structure and Eigenanalysis
Patterson, N., Price, A. L., & Reich, D. (2006) · PLoS Genetics · doi:10.1371/journal.pgen.0020190 · Cited by 5,280 · cited 1×
“studying neurons individually (Cunningham and Yu, 2014), and in the field of genetics it is used to study differences in genetic make-up of different populations (Patterson et al., 2006).”
Causation, Prediction, and Search
Spirtes, P., Glymour, C., & Scheines, R. (2001) · doi:10.7551/mitpress/1754.001.0001 · Cited by 4,521
Reading Mendelian randomisation studies: a guide, glossary, and checklist for clinicians
Davies, N. M., Holmes, M. V., & Davey Smith, G. (2018) · BMJ · doi:10.1136/bmj.k601 · Cited by 4,404 · cited 1×
“While in principle the genotype measure should only affect the outcome indirectly through its effect on the exposure of interest (Davies et al., 2018), it is also possible to block additional indirect (genetic) paths by conditioning on mediators on such paths.”
Identification of Causal Effects Using Instrumental Variables
Angrist, J. D., Imbens, G. W., & Rubin, D. B. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476902 · Cited by 4,230
A critique of the cross-lagged panel model
Hamaker, E. L., Kuiper, R. M., & Grasman, R. P. P. P. (2015) · Psychological Methods · doi:10.1037/a0038889 · Cited by 4,005
Self-citationA survey of cross-validation procedures for model selection
Arlot, S., & Celisse, A. (2010) · Statistics Surveys · doi:10.1214/09-ss054 · Cited by 3,522
Causal inference in statistics: An overview
Pearl, J. (2009) · Statistics Surveys · doi:10.1214/09-ss057 · Cited by 2,336 · cited 3×
“…methodology that can improve causal inference under ideal and less ideal scenarios (e.g., Angrist and Pischke, 2009; Foster, 2010; Hernán and Robins, 2020; Pearl, 2009a, 2009b; Rosenbaum and Rubin, 1983; Schafer and Kang, 2008; Shrout et al., 2008; VanderWeele, 2015; VanSteelandt and Lange, 2012).”
Resting-state connectivity biomarkers define neurophysiological subtypes of depression
Drysdale, A. T., Grosenick, L., Downar, J., Dunlop, K., Mansouri, F., Meng, Y., Fetcho, R. N., Zebley, B., Oathes, D. J., Etkin, A., et al. (2017) · Nature Medicine · doi:10.1038/nm.4246 · Cited by 2,170
The Scientific Use of Factor Analysis in Behavioral and Life Sciences
Cattell, R. B. (1978) · doi:10.1007/978-1-4684-2262-7 · Cited by 2,165
Molenaar, P. C. M. (2004) · Measurement: Interdisciplinary Research & Perspective · doi:10.1207/s15366359mea0204_1 · Cited by 1,943 · cited 3×
“While finding replicable results may be seen as an important step towards this ultimate goal, there is also a large body of literature arguing that averages and aggregates obtained at the level of the population cannot be automatically generalized to the individual (cf. Molenaar, 2004).”
BackgroundResultMeta-analysis of individual participant data: rationale, conduct, and reporting
Riley, R. D., Lambert, P. C., & Abo-Zaid, G. (2010) · BMJ · doi:10.1136/bmj.c221 · Cited by 1,701 · cited 1×
“A related approach is individual participant data (IPD) meta-analysis, which originated in biomedical research (Riley et al., 2010), and is now slowly gaining ground in developmental science (e.”
Identification, Inference and Sensitivity Analysis for Causal Mediation Effects
Imai, K., Keele, L., & Yamamoto, T. (2010) · Statistical Science · doi:10.1214/10-sts321 · Cited by 1,628
The SAGE Encyclopedia of Educational Research, Measurement, and Evaluation
Frey, B. B. (2018) · doi:10.4135/9781506326139 · Cited by 1,471
Dimensionality reduction for large-scale neural recordings
Cunningham, J. P., & Yu, B. M. (2014) · Nature Neuroscience · doi:10.1038/nn.3776 · Cited by 1,219
Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable
Elwert, F., & Winship, C. (2014) · Annual Review of Sociology · doi:10.1146/annurev-soc-071913-043455 · Cited by 1,168 · cited 2×
“Additionally, DAGs are also a useful tool in understanding phenomena such as selection bias, nonresponse bias, and measurement bias (e.g., Elwert and Winship, 2014; Hernán and Robins, 2020).”
BackgroundMethodBaldwin, J. R., Reuben, A., Newbury, J. B., & Danese, A. (2019) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2019.0097 · Cited by 1,094
Thinking Clearly About Correlations and Causation: Graphical Causal Models for Observational Data
Rohrer, J. M. (2018) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245917745629 · Cited by 1,002 · cited 5×
“…DAGs to decide whether one should use baseline adjustment in change analysis (see also: Pearl, 2016; Kim and Steiner, 2019; Tennant et al., 2019); Rohrer (2018) discusses DAG methodology in psychology; Lee (2012) presents an extensive account of DAG methodology in the context of personality…”
InfluentialMachine Learning Approaches for Clinical Psychology and Psychiatry
Dwyer, D. B., Falkai, P., & Koutsouleris, N. (2018) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-032816-045037 · Cited by 966 · cited 2×
“The concept of cross-validation lies at the heart of supervised learning, which is a type of machine learning that mitigates the risk of overfitting when we try to predict an observable outcome as accurately as possible (Dwyer et al., 2018; Hastie et al., 2009; Yarkoni & Westfall, 2017).”
Berry, D., & Willoughby, M. T. (2017) · Child Development · doi:10.1111/cdev.12660 · Cited by 737
Elliott, M. L., Knodt, A. R., Ireland, D., Morris, M. L., Poulton, R., Ramrakha, S., Sison, M. L., Moffitt, T. E., Caspi, A., & Hariri, A. R. (2020) · Psychological Science · doi:10.1177/0956797620916786 · Cited by 714
Taking Account of Time Lags in Causal Models
Gollob, H. F., & Reichardt, C. S. (1987) · Child Development · doi:10.2307/1130293 · Cited by 572 · cited 1×
“Moreover, lagged relations depend critically on the distance in time between the observations (Deboeck and Preacher, 2016; Gollob and Reichardt, 1987; Ryan et al., 2018; Voelkle et al., 2012).”
A Second Chance to Get Causal Inference Right: A Classification of Data Science Tasks
Hernán, M. A., Hsu, J., & Healy, B. (2019) · CHANCE · doi:10.1080/09332480.2019.1579578 · Cited by 495
Addressing the theory crisis in psychology
Oberauer, K., & Lewandowsky, S. (2019) · Psychonomic Bulletin & Review · doi:10.3758/s13423-019-01645-2 · Cited by 462 · cited 1×
“may be of little value if they are based on statistical models that are not properly linked to an underlying theory (Larzelere et al., 2010; Oberauer and Lewandowsky, 2019; Szollosi et al., 2019).”
On the distinction between interaction and effect modification
VanderWeele, T. J. (2009) · Epidemiology · doi:10.1097/ede.0b013e3181ba333c · Cited by 450
A unified framework of longitudinal models to examine reciprocal relations.
Usami, S., Murayama, K., & Hamaker, E. L. (2019) · Psychological Methods · doi:10.1037/met0000210 · Cited by 437 · cited 2×
“However, there are diverse ways in which this can be done, and these approaches can easily lead to different, and even conflicting conclusions when results are used for causal inference (Allison, 2006; Larzelere, Ferrer, Kuhn & Danelia, 2010; Usami et al., 2019).”
Self-citationComparing meta-analyses and preregistered multiple-laboratory replication projects
Kvarven, A., Strømland, E., & Johannesson, M. (2019) · Nature Human Behaviour · doi:10.1038/s41562-019-0787-z · Cited by 271 · cited 1×
“Moreover, publication bias against null results (Rosenthal, 1979), and the profuse use of ‘researcher degrees of freedom’ (see Luck and Gaspelin, 2017 for an example from EEG research), might be counteracted by (pre-)registration (Kvarven et al., 2019).”
ResultDependent Stressful Life Events and Prior Depressive Episodes in the Prediction of Major Depression
Kendler, K. S., & Gardner, C. O. (2010) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2010.136 · Cited by 156 · cited 2×
“quasi-experimental method such as propensity score matching makes the causal claim more plausible (Kendler and Gardner, 2010; Ohlsson and Kendler, 2020).”
How to use Mendelian randomization to anticipate the results of randomized trials
Ference, B. A. (2018) · European Heart Journal · doi:10.1093/eurheartj/ehx462 · Cited by 96
Gardner, F., Leijten, P., Melendez-Torres, G. J., Landau, S., Harris, V., Mann, J., Beecham, J., Hutchings, J., & Scott, S. (2019) · Child Development · doi:10.1111/cdev.13138 · Cited by 95
Towards a neural model of infant cry perception
Witteman, J., Van IJzendoorn, M. H., Rilling, J. K., Bos, P. A., Schiller, N. O., & Bakermans-Kranenburg, M. J. (2019) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2019.01.026 · Cited by 94
A Continuous-Time Approach to Intensive Longitudinal Data: What, Why, and How?
Ryan, O., Kuiper, R. M., & Hamaker, E. L. (2018) · Continuous Time Modeling in the Behavioral and Related Sciences · doi:10.1007/978-3-319-77219-6_2 · Cited by 67
Self-citationMayer, A., Zimmermann, J., Hoyer, J., Salzer, S., Wiltink, J., Leibing, E., & Leichsenring, F. (2020) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2019.1671196 · Cited by 21
Cited by
van IJzendoorn, M. H., Schuengel, C., Wang, Q., & Bakermans-Kranenburg, M. J. (2023) · Development and Psychopathology · doi:10.1017/s0954579421001462 · Cited by 116
“It should however be noted that even a RCT may not guarantee causal mediation free from confounder biases (Hamaker et al., 2020).”
Causal inference on human behaviour
Bailey, D. H., Jung, A. J., Beltz, A. M., Eronen, M. I., Gische, C., Hamaker, E. L., Kording, K. P., Lebel, C., Lindquist, M. A., Moeller, J., et al. (2024) · Nature Human Behaviour · doi:10.1038/s41562-024-01939-z · Cited by 56
“…clarity helps readers, but most importantly the researchers themselves, to determine (1) whether the purpose of the study is to estimate causal effects at all, (2) which kinds of effects the researcher is interested in 64–66 and (3) whether the question asked can be answered by the data at hand.”
Self-citationDistinct sex-specific DNA methylation differences in Alzheimer’s disease
C. Silva, T., Zhang, W., Young, J. I., Gomez, L., Schmidt, M. A., Varma, A., Chen, X. S., Martin, E. R., & Wang, L. (2022) · Alzheimer's Research & Therapy · doi:10.1186/s13195-022-01070-z · Cited by 33
Metadata
- Authors
- Hamaker, E. L., Mulder, J. D., & van IJzendoorn, M. H.
- Venue
- Developmental Cognitive Neuroscience
- Publisher
- Elsevier BV
- Published
- 2020-12
- Volume
- 46
- Pages
- 100867
- ISSN
- 1878-9293 (ISSN-L)
- OpenAlex
- W3097115784
- Cited by
- 102
- References
- 35
- FWCI
- 7.60
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.