Annual Research Review: Current limitations and future directions in MRI studies of child‐ and adult‐onset developmental psychopathologies
Open accessThe DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Abstract
Background: The widespread use of Magnetic Resonance Imaging ( MRI ) in the study of child‐ and adult‐onset developmental psychopathologies has generated many investigations that have measured brain structure and function in vivo throughout development, often generating great excitement over our ability to visualize the living, developing brain using the attractive, even seductive images that these studies produce. Often lost in this excitement is the recognition that brain imaging generally, and MRI in particular, is simply a technology, one that does not fundamentally differ from any other technology, be it a blood test, a genotyping assay, a biochemical assay, or behavioral test. No technology alone can generate valid scientific findings. Rather, it is only technology coupled with a strong experimental design that can generate valid and reproducible findings that lead to new insights into the mechanisms of disease and therapeutic response. Methods: In this review we discuss selected studies to illustrate the most common and important limitations of MRI study designs as most commonly implemented thus far, as well as the misunderstanding that the interpretations of findings from those studies can create for our theories of developmental psychopathologies. Results: Common limitations of MRI study designs are in large part responsible thus far for the generally poor reproducibility of findings across studies, poor generalizability to the larger population, failure to identify developmental trajectories, inability to distinguish causes from effects of illness, and poor ability to infer causal mechanisms in most MRI studies of developmental psychopathologies. For each of these limitations in study design and the difficulties they entail for the interpretation of findings, we discuss various approaches that numerous laboratories are now taking to address those difficulties, which have in common the yoking of brain imaging technologies to studies with inherently stronger designs that permit more valid and more powerful causal inferences. Those study designs include epidemiological, longitudinal, high‐risk, clinical trials, and multimodal imaging studies. Conclusions: We highlight several studies that have yoked brain imaging technologies to these stronger designs to illustrate how doing so can aid our understanding of disease mechanisms and in the foreseeable future can improve clinical diagnosis, prevention, and treatment planning for developmental psychopathologies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641 · cited 2×
“These problems of reliability, validity, and generalizability associated with small sample sizes are only worsened by the frequent use of liberal statistical thresholds and poorly specified a priori hypotheses, as noted elsewhere (Button et al., 2013, Philip et al., 2012).”
BackgroundAnterior Cingulate Conflict Monitoring and Adjustments in Control
Kerns, J. G., Cohen, J. D., MacDonald, A. W., Cho, R. Y., Stenger, V. A., & Carter, C. S. (2004) · Science · doi:10.1126/science.1089910 · Cited by 2,891 · cited 1×
“…(Bush et al., 1998, Carter et al., 1995, Leung et al., 2000, Pardo et al., 1990, Peterson et al., 2002, Peterson et al., 1999, Horga et al., 2011, Kerns et al., 2004), during pain studies in which participants must inhibit withdrawal of the painful extremity (Craig et al., 1996, Derbyshire and…”
BackgroundWhite matter integrity, fiber count, and other fallacies: The do's and don'ts of diffusion MRI
Jones, D. K., Knösche, T. R., & Turner, R. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2012.06.081 · Cited by 2,402 · cited 1×
“For example, diffusion tensor imaging at present is generally unable to determine the true orientation of nerve fiber bundles at points where fiber bundles cross, owing to a much lower spatial resolution of the imaging modality than the resolution of the crossing fibers (Jones et al., 2013).”
BackgroundUnbiased average age-appropriate atlases for pediatric studies
Fonov, V., Evans, A. C., Botteron, K., Almli, C. R., McKinstry, R. C., & Collins, D. L. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.07.033 · Cited by 2,290 · cited 1×
“…and normalization procedures needed to transform individual images of the brain into a common stereotactic space (Almli et al., 2007), so as to minimize the introduction of bias within image processing procedures that can influence findings, at least for a given age group (Fonov et al., 2011).”
BackgroundBeyond mind-reading: multi-voxel pattern analysis of fMRI data
Norman, K. A., Polyn, S. M., Detre, G. J., & Haxby, J. V. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.07.005 · Cited by 2,271
Machine learning classifiers and fMRI: A tutorial overview
Pereira, F., Mitchell, T., & Botvinick, M. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.11.007 · Cited by 1,624 · cited 1×
“…the general principles of these approaches and their applications to clinical classification in developmental and adult psychopathologies are well described elsewhere (Bray et al., 2009, Haubold et al., 2012, Kloppel et al., 2012, Norman et al., 2006, Orru et al., 2012, Pereira et al., 2009).”
BackgroundPardo, J. V., Pardo, P. J., Janer, K. W., & Raichle, M. E. (1990) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.87.1.256 · Cited by 1,495 · cited 1×
“…of tasks that require inhibitory control, such as the Stroop, Simon, and go/no-go tasks (Bush et al., 1998, Carter et al., 1995, Leung et al., 2000, Pardo et al., 1990, Peterson et al., 2002, Peterson et al., 1999, Horga et al., 2011, Kerns et al., 2004), during pain studies in which participants…”
MethodBaxter, L. R. (1992) · Archives of General Psychiatry · doi:10.1001/archpsyc.1992.01820090009002 · Cited by 1,293
Toward systems neuroscience of ADHD: a meta-analysis of 55 fMRI studies
Cortese, S., Kelly, C., Chabernaud, C., Proal, E., Di Martino, A., Milham, M. P., & Castellanos, F. X. (2012) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2012.11101521 · Cited by 1,067 · cited 1×
“Cross-sectional studies of attention deficit hyperactivity disorder (ADHD) have also produced variable findings across multiple brain regions, despite the presence of reasonably consistent findings of prefrontal hypoactivation across both adults and children (Cortese et al., 2012).”
BackgroundOffspring of Depressed Parents: 20 Years Later
Weissman, M. M., Wickramaratne, P., Nomura, Y., Warner, V., Pilowsky, D., & Verdeli, H. (2006) · American Journal of Psychiatry · doi:10.1176/ajp.2006.163.6.1001 · Cited by 1,059
Cited by
The search for imaging biomarkers in psychiatric disorders
Abi-Dargham, A., & Horga, G. (2016) · Nature Medicine · doi:10.1038/nm.4190 · Cited by 311
Self-citationPrenatal Maternal Stress, Child Cortical Thickness, and Adolescent Depressive Symptoms
Davis, E. P., Hankin, B. L., Glynn, L. M., Head, K., Kim, D. J., & Sandman, C. A. (2020) · Child Development · doi:10.1111/cdev.13252 · Cited by 87
Ambrosino, S., de Zeeuw, P., Wierenga, L. M., van Dijk, S., & Durston, S. (2017) · Cerebral Cortex · doi:10.1093/cercor/bhx182 · Cited by 67
“Therefore, there is a call in the fi eld for replication in other, independent longitudinal samples (Horga et al. 2014).”
Wang, Y., Bernanke, J., Peterson, B. S., McGrath, P., Stewart, J., Chen, Y., Lee, S., Wall, M., Bastidas, V., Hong, S., et al. (2019) · The Lancet Psychiatry · doi:10.1016/s2215-0366(19)30179-8 · Cited by 55
Self-citationEvidence for neuroplastic compensation in the cerebral cortex of persons with depressive illness
Bansal, R., Hellerstein, D. J., & Peterson, B. S. (2018) · Molecular Psychiatry · doi:10.1038/mp.2017.34 · Cited by 41
“Most importantly, the absence of control over experimental variables renders case-control studies merely associational and incapable of supporting causal inferences concerning mechanisms of pathogenesis or treatment response(17).”
BackgroundSelf-citationBansal, R., Hellerstein, D. J., Sawardekar, S., O’Neill, J., & Peterson, B. S. (2019) · PLOS ONE · doi:10.1371/journal.pone.0219679 · Cited by 8
Self-citation
Metadata
- Authors
- Horga, G., Kaur, T., & Peterson, B. S.
- Venue
- Journal of Child Psychology and Psychiatry
- Publisher
- Wiley
- Published
- 2014-01-20
- Volume
- 55
- Issue
- 6
- Pages
- 659-680
- ISSN
- 0021-9630 (ISSN-L)
- 1469-7610
- OpenAlex
- W2094958859
- Cited by
- 74
- References
- 48
- FWCI
- 2.55
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.