The Heterogeneity Problem: Approaches to Identify Psychiatric Subtypes
Open accessAbstract
The imprecise nature of psychiatric nosology restricts progress towards characterizing and treating mental health disorders. One issue is the 'heterogeneity problem': different causal mechanisms may relate to the same disorder, and multiple outcomes of interest can occur within one individual. Our review tackles this heterogeneity problem, providing considerations, concepts, and approaches for investigators examining human cognition and mental health. We highlight the difficulty of pure dimensional approaches due to 'the curse of dimensionality'. Computationally, we consider supervised and unsupervised statistical approaches to identify putative subtypes within a population. However, we emphasize that subtype identification should be linked to a particular outcome or question. We conclude with novel hybrid approaches that can identify subtypes tied to outcomes, and may help advance precision diagnostic and treatment tools.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
One aspect of heterogeneity in ADHD symptoms and cognitive deficits is its subtypes.
“One aspect of heterogeneity in ADHD symptoms and cognitive deficits is its subtypes [8, 9] which includes a predominantly hyperactive (ADHD-H), inattentive (ADHD-I), and combined (ADHD-C) subtype.”
From ADHD subtype-specific cognitive correlates and association with self-esteem: a quantitative difference (2020) · cites this paper as [9]
Multiple routes likely contribute to the expression of EF and hyperactive/inattentive symptoms across disorders.
“but that multiple routes likely contribute to the expression of EF and hyperactive/inattentive symptoms across disorders (Chan et al., 2008; Feczko et al., 2019; Molitor et al., 2018; Volkow et al., 2011).”
From Heterogeneity of executive function revealed by a functional random forest approach across ADHD and ASD (2020) · cites this paper as Feczko et al., 2019
A growing body of evidence suggests multiple pathways lead to shared symptoms among a given disorder.
“A growing body of evidence suggests multiple pathways lead to shared symptoms among a given disorder (Castellanos et al., 2006; Feczko et al., 2019).”
From Heterogeneity of executive function revealed by a functional random forest approach across ADHD and ASD (2020) · cites this paper as Feczko et al., 2019
It's important for any machine learning model, in particular those using cross-validation, to further validate identified subgroups.
“It's important for any machine learning model, in particular those using cross-validation, to further validate identified subgroups (Feczko et al., 2019).”
From Heterogeneity of executive function revealed by a functional random forest approach across ADHD and ASD (2020) · cites this paper as Feczko et al., 2019
This supports the transdiagnostic approach and is consistent with previous work indicating that the underlying mechanisms leading to observed symptoms are likely shared across ASD and ADHD, even though there may be more than one.
“This supports the transdiagnostic approach and is consistent with previous work indicating that the underlying mechanisms leading to observed symptoms are likely shared across ASD and ADHD, even though there may be more than one (Chan et al., 2008; Feczko et al., 2019; Leitner, 2014; Molitor et al., 2018).”
From Heterogeneity of executive function revealed by a functional random forest approach across ADHD and ASD (2020) · cites this paper as Feczko et al., 2019
Several previous studies found linear age-related FCS decreases in medial prefrontal cortex, precuneus, insula, and calcarine and linear FCS increases in sensorimotor areas based on general linear model.
“Similar to our findings, several previous studies found linear-age-related FCS decreases in the medial prefrontal cortex, precuneus, insula, and calcarine and linear FCS increases in sensorimotor areas based on the general linear model [36-38].”
From Mapping neurophysiological subtypes of major depressive disorder using normative models of the functional connectome (2023) · cites this paper as [38]
From the homogeneity assumption, the comorbidity and heterogeneity problems emerge and limit psychiatric research.
“From the homo- geneity assumption, the comorbidity (17) and heterogeneity (18,19) problems emerge and limit psychiatric research (20–26).”
From Methods and challenges for assessing heterogeneity (2020) · cites this paper as [18]
The appropriate subtypes are likely to differ based on whether one is interested in diagnosis, prognosis, treatment response, mechanism, etc.
“The appropriate subtypes are likely going to differ based on whether one is interested in diagnosis, prognosis, treatment response, mechanism, etc. (18).”
From Methods and challenges for assessing heterogeneity (2020) · cites this paper as [18]
Most subtyping methods cannot discover unknown subtypes tied to a question.
“Critically, most subtyping methods cannot discover unknown subtypes tied to a question (18).”
From Methods and challenges for assessing heterogeneity (2020) · cites this paper as [18]
The heterogeneity problem comprises two tenets: different underlying mechanisms may drive the same disorder, and factors important for mental health outcomes may be unrelated to such mechanisms depending on the outcome of interest.
“The heterogeneity problem comprises two tenets (18). First, different underlying mechanisms may drive the same disorder. Second, factors important for mental health outcomes may be unrelated to such mechanisms, depending on the outcome of interest.”
From Methods and challenges for assessing heterogeneity (2020) · cites this paper as [18]
Newer hybrid models such as normative modeling and the functional random forest may overcome the limitations of the bifactor framework and allow new inferences in psychopathology research.
“Newer hybrid models, such as normative modeling (19,59–61) or the functional random forest (FRF) (18,62), may overcome these limitations and enable new inferences from psychopathology studies.”
From Methods and challenges for assessing heterogeneity (2020) · cites this paper as [18]
The FRF is able to find trajectory subtypes in longitudinal data, for example p subtypes linked to ADHD outcomes.
“The FRF can identify trajectory subtypes from longitudinal data, such as p subtypes united or tied to ADHD outcomes.”
From Methods and challenges for assessing heterogeneity (2020) · cites this paper as [18]
The FRF consists of several approaches that have been detailed elsewhere.
“The FRF comprises several ap- proaches, which have been explicitly detailed elsewhere (18).”
From Methods and challenges for assessing heterogeneity (2020) · cites this paper as [18]
The bifactor framework has limits: because it is a supervised approach, it requires researchers to specify specific factors, so the researcher cannot discover new ones.
“Because it is a supervised approach, the bifactor framework requires researchers to specify specific factors, such as internalizing and externalizing. Therefore, the researcher cannot discover new ones (18).”
From Methods and challenges for assessing heterogeneity (2020) · cites this paper as [18]
The authors previously proposed the functional random forest to identify subtypes tied to an outcome.
“More recently, we proposed the FRF to identify subtypes tied to an outcome (18,62).”
From Methods and challenges for assessing heterogeneity (2020) · cites this paper as [18]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
1 retracted
Karalunas, S. L., Fair, D., Musser, E. D., Aykes, K., Iyer, S. P., & Nigg, J. T. (2014) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2014.763 · Cited by 340 · see citing works
Self-citationRetractedBreiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538 · see citing works
A global reference for human genetic variation
The 1000 Genomes Project Consortium, authors, C., Auton, A., Abecasis, G. R., Steering committee, Altshuler, D. M., Durbin, R. M., Abecasis, G. R., Bentley, D. R., Chakravarti, A., et al. (2015) · Nature · doi:10.1038/nature15393 · Cited by 18,247 · see citing works
Depression and quality of life in older persons: A review
Sivertsen, H., Bjørkløf, G. H., Engedal, K., Selbæk, G., & Helvik, A.-S. (2015) · Dementia and Geriatric Cognitive Disorders · doi:10.1159/000437299 · Cited by 14,152 · see citing works
A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection
Kohavi, R. (1995) · Zenodo · doi:10.5281/zenodo.19712698 · Cited by 10,909 · see citing works
Insel, T., Cuthbert, B., Garvey, M., Heinssen, R., Pine, D. S., Quinn, K., Sanislow, C., & Wang, P. (2010) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2010.09091379 · Cited by 7,067 · see citing works
Leek, J. T., Johnson, W. E., Parker, H. S., Jaffe, A. E., & Storey, J. D. (2012) · Bioinformatics · doi:10.1093/bioinformatics/bts034 · Cited by 6,231 · see citing works
A review of feature selection techniques in bioinformatics
Saeys, Y., Inza, I., & Larrañaga, P. (2007) · Bioinformatics · doi:10.1093/bioinformatics/btm344 · Cited by 5,252 · see citing works
Robins, L. N. (1981) · Archives of General Psychiatry · doi:10.1001/archpsyc.1981.01780290015001 · Cited by 5,219 · see citing works
Maps of random walks on complex networks reveal community structure
Rosvall, M., & Bergstrom, C. T. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0706851105 · Cited by 4,583 · see citing works
Kotov, R., Krueger, R. F., Watson, D., Achenbach, T. M., Althoff, R. R., Bagby, R. M., Brown, T. A., Carpenter, W. T., Caspi, A., Clark, L. A., et al. (2017) · Journal of Abnormal Psychology · doi:10.1037/abn0000258 · Cited by 3,335 · see citing works
Toward the future of psychiatric diagnosis: the seven pillars of RDoC
Cuthbert, B. N., & Insel, T. R. (2013) · BMC Medicine · doi:10.1186/1741-7015-11-126 · Cited by 3,053 · see citing works
(2013) · The Lancet · doi:10.1016/s0140-6736(12)62129-1 · Cited by 3,010 · see citing works
On the mean accuracy of statistical pattern recognizers
Hughes, G. W. (1968) · IEEE Transactions on Information Theory · doi:10.1109/tit.1968.1054102 · Cited by 2,890 · see citing works
Establishment of Diagnostic Validity in Psychiatric Illness: Its Application to Schizophrenia
ROBINS, E., & GUZE, S. B. (1970) · American Journal of Psychiatry · doi:10.1176/ajp.126.7.983 · Cited by 2,243 · see citing works
ADHD Working Group of the Psychiatric Genomics Consortium (PGC), Demontis, D., Early Lifecourse & Genetic Epidemiology (EAGLE) Consortium, 23andMe Research Team, Walters, R. K., Martin, J., Mattheisen, M., Als, T. D., Agerbo, E., Baldursson, G., et al. (2019) · Nature Genetics · doi:10.1038/s41588-018-0269-7 · Cited by 2,203 · see citing works
Prediction of individual brain maturity using fMRI
Dosenbach, N. U. F., Nardos, B., Cohen, A. L., Fair, D. A., Power, J. D., Church, J. A., Nelson, S. M., Wig, G. S., Vogel, A. C., Lessov-Schlaggar, C. N., et al. (2010) · Science · doi:10.1126/science.1194144 · Cited by 2,183 · see citing works
Self-citationResting-state connectivity biomarkers define neurophysiological subtypes of depression
Drysdale, A. T., Grosenick, L., Downar, J., Dunlop, K., Mansouri, F., Meng, Y., Fetcho, R. N., Zebley, B., Oathes, D. J., Etkin, A., et al. (2017) · Nature Medicine · doi:10.1038/nm.4246 · Cited by 2,170 · see citing works
Capturing Heterogeneity in Gene Expression Studies by Surrogate Variable Analysis
Leek, J. T., & Storey, J. D. (2007) · PLoS Genetics · doi:10.1371/journal.pgen.0030161 · Cited by 1,930 · see citing works
Analysis of shared heritability in common disorders of the brain
The Brainstorm Consortium, Anttila, V., Bulik-Sullivan, B., Finucane, H. K., Walters, R. K., Bras, J., Duncan, L., Escott-Price, V., Falcone, G. J., Gormley, P., et al. (2018) · Science · doi:10.1126/science.aap8757 · Cited by 1,924 · see citing works
Equifinality and multifinality in developmental psychopathology
Cicchetti, D., & Rogosch, F. A. (1996) · Development and Psychopathology · doi:10.1017/s0954579400007318 · Cited by 1,842 · see citing works
(2014) · African Studies Companion Online · doi:10.1163/1872-9037_afco_dum_r0022a · Cited by 1,664 · see citing works
The NIMH Research Domain Criteria (RDoC) Project: Precision Medicine for Psychiatry
Insel, T. R. (2014) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2014.14020138 · Cited by 1,472 · see citing works
Generation and evaluation of a cortical area parcellation from resting-state correlations
Gordon, E. M., Laumann, T. O., Adeyemo, B., Huckins, J. F., Kelley, W. M., & Petersen, S. E. (2016) · Cerebral Cortex · doi:10.1093/cercor/bhu239 · Cited by 1,463 · see citing works
Everitt, B. J. (2005) · Encyclopedia of Statistics in Behavioral Science · doi:10.1002/0470013192.bsa231 · Cited by 1,277 · see citing works
Most genetic risk for autism resides with common variation
Gaugler, T., Klei, L., Sanders, S. J., Bodea, C. A., Goldberg, A. P., Lee, A. B., Mahajan, M., Manaa, D., Pawitan, Y., Reichert, J., et al. (2014) · Nature Genetics · doi:10.1038/ng.3039 · Cited by 1,239 · see citing works
Regier, D. A., Narrow, W. E., Clarke, D. E., Kraemer, H. C., Kuramoto, S. J., Kuhl, E. A., & Kupfer, D. J. (2013) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2012.12070999 · Cited by 1,163 · see citing works
Early brain development in infants at high risk for autism spectrum disorder
The IBIS Network, Hazlett, H. C., Gu, H., Munsell, B. C., Kim, S. H., Styner, M., Wolff, J. J., Elison, J. T., Swanson, M. R., Zhu, H., et al. (2017) · Nature · doi:10.1038/nature21369 · Cited by 1,128 · see citing works
Realism, anti-foundationalism and the enthusiasm for natural kinds
Boyd, R. N. (1991) · Philosophical Studies · doi:10.1007/bf00385837 · Cited by 1,088 · see citing works
Temperament and developmental psychopathology
Nigg, J. T. (2006) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2006.01612.x · Cited by 971 · see citing works
Self-citationThe conception of the ABCD study: From substance use to a broad NIH collaboration
Volkow, N. D., Koob, G. F., Croyle, R. T., Bianchi, D. W., Gordon, J. A., Koroshetz, W. J., Pérez-Stable, E. J., Riley, W. T., Bloch, M. H., Conway, K., et al. (2018) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2017.10.002 · Cited by 970 · see citing works
Single subject prediction of brain disorders in neuroimaging: Promises and pitfalls
Arbabshirani, M. R., Plis, S., Sui, J., & Calhoun, V. D. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2016.02.079 · Cited by 912 · see citing works
Cross-validation failure: Small sample sizes lead to large error bars
Varoquaux, G. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2017.06.061 · Cited by 897 · see citing works
The classification of children's psychiatric symptoms: A factor-analytic study.
Achenbach, T. M. (1966) · Psychological Monographs: General and Applied · doi:10.1037/h0093906 · Cited by 885 · see citing works
A survey on unsupervised outlier detection in high‐dimensional numerical data
Zimek, A., Schubert, E., & Kriegel, H. (2012) · Statistical Analysis and Data Mining The ASA Data Science Journal · doi:10.1002/sam.11161 · Cited by 864 · cited 1× · see citing works
“On the other hand, if one assumes that the population is comprised of multiple subtypes with different underlying distributions[69,72], then instead of detecting outliers one aims to distinguish boundaries between subtypes.”
BackgroundAn information-theoretic framework for resolving community structure in complex networks
Rosvall, M., & Bergstrom, C. T. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0611034104 · Cited by 789 · see citing works
Identifying Multiple Outliers in Multivariate Data
Hadi, A. S. (1992) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.2517-6161.1992.tb01449.x · Cited by 775 · see citing works
The Emergence of Developmental Psychopathology
Cicchetti, D. (1984) · Child Development · doi:10.2307/1129830 · Cited by 769 · see citing works
Deriving reproducible biomarkers from multi-site resting-state data: An Autism-based example
Abraham, A., Milham, M. P., Di Martino, A., Craddock, R. C., Samaras, D., Thirion, B., & Varoquaux, G. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2016.10.045 · Cited by 701 · see citing works
Submodel Selection and Evaluation in Regression. The X-Random Case
Breiman, L., & Spector, P. C. (1992) · International Statistical Review · doi:10.2307/1403680 · Cited by 689 · see citing works
Understanding heterogeneity in clinical cohorts using normative models: Beyond case-control studies
Marquand, A. F., Rezek, I., Buitelaar, J., & Beckmann, C. F. (2016) · Biological Psychiatry · doi:10.1016/j.biopsych.2015.12.023 · Cited by 683 · see citing works
Cross-trial prediction of treatment outcome in depression: a machine learning approach
Chekroud, A. M., Zotti, R. J., Shehzad, Z., Gueorguieva, R., Johnson, M. K., Trivedi, M. H., Cannon, T. D., Krystal, J. H., & Corlett, P. R. (2016) · The Lancet Psychiatry · doi:10.1016/s2215-0366(15)00471-x · Cited by 676 · see citing works
The International Joint Conference on Artificial Intelligence (IJCAI)
(1972) · Artificial Intelligence · doi:10.1016/0004-3702(72)90052-5 · Cited by 480 · see citing works
Fair, D. A., Bathula, D., Nikolas, M. A., & Nigg, J. T. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1115365109 · Cited by 464 · cited 1× · see citing works
“A community detection approach [80] uses a similar bottom up approach to identify novel executive function [80], temperament [81], and neural [82,83] subtypes in an ADHD population.”
MethodSelf-citationFair, D. A., Nigg, J. T., Iyer, S., Bathula, D., Mills, K. L., Dosenbach, N. U. F., Schlaggar, B. L., Mennes, M., Gutman, D., Bangaru, S., et al. (2013) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2012.00080 · Cited by 463 · see citing works
Self-citationTopological organization of the human brain functional connectome across the lifespan
Cao, M., Wang, J.-H., Dai, Z.-J., Cao, X.-Y., Jiang, L.-L., Fan, F.-M., Song, X.-W., Xia, M.-R., Shu, N., Dong, Q., et al. (2014) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2013.11.004 · Cited by 440 · see citing works
Linked dimensions of psychopathology and connectivity in functional brain networks
Xia, C. H., Ma, Z., Ciric, R., Gu, S., Betzel, R. F., Kaczkurkin, A. N., Calkins, M. E., Cook, P. A., García de la Garza, A., Vandekar, S. N., et al. (2018) · Nature Communications · doi:10.1038/s41467-018-05317-y · Cited by 437 · see citing works
The UNC/UMN Baby Connectome Project (BCP): An overview of the study design and protocol development
Howell, B., Styner, M. A., Gao, W., Yap, P., Wang, L., Baluyot, K., Yacoub, E. S., Chen, G., Potts, T., Salzwedel, A., et al. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.03.049 · Cited by 431 · see citing works
DSM-5 and autism spectrum disorders (ASDs): an opportunity for identifying ASD subtypes
Grzadzinski, R., Huerta, M., & Lord, C. (2013) · Molecular Autism · doi:10.1186/2040-2392-4-12 · Cited by 378 · cited 5× · see citing works
“A uthor M anuscript A uthor M anuscript A uthor M anuscript A uthor M anuscript Evidence suggests that major psychiatric conditions are heterogeneous While a plurality of inputs to a given psychiatric presentation has been proposed recently in DSM-5[27] and for far longer in the literature [28], accumulating and recen…”
BackgroundInfluentialFried, E. I. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00309 · Cited by 367 · see citing works
Unraveling the Miswired Connectome: A Developmental Perspective
Martino, A. D., Fair, D. A., Kelly, C. A. M., Satterthwaite, T. D., Castellanos, F. X., Thomason, M. E., Craddock, R. C., Luna, B., LEVENTHAL, B. L., Zuo, X., et al. (2014) · Neuron · doi:10.1016/j.neuron.2014.08.050 · Cited by 346 · see citing works
Self-citationDunlop, B. W., Rajendra, J. K., Craighead, W. E., Kelley, M. E., McGrath, C. L., Choi, K. S., Kinkead, B., Nemeroff, C. B., & Mayberg, H. S. (2017) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2016.16050518 · Cited by 342 · cited 5× · see citing works
“as in [38], see also [47]) may not generalize to independent datasets across different sites[48], and therefore require additional independent validation (see Box: 3).”
BackgroundMethodInfluentialMichalos, A. C. (2014) · Springer eBooks · doi:10.1007/978-94-007-0753-5_100465 · Cited by 335 · see citing works
Genomic Patterns of De Novo Mutation in Simplex Autism
Turner, T. N., Coe, B. P., Dickel, D. E., Hoekzema, K., Nelson, B. J., Zody, M. C., Kronenberg, Z. N., Hormozdiari, F., Raja, A. N., Pennacchio, L. A., et al. (2017) · Cell · doi:10.1016/j.cell.2017.08.047 · Cited by 330 · see citing works
DNA methylation signatures of chronic low-grade inflammation are associated with complex diseases
WHI-EMPC Investigators, Ligthart, S., Disease, C. E. O. C. H., Marzi, C., Aslibekyan, S. W., Mendelson, M., Conneely, K. N., Tanaka, T., Colicino, E., Waite, L. L., et al. (2016) · Genome biology · doi:10.1186/s13059-016-1119-5 · Cited by 327 · see citing works
Constantino, J. N., & Charman, T. (2016) · The Lancet Neurology · doi:10.1016/s1474-4422(15)00151-9 · Cited by 294 · see citing works
Lessons from Controversy: Ovarian Cancer Screening and Serum Proteomics
Ransohoff, D. F. (2005) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/dji054 · Cited by 265 · see citing works
Cohen, A. C., Everitt, B. J., & Hand, D. J. (1982) · Technometrics · doi:10.2307/1267834 · Cited by 260 · see citing works
Multiaxial Classification of Child and Adolescent Psychiatric Disorders
World Health Organisation, & Rutter, S. M. (1996) · Cambridge University Press eBooks · doi:10.1017/cbo9780511983757 · Cited by 216 · see citing works
Use of Machine Learning to Identify Children with Autism and Their Motor Abnormalities
Crippa, A., Salvatore, C., Perego, P., Forti, S., Nobile, M., Molteni, M., & Castiglioni, I. (2015) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-015-2379-8 · Cited by 208 · see citing works
Philosophical Issues in Psychiatry: Explanation, Phenomenology, and Nosology
Kendler, K. S., & Parnas, J. (2015) · Cited by 199 · see citing works
A general prediction model for the detection of ADHD and Autism using structural and functional MRI
Sen, B., Borle, N. C., Greiner, R., & Brown, M. R. G. (2018) · PLOS ONE · doi:10.1371/journal.pone.0194856 · Cited by 198 · see citing works
An historical framework for psychiatric nosology
Kendler, K. S. (2009) · Psychological Medicine · doi:10.1017/s0033291709005753 · Cited by 191 · see citing works
Chen, C. P., Keown, C. L., Jahedi, A., Nair, A., Pflieger, M. E., Bailey, B. A., & Müller, R.-A. (2015) · NeuroImage: Clinical · doi:10.1016/j.nicl.2015.04.002 · Cited by 183 · see citing works
Combining clinical variables to optimize prediction of antidepressant treatment outcomes
Iniesta, R., Malki, K., Maier, W., Rietschel, M., Mors, O. N., Hauser, J., Henigsberg, N., Dernovšek, M. Z., Souery, D., Stahl, D. R., et al. (2016) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2016.03.016 · Cited by 179 · see citing works
Uddin, L. Q., Dajani, D. R., Voorhies, W., Bednarz, H., & Kana, R. K. (2017) · Translational Psychiatry · doi:10.1038/tp.2017.164 · Cited by 173 · see citing works
Subtyping cognitive profiles in Autism Spectrum Disorder using a Functional Random Forest algorithm
Feczko, E., Balba, N. M., Miranda-Dominguez, O., Cordova, M., Karalunas, S. L., Irwin, L., Demeter, D. V., Hill, A. P., Langhorst, B. H., Grieser Painter, J., et al. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2017.12.044 · Cited by 173 · see citing works
Self-citationClinical prediction from structural brain MRI scans: A large-scale empirical study
Initiative, F. T. A. D. N., Sabuncu, M. R., & Konukoglu, E. (2015) · Neuroinformatics · doi:10.1007/s12021-014-9238-1 · Cited by 161 · see citing works
Riglin, L., Collishaw, S., Thapar, A. K., Dalsgaard, S., Langley, K., Smith, G. D., Stergiakouli, E., Maughan, B., O’Donovan, M. C., & Thapar, A. (2016) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2016.2817 · Cited by 161 · see citing works
Spline Smoothing over Difficult Regions
Ramsay, T. (2002) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/1467-9868.00339 · Cited by 150 · see citing works
Karalunas, S. L., Hawkey, E., Gustafsson, H., Miller, M., Langhorst, M., Cordova, M., Fair, D., & Nigg, J. T. (2018) · Journal of Abnormal Child Psychology · doi:10.1007/s10802-017-0394-2 · Cited by 148 · see citing works
Self-citationUncovering general, shared, and unique temporal patterns in ambulatory assessment data.
Lane, S., Gates, K. M., Pike, H., Beltz, A. M., & Wright, A. G. C. (2018) · Psychological Methods · doi:10.1037/met0000192 · Cited by 136 · see citing works
Characterizing heterogeneity in children with and without ADHD based on reward system connectivity
Costa Dias, T. G., Iyer, S. P., Carpenter, S. D., Cary, R. P., Wilson, V. B., Mitchell, S. H., Nigg, J. T., & Fair, D. A. (2015) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2014.12.005 · Cited by 130 · see citing works
Self-citationBecht, A. I., Nelemans, S. A., Branje, S. J. T., Vollebergh, W. A. M., Koot, H. M., Denissen, J. J. A., & Meeus, W. H. J. (2016) · Developmental Psychology · doi:10.1037/dev0000245 · Cited by 129 · see citing works
Computational nosology and precision psychiatry
Friston, K. J., Redish, A. D., & Gordon, J. A. (2017) · Computational Psychiatry · doi:10.1162/cpsy_a_00001 · Cited by 126 · see citing works
Mistry, S., Harrison, J. R., Smıth, D. J., Escott‐Price, V., & Zammit, S. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2018.02.005 · Cited by 124 · see citing works
Cheng, W., Rolls, E. T., Qiu, J., Xie, X., Wei, D., Huang, C., Yang, A. C., Tsai, S., Li, Q., Meng, J., et al. (2018) · Translational Psychiatry · doi:10.1038/s41398-018-0139-1 · Cited by 123 · see citing works
Attention Deficit Hyperactivity Disorder
Matthews, M., Nigg, J. T., & Fair, D. A. (2013) · Current topics in behavioral neurosciences · doi:10.1007/978-3-662-45758-0_249 · Cited by 121 · see citing works
Self-citationAre There Executive Dysfunction Subtypes Within ADHD?
Roberts, B. A., Martel, M. M., & Nigg, J. T. (2017) · Journal of Attention Disorders · doi:10.1177/1087054713510349 · Cited by 116 · see citing works
Self-citationTransient increased thalamic-sensory connectivity and decreased whole-brain dynamism in autism
Fu, Z., Tu, Y., Di, X., Du, Y., Jing Sui (Beijing Normal University), my correct affiliation is beijing normal university, N. Q. U. O. S. A. T., Biswal, B. B., Zhang, Z., de Lacy, N., & Calhoun, V. D. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.06.003 · Cited by 116 · see citing works
Zachar, P., & Kendler, K. S. (2017) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-032816-045020 · Cited by 115 · see citing works
Gates, K. M., Molenaar, P. C. M., Iyer, S. P., Nigg, J. T., & Fair, D. A. (2014) · PLoS ONE · doi:10.1371/journal.pone.0091322 · Cited by 107 · see citing works
Self-citationWright, A. G. C., Gates, K. M., Arizmendi, C., Lane, S., Woods, W. C., & Edershile, E. A. (2019) · Psychological Assessment · doi:10.1037/pas0000617 · Cited by 107 · see citing works
A Monte Carlo evaluation of weighted community detection algorithms
Gates, K. M., Henry, T., Steinley, D., & Fair, D. A. (2016) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2016.00045 · Cited by 106 · cited 2× · see citing works
“The technique is robust to many case scenarios[87].”
BackgroundMethodSelf-citationKaralunas, S. L., Gustafsson, H. C., Dieckmann, N. F., Tipsord, J., Mitchell, S. H., & Nigg, J. T. (2017) · Journal of Abnormal Psychology · doi:10.1037/abn0000292 · Cited by 104 · see citing works
Self-citationThe predictive power of structural MRI in Autism diagnosis
Katuwal, G. J., Cahill, N. D., Baum, S. A., & Michael, A. M. (2015) · 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2015.7319338 · Cited by 98 · see citing works
(21875336), W. J., (7803908), S. D., (21875339), I.-A. O., (21875267), K. M., (19191715), F. A., & (21875342), F. S. (2025) · Figshare · Cited by 97 · see citing works
Jamal, W., Das, S., Oprescu, I.-A., Maharatna, K., Apicella, F., & Sicca, F. (2014) · Journal of Neural Engineering · doi:10.1088/1741-2560/11/4/046019 · Cited by 93 · see citing works
Xu, Y., Chen, X.-T., Luo, M., Tang, Y., Zhang, G., Wu, D., Yang, B., Ruan, D., & Wang, H.-L. (2015) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2015.03.006 · Cited by 92 · see citing works
Wang, T., Zhang, X., Li, A., Zhu, M., Liu, S., Qin, W., Li, J., Yu, C., Jiang, T., & Liu, B. (2017) · NeuroImage: Clinical · doi:10.1016/j.nicl.2017.02.011 · Cited by 88 · see citing works
The Myth of Optimality in Clinical Neuroscience
Holmes, A. J., & Patrick, L. M. (2018) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2017.12.006 · Cited by 88 · see citing works
McConaughy, S. H., Achenbach, T. M., & Gent, C. L. (1988) · Research on Child and Adolescent Psychopathology · doi:10.1007/bf00914262 · Cited by 85 · see citing works
Locke, J., Shih, W., Kretzmann, M., & Kasari, C. (2016) · Autism · doi:10.1177/1362361315599468 · Cited by 83 · see citing works
Variation in strategy use across measures of verbal working memory
Morrison, A. B., Rosenbaum, G. M., Fair, D. A., & Chein, J. M. (2016) · Memory & Cognition · doi:10.3758/s13421-016-0608-9 · Cited by 83 · see citing works
Self-citationCommon polygenic variation and risk for childhood-onset schizophrenia
Ahn, K., An, S. S., Shugart, Y. Y., & Rapoport, J. L. (2014) · Molecular Psychiatry · doi:10.1038/mp.2014.158 · Cited by 75 · see citing works
Saeliw, T., Tangsuwansri, C., Thongkorn, S., Chonchaiya, W., Suphapeetiporn, K., Mutirangura, A., Tencomnao, T., Hu, V. W., & Sarachana, T. (2018) · Molecular Autism · doi:10.1186/s13229-018-0213-9 · Cited by 72 · see citing works
Stapinski, L. A., Edwards, A. C., Hickman, M., Araya, R., Teesson, M., Newton, N. C., Kendler, K. S., & Heron, J. (2016) · Prevention Science · doi:10.1007/s11121-016-0652-5 · Cited by 68 · see citing works
Attention Deficit Hyperactivity Disorder
Matthews, M., Nigg, J. T., & Fair, D. A. (2013) · Current topics in behavioral neurosciences · doi:10.1007/7854_2013_249 · Cited by 63 · see citing works
Self-citationJaffe, A. E., Hyde, T. M., Kleinman, J. E., Weinbergern, D. R., Chenoweth, J. G., McKay, R. D. G., Leek, J. T., & Colantuoni, C. (2015) · BMC Bioinformatics · doi:10.1186/s12859-015-0808-5 · Cited by 62 · see citing works
Polygenic risk score and heritability estimates reveals a genetic relationship between ASD and OCD
Guo, W., Samuels, J. F., Wang, Y., Cao, H., Ritter, M., Nestadt, P. S., Krasnow, J., Greenberg, B. D., Fyer, A. J., McCracken, J. T., et al. (2017) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2017.03.011 · Cited by 59 · see citing works
Divide and Conquer: Sub-Grouping of ASD Improves ASD Detection Based on Brain Morphometry
Katuwal, G. J., Baum, S. A., Cahill, N. D., & Michael, A. M. (2016) · PLOS ONE · doi:10.1371/journal.pone.0153331 · Cited by 49 · see citing works
Vidal, L. M., Martínez‐Garcia, M., Pretus, C., García‐García, D., Martínez, K., Janssen, J., Vilarroya, Ó., Castellanos, F. X., Desco, M., Sepulcre, J., et al. (2018) · Human Brain Mapping · doi:10.1002/hbm.24013 · Cited by 40 · see citing works
Wiggins, L. D., Tian, L. H., Levy, S. E., Rice, C. E., Lee, L., Schieve, L. A., Pandey, J., Daniels, J. L., Blaskey, L. G., Hepburn, S., et al. (2017) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-017-3280-4 · Cited by 31 · see citing works
Extraordinary science and psychiatry: Responses to the crisis in mental health research
Friesen, P. (2017) · Philosophical Psychology · doi:10.1080/09515089.2017.1397621 · Cited by 28 · see citing works
Clustering High-Dimensional Landmark-Based Two-Dimensional Shape Data
Huang, C., Styner, M. A., & Zhu, H. (2015) · Journal of the American Statistical Association · doi:10.1080/01621459.2015.1034802 · Cited by 25 · see citing works
Individual differences in cognitive performance and brain structure in typically developing children
Yokota, S., Takeuchi, H., Hashimoto, T., Hashizume, H., Asano, K., Asano, M., Sassa, Y., Taki, Y., & Kawashima, R. (2015) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2015.05.003 · Cited by 23 · see citing works
A Theoretical Framework for Evaluating Psychiatric Research Strategies
Katahira, K., & Yamashita, Y. (2017) · Computational Psychiatry · doi:10.1162/cpsy_a_00008 · Cited by 22 · see citing works
Individual heterogeneity generating explosive system network dynamics
Manrique, P. D., & Johnson, N. F. (2018) · Physical review. E · doi:10.1103/physreve.97.032311 · Cited by 22 · see citing works
Heritable genotype contrast mining reveals novel gene associations specific to autism subgroups
Spencer, M., Takahashi, N., Chakraborty, S., Miles, J. H., & Shyu, C. (2017) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2017.11.016 · Cited by 20 · see citing works
Evaluating the evidence for biotypes of depression: attempted replication of Drysdale et.al. 2017Preprint
Dinga, R., Schmaal, L., Penninx, B. W. J. H., van Tol, M., Veltman, D. J., van Velzen, L. S., van der Wee, N. J. A., & Marquand, A. F. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/416321 · Cited by 20 · see citing works
Fertig, E. J., Ozawa, H., Thakar, M., Howard, J. D., Kagohara, L. T., Krigsfeld, G. S., Ranaweera, R. S., Hughes, R. M., Pérez, J., Jones, S., et al. (2016) · Oncotarget · doi:10.18632/oncotarget.12075 · Cited by 17 · see citing works
Prediction of Primary Care Depression Outcomes at Six Months: Validation of DOC-6 ©
Angstman, K. B., Garrison, G. M., González, C. A., Cozine, D. W., Cozine, E. W., & Katzelnick, D. J. (2017) · The Journal of the American Board of Family Medicine · doi:10.3122/jabfm.2017.03.160313 · Cited by 15 · see citing works
Dimensions of Personality, Psychiatric Syndromes, and Mathematical Models
Eysenck, S. B. G., Eysenck, H. J., & CLARIDGE, G. S. (1960) · Journal of Mental Science · doi:10.1192/bjp.106.443.581 · Cited by 15 · see citing works
de Lacy, N., Kodish, I. M., Rachakonda, S., & Calhoun, V. D. (2018) · Human Brain Mapping · doi:10.1002/hbm.24187 · Cited by 14 · see citing works
Identification of key target genes and pathways in laryngeal carcinoma
Liu, F., Du, J., Liu, J., & Wen, B. (2016) · Oncology Letters · doi:10.3892/ol.2016.4750 · Cited by 13 · see citing works
Growing a New Study: Environmental Influences on Child Health Outcomes
Schmidt, C. W. (2015) · Environmental Health Perspectives · doi:10.1289/ehp.123-a260 · Cited by 12 · see citing works
Wagner, S., Tadić, A., Roll, S. C., Engel, A., Dreimüller, N., Engelmann, J., & Lieb, K. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.06.042 · Cited by 12 · see citing works
Locke, J. J., Anderson, A., Frederick, L., & Kasari, C. L. (2018) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-018-3662-2 · Cited by 11 · see citing works
Extraordinary Science and Psychiatry: Responses to the Crisis in Mental Health Research
Poland, J. S., & Tekin, Ş. (2017) · Project Muse (Johns Hopkins University) · Cited by 8 · see citing works
Mason, D., & Hsin, H. (2018) · History of Psychiatry · doi:10.1177/0957154x18757341 · Cited by 8 · see citing works
Commentary – Autism Spectrum Disorder: Spectrum or Cluster?
Pruett, J. R., & Povinelli, D. J. (2016) · Autism Research · doi:10.1002/aur.1650 · Cited by 7 · see citing works
Obulkasim, A., Fornerod, M. W. J., Zwaan, M. C., Reinhardt, D., & van den Heuvel‐Eibrink, M. M. (2015) · BMC Bioinformatics · doi:10.1186/s12859-015-0737-3 · Cited by 3 · see citing works
Flagged first, then by citations
3 of the 126 references couldn’t be matched to a known paper.
Research works printed but not linked: 10
- [58]Fair DA (2012) Distinct neuropsychological subgroups in typically developing youth inform heterogeneity in children with ADHD. Proc. Natl. Acad. Sci 109, 6769– 6774 22474392 PMC3340031
- [70]Insel TR (2014) The nimh research domain criteria (rdoc) project: Precision medicine for psychiatry. Am. J. Psychiatry 171, 395– 397 24687194
- [80]Fair DA (2012) Distinct neuropsychological subgroups in typically developing youth inform heterogeneity in children with ADHD. Proc. Natl. Acad. Sci. USA 109, 6769– 6774 22474392 PMC3340031
- [88]Everitt B (1993) Cluster analysis, (3rd edn) Arnold E; Halsted Press.
- [92]Rosvall M and Bergstrom CT (2008) Maps of random walks on complex networks reveal community structure. Proc. Natl. Acad. Sci. U. S. A 105, 1118– 1123 %U http://www.ncbi.nlm.nih.gov.beckerpro 18216267 PMC2234100
- [107]Gray JA (1980) Ivan Pavlov, Viking Press New York.
- [108]Nigg JT and Barkley RA Attention deficit hyperactivity disorder. In Developmental Psychopathology (Mash E and Barkley RA, eds), Guilford Press
- [111]Cuthbert BN and Insel TR (2013) Toward the future of psychiatric diagnosis: the seven pillars of RDoC. BMC Med 11, 126 23672542 PMC3653747
- [112]Redish AD and Gordon JA (2016) Computational Psychiatry. New Perspect. Ment. Illness, MIT Press
- [125]Wickham H (2016) ggplot2: Elegant Graphics for Data Analysis, Springer-Verlag New York.
Cited by
Sorted by citations
The normative modeling framework for computational psychiatry
Rutherford, S. E., Kia, S. M., Wolfers, T., Fraza, C., Zabihi, M., Dinga, R., Berthet, P., Worker, A., Verdi, S., Ruhé, H. G., et al. (2022) · Nature Protocols · doi:10.1038/s41596-022-00696-5 · Cited by 283 · see citing works
Dissecting diagnostic heterogeneity in depression by integrating neuroimaging and genetics
Buch, A. M., & Liston, C. M. (2020) · Neuropsychopharmacology · doi:10.1038/s41386-020-00789-3 · Cited by 271 · see citing works
Timmons, A. C., Duong, J. B., Simo Fiallo, N., Lee, T., Vo, H. P. Q., Ahle, M. W., Comer, J. S., Brewer, L. C., Frazier, S. L., & Chaspari, T. (2023) · Perspectives on Psychological Science · doi:10.1177/17456916221134490 · Cited by 263 · see citing works
From promise to practice: towards the realisation of AI-informed mental health care
Koutsouleris, N., Hauser, T. U., Skvortsova, V., & De Choudhury, M. (2022) · The Lancet Digital Health · doi:10.1016/s2589-7500(22)00153-4 · Cited by 251 · see citing works
Clemente‐Suárez, V. J., Redondo-Flórez, L., Beltrán-Velasco, A. I., Ramos‐Campo, D. J., Belinchón-deMiguel, P., Martínez‐Guardado, I., Dalamitros, A. A., Sepulveda, R. A. Y., Martín-Rodríguez, A., & Tornero-Aguilera, J. F. (2023) · Biomedicines · doi:10.3390/biomedicines11092488 · Cited by 241 · see citing works
Evidence-based umbrella review of 162 peripheral biomarkers for major mental disorders
Carvalho, A. F., Solmi, M., Sanches, M., Machado, M. O., Stubbs, B., Ajnakina, O., Sherman, C., Sun, Y. R., Liu, C. S., Brunoni, A. R., et al. (2020) · Translational Psychiatry · doi:10.1038/s41398-020-0835-5 · Cited by 204 · see citing works
Modern views of machine learning for precision psychiatry
Chen, Z. S., Kulkarni, P., Galatzer‐Levy, I. R., Bigio, B., Nasca, C., & Zhang, Y. (2022) · Patterns · doi:10.1016/j.patter.2022.100602 · Cited by 225 · see citing works
Peripheral Markers of Depression
Nobis, A., Zalewski, D., & Waszkiewicz, N. (2020) · Journal of Clinical Medicine · doi:10.3390/jcm9123793 · Cited by 197 · see citing works
An overview of clustering methods with guidelines for application in mental health research
Gao, C. X., Dwyer, D. E., Zhu, Y., Smith, C. L., Du, L., Filia, K., Bayer, J., Menssink, J. M., Wang, T., Bergmeir, C., et al. (2023) · Psychiatry Research · doi:10.1016/j.psychres.2023.115265 · Cited by 213 · see citing works
Lynch, C. J., Gunning, F. M., & Liston, C. M. (2020) · Biological Psychiatry · doi:10.1016/j.biopsych.2020.01.012 · Cited by 181 · see citing works
Williams, Z. J., He, J. L., Cascio, C. J., & Woynaroski, T. G. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2020.11.030 · Cited by 175 · see citing works
Toward Neurosubtypes in Autism
Hong, S., Vogelstein, J. T., Gozzi, A., Bernhardt, B. C., Yeo, B. T. T., Milham, M. P., & Martino, A. D. (2020) · Biological Psychiatry · doi:10.1016/j.biopsych.2020.03.022 · Cited by 167 · see citing works
Disentangling Heterogeneity in Alzheimer’s Disease and Related Dementias Using Data-Driven Methods
Habes, M., Grothe, M. J., Tunc, B., McMillan, C., Wolk, D. A., & Davatzikos, C. (2020) · Biological Psychiatry · doi:10.1016/j.biopsych.2020.01.016 · Cited by 167 · see citing works
Language Acquisition and Language Disorders
(2013) · Language acquisition & language disorders · doi:10.1075/lald · Cited by 166 · see citing works
A radical change in our autism research strategy is needed: Back to prototypes
Mottron, L. (2021) · Autism Research · doi:10.1002/aur.2494 · Cited by 143 · see citing works
Sun, X., Sun, J., Lu, X., Dong, Q., Zhang, L., Wang, W., Liu, J., Ma, Q., Wang, X., Wei, D., et al. (2023) · Biological Psychiatry · doi:10.1016/j.biopsych.2023.05.021 · Cited by 129 · see citing works
van Rentergem, J. A. A., Deserno, M. K., & Geurts, H. M. (2021) · Clinical Psychology Review · doi:10.1016/j.cpr.2021.102033 · Cited by 130 · see citing works
Spichak, S., Bastiaanssen, T. F. S., Berding, K., Vlckova, K., Clarke, G., Dinan, T. G., & Cryan, J. F. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.02.044 · Cited by 127 · see citing works
What have we really learned from functional connectivity in clinical populations?
Zhang, J., Kucyi, A., Raya, J., Nielsen, A. N., Nomi, J. S., Damoiseaux, J. S., Greene, D. J., Horovitz, S. G., Uddin, L. Q., & Whitfield, S. (2021) · NeuroImage · doi:10.1016/j.neuroimage.2021.118466 · Cited by 124 · see citing works
Inclusive Education of Students With General Learning Difficulties: A Meta-Analysis
Krämer, S., Møller, J., & Zimmermann, F. (2021) · Review of Educational Research · doi:10.3102/0034654321998072 · Cited by 122 · see citing works
Tiego, J., Martin, E. A., DeYoung, C. G., Hagan, K. E., Cooper, S. E., Pasion, R., Satchell, L. P., Shackman, A. J., Bellgrove, M. A., Fornito, A., et al. (2023) · Nature Mental Health · doi:10.1038/s44220-023-00057-5 · Cited by 118 · see citing works
Adolescent Brain Cognitive Development (ABCD) Community MRI Collection and UtilitiesPreprint
Feczko, E., Conan, G., Marek, S. A., Tervo‐Clemmens, B., Cordova, M., Doyle, O. J., Earl, E., Perrone, A. J., Sturgeon, D., Klein, R., et al. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.07.09.451638 · Cited by 119 · see citing works
Self-citationFunctional connectomics in depression: insights into therapies
Chai, Y., Sheline, Y. I., Oathes, D. J., Balderston, N. L., Rao, H., & Yu, M. (2023) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2023.05.006 · Cited by 108 · see citing works
Shan, X., Uddin, L. Q., Xiao, J., He, C., Ling, Z., Li, L., Huang, X., Chen, H., & Duan, X. (2022) · Biological Psychiatry · doi:10.1016/j.biopsych.2022.01.011 · Cited by 100 · see citing works
Methods and challenges for assessing heterogeneity
Feczko, E., & Fair, D. A. (2020) · Biological Psychiatry · doi:10.1016/j.biopsych.2020.02.015 · Cited by 96 · see citing works
Self-citationKanhirakadavath, M. R., & Chandran, M. S. M. (2022) · Diagnostics · doi:10.3390/diagnostics12020518 · Cited by 99 · see citing works
Jin, D., Zhou, B., Han, Y., Ren, J., Han, T., Liu, B., Lu, J., Song, C., Wang, P., Wang, D., et al. (2020) · Advanced Science · doi:10.1002/advs.202000675 · Cited by 91 · see citing works
Karalunas, S. L., & Nigg, J. T. (2020) · Biological Psychiatry · doi:10.1016/j.biopsych.2019.11.002 · Cited by 84 · see citing works
Self-citationMulti-cohort and longitudinal Bayesian clustering study of stage and subtype in Alzheimer’s disease
Poulakis, K., Pereira, J. B., Muehlboeck, J., Wahlund, L., Smedby, Ö., Volpe, G., Masters, C. L., Ames, D. J., Niimi, Y., Iwatsubo, T., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-32202-6 · Cited by 84 · see citing works
Recent advances in psychoradiology
Luo, L., You, W., Delbello, M., Gong, Q., & Li, F. (2022) · Physics in Medicine and Biology · doi:10.1088/1361-6560/ac9d1e · Cited by 67 · see citing works
Towards robust and replicable sex differences in the intrinsic brain function of autism
Floris, D. L., Filho, J. O. A., Lai, M., Giavasis, S., Oldehinkel, M., Mennes, M., Charman, T., Tillmann, J., Dumas, G., Ecker, C., et al. (2021) · Molecular Autism · doi:10.1186/s13229-021-00415-z · Cited by 77 · see citing works
Mental health in the UK Biobank: A roadmap to self‐report measures and neuroimaging correlates
Dutt, R., Hannon, K., Easley, T. O., Griffis, J. C., Zhang, W., & Bijsterbosch, J. D. (2021) · Human Brain Mapping · doi:10.1002/hbm.25690 · Cited by 71 · see citing works
Accommodating site variation in neuroimaging data using normative and hierarchical Bayesian models
Bayer, J., Dinga, R., Kia, S. M., Kottaram, A., Wolfers, T., Lv, J., Zalesky, A., Schmaal, L., & Marquand, A. F. (2022) · NeuroImage · doi:10.1016/j.neuroimage.2022.119699 · Cited by 72 · see citing works
Koirala, S., Grimsrud, G. J., Mooney, M. A., Larsen, B., Feczko, E., Elison, J. T., Nelson, S. M., Nigg, J. T., Tervo‐Clemmens, B., & Fair, D. A. (2024) · Nature reviews. Neuroscience · doi:10.1038/s41583-024-00869-z · Cited by 73 · see citing works
Self-citationPractical AI application in psychiatry: historical review and future directions
Sun, J., Lu, T., Shao, X., Han, Y., Xia, Y., Zheng, Y., Wang, Y., Li, X., Ravindran, A. V., Fan, L., et al. (2025) · Molecular Psychiatry · doi:10.1038/s41380-025-03072-3 · Cited by 78 · see citing works
Poor Separation of Clinical Symptom Profiles by DSM-5 Disorder Criteria
Newson, J. J., Pastukh, V., & Thiagarajan, T. C. (2021) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2021.775762 · Cited by 64 · see citing works
A synergetic turn in cognitive neuroscience of brain diseases
Ibanez, A., Kringelbach, M. L., & Deco, G. (2024) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2023.12.006 · Cited by 65 · see citing works
Diffusion-Weighted Imaging in Mild Traumatic Brain Injury: A Systematic Review of the Literature
Lindsey, H. M., Hodges, C. B., Greer, K. M., Wilde, E. A., & Merkley, T. L. (2021) · Neuropsychology Review · doi:10.1007/s11065-021-09485-5 · Cited by 63 · see citing works
Gueguen, M. C. M., Schweitzer, E. M., & Konova, A. B. (2020) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2020.08.007 · Cited by 64 · see citing works
Maglanoc, L. A., Kaufmann, T., Jonassen, R., Hilland, E., Beck, D., Landrø, N. I., & Westlye, L. T. (2019) · Human Brain Mapping · doi:10.1002/hbm.24802 · Cited by 59 · see citing works
Jacobs, G. R., Voineskos, A. N., Hawco, C. S., Stefanik, L., Forde, N. J., Dickie, E. W., Lai, M., Szatmári, P., Schachar, R. J., Crosbie, J., et al. (2020) · Neuropsychopharmacology · doi:10.1038/s41386-020-00902-6 · Cited by 60 · see citing works
Johnson, D., Letchumanan, V., Thum, C. C., Thurairajasingam, S., & Lee, L. (2023) · Nutrients · doi:10.3390/nu15061382 · Cited by 65 · see citing works
Morphological Profiling of Schizophrenia: Cluster Analysis of MRI-Based Cortical Thickness Data
Pan, Y., Pu, W., Chen, X., Huang, X., Cai, Y., Tao, H., Xue, Z., Mackinley, M., Limongi, R., Liu, Z., et al. (2019) · Schizophrenia Bulletin · doi:10.1093/schbul/sbz112 · Cited by 59 · see citing works
Reward Processing in Novelty Seekers: A Transdiagnostic Psychiatric Imaging Biomarker
Qi, S., Schumann, G., Bustillo, J., Turner, J. A., Jiang, R., Zhi, D., Fu, Z., Mayer, A. R., Vergara, V. M., Silva, R. F., et al. (2021) · Biological Psychiatry · doi:10.1016/j.biopsych.2021.01.011 · Cited by 55 · see citing works
Brucar, L. R., Feczko, E., Fair, D. A., & Zilverstand, A. (2022) · Biological Psychiatry · doi:10.1016/j.biopsych.2022.12.020 · Cited by 59 · see citing works
Self-citationCordova, M., Shada, K., Demeter, D. V., Doyle, O., Miranda-Dominguez, O., Perrone, A., Schifsky, E., Graham, A., Fombonne, E., Langhorst, B., et al. (2020) · NeuroImage: Clinical · doi:10.1016/j.nicl.2020.102245 · Cited by 54 · see citing works
Self-citationJiménez‐Fernández, S., Manuel Gurpegui, A., Rojas, D. G., Gutiérrez-Rojas, L., Carretero, M. D., & Correll, C. U. (2022) · Journal of Affective Disorders · doi:10.1016/j.jad.2022.07.015 · Cited by 57 · see citing works
Precision Neuroimaging for Localization-Related Psychiatry
Laumann, T. O., Zorumski, C. F., & Dosenbach, N. U. F. (2023) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2023.1576 · Cited by 56 · see citing works
Modeling Individual Differences in Brain Development
Becht, A., & Mills, K. L. (2020) · Biological Psychiatry · doi:10.1016/j.biopsych.2020.01.027 · Cited by 57 · see citing works
Which ‘Working’ Components of Working Memory aren’t Working in Youth with ADHD?
Fosco, W. D., Kofler, M. J., Groves, N. B., Chan, E. S. M., & Raiker, J. S. (2020) · Journal of Abnormal Child Psychology · doi:10.1007/s10802-020-00621-y · Cited by 55 · see citing works
Intensification of functional neural control on heartbeat dynamics in subclinical depression
Catrambone, V., Benvenuti, S. M., Gentili, C., & Valenza, G. (2021) · Translational Psychiatry · doi:10.1038/s41398-021-01336-4 · Cited by 58 · see citing works
Molavi, P., Nadermohammadi, M., Salvat Ghojehbeiglou, H., Vicario, C. M., Nitsche, M. A., & Salehinejad, M. A. (2020) · BMC Psychiatry · doi:10.1186/s12888-020-02887-4 · Cited by 51 · see citing works
“One aspect of heterogeneity in ADHD symptoms and cognitive deficits is its subtypes [8, 9] which includes a predominantly hyperactive (ADHDH), inattentive (ADHD-I), and combined (ADHD-C) subtype.”
BackgroundCirculating Proteins Influencing Psychiatric Disease: A Mendelian Randomization Study
Lu, T., Forgetta, V., Greenwood, C. M. T., Zhou, S., & Richards, J. B. (2022) · Biological Psychiatry · doi:10.1016/j.biopsych.2022.08.015 · Cited by 53 · see citing works
Language Network Dysfunction and Formal Thought Disorder in Schizophrenia
Palaniyappan, L. K., Homan, P., & Alonso-Sánchez, M. F. (2022) · Schizophrenia Bulletin · doi:10.1093/schbul/sbac159 · Cited by 52 · see citing works
Functional Connectome–Based Predictive Modeling in Autism
Horien, C. L., Floris, D. L., Greene, A. S., Noble, S., Rolison, M. J., Tejavibulya, L., O’Connor, D. A., McPartland, J. C., Scheinost, D., Chawarska, K., et al. (2022) · Biological Psychiatry · doi:10.1016/j.biopsych.2022.04.008 · Cited by 47 · see citing works
Hughes, D., Kunitoki, K., Elyounssi, S., Luo, M., Bazer, O. M., Hopkinson, C. E., Dowling, K. F., Doyle, A. E., Dunn, E. C., Eryilmaz, H., et al. (2023) · Nature Neuroscience · doi:10.1038/s41593-023-01321-8 · Cited by 43 · see citing works
Ben‐Zion, Z., Zeevi, Y., Keynan, J. N., Admon, R., Kozlovski, T., Sharon, H., Halpern, P., Liberzon, I., Shalev, A. Y., Benjamini, Y., et al. (2020) · Translational Psychiatry · doi:10.1038/s41398-020-00898-z · Cited by 46 · see citing works
Ji, C., Patil, K. R., Yeo, B. T. T., & Eickhoff, S. B. (2022) · Biological Psychiatry · doi:10.1016/j.biopsych.2022.07.025 · Cited by 43 · see citing works
BPI-GNN: Interpretable brain network-based psychiatric diagnosis and subtyping
Zheng, K., Yu, S., Chen, L., Dang, L., & Chen, B. (2024) · NeuroImage · doi:10.1016/j.neuroimage.2024.120594 · Cited by 44 · see citing works
Inflammatory phenotype of depression symptom structure: A network perspective
Moriarity, D. P., van Borkulo, C., & Alloy, L. B. (2021) · Brain Behavior and Immunity · doi:10.1016/j.bbi.2020.12.005 · Cited by 45 · see citing works
Mekkes, N., Groot, M., Hoekstra, E., de Boer, A., Dagkesamanskaia, E., Bouwman, S., Wehrens, S. M. T., Herbert, M. K., Wever, D. D., Rozemüller, A. J. M., et al. (2024) · Nature Medicine · doi:10.1038/s41591-024-02843-9 · Cited by 45 · see citing works
Neuroanatomical heterogeneity and homogeneity in individuals at clinical high risk for psychosis
Baldwin, H., Raduà, J., Antoniades, M., Haas, S. S., Frangou, S., Agartz, I., Allen, P., Andreassen, O. A., Atkinson, K., Bachman, P., et al. (2022) · Translational Psychiatry · doi:10.1038/s41398-022-02057-y · Cited by 41 · see citing works
State of the Science: The Hierarchical Taxonomy of Psychopathology (HiTOP)
Cicero, D. C., Ruggero, C. J., Balling, C. E., Bottera, A. R., Cheli, S., Elkrief, L., Forbush, K. T., Hopwood, C. J., Jonas, K. G., Jutras‐Aswad, D., et al. (2024) · Behavior Therapy · doi:10.1016/j.beth.2024.05.001 · Cited by 42 · see citing works
Kaczkurkin, A., Moore, T. M., Sotiras, A., Xia, C., Shinohara, R., & Satterthwaite, T. (2019) · Biological Psychiatry · doi:10.1016/j.biopsych.2019.12.015 · Cited by 43 · see citing works
Gerraty, R. T., Provost, A. C., Li, L., Wagner, E. A., Haas, M., & Lancashire, L. (2023) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2023.1076657 · Cited by 42 · see citing works
Maternal Perinatal Stress Trajectories and Negative Affect and Amygdala Development in Offspring
Marr, M. C., Graham, A. M., Feczko, E., Nolvi, S., Thomas, E., Sturgeon, D., Schifsky, E., Rasmussen, J. M., Gilmore, J. H., Styner, M. A., et al. (2023) · American Journal of Psychiatry · doi:10.1176/appi.ajp.21111176 · Cited by 40 · see citing works
Self-citationTreatment Personalization and Precision Mental Health Care: Where are we and where do we want to go?
Danilo Moggia, N., Lutz, W., Brakemeier, E., & Bickman, L. (2024) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-024-01407-w · Cited by 38 · see citing works
The challenges of using machine learning models in psychiatric research and clinical practice
Ostojic, D., Lalousis, P. A., Donohoe, G. J., & Morris, D. W. (2024) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2024.08.005 · Cited by 40 · see citing works
Olsen, A., Babikian, T., Bigler, E. D., Caeyenberghs, K., Conde, V., Dams-O’Connor, K., Dobryakova, E., Genova, H. M., Grafman, J. H., Haberg, A. K., et al. (2020) · Brain Imaging and Behavior · doi:10.1007/s11682-020-00313-7 · Cited by 37 · see citing works
Kirkpatrick, R. H., Munoz, D. P., Khalid-Khan, S., & Booij, L. (2021) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2020.11.023 · Cited by 41 · see citing works
Molero, P., Reina, G., Blom, J. D., Martínez‐González, M. Á., Reinken, A., de Kloet, E. R., & Molendijk, M. L. (2023) · Epidemiology and Psychiatric Sciences · doi:10.1017/s2045796023000719 · Cited by 35 · see citing works
Wen, J., Antoniades, M., Yang, Z., Hwang, G., Skampardoni, I., Wang, R., & Davatzikos, C. A. (2024) · Biological Psychiatry · doi:10.1016/j.biopsych.2024.04.017 · Cited by 34 · see citing works
The Normative Modeling Framework for Computational PsychiatryPreprint
Rutherford, S. E., Kia, S. M., Wolfers, T., Fraza, C., Zabihi, M., Dinga, R., Berthet, P., Worker, A., Verdi, S., Ruhé, H. G., et al. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.08.08.455583 · Cited by 34 · see citing works
Intrinsic timescales and predictive allostatic interoception in brain health and disease
Ibanez, A., & Northoff, G. (2024) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105510 · Cited by 36 · see citing works
Bobo, W. V., Ommeren, B. V., & Athreya, A. P. (2022) · Expert Review of Clinical Pharmacology · doi:10.1080/17512433.2022.2112949 · Cited by 36 · see citing works
A Review and a Framework of Variables for Defining and Characterizing Tinnitus Subphenotypes
Genitsaridi, E., Hoare, D. J., Kypraios, T., & Hall, D. A. (2020) · Brain Sciences · doi:10.3390/brainsci10120938 · Cited by 33 · see citing works
Genesis, modelling and methodological remedies to autism heterogeneity
Rabot, J., Rødgaard, E.-M., Joober, R., Dumas, G., Bzdok, D., Bernhardt, B., Jacquemont, S., & Mottron, L. (2023) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105201 · Cited by 31 · see citing works
Replicability and generalizability in population psychiatric neuroimaging
Marek, S. A., & Laumann, T. O. (2024) · Neuropsychopharmacology · doi:10.1038/s41386-024-01960-w · Cited by 31 · see citing works
Catalán, A., Raduà, J., McCutcheon, R. A., Aymerich, C., Pedruzo, B., Torres, M. Á. G., Baldwin, H., Stone, W. S., Giuliano, A. J., McGuire, P. K., et al. (2022) · Translational Psychiatry · doi:10.1038/s41398-022-01961-7 · Cited by 32 · see citing works
Valenza, G. (2023) · Frontiers in Network Physiology · doi:10.3389/fnetp.2023.1125495 · Cited by 32 · see citing works
Insomnia Subtypes Have Differentiating Deviations in Brain Structural Connectivity
Bresser, T., Blanken, T. F., de Lange, S. C., Leerssen, J., Foster‐Dingley, J. C., Lakbila‐Kamal, O., Wassing, R., Ramautar, J. R., Stoffers, D., van den Heuvel, M. P., et al. (2024) · Biological Psychiatry · doi:10.1016/j.biopsych.2024.06.014 · Cited by 32 · see citing works
Shao, J., Qin, J., Wang, H., Sun, Y., Zhang, W., Wang, X., Wang, T., Li, X., Yao, Z., & Lü, Q. (2023) · Biological Psychiatry · doi:10.1016/j.biopsych.2023.08.005 · Cited by 29 · see citing works
Fair, D. A., Dosenbach, N. U. F., Moore, A. H., Satterthwaite, T. D., & Milham, M. P. (2021) · Annual Review of Developmental Psychology · doi:10.1146/annurev-devpsych-121318-085124 · Cited by 30 · see citing works
Self-citationEstimating Treatment Effect Heterogeneity in Psychiatry: A Review and Tutorial With Causal Forests
Sverdrup, E., Petukhova, M., & Wager, S. (2025) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.70015 · Cited by 29 · see citing works
Linking cerebellar functional gradients to transdiagnostic behavioral dimensions of psychopathology
Dong, D., Guell, X., Genon, S., Wang, Y., Ji, C., Eickhoff, S. B., Yao, D., & Luo, C. (2022) · NeuroImage Clinical · doi:10.1016/j.nicl.2022.103176 · Cited by 29 · see citing works
Lv, Q., Yan, M., Shen, X., Wu, J., Yu, W., Yan, S., Yang, F., Zeljic, K., Shi, Y., Zhou, Z., et al. (2020) · Cerebral Cortex · doi:10.1093/cercor/bhaa229 · Cited by 28 · see citing works
Choi, H., Byeon, K., Park, B., Lee, J., Valk, S. L., Bernhardt, B. C., Martino, A. D., Milham, M. P., Hong, S., & Park, H. (2022) · NeuroImage · doi:10.1016/j.neuroimage.2022.119212 · Cited by 29 · see citing works
Champ, R., Adamou, M., & Tolchard, B. (2021) · PLoS ONE · doi:10.1371/journal.pone.0261247 · Cited by 27 · see citing works
The promise of precision functional mapping for neuroimaging in psychiatry
Demeter, D. V., & Greene, D. J. (2024) · Neuropsychopharmacology · doi:10.1038/s41386-024-01941-z · Cited by 27 · see citing works
Zhang, Y., Liao, J., Li, Q., Zhang, X., Liu, L., Yan, J., Zhang, D., Yan, H., & Yue, W. (2021) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2021.681701 · Cited by 27 · see citing works
Yamaguchi, H., Hashimoto, Y., Sugihara, G., Miyata, J., Murai, T., Takahashi, H., Honda, M., Hishimoto, A., & Yamashita, Y. (2021) · Frontiers in Neuroscience · doi:10.3389/fnins.2021.652987 · Cited by 27 · see citing works
Data-Driven Approaches to Neuroimaging Analysis to Enhance Psychiatric Diagnosis and Therapy
Zhang, X., Braun, U., Tost, H., & Bassett, D. S. (2020) · Biological Psychiatry Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2019.12.015 · Cited by 27 · see citing works
Knott, R., Johnson, B., Tiego, J., Mellahn, O., Finlay, A., Kallady, K., Kouspos, M., Sindhu, V. P. M., Hawi, Z., Arnatkevic̆iūtė, A., et al. (2021) · Molecular Autism · doi:10.1186/s13229-021-00457-3 · Cited by 24 · see citing works
Hoy, N. W., Lynch, S. J., Waszczuk, M., Reppermund, S., & Mewton, L. (2023) · Neuroscience and Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105431 · Cited by 21 · see citing works
Moriarity, D. P., Joyner, K. J., Slavich, G. M., & Alloy, L. B. (2022) · Molecular Psychiatry · doi:10.1038/s41380-021-01414-5 · Cited by 25 · see citing works
Shi, W., Fan, L., Wang, H., Liu, B., Li, W., Li, J., Cheng, L., Chu, C., Song, M., Jing Sui (Beijing Normal University), my correct affiliation is beijing normal university, N. Q. U. O. S. A. T., et al. (2022) · Cerebral Cortex · doi:10.1093/cercor/bhac301 · Cited by 24 · see citing works
Mooney, M. A., Hermosillo, R. J. M., Feczko, E., Miranda-Domínguez, Ó., Moore, L. A., Perrone, A. J., Byington, N., Grimsrud, G. J., Rueter, A., Nousen, E. K., et al. (2024) · Journal of Neuroscience · doi:10.1523/jneurosci.1202-23.2023 · Cited by 28 · see citing works
Self-citationAccommodating site variation in neuroimaging data using normative and hierarchical Bayesian modelsPreprint
Bayer, J., Dinga, R., Kia, S. M., Kottaram, A., Wolfers, T., Lv, J., Zalesky, A., Schmaal, L., & Marquand, A. F. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.02.09.430363 · Cited by 25 · see citing works
Clark, H. M., Hankin, B. L., Narayan, A. J., & Davis, E. P. (2024) · Development and Psychopathology · doi:10.1017/s0954579422001390 · Cited by 24 · see citing works
the Eurosibs Team, Hendry, A. J., Jones, E. J. H., Bedford, R., Konke, L. A., Ali, J. B., Bölte, S., Brocki, K. C., Demurie, E., Johnson, M. H., et al. (2020) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-020-04465-9 · Cited by 25 · see citing works
- Authors
- Feczko, E., Miranda-Dominguez, O., Marr, M., Graham, A. M., Nigg, J. T., & Fair, D. A.
- Affiliations
- Oregon Health & Science University (US)
- Corresponding author
- Feczko, Eric
- Fair, Damien A.
- Venue
- Trends in Cognitive Sciences
- Publisher
- Elsevier BV
- Published
- 2019-07
- Volume
- 23
- Issue
- 7
- Pages
- 584-601
- ISSN
- 1364-6613 (ISSN-L)
- PMC
- PMC6821457
- OpenAlex
- W2947752575
- Cited by
- 443
- References
- 126
- Citations by year
- 2026: 51 · 2025: 69 · 2024: 83 · 2023: 88 · 2022: 59 · 2021: 43 · 2020: 40 · 2019: 9 · 2013: 1
- FWCI
- 5.63
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Trends in Cognitive Sciences (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- DeStefano Family Foundation
- National Library of Medicine (T15 LM007088)
- National Institute of Mental Health (R01 MH096773, R00 MH091238, R01 MH096773-03S1, R01 MH 096773–05, R01 MH086654, R01 MH59107)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Social Sciences › Arts and Humanities › Philosophy › Mental Health and Psychiatry
- Life Sciences › Neuroscience › Cognitive Neuroscience › Functional Brain Connectivity Studies
- Keywords
- psychiatric classification, dimensional models, curse of dimensionality, supervised learning, unsupervised learning, precision psychiatry, mental illness, causal mechanisms
- MeSH terms
- Mental Disorders, Brain, Cognition, Humans, Individuality, Models, Statistical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review