The meaning of significant mean group differences for biomarker discovery
Open accessThe DOI matches its Crossref record; 52 of the 55 references it cites were found in a registry or an index, and 3 are not checked yet.
Abstract
Over the past decade, biomarker discovery has become a key goal in psychiatry to aid in the more reliable diagnosis and prognosis of heterogeneous psychiatric conditions and the development of tailored therapies. Nevertheless, the prevailing statistical approach is still the mean group comparison between “cases” and “controls,” which tends to ignore within-group variability. In this educational article, we used empirical data simulations to investigate how effect size, sample size, and the shape of distributions impact the interpretation of mean group differences for biomarker discovery. We then applied these statistical criteria to evaluate biomarker discovery in one area of psychiatric research—autism research. Across the most influential areas of autism research, effect size estimates ranged from small ( d = 0.21, anatomical structure) to medium ( d = 0.36 electrophysiology, d = 0.5, eye-tracking) to large ( d = 1.1 theory of mind). We show that in normal distributions, this translates to approximately 45% to 63% of cases performing within 1 standard deviation (SD) of the typical range, i.e., they do not have a deficit/atypicality in a statistical sense. For a measure to have diagnostic utility as defined by 80% sensitivity and 80% specificity, Cohen’s d of 1.66 is required, with still 40% of cases falling within 1 SD. However, in both normal and nonnormal distributions, 1 (skewness) or 2 (platykurtic, bimodal) biologically plausible subgroups may exist despite small or even nonsignificant mean group differences. This conclusion drastically contrasts the way mean group differences are frequently reported. Over 95% of studies omitted the “on average” when summarising their findings in their abstracts (“autistic people have deficits in X”), which can be misleading as it implies that the group-level difference applies to all individuals in that group. We outline practical approaches and steps for researchers to explore mean group comparisons for the discovery of stratification biomarkers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
![Fig 1 Simulations of the degree to which 2 groups overlap at different effect sizes. (a) Percentage of autistic individuals (red) falling within 1 SD and 2 SDs of the control (blue) distribution at effect size of d = 0.2, 0.5, 1, and 2.7. 0 = mean, σ = SD. Simulations based on 10,000 random draws assuming the same SD and absolute mean difference in the population. The red shaded area indicates the % of cases above 2 SDs. (b) Although sample size does not bias the effect size estimates themselves, it does substantially affect their precision, which is reflected in the width of the CI. The precision of effect size estimates with sample sizes of N = 20 and N = 100. Purple shading denotes CIs around 1 SD of the mean and red shading CIs around 2 SDs of the mean. For example, for a small effect size at Cohen’s d of 0.2, with N = 100 participants per group, between 60% and 75% of autistic people would fall within 1 SD of the control mean. With smaller samples of N = 20 per group, ranges grow to 40%–85% within 1 SD and to 75%–100% within 2 SDs. At Cohen’s d of 0.5, with N = 100 versus N = 20, 55%–71% versus 45%–80% of people with ASD would fall within 1 SD and between 89%–97% versus 85%–100% within 2 SDs of the TD mean, etc. Hence, with small sample sizes, the range of possible results is so wide that it is difficult to make accurate inferences of the frequency or severity of cases who have abnormalities on that measure from single studies. As recently noted, studies with small sample sizes (low power), paired with publication bias and file drawer effects as well as high sample variability (true heterogeneity within a condition), can lead a whole field to overestimate the magnitude of the true population effect [49,50]. ASD, autism spectrum disorder; CI, confidence interval; SD, standard deviation.](https://figures.cochat.ai/paper-figures/c5503c04d4d74c59b2fcb557199a8eaa/the-meaning-of-significant-mean-group-differences-for-biomarker-discovery-figure-1.jpg)

![Fig 3 Average effect sizes of meta-analyses per modality. The distributions of the original data included in the meta-analyses were often not reported. This is exemplified in S1 Table where we checked information on the data distributions of the 49 original papers included in a review of emotion recognition [20]. However, in the majority of papers, parametric statistics were employed, which may be taken as indicating normal distribution. EF, executive function; ET, eye-tracking; fMRI, functional MRI; MMN, mismatch negativity; PRS, polygenic risk score; ROI, region of interest; sMRI, structural MRI; SNP, single-nucleotide polymorphism; ToM, theory of mind.](https://figures.cochat.ai/paper-figures/a5de641bcc1b495e8b198e1df006e17c/the-meaning-of-significant-mean-group-differences-for-biomarker-discovery-figure-3.jpg)
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, this metric may not be interpretable if derived out of non-normal distributions, as is often encountered in neuroimaging 8 .”
From Candidate diagnostic biomarkers for neurodevelopmental disorders in children and adolescents: a systematic review (2023) · cites this paper as [8]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Although there are no established benchmarks for these metrics, quantitative measures that allow diagnostic accuracy with at least 80% sensitivity and 80% specificity are often considered as clinically useful 8”
From Candidate diagnostic biomarkers for neurodevelopmental disorders in children and adolescents: a systematic review (2023) · cites this paper as [8]
The cited source says what the claim attributes to it.
In the citing paper
“Whenever effect sizes were reported, these were generally in the low or moderate range, and certainly not in the range of an effect size of d=1.66 that would be needed to lead to a sensitivity and specificity of 80% 8 .”
From Candidate diagnostic biomarkers for neurodevelopmental disorders in children and adolescents: a systematic review (2023) · cites this paper as [8]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Cohen, J. (2013) · doi:10.4324/9780203771587 · Cited by 25,373
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641 · cited 1×
“As recently noted, studies with small sample sizes (low power), paired with publication bias and file drawer effects as well as high sample variability (true heterogeneity within a condition), can lead a whole field to overestimate the magnitude of the true population effect [49,50].”
BackgroundInsel, T., Cuthbert, B., Garvey, M., Heinssen, R., Pine, D. S., Quinn, K., Sanislow, C., & Wang, P. (2010) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2010.09091379 · Cited by 7,067
Biomarkers and surrogate endpoints: Preferred definitions and conceptual framework
(2001) · Clinical Pharmacology & Therapeutics · doi:10.1067/mcp.2001.113989 · Cited by 6,762
Toward the future of psychiatric diagnosis: the seven pillars of RDoC
Cuthbert, B. N., & Insel, T. R. (2013) · BMC Medicine · doi:10.1186/1741-7015-11-126 · Cited by 3,053 · cited 1×
“This biomarker-clinical phenotype relationship could be linear or nonlinear such that the atypicality only becomes clinically relevant from a certain degree or “tipping point” [39].”
BackgroundIdentification of common genetic risk variants for autism spectrum disorder
Autism Spectrum Disorder Working Group of the Psychiatric Genomics Consortium, Grove, J., BUPGEN, Major Depressive Disorder Working Group of the Psychiatric Genomics Consortium, 23andMe Research Team, Ripke, S., Als, T. D., Mattheisen, M., Walters, R. K., Won, H., et al. (2019) · Nature Genetics · doi:10.1038/s41588-019-0344-8 · Cited by 2,421
Resting-state connectivity biomarkers define neurophysiological subtypes of depression
Drysdale, A. T., Grosenick, L., Downar, J., Dunlop, K., Mansouri, F., Meng, Y., Fetcho, R. N., Zebley, B., Oathes, D. J., Etkin, A., et al. (2017) · Nature Medicine · doi:10.1038/nm.4246 · Cited by 2,170
Comparing effect sizes in follow-up studies: ROC Area, Cohen's d, and r.
Rice, M. E., & Harris, G. T. (2005) · Law and Human Behavior · doi:10.1007/s10979-005-6832-7 · Cited by 1,608
The unicorn, the normal curve, and other improbable creatures.
Micceri, T. (1989) · Psychological Bulletin · doi:10.1037//0033-2909.105.1.156 · Cited by 1,485
Attention-deficit/hyperactivity disorder
Faraone, S. V., Asherson, P., Banaschewski, T., Biederman, J., Buitelaar, J. K., Ramos-Quiroga, J. A., Rohde, L. A., Sonuga-Barke, E. J. S., Tannock, R., & Franke, B. (2015) · Nature Reviews Disease Primers · doi:10.1038/nrdp.2015.20 · Cited by 1,479
Self-citationThe NIMH Research Domain Criteria (RDoC) Project: Precision Medicine for Psychiatry
Insel, T. R. (2014) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2014.14020138 · Cited by 1,472 · cited 1×
“On the one hand, the clinical and etiological heterogeneity of most neurodevelopmental and psychiatric conditions (as well as substantial overlap between conditions) is widely accepted among researchers and clinicians [1].”
BackgroundAutism spectrum disorders: a meta-analysis of executive function
Demetriou, E. A., Lampit, A., Quintana, D. S., Naismith, S. L., Song, Y. J. C., Pye, J. E., Hickie, I., & Guastella, A. J. (2018) · Molecular Psychiatry · doi:10.1038/mp.2017.75 · Cited by 841
Recognition of Emotions in Autism: A Formal Meta-Analysis
Uljarevic, M., & Hamilton, A. (2013) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-012-1695-5 · Cited by 824 · cited 3×
“For illustrative purposes, we selected 1 representative published meta-analysis per domain and compiled average effect sizes for theory of mind [21], executive function [22], emotion recognition [20], eye-tracking [33], EEG of mismatch negativity [23], and N170 [34], functional MRI of reward processing [24], structura…”
BackgroundMethodMachine Learning for Precision Psychiatry: Opportunities and Challenges
Bzdok, D., & Meyer-Lindenberg, A. (2018) · Biological Psychiatry: Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2017.11.007 · Cited by 796
Self-citationDevelopmental psychopathology, Vol. 1: Theory and methods.
Cicchetti, D., & Cohen, D. J. (1995) · Cited by 645
Studies on 5-hydroxyindole metabolism in autistic and other mentally retarded children
Schain, R. J., & Freedman, D. X. (1961) · The Journal of Pediatrics · doi:10.1016/s0022-3476(61)80261-8 · Cited by 579 · cited 1×
“In autism research, this is exemplified by hyperserotonemia that has been found in approximately 30% of autistic individuals [31,32].”
BackgroundBig data approaches to decomposing heterogeneity across the autism spectrum
Lombardo, M. V., Lai, M.-C., & Baron-Cohen, S. (2019) · Molecular Psychiatry · doi:10.1038/s41380-018-0321-0 · Cited by 537
van Rooij, D., Anagnostou, E., Arango, C., Auzias, G., Behrmann, M., Busatto, G. F., Calderoni, S., Daly, E., Deruelle, C., Di Martino, A., et al. (2018) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2017.17010100 · Cited by 485
Self-citationAspirin: a review of its neurobiological properties and therapeutic potential for mental illness
Berk, M., Dean, O., Drexhage, H., McNeil, J. J., Moylan, S., O'Neil, A., Davey, C. G., Sanna, L., & Maes, M. (2013) · BMC Medicine · doi:10.1186/1741-7015-11-74 · Cited by 391
Frazier, T. W., Strauss, M., Klingemier, E. W., Zetzer, E. E., Hardan, A. Y., Eng, C., & Youngstrom, E. A. (2017) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2017.05.005 · Cited by 376
Autism spectrum heterogeneity: fact or artifact?
Mottron, L., & Bzdok, D. (2020) · Molecular Psychiatry · doi:10.1038/s41380-020-0748-y · Cited by 332
Self-citationEvaluation of the Social Motivation Hypothesis of Autism: A Systematic Review and Meta-analysis
Clements, C. C., Zoltowski, A. R., Yankowitz, L. D., Yerys, B. E., Schultz, R. T., & Herrington, J. D. (2018) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2018.1100 · Cited by 316 · cited 2×
“For illustrative purposes, we selected 1 representative published meta-analysis per domain and compiled average effect sizes for theory of mind [21], executive function [22], emotion recognition [20], eye-tracking [33], EEG of mismatch negativity [23], and N170 [34], functional MRI of reward processing [24], structura…”
BackgroundMethodA meta-analysis of mentalizing impairments in adults with schizophrenia and autism spectrum disorder
Chung, Y. S., Barch, D., & Strube, M. (2014) · Schizophrenia Bulletin · doi:10.1093/schbul/sbt048 · Cited by 310
Loth, E., Charman, T., Mason, L., Tillmann, J., Jones, E. J. H., Wooldridge, C., Ahmad, J., Auyeung, B., Brogna, C., Ambrosino, S., et al. (2017) · Molecular Autism · doi:10.1186/s13229-017-0146-8 · Cited by 299
Self-citationPredicting Polygenic Risk of Psychiatric Disorders
Martin, A. R., Daly, M. J., Robinson, E. B., Hyman, S. E., & Neale, B. M. (2019) · Biological Psychiatry · doi:10.1016/j.biopsych.2018.12.015 · Cited by 299
Velikonja, T., Fett, A.-K., & Velthorst, E. (2019) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2018.3645 · Cited by 292
Dissecting diagnostic heterogeneity in depression by integrating neuroimaging and genetics
Buch, A. M., & Liston, C. (2021) · Neuropsychopharmacology · doi:10.1038/s41386-020-00789-3 · Cited by 274
Zhang, T., Pang, C., Li, N., Zhou, E., & Zhao, K. (2013) · BMC Medicine · doi:10.1186/1741-7015-11-1 · Cited by 270
Wang, H.-T., Smallwood, J., Mourao-Miranda, J., Xia, C. H., Satterthwaite, T. D., Bassett, D. S., & Bzdok, D. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.116745 · Cited by 244
Self-citationMulder, E. J., Anderson, G. M., Kema, I. P., de Bildt, A., van Lang, N. D., den Boer, J. A., & Minderaa, R. B. (2004) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-200404000-00016 · Cited by 199
Lynch, C. J., Gunning, F. M., & Liston, C. (2020) · Biological Psychiatry · doi:10.1016/j.biopsych.2020.01.012 · Cited by 185
The Accuracy of Risk Scores in Predicting Ovarian Malignancy: A Systematic Review
Geomini, P., Kruitwagen, R., Bremer, G. L., Cnossen, J., & Mol, B. W. J. (2009) · Obstetrics & Gynecology · doi:10.1097/aog.0b013e318195ad17 · Cited by 184
Atypicality of the N170 Event-Related Potential in Autism Spectrum Disorder: A Meta-analysis
Kang, E., Keifer, C. M., Levy, E. J., Foss-Feig, J. H., McPartland, J. C., & Lerner, M. D. (2018) · Biological Psychiatry: Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2017.11.003 · Cited by 144
The IBIS Network, Wolff, J. J., Swanson, M. R., Elison, J. T., Gerig, G., Pruett, J. R., Styner, M. A., Vachet, C., Botteron, K. N., Dager, S. R., et al. (2017) · Molecular Autism · doi:10.1186/s13229-017-0126-z · Cited by 142
Identification and validation of biomarkers for autism spectrum disorders
Loth, E., Spooren, W., Ham, L. M., Isaac, M. B., Auriche-Benichou, C., Banaschewski, T., Baron-Cohen, S., Broich, K., Bölte, S., Bourgeron, T., et al. (2016) · Nature Reviews Drug Discovery · doi:10.1038/nrd.2015.7 · Cited by 140 · cited 2×
“By contrast, assuming that a clinical condition is heterogeneous, a stratification biomarker refers to a measurable characteristic that can be used to identify more homogeneous biological subgroups within or across established diagnostic categories [4,7,13].”
BackgroundSelf-citationSchwartz, S., Shinn-Cunningham, B., & Tager-Flusberg, H. (2018) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2018.01.008 · Cited by 137 · cited 2×
“For illustrative purposes, we selected 1 representative published meta-analysis per domain and compiled average effect sizes for theory of mind [21], executive function [22], emotion recognition [20], eye-tracking [33], EEG of mismatch negativity [23], and N170 [34], functional MRI of reward processing [24], structura…”
BackgroundMethodKendler, K. S. (2012) · Molecular Psychiatry · doi:10.1038/mp.2011.70 · Cited by 126
Thompson, B. (1999) · Theory & Psychology · doi:10.1177/095935439992006 · Cited by 118
Quantifying factors for the success of stratified medicine
Trusheim, M. R., Burgess, B., Hu, S. X., Long, T. W., Averbuch, S. D., Flynn, A. A., Lieftucht, A., Mazumder, A., Milloy, J., Shaw, P. M., et al. (2011) · Nature Reviews Drug Discovery · doi:10.1038/nrd3557 · Cited by 116
Ahmed, A. O., Strauss, G. P., Buchanan, R. W., Kirkpatrick, B. W., & Carpenter, W. T. (2017) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2017.11.004 · Cited by 102
The Importance of Effect Magnitude
Kirk, R. E. (2003) · Handbook of Research Methods in Experimental Psychology · doi:10.1002/9780470756973.ch5 · Cited by 94
Inference and Prediction Diverge in Biomedicine
Bzdok, D., Engemann, D. A., Grisel, O., Varoquaux, G. P., & Thirion, B. (2020) · Patterns · doi:10.1016/j.patter.2020.100119 · Cited by 92
Self-citationThe impact of sample size on the reproducibility of voxel-based lesion-deficit mappings
Lorca-Puls, D. L., Gajardo-Vidal, A., White, J., Seghier, M. L., Leff, A. P., Green, D. W., Crinion, J. T., Ludersdorfer, P., Hope, T. M. H., Bowman, H., et al. (2018) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2018.03.014 · Cited by 82
Considerations in biomarker development for neurodevelopmental disorders
McPartland, J. C. (2016) · Current Opinion in Neurology · doi:10.1097/wco.0000000000000300 · Cited by 80
Effect size measures in a two-independent-samples case with nonnormal and nonhomogeneous data
Li, J. C. (2015) · Behavior Research Methods · doi:10.3758/s13428-015-0667-z · Cited by 79
What evidence do we need for biomarker qualification?
Leptak, C., Menetski, J. P., Wagner, J. A., Aubrecht, J., Brady, L., Brumfield, M., Chin, W. W., Hoffmann, S., Kelloff, G., Lavezzari, G., et al. (2017) · Science Translational Medicine · doi:10.1126/scitranslmed.aal4599 · Cited by 78
Multivariate revisit to “sex beyond the genitalia”
Rosenblatt, J. D. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1523961113 · Cited by 75
Heterogeneity of schizophrenia: Genetic and symptomatic factors
Takahashi, S. (2013) · American Journal of Medical Genetics Part B Neuropsychiatric Genetics · doi:10.1002/ajmg.b.32161 · Cited by 72
Variance Heterogeneity in Published Psychological Research: A Review and a New Index
Ruscio, J., & Roche, B. (2011) · Methodology · doi:10.1027/1614-2241/a000034 · Cited by 51
Welberg, L. (2012) · Nature reviews. Neuroscience · doi:10.1038/nrn3417 · Cited by 46
Stephenson, D., Hill, D., Cedarbaum, J. M., Tome, M., Vamvakas, S., Romero, K., Conrado, D. J., Dexter, D. T., Seibyl, J., Jennings, D., et al. (2019) · Journal of Parkinson’s Disease · doi:10.3233/jpd-191648 · Cited by 46 · cited 1×
“Recent interest in biomarker discovery has been sparked by their successful clinical use in multiple areas of medicine [8], to aid in more objective and reliable diagnosis of a condition, or in predicting individual treatment response [9].”
BackgroundEnglish, P. A., Williams, J. A., Martini, J., Motzer, R. J., Valota, O., & Buller, R. E. (2015) · Future Oncology · doi:10.2217/fon.15.290 · Cited by 28
Big data approaches to decomposing heterogeneity across the autism spectrumPreprint
Lombardo, M. V., Lai, M., & Baron‐Cohen, S. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/278788 · Cited by 28
Brand, A., & Bradley, M. T. (2016) · Psychological Reports · doi:10.1177/0033294115625265 · Cited by 25
Stephenson, D. T., Hill, D., Cedarbaum, J. M., Tome, M. B., Vamvakas, S., Romero, K., Conrado, D. J., Dexter, D. T., Seibyl, J. P., Jennings, D. L., et al. (2019) · Journal of Parkinson s Disease · doi:10.3233/jpd-199003 · Cited by 7
Cited by
Evidence for embracing normative modeling
Rutherford, S., Barkema, P., Tso, I. F., Sripada, C., Beckmann, C. F., Ruhe, H. G., & Marquand, A. F. (2023) · eLife · doi:10.7554/elife.85082 · Cited by 175
Self-citationCortese, S., Solmi, M., Michelini, G., Bellato, A., Blanner, C., Canozzi, A., Eudave, L., Farhat, L. C., Højlund, M., Köhler‐Forsberg, O., et al. (2023) · World Psychiatry · doi:10.1002/wps.21037 · Cited by 147
Haghayegh, F., Norouziazad, A., Haghani, E., Feygin, A. A., Rahimi, R. H., Ghavamabadi, H. A., Sadighbayan, D., Madhoun, F., Papagelis, M., Felfeli, T., et al. (2024) · Advanced Science · doi:10.1002/advs.202400595 · Cited by 170
A Systematic Review of Aperiodic Neural Activity in Clinical Investigations
Donoghue, T. (2025) · European Journal of Neuroscience · doi:10.1111/ejn.70255 · Cited by 111
Restoring the missing person to personalized medicine and precision psychiatry
Gómez-Carrillo, A., Paquin, V., Dumas, G., & Kirmayer, L. J. (2023) · Frontiers in Neuroscience · doi:10.3389/fnins.2023.1041433 · Cited by 71
Self-citation
Metadata
- Authors
- Loth, E., Ahmad, J., Chatham, C., López, B., Carter, B., Crawley, D., Oakley, B., Hayward, H., Cooke, J., San José Cáceres, A., Bzdok, D., Jones, E., Charman, T., Beckmann, C., Bourgeron, T., Toro, R., Buitelaar, J., Murphy, D., & Dumas, G.
- Affiliations
- King's College London (GB)
- University of Greenwich (GB)
- University of Portsmouth (GB)
- Canadian Institute for Advanced Research (CA)
- Birkbeck, University of London (GB)
- Radboud University Medical Center (NL)
- Centre National de la Recherche Scientifique (FR)
- Corresponding author
- Dumas, Guillaume
- ORCID
- Venue
- PLOS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2021-11-18
- Volume
- 17
- Issue
- 11
- Pages
- e1009477
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- PMC
- PMC8601419
- OpenAlex
- W3213490299
- Cited by
- 52
- References
- 52
- Citations by year
- 2026: 7 · 2025: 11 · 2024: 9 · 2023: 13 · 2022: 12
- FWCI
- 4.91
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Computational Biology (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Research Portal (King's College London) (publishedVersion, other-oa)
- BIROn (Birkbeck, University of London) (acceptedVersion)
- Greenwich Academic Literature Archive (University of Greenwich) (acceptedVersion)
- Zenodo (CERN European Organization for Nuclear Research) (submittedVersion, cc-by)
- HAL (submittedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Radboud Repository (Radboud University) (submittedVersion)
- Radboud Repository (Radboud University) (submittedVersion, other-oa)
- Funders
- innovative medicines initiative (777394)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Life Sciences › Neuroscience › Cognitive Neuroscience › Autism Spectrum Disorder Research
- Keywords
- biomarker discovery, effect size, within-group variation, autism spectrum disorder, diagnostic value, sensitivity and specificity, non-normal distributions, sample size, case-control comparison, theory of mind, eye tracking, electrophysiology, anatomical structures
- MeSH terms
- Autistic Disorder, Mental Disorders, Computer Simulation, Humans, Individuality, Neuropsychology, Biomarkers, Normal Distribution, Case-Control Studies, Sample Size, Computational Biology, Neuropsychiatry, Neurodevelopmental Disorders
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.