The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Applying Machine Learning to Facilitate Autism Diagnostics: Pitfalls and Promises
Open accessAbstract
Machine learning has immense potential to enhance diagnostic and intervention research in the behavioral sciences, and may be especially useful in investigations involving the highly prevalent and heterogeneous syndrome of autism spectrum disorder. However, use of machine learning in the absence of clinical domain expertise can be tenuous and lead to misinformed conclusions. To illustrate this concern, the current paper critically evaluates and attempts to reproduce results from two studies (Wall et al. in Transl Psychiatry 2(4):e100, 2012a; PloS One 7(8), 2012b) that claim to drastically reduce time to diagnose autism using machine learning. Our failure to generate comparable findings to those reported by Wall and colleagues using larger and more balanced data underscores several conceptual and methodological problems associated with these studies. We conclude with proposed best-practices when using machine learning in autism research, and highlight some especially promising areas for collaborative work at the intersection of computational and behavioral science.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The WEKA data mining software: an update
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1656274.1656278 · Cited by 17,750
A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection
Kohavi, R. (1995) · Zenodo · doi:10.5281/zenodo.19712698 · Cited by 10,909
Lord, C., Rutter, M., & Le Couteur, A. (1994) · Journal of Autism and Developmental Disorders · doi:10.1007/bf02172145 · Cited by 9,065
Lord, C., Risi, S., Lambrecht, L., Cook, E. H., Leventhal, B. L., DiLavore, P. C., Pickles, A., & Rutter, M. (2000) · Journal of Autism and Developmental Disorders · doi:10.1023/a:1005592401947 · Cited by 7,520
Picard, R. W. (1997) · MIT Press · doi:10.7551/mitpress/1140.001.0001 · Cited by 7,382
The INTERSPEECH 2009 emotion challenge
Schuller, B., Steidl, S., & Batliner, A. (2009) · Interspeech 2009 · doi:10.21437/interspeech.2009-103 · Cited by 938
Defining the broader phenotype of autism: genetic, brain, and behavioral perspectives
DAWSON, G., WEBB, S., SCHELLENBERG, G. D., DAGER, S., FRIEDMAN, S., AYLWARD, E., & RICHARDS, T. (2002) · Development and Psychopathology · doi:10.1017/s0954579402003103 · Cited by 467
Subgrouping the Autism Spectrum: Reflections on DSM-5
Lai, M.-C., Lombardo, M. V., Chakrabarti, B., & Baron-Cohen, S. (2013) · PLoS Biology · doi:10.1371/journal.pbio.1001544 · Cited by 330 · cited 1×
“Lai et al. (2013) generated a list of desired behavioral specifiers toward identification of subgroups in autism, offering one potential direction for bringing computational methods to bear.”
BackgroundAnnual research review: re-thinking the classification of autism spectrum disorders
Lord, C., & Jones, R. M. (2012) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2012.02547.x · Cited by 290
Levitt, P., & Campbell, D. B. (2009) · Journal of Clinical Investigation · doi:10.1172/jci37934 · Cited by 234 · cited 2×
“The ADOS is a widely used, standardized assessment for diagnosing ASD that consists of 30–45 min of semistructured interaction with a trained administrator to elicit and code behaviors relating to social interaction, communication, play, and imaginative use of materials (Lord et al. 2000). The ADOS consists of four di…”
BackgroundMethod
Cited by
Machine learning algorithm validation with a limited sample size
Vabalas, A., Gowen, E., Poliakoff, E., & Casson, A. J. (2019) · PLOS ONE · doi:10.1371/journal.pone.0224365 · Cited by 1,901
Leakage and the reproducibility crisis in machine-learning-based science
Kapoor, S., & Narayanan, A. (2023) · Patterns · doi:10.1016/j.patter.2023.100804 · Cited by 1,387
“For example, Bone et al.(61) highlight that in a study on predicting autism using ML models, excluding the data corresponding to borderline cases of autism leads to leakage because the test set is no longer representative of the general population about which claims are made.”
BackgroundLuo, W., Phung, D., Tran, T., Gupta, S., Rana, S., Karmakar, C., Shilton, A., Yearwood, J., Dimitrova, N., Ho, T. B., et al. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5870 · Cited by 988
Introduction to technologies in the daily lives of individuals with autism
Shic, F., & Goodwin, M. (2015) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-015-2640-1 · Cited by 35
Self-citation
Metadata
- Authors
- Bone, D., Goodwin, M. S., Black, M. P., Lee, C.-C., Audhkhasi, K., & Narayanan, S.
- Venue
- Journal of Autism and Developmental Disorders
- Published
- 2014-10-08
- Volume
- 45
- Issue
- 5
- Pages
- 1121-1136
- ISSN
- 0162-3257 (ISSN-L)
- 1573-3432
- OpenAlex
- W2092444470
- Cited by
- 236
- References
- 11
- FWCI
- 3.92
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Applying Machine Learning to Facilitate Autism Diagnostics: Pitfalls and Promises. https://app.cochat.ai/papers/10.1007/s10803-014-2268-6
- The paper
- Bone, D., Goodwin, M. S., Black, M. P., Lee, C.-C., Audhkhasi, K., & Narayanan, S. (2015). Applying Machine Learning to Facilitate Autism Diagnostics: Pitfalls and Promises. Journal of Autism and Developmental Disorders. https://doi.org/10.1007/s10803-014-2268-6
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.