CoChat

Using Functional or Structural Magnetic Resonance Images and Personal Characteristic Data to Identify ADHD and Autism

Open access

The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.

Abstract

A clinical tool that can diagnose psychiatric illness using functional or structural magnetic resonance (MR) brain images has the potential to greatly assist physicians and improve treatment efficacy. Working toward the goal of automated diagnosis, we propose an approach for automated classification of ADHD and autism based on histogram of oriented gradients (HOG) features extracted from MR brain images, as well as personal characteristic data features. We describe a learning algorithm that can produce effective classifiers for ADHD and autism when run on two large public datasets. The algorithm is able to distinguish ADHD from control with hold-out accuracy of 69.6% (over baseline 55.0%) using personal characteristics and structural brain scan features when trained on the ADHD-200 dataset (769 participants in training set, 171 in test set). It is able to distinguish autism from control with hold-out accuracy of 65.0% (over baseline 51.6%) using functional images with personal characteristic data when trained on the Autism Brain Imaging Data Exchange (ABIDE) dataset (889 participants in training set, 222 in test set). These results outperform all previously presented methods on both datasets. To our knowledge, this is the first demonstration of a single automated learning process that can produce classifiers for distinguishing patients vs. controls from brain imaging data with above-chance accuracy on large datasets for two different psychiatric illnesses (ADHD and autism). Working toward clinical applications requires robustness against real-world conditions, including the substantial variability that often exists among data collected at different institutions. It is therefore important that our algorithm was successful with the large ADHD-200 and ABIDE datasets, which include data from hundreds of participants collected at multiple institutions. While the resulting classifiers are not yet clinically relevant, this work shows that there is a signal in the (f)MRI data that a learning algorithm is able to find. We anticipate this will lead to yet more accurate classifiers, over these and other psychiatric disorders, working toward the goal of a clinical tool for high accuracy differential diagnosis.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1371/journal.pone.0166934

Cites

51 of 51 references verified0 citation errors · 0 not checkable

Statistics

Figures

Fig 1 Summary of the learning pipeline. 1) Each image in the datasets is preprocessed (see section Preprocessing and Fig 2), reducing the dimensions from about 100,000,000 (79 × 95 × 68 × 200) to about 500,000. 2) The MHPC system then extracts the 3D-HOG features of each image reducing the number of dimensions to about 100,000; see section Histogram of oriented gradients (HOG) features. 3) The last step tries to select the best learner (from the initial set of base learners) and feature set, based on running 5-fold cross validation over the training set, using different combinations of the number of features and base learners. This step reduces the number of dimensions to a number under 1000; see section Results. HOG feature extraction, minimum redundancy maximum relevance (MRMR) feature selection and base learner selection are all parts of the MHPC algorithm (shown in the red box above). See Algorithm 1 for details. This figure is best viewed in color.
Fig 1 Summary of the learning pipeline. 1) Each image in the datasets is preprocessed (see section Preprocessing and Fig 2), reducing the dimensions from about 100,000,000 (79 × 95 × 68 × 200) to about 500,000. 2) The MHPC system then extracts the 3D-HOG features of each image reducing the number of dimensions to about 100,000; see section Histogram of oriented gradients (HOG) features. 3) The last step tries to select the best learner (from the initial set of base learners) and feature set, based on running 5-fold cross validation over the training set, using different combinations of the number of features and base learners. This step reduces the number of dimensions to a number under 1000; see section Results. HOG feature extraction, minimum redundancy maximum relevance (MRMR) feature selection and base learner selection are all parts of the MHPC algorithm (shown in the red box above). See Algorithm 1 for details. This figure is best viewed in color.CC BY · PubMed Central
Fig 2 Preprocessing pipeline. The preprocessing pipeline for functional and structural magnetic resonance images is summarized in the figure. Orange shapes in the image show the steps of preprocessing necessary for both fMRI and structural MRI scans. Green shapes show the preprocessing steps only needed for fMRI scans. This figure is best viewed in color.
Fig 2 Preprocessing pipeline. The preprocessing pipeline for functional and structural magnetic resonance images is summarized in the figure. Orange shapes in the image show the steps of preprocessing necessary for both fMRI and structural MRI scans. Green shapes show the preprocessing steps only needed for fMRI scans. This figure is best viewed in color.CC BY · PubMed Central
Fig 3 HOG bins in 2D and 3D space. Left and right panels show HOG bins in 2D and 3D space, respectively.
Fig 3 HOG bins in 2D and 3D space. Left and right panels show HOG bins in 2D and 3D space, respectively.CC BY · PubMed Central
Fig 4 Gradient vector of a sample pixel. For illustration, we describe the 2D HOG feature computation process. Here, we consider a single pixel, the one shown in red, whose neighbors have intensities 56, 93, 94, and 55. The blue arrow is the sample gradient, computed as described below. (This figure is best viewed in color.)
Fig 4 Gradient vector of a sample pixel. For illustration, we describe the 2D HOG feature computation process. Here, we consider a single pixel, the one shown in red, whose neighbors have intensities 56, 93, 94, and 55. The blue arrow is the sample gradient, computed as described below. (This figure is best viewed in color.)CC BY · PubMed Central
Fig 5 Input and output of 2D HOG on a brain image. The left panel shows an axial slice of a structural MR image of a brain. The right panel shows the HOG features of the same slice. Here, we represent the HOG features by an 8-sided “star”, where the length of each arm is the size of the histogram in that direction. This representation is generated using VLFeat [32].
Fig 5 Input and output of 2D HOG on a brain image. The left panel shows an axial slice of a structural MR image of a brain. The right panel shows the HOG features of the same slice. Here, we represent the HOG features by an 8-sided “star”, where the length of each arm is the size of the histogram in that direction. This representation is generated using VLFeat [32].CC BY · PubMed Central
Fig 6 5-fold cross validation accuracies on the training set. The accuracies are obtained using RBF SVM (with various sigma values), on the training portion of the ADHD-200 dataset using functional images plus personal characteristic data. This figure is best viewed in color.
Fig 6 5-fold cross validation accuracies on the training set. The accuracies are obtained using RBF SVM (with various sigma values), on the training portion of the ADHD-200 dataset using functional images plus personal characteristic data. This figure is best viewed in color.CC BY · PubMed Central
Fig 7 Summary of ADHD-200 dataset classification results. The black horizontal dotted line shows the baseline chance accuracy of the test set. Each vertical bar shows the mean and range of the cross validation results for the selected base learner (L) and feature set (FS*(L)) on the training set, as produced with MHPC (Algorithm 1). The blue asterisks * show the accuracy of each classifier on the hold-out set. The classifiers on the x-axis are ordered by the types of features they used, including various combinations of structural MRI, functional MRI, and personal characteristic data. The legend also identifies the actual classifier used. This figure is best viewed in color.
Fig 7 Summary of ADHD-200 dataset classification results. The black horizontal dotted line shows the baseline chance accuracy of the test set. Each vertical bar shows the mean and range of the cross validation results for the selected base learner (L) and feature set (FS*(L)) on the training set, as produced with MHPC (Algorithm 1). The blue asterisks * show the accuracy of each classifier on the hold-out set. The classifiers on the x-axis are ordered by the types of features they used, including various combinations of structural MRI, functional MRI, and personal characteristic data. The legend also identifies the actual classifier used. This figure is best viewed in color.CC BY · PubMed Central
Fig 8 Summary of ABIDE dataset classification results. Conventions are the same as for Fig 7. This figure is best viewed in color.
Fig 8 Summary of ABIDE dataset classification results. Conventions are the same as for Fig 7. This figure is best viewed in color.CC BY · PubMed Central
Fig 9 Extracted block regions from ADHD-200 structural MRI dataset. See text for details.
Fig 9 Extracted block regions from ADHD-200 structural MRI dataset. See text for details.CC BY · PubMed Central
Fig 10 Extracted block regions from ABIDE fMRI dataset. See text for details.
Fig 10 Extracted block regions from ABIDE fMRI dataset. See text for details.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 51 references

Cited by

See all 117

Metadata

Authors
Ghiassian, S., Greiner, R., Jin, P., & Brown, M. R. G.
Affiliations
University of Alberta (CA)
Corresponding author
Brown, Matthew R. G.
Venue
PLOS ONE
Published
2016-12-28
Volume
11
Issue
12
Pages
e0166934
ISSN
1932-6203 (ISSN-L)
OpenAlex
W2561837554
Cited by
116
References
51
Citations by year
2026: 5 · 2025: 12 · 2024: 9 · 2023: 17 · 2022: 15 · 2021: 16 · 2020: 19 · 2019: 11 · 2018: 8 · 2017: 4
FWCI
4.88
Type
journal article
Language
en
Open access
Locations
  • PLoS ONE (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • RePEc: Research Papers in Economics (submittedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • Figshare (submittedVersion, cc-by)
Funders
  • Alberta Machine Intelligence Institute (AMII) internal funding (Project Title: Patient Specific fMRI-based Psychiatric Diagnosis and Treatment)
  • Canadian Institutes of Health Research (CA) (Grant Number: CSE125741)
  • Natural Sciences and Engineering Research Council of Canada (CA) (Grant Number: 203245)
Topics
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Autism Spectrum Disorder Research
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Functional Brain Connectivity Studies
  • Health Sciences › Medicine › Psychiatry and Mental health › Attention Deficit Hyperactivity Disorder
Keywords
attention deficit hyperactivity disorder, autism spectrum disorder, automated diagnosis, brain MRI, functional MRI, structural MRI, histogram of oriented gradients, differential diagnosis, mental illness, ADHD-200, ABIDE
MeSH terms
Machine Learning, Algorithms, Attention Deficit Disorder with Hyperactivity, Autistic Disorder, Child, Female, Humans, Magnetic Resonance Imaging, Male, Medical Informatics, Case-Control Studies, Functional Neuroimaging

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Using Functional or Structural Magnetic Resonance Images and Personal Characteristic Data to Identify ADHD and Autism. https://app.cochat.ai/papers/10.1371/journal.pone.0166934
The paper
Ghiassian, S., Greiner, R., Jin, P., & Brown, M. R. G. (2016). Using Functional or Structural Magnetic Resonance Images and Personal Characteristic Data to Identify ADHD and Autism. PLOS ONE. https://doi.org/10.1371/journal.pone.0166934

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.