CoChat

Task-specific feature extraction and classification of fMRI volumes using a deep neural network initialized with a deep belief network: Evaluation using sensorimotor tasks

Open access
Jang, Hojin, Plis, Sergey M., Calhoun, Vince D., Lee, Jong-Hwan · 2017 · NeuroImage
Cited by 110

The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.

Abstract

Feedforward deep neural networks (DNNs), artificial neural networks with multiple hidden layers, have recently demonstrated a record‐breaking performance in multiple areas of applications in computer vision and speech processing. Following the success, DNNs have been applied to neuroimaging modalities including functional/structural magnetic resonance imaging (MRI) and positron‐emission tomography data. However, no study has explicitly applied DNNs to 3D whole‐brain fMRI volumes and thereby extracted hidden volumetric representations of fMRI that are discriminative for a task performed as the fMRI volume was acquired. Our study applied fully connected feedforward DNN to fMRI volumes collected in four sensorimotor tasks (i.e., left‐hand clenching, right‐hand clenching, auditory attention, and visual stimulus) undertaken by 12 healthy participants. Using a leave‐one‐subject‐out cross‐validation scheme, a restricted Boltzmann machine‐based deep belief network was pretrained and used to initialize weights of the DNN. The pretrained DNN was fine‐tuned while systematically controlling weight‐sparsity levels across hidden layers. Optimal weight‐sparsity levels were determined from a minimum validation error rate of fMRI volume classification. Minimum error rates (mean ± standard deviation; %) of 6.9 (± 3.8) were obtained from the three‐layer DNN with the sparsest condition of weights across the three hidden layers. These error rates were even lower than the error rates from the single‐layer network (9.4 ± 4.6) and the two‐layer network (7.4 ± 4.1). The estimated DNN weights showed spatial patterns that are remarkably task‐specific, particularly in the higher layers. The output values of the third hidden layer represented distinct patterns/codes of the 3D whole‐brain fMRI volume and encoded the information of the tasks as evaluated from representational similarity analysis. Our reported findings show the ability of the DNN to classify a single fMRI volume based on the extraction of hidden representations of fMRI volumes associated with tasks across multiple hidden layers. Our study may be beneficial to the automatic classification/diagnosis of neuropsychiatric and neurological diseases and prediction of disease severity and recovery in (pre‐) clinical settings using fMRI volumes without requiring an estimation of activation patterns or ad hoc statistical evaluation. HighlightsDeep neural network (DNN) was proposed to classify fMRI volume of sensorimotor tasks.DNN weights were optimized via non‐zero value percentage in cross‐validation (CV) framework.Classification performance was superior from three‐layer DNN than one‐/two‐/four‐layer DNNs.Weight/hidden representations were highly task‐specific from higher than lower hidden layers.Sparsity of weights between the input and first hidden layer enhanced the performance.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.neuroimage.2016.04.003

Cites

21 of 21 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 21 references

Cited by

Metadata

Authors
Jang, H., Plis, S. M., Calhoun, V. D., & Lee, J.-H.
Venue
NeuroImage
Publisher
Elsevier BV
Published
2017-01
Volume
145
Issue
Pt B
Pages
314-328
ISSN
1053-8119 (ISSN-L)
OpenAlex
W2325276834
Cited by
110
References
21
FWCI
7.44
Type
journal article
Language
en
Open access
bronze

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.