CoChat

Multi-Channel 3D Deep Feature Learning for Survival Time Prediction of Brain Tumor Patients Using Multi-Modal Neuroimages

Open access

The DOI matches its Crossref record; 68 of the 69 references it cites were found in a registry or an index.

Abstract

High-grade gliomas are the most aggressive malignant brain tumors. Accurate pre-operative prognosis for this cohort can lead to better treatment planning. Conventional survival prediction based on clinical information is subjective and could be inaccurate. Recent radiomics studies have shown better prognosis by using carefully-engineered image features from magnetic resonance images (MRI). However, feature engineering is usually time consuming, laborious and subjective. Most importantly, the engineered features cannot effectively encode other predictive but implicit information provided by multi-modal neuroimages. We propose a two-stage learning-based method to predict the overall survival (OS) time of high-grade gliomas patient. At the first stage, we adopt deep learning, a recently dominant technique of artificial intelligence, to automatically extract implicit and high-level features from multi-modal, multi-channel preoperative MRI such that the features are competent of predicting survival time. Specifically, we utilize not only contrast-enhanced T1 MRI, but also diffusion tensor imaging (DTI) and resting-state functional MRI (rs-fMRI), for computing multiple metric maps (including various diffusivity metric maps derived from DTI, and also the frequency-specific brain fluctuation amplitude maps and local functional connectivity anisotropy-related metric maps derived from rs-fMRI) from 68 high-grade glioma patients with different survival time. We propose a multi-channel architecture of 3D convolutional neural networks (CNNs) for deep learning upon those metric maps, from which high-level predictive features are extracted for each individual patch of these maps. At the second stage, those deeply learned features along with the pivotal limited demographic and tumor-related features (such as age, tumor size and histological type) are fed into a support vector machine (SVM) to generate the final prediction result (i.e., long or short overall survival time). The experimental results demonstrate that this multi-model, multi-channel deep survival prediction framework achieves an accuracy of 90.66%, outperforming all the competing methods. This study indicates highly demanded effectiveness on prognosis of deep learning technique in neuro-oncological applications for better individualized treatment planning towards precision medicine.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1038/s41598-018-37387-9

Cites

68 of 68 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Schematic description of the proposed survival prediction framework for high-grade glioma patients, by using (1) 3D CNN-based deep learning to conduct feature learning and (2) an SVM for final prediction (long or short OS).
Figure 1 Schematic description of the proposed survival prediction framework for high-grade glioma patients, by using (1) 3D CNN-based deep learning to conduct feature learning and (2) an SVM for final prediction (long or short OS).CC BY · PubMed Central
Figure 2 A sample glioblastoma patient in our dataset. T1 MRI is presented as a single metric map, while DTI and rs-fMRI are presented as multi-channel metric maps.
Figure 2 A sample glioblastoma patient in our dataset. T1 MRI is presented as a single metric map, while DTI and rs-fMRI are presented as multi-channel metric maps.CC BY · PubMed Central
Figure 3 Kaplan-Meier plot of the two groups’ survival data based on our predicted results. Dotted line indicates the 95% confidence interval.
Figure 3 Kaplan-Meier plot of the two groups’ survival data based on our predicted results. Dotted line indicates the 95% confidence interval.CC BY · PubMed Central
Figure 4 OS prediction results using different imaging modalities. “Proposed” denotes the prediction result by combining all modalities together.
Figure 4 OS prediction results using different imaging modalities. “Proposed” denotes the prediction result by combining all modalities together.CC BY · PubMed Central
Figure 5 The experimental results using different feature extraction methods (such as 2D CNN and the proposed 3D CNN).
Figure 5 The experimental results using different feature extraction methods (such as 2D CNN and the proposed 3D CNN).CC BY · PubMed Central
Figure 6 The experimental results using different kinds of (unsupervised vs. supervised) features.
Figure 6 The experimental results using different kinds of (unsupervised vs. supervised) features.CC BY · PubMed Central
Figure 7 Comparison of experimental results with SVM, CNN and CNN + SVM.
Figure 7 Comparison of experimental results with SVM, CNN and CNN + SVM.CC BY · PubMed Central
Figure 8 An illustration of the CNN architecture for the single-channel feature extraction from 3D patches. There are four convolutional layer groups and three fully-connected layers. The network’s input is a 32 × 32 × 32 patch from a tumor region of a patient, and the output is the decision that this patient belongs to the long or short survival group.
Figure 8 An illustration of the CNN architecture for the single-channel feature extraction from 3D patches. There are four convolutional layer groups and three fully-connected layers. The network’s input is a 32 × 32 × 32 patch from a tumor region of a patient, and the output is the decision that this patient belongs to the long or short survival group.CC BY · PubMed Central
Figure 9 Architecture of mCNN for feature extraction from multi-channel data.
Figure 9 Architecture of mCNN for feature extraction from multi-channel data.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 68 references

Research works printed but not linked: 2

  1. Coons, S. W., Johnson, P. C., Scheithauer, B. W., Yates, A. J. & Pearl, D. K. Improving diagnostic accuracy and interobserver concordance in the classification and grading of primary gliomas. Cancer 79, 1381–1393 (1997). · doi:10.1002/(sici)1097-0142(19970401)79:7<1381::aid-cncr16>3.0.co;2-w
  2. Guyon, I. & Elisseeff, A. An introduction to variable and feature selection. Journal of machine learning research 3, 1157–1182 (2003).

Cited by

See all 213

Metadata

Authors
Nie, D., Lu, J., Zhang, H., Adeli, E., Wang, J., Yu, Z., Liu, L., Wang, Q., Wu, J., & Shen, D.
Affiliations
  • University of North Carolina at Chapel Hill (US)
  • Fudan University (CN)
  • Shanghai Jiao Tong University (CN)
Corresponding author
  • Wang, Qian
  • Wu, Jinsong
  • Shen, Dinggang
Venue
Scientific Reports
Published
2019-01-31
Volume
9
Issue
1
Pages
1103-1103
ISSN
2045-2322 (ISSN-L)
OpenAlex
W2912884588
Cited by
213
References
69
Citations by year
2026: 13 · 2025: 25 · 2024: 32 · 2023: 35 · 2022: 27 · 2021: 34 · 2020: 39 · 2019: 7
FWCI
17.54
Type
journal article
Language
en
Open access
Licence
Locations
  • Scientific Reports (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Carolina Digital Repository (University of North Carolina at Chapel Hill) (submittedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
  • UNC Libraries
Funders
U.S. Department of Health &amp; Human Services | NIH | NIH Clinical Center (EB006733)
Topics
  • Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiomics and Machine Learning in Medical Imaging
  • Health Sciences › Medicine › Oncology › Glioma Diagnosis and Treatment
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Brain Tumor Detection and Classification
Keywords
high-grade glioma, overall survival prediction, multimodal neuroimaging, diffusion tensor imaging, resting-state fMRI, support vector machine, preoperative MRI, precision medicine
MeSH terms
Deep Learning, Adolescent, Adult, Aged, Algorithms, Brain Neoplasms, Female, Glioma, Humans, Male, Middle Aged, Survival Rate, Databases, Factual, Disease-Free Survival, Diffusion Tensor Imaging, Neoplasm Grading

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Multi-Channel 3D Deep Feature Learning for Survival Time Prediction of Brain Tumor Patients Using Multi-Modal Neuroimages. https://app.cochat.ai/papers/10.1038/s41598-018-37387-9
The paper
Nie, D., Lu, J., Zhang, H., Adeli, E., Wang, J., Yu, Z., Liu, L., Wang, Q., Wu, J., & Shen, D. (2019). Multi-Channel 3D Deep Feature Learning for Survival Time Prediction of Brain Tumor Patients Using Multi-Modal Neuroimages. Scientific Reports. https://doi.org/10.1038/s41598-018-37387-9

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.