Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Cited by 195

The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.

A systematic review of machine learning models for predicting outcomes of stroke with structured data

Open access
Wang, Wenjuan, Kiik, Martin, Peek, Niels, Curcin, Vasa, Marshall, Iain J., Rudd, Anthony G., Wang, Yanzhong, Douiri, Abdel, Wolfe, Charles D., Bray, Benjamin · 2020 · PLOS ONE

Abstract

BACKGROUND AND PURPOSE: Machine learning (ML) has attracted much attention with the hope that it could make use of large, routinely collected datasets and deliver accurate personalised prognosis. The aim of this systematic review is to identify and critically appraise the reporting and developing of ML models for predicting outcomes after stroke. METHODS: We searched PubMed and Web of Science from 1990 to March 2019, using previously published search filters for stroke, ML, and prediction models. We focused on structured clinical data, excluding image and text analysis. This review was registered with PROSPERO (CRD42019127154). RESULTS: Eighteen studies were eligible for inclusion. Most studies reported less than half of the terms in the reporting quality checklist. The most frequently predicted stroke outcomes were mortality (7 studies) and functional outcome (5 studies). The most commonly used ML methods were random forests (9 studies), support vector machines (8 studies), decision trees (6 studies), and neural networks (6 studies). The median sample size was 475 (range 70-3184), with a median of 22 predictors (range 4-152) considered. All studies evaluated discrimination with thirteen using area under the ROC curve whilst calibration was assessed in three. Two studies performed external validation. None described the final model sufficiently well to reproduce it. CONCLUSIONS: The use of ML for predicting stroke outcomes is increasing. However, few met basic reporting standards for clinical prediction tools and none made their models available in a way which could be used or evaluated. Major improvements in ML study conduct and reporting are needed before it can meaningfully be considered for practice.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1371/journal.pone.0234722

Cites

16 of 16 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 16 references

Research works printed but not linked: 25

  1. CO Johnson, 2019, Global, regional, and national burden of stroke, 1990–2016: a systematic analysis for the Global Burden of Disease Study 2016, The Lancet Neurology, 18, 439, 10.1016/S1474-4422(19)30034-1 · DOI · Paper page
  2. H Kamal, 2018, Machine Learning in Acute Ischemic Stroke Neuroimaging, Front Neurol, 9, 945, 10.3389/fneur.2018.00945 · DOI
  3. R Feng, 2018, Deep learning guided stroke management: a review of clinical applications, J NeuroIntervent Surg, 10, 358, 10.1136/neurintsurg-2017-013355 · DOI
  4. E-J Lee, 2017, Deep into the Brain: Artificial Intelligence in Stroke Imaging, J Stroke, 19, 277, 10.5853/jos.2017.02054 · DOI · Paper page
  5. HJA van Os, 2018, Predicting Outcome of Endovascular Treatment for Acute Ischemic Stroke: Potential Value of Machine Learning Algorithms, Front Neurol, 9, 784, 10.3389/fneur.2018.00784 · DOI · Paper page
  6. M Monteiro, 2018, Using Machine Learning to Improve the Prediction of Functional Outcome in Ischemic Stroke Patients, IEEE/ACM Trans Comput Biol Bioinform, 15, 1953, 10.1109/TCBB.2018.2811471 · DOI
  7. J Lin, 2018, Prediction of neurologic deterioration based on support vector machine algorithms and serum osmolarity equations, Brain Behav, 8, e01023, 10.1002/brb3.1023 · DOI
  8. Y Liang, 2019, Comparative Study of Back Propagation Artificial Neural Networks and Logistic Regression Model in Predicting Poor Prognosis after Acute Ischemic Stroke, Open Med (Wars), 14, 324, 10.1515/med-2019-0030 · DOI
  9. J Heo, 2019, Machine Learning-Based Model for Prediction of Outcomes in Acute Stroke, Stroke, 50, 1263, 10.1161/STROKEAHA.118.024293 · DOI · Paper page
  10. S Tanioka, 2019, Machine Learning Analysis of Matricellular Proteins and Clinical Variables for Early Prediction of Delayed Cerebral Ischemia After Aneurysmal Subarachnoid Hemorrhage, Mol Neurobiol
  11. AP Cox, 2016, Predictive analysis for identifying potentially undiagnosed post-stroke spasticity patients in United Kingdom, J Biomed Inform, 60, 328, 10.1016/j.jbi.2016.02.012 · doi:10.1016/j.jbi.2016.02.012
  12. JF Easton, 2014, Risk factors and prediction of very short term versus short/intermediate term post-stroke mortality: A data mining approach, Computers in Biology and Medicine, 54, 199, 10.1016/j.compbiomed.2014.09.003 · DOI
  13. C Tjortjis, 2007, Using T3, an improved decision tree classifier, for mining stroke-related medical data, Methods Inf Med, 46, 523, 10.1160/ME0317 · DOI
  14. J Kruppa, 2014, Probability estimation with machine learning methods for dichotomous and multicategory outcome: applications, Biom J, 56, 564, 10.1002/bimj.201300077 · DOI
  15. IR Konig, 2007, Practical experiences on the necessity of external validation, Stat Med, 26, 5499, 10.1002/sim.3069 · DOI
  16. G Celik, 2014, Predicting 10-day mortality in patients with strokes using neural networks and multivariate statistical methods, J Stroke Cerebrovasc Dis, 23, 1506, 10.1016/j.jstrokecerebrovasdis.2013.12.018 · DOI
  17. M Tokmakci, 2008, The reevaluate statistical results of quality of life in patients with cerebrovascular disease using adaptive network-based fuzzy inference system, Expert Systems with Applications, 34, 958, 10.1016/j.eswa.2006.10.026 · doi:10.1016/j.eswa.2006.10.026
  18. AR Al Taleb, 2017, Application of Data Mining Techniques to Predict Length of Stay of Stroke Patients
  19. KC Ho, 2014, Predicting discharge mortality after acute ischemic stroke using balanced data, AMIA Annu Symp Proc, 2014, 1787
  20. UB Mogensen, 2013, A random forest approach for competing risks based on pseudo-values, Statistics in Medicine, 32, 3102, 10.1002/sim.5775 · DOI
  21. S-Y Peng, 2010, Random forest can predict 30-day mortality of spontaneous intracerebral hemorrhage with remarkable discrimination, Eur J Neurol, 17, 945, 10.1111/j.1468-1331.2010.02955.x · DOI
  22. T Li, 2018, HyperTuner: Visual Analytics for Hyperparameter Tuning by Professionals, 11
  23. S Senanayake, 2019, Machine learning in predicting graft failure following kidney transplantation: A systematic review of published predictive models, International Journal of Medical Informatics, 130, 103957, 10.1016/j.ijmedinf.2019.103957 · DOI
  24. ND Shah, 2018, Big Data and Predictive Analytics: Recalibrating Expectations, JAMA, 320, 27, 10.1001/jama.2018.5602 · DOI · Paper page
  25. EW Steyerberg, 2014, Towards better clinical prediction models: seven steps for development and an ABCD for validation, European Heart Journal, 35, 1925, 10.1093/eurheartj/ehu207 · DOI · Paper page

Cited by

See all 195

Metadata

Authors
Wang, W., Kiik, M., Peek, N., Curcin, V., Marshall, I. J., Rudd, A. G., Wang, Y., Douiri, A., Wolfe, C. D., & Bray, B.
Venue
PLOS ONE
Published
2020-06-12
Volume
15
Issue
6
Pages
e0234722
ISSN
1932-6203 (ISSN-L)
OpenAlex
W3034655770
Cited by
195
References
16
FWCI
6.62
Type
journal article
Language
en
Open access
gold

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: A systematic review of machine learning models for predicting outcomes of stroke with structured data. https://app.cochat.ai/papers/10.1371/journal.pone.0234722
The paper
Wang, W., Kiik, M., Peek, N., Curcin, V., Marshall, I. J., Rudd, A. G., Wang, Y., Douiri, A., Wolfe, C. D., & Bray, B. (2020). A systematic review of machine learning models for predicting outcomes of stroke with structured data. PLOS ONE. https://doi.org/10.1371/journal.pone.0234722

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.