The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Ranking Information Extracted from Uncertainty Quantification of the Prediction of a Deep Learning Model on Medical Time Series Data
Open accessAbstract
Uncertainty quantification in deep learning models is especially important for the medical applications of this complex and successful type of neural architectures. One popular technique is Monte Carlo dropout that gives a sample output for a record, which can be measured statistically in terms of average probability and variance for each diagnostic class of the problem. The current paper puts forward a convolutional–long short-term memory network model with a Monte Carlo dropout layer for obtaining information regarding the model uncertainty for saccadic records of all patients. These are next used in assessing the uncertainty of the learning model at the higher level of sets of multiple records (i.e., registers) that are gathered for one patient case by the examining physician towards an accurate diagnosis. Means and standard deviations are additionally calculated for the Monte Carlo uncertainty estimates of groups of predictions. These serve as a new collection where a random forest model can perform both classification and ranking of variable importance. The approach is validated on a real-world problem of classifying electrooculography time series for an early detection of spinocerebellar ataxia 2 and reaches an accuracy of 88.59% in distinguishing between the three classes of patients.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures








Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Unlike those studies, untangling the complexity of various DNNs and addressing uncertainty for a variety of computer vision tasks has attracted significant interest [495].”
From A review of uncertainty quantification in deep learning: Techniques, applications and challenges (2021) · cites this paper as [495]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
Pławiak, P., & Acharya, U. R. (2020) · Neural Computing and Applications · doi:10.1007/s00521-018-03980-2 · Cited by 248
RetractedScikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
Dropout as a bayesian approximation: Representing model uncertainty in deep learning
Gal, Y., & Ghahramani, Z. (2015) · arXiv · doi:10.48550/arxiv.1506.02142 · Cited by 6,471
Deep Learning for Electromyographic Hand Gesture Signal Classification Using Transfer Learning
Cote-Allard, U., Fall, C. L., Drouin, A., Campeau-Lecours, A., Gosselin, C., Glette, K., Laviolette, F., & Gosselin, B. (2019) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2019.2896269 · Cited by 738
Electrocardiogram generation with a bidirectional LSTM-CNN generative adversarial network
Zhu, F., Ye, F., Fu, Y., Liu, Q., & Shen, B. (2019) · Scientific Reports · doi:10.1038/s41598-019-42516-z · Cited by 540
A new approach for arrhythmia classification using deep coded features and LSTM networks
Yildirim, O., Baloglu, U. B., Tan, R.-S., Ciaccio, E. J., & Acharya, U. R. (2019) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2019.05.004 · Cited by 386
A Fast Machine Learning Model for ECG-Based Heartbeat Classification and Arrhythmia Detection
Alfaras, M., Soriano, M. C., & Ortín, S. (2019) · Frontiers in Physics · doi:10.3389/fphy.2019.00103 · Cited by 265
Deep Learning Fundus Image Analysis for Diabetic Retinopathy and Macular Edema Grading
Sahlsten, J., Jaskari, J., Kivinen, J., Turunen, L., Jaanio, E., Hietala, K., & Kaski, K. (2019) · Scientific Reports · doi:10.1038/s41598-019-47181-w · Cited by 252
BreakHis based breast cancer automatic diagnosis using deep learning: Taxonomy, survey and insights
Benhammou, Y., Achchab, B., Herrera, F., & Tabik, S. (2020) · Neurocomputing · doi:10.1016/j.neucom.2019.09.044 · Cited by 170
Bačanin, N., Bezdan, T., Tuba, E., Strumberger, I., & Tuba, M. (2020) · Algorithms · doi:10.3390/a13030067 · Cited by 163
CWV-BANN-SVM ensemble learning classifier for an accurate diagnosis of breast cancer
Abdar, M., & Makarenkov, V. (2019) · Measurement · doi:10.1016/j.measurement.2019.05.022 · Cited by 129
Deep Neural Networks for ECG-Based Pulse Detection during Out-of-Hospital Cardiac Arrest
Elola, A., Aramendi, E., Irusta, U., Picón, A., Alonso, E., Owens, P. C., & Idris, A. H. (2019) · Entropy · doi:10.3390/e21030305 · Cited by 79
Stoean, C., Paja, W., Stoean, R., & Sandita, A. (2019) · PLoS ONE · doi:10.1371/journal.pone.0223593 · Cited by 71
Self-citationGuo, F., NG, M. M., Goubran, M., Petersen, S. E., Piechnik, S. K., Neubauer, S., & Wright, G. A. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101636 · Cited by 68
Stoean, R. (2018) · Neural Computing and Applications · doi:10.1007/s00521-018-3709-5 · Cited by 60
Self-citationUncertainty-driven Sanity Check: Application to Postoperative Brain Tumor Cavity SegmentationPreprint
Jungo, A., Meier, R., Ermiş, E., Herrmann, E., & Reyes, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.03106 · Cited by 53
Stoean, C., Stoean, R., Atencia, M., Abdar, M., Velázquez‐Pérez, L., Khosravi, A., Nahavandi, S., Acharya, U. R., & Joya, G. (2020) · Sensors · doi:10.3390/s20113032 · Cited by 40
Self-citationGenerational Feature Elimination and Some Other Ranking Feature Selection Methods
Paja, W., Pancerz, K., & Grochowalski, P. (2017) · Intelligent systems reference library · doi:10.1007/978-3-319-67588-6_6 · Cited by 37
Augmenting Recurrent Neural Networks Resilience by Dropout
Bacciu, D., & Crecchi, F. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2899744 · Cited by 37
Mittal, S., Stoean, C., Kajdacsy‐Balla, A., & Bhargava, R. (2019) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2019.00246 · Cited by 37
Self-citationLedezma, C. A., Zhou, X., Rodríguez, B., Tan, P. J., & Díaz‐Zuccarini, V. (2019) · PLoS ONE · doi:10.1371/journal.pone.0220294 · Cited by 34
Bayesian LSTMs in medicinePreprint
van der Westhuizen, J., & Lasenby, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.01242 · Cited by 27
(2020) · Lecture notes in computer science · doi:10.1007/978-3-030-45385-5 · Cited by 25
Bioinformatics and Medicine in the Era of Deep Learning
Bacciu, D., Lisboa, P. J. G., Martín‐Guerrero, J. D., Stoean, R., & Vellido, A. (2018) · RECERCAT (Consorci de Serveis Universitaris de Catalunya) · doi:10.48550/arxiv.1802.09791 · Cited by 24
Self-citationYang, X., Tang, W. T., Tjio, G., Yeo, S. Y., & Su, Y. (2019) · Neurocomputing · doi:10.1016/j.neucom.2018.10.105 · Cited by 24
Deep Active Learning for Axon-Myelin Segmentation on Histology Data
di Scandalea, M. L., Perone, C. S., Boudreau, M., & Cohen-Adad, J. (2019) · arXiv · doi:10.48550/arxiv.1907.05143 · Cited by 19 · cited 1×
“MCD was also applied for deep active learning on histological slides, also for segmentation [18].”
MethodTv, V., Chavan, D., Malhotra, P., Vig, L., & Shroff, G. M. (2019) · International Journal of Prognostics and Health Management · doi:10.36001/ijphm.2019.v10i4.2612 · Cited by 17
A hybrid unsupervised—Deep learning tandem for electrooculography time series analysis
Stoean, R., Stoean, C., Becerra-García, R., García−Bermúdez, R., Atencia, M., García-Lagos, F., Velázquez‐Pérez, L., & Joya, G. (2020) · PLoS ONE · doi:10.1371/journal.pone.0236401 · Cited by 10
Self-citationStoean, C., Stoean, R., Becerra-García, R., García−Bermúdez, R., Atencia, M., García-Lagos, F., Velázquez‐Pérez, L., & Joya, G. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-20518-8_3 · Cited by 9
Self-citationKochev, S., Stevchev, N., Kocheva, S. A., Eftimov, T., & Simjanoska, M. (2020) · International Joint Conference on Biomedical Engineering Systems and Technologies (BIOSTEC) · doi:10.5220/0008967202280235 · Cited by 2
Cited by
A review of uncertainty quantification in deep learning: Techniques, applications and challenges
Abdar, M., Pourpanah, F., Hussain, S., Rezazadegan, D., Liu, L., Ghavamzadeh, M., Fieguth, P., Cao, X., Khosravi, A., Acharya, U. R., et al. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.05.008 · Cited by 3,111
“[271], Oh et al.”
Zhao, Z., Yun, S., Jia, L., Guo, J., Meng, Y., He, N., Li, X., Shi, J., & Yang, L. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.105982 · Cited by 389
Bačanin, N., Stoean, C., Zivkovic, M. Z., Rakić, M., Strulak-Wójcikiewicz, R., & Stoean, R. (2023) · Energies · doi:10.3390/en16031434 · Cited by 161
Self-citationStoean, C., Zivkovic, M. Z., Bozovic, A., Bačanin, N., Strulak-Wójcikiewicz, R., Antonijević, M., & Stoean, R. (2023) · Axioms · doi:10.3390/axioms12030266 · Cited by 118
Self-citationMizdraković, V., Kljajić, M., Zivkovic, M. Z., Bačanin, N., Jovanović, L., Deveci, M., & Witold Pedrycz, C. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112026 · Cited by 91
Metadata
- Authors
- Stoean, R., Stoean, C., Atencia, M., Rodríguez-Labrada, R., & Joya, G.
- Affiliations
- Romanian Institute of Science and Technology (RO)
- Romanian Institute of Science and Technology, 400022 Cluj-Napoca, Romania
- Universidad de Málaga (ES)
- Cuban Neuroscience Center, 11600 Havana, Cuba
- Venue
- Mathematics
- Publisher
- MDPI AG
- Published
- 2020-07-02
- Volume
- 8
- Issue
- 7
- Pages
- 1078
- ISSN
- 2227-7390 (ISSN-L)
- OpenAlex
- W3038849371
- Cited by
- 16
- References
- 30
- Citations by year
- 2026: 1 · 2024: 3 · 2023: 3 · 2022: 1 · 2021: 6 · 2020: 2
- FWCI
- 1.18
- Type
- journal article
- Language
- en
- Open access
- gold
- dx.doi.org
- Licence
- Locations
- Mathematics (publishedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Greater South Information System
- Funders
- Ministerio de Ciencia e Innovación (TIN2017-88728-C2-1-R)
- University of Málaga-Andalucía-Tech through the Plan Propio de Investigación y Transferencia (Project DIATAX: 345 Integración de nuevas tecnologías para el diagnóstico temprano de las Ataxias Hereditarias)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Keywords
- uncertainty quantification, Monte Carlo dropout, convolutional LSTM, electrooculography, saccades, spinocerebellar ataxia type 2, early diagnosis, random forest, variable importance ranking
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.