Ensemble Deep Learning for Biomedical Time Series Classification
Open accessAbstract
Ensemble learning has been proved to improve the generalization ability effectively in both theory and practice. In this paper, we briefly outline the current status of research on it first. Then, a new deep neural network-based ensemble method that integrates filtering views, local views, distorted views, explicit training, implicit training, subview prediction, and Simple Average is proposed for biomedical time series classification. Finally, we validate its effectiveness on the Chinese Cardiovascular Disease Database containing a large number of electrocardiogram recordings. The experimental results show that the proposed method has certain advantages compared to some well-known ensemble methods, such as Bagging and AdaBoost.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The ensemble model is a method to improve the accuracy rate of the model.
“The ensemble model is a method to improve the accuracy rate of the model [26, 27].”
From Method for diagnosis of acute lymphoblastic leukemia based on vit-cnn ensemble model (2021) · cites this paper as [27]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538 · see citing works
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · see citing works
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928 · see citing works
A decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466 · see citing works
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336 · see citing works
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325 · see citing works
Statistical Comparisons of Classifiers over Multiple Data Sets
Demšar, J. (2006) · doi:10.5555/1248547.1248548 · Cited by 11,966 · see citing works
Wolpert, D. H. (1992) · Neural Networks · doi:10.1016/s0893-6080(05)80023-1 · Cited by 7,951 · see citing works
Learning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 7,048 · see citing works
The random subspace method for constructing decision forests
Ho, T. K. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.709601 · Cited by 6,874 · see citing works
Learning Deep Architectures for AI
Bengio, Y. (2009) · now publishers, Inc. eBooks · doi:10.1561/9781601982957 · Cited by 5,037 · see citing works
Greedy layer-wise training of deep networks
Bengio, Y., Lamblin, P., Popovici, D., & Larochelle, H. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0024 · Cited by 4,841 · see citing works
The Strength of Weak Learnability
Schapire, R. E. (1990) · Machine Learning · doi:10.1007/bf00116037 · Cited by 4,600 · see citing works
Hansen, L. K., & Salamon, P. (1990) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.58871 · Cited by 4,260 · see citing works
An Empirical Comparison of Voting Classification Algorithms: Bagging, Boosting, and Variants
Bauer, E. J., & Kohavi, R. (1999) · Machine Learning · doi:10.1023/a:1007515423169 · Cited by 2,627 · see citing works
Rotation Forest: A New Classifier Ensemble Method
Rodríguez, J. J., Kuncheva, L. I., & Alonso, C. J. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.211 · Cited by 1,897 · see citing works
Classification by pairwise coupling
Hastie, T., & Tibshirani, R. J. (1998) · The Annals of Statistics · doi:10.1214/aos/1028144844 · Cited by 1,304 · see citing works
A brief introduction to boosting
Schapire, R. E. (1999) · Cited by 1,301 · see citing works
Accelerating the convergence of the back-propagation method
Vogl, T. P., Mangis, J. K., Rigler, A. K., et al. (1988) · Biological Cybernetics · doi:10.1007/bf00332914 · Cited by 1,107 · see citing works
Application of majority voting to pattern recognition: an analysis of its behavior and performance
Lam, L., & Suen, S.-P. (1997) · IEEE Transactions on Systems Man and Cybernetics - Part A Systems and Humans · doi:10.1109/3468.618255 · Cited by 870 · see citing works
Time Series Classification Using Multi-Channels Deep Convolutional Neural Networks
Zheng, Y., Liu, Q., Chen, E., Ge, Y., & Zhao, J. L. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-08010-9_33 · Cited by 689 · see citing works
Prediction Games and Arcing Algorithms
Breiman, L. (1999) · Neural Computation · doi:10.1162/089976699300016106 · Cited by 530 · see citing works
Heartbeat Classification Using Morphological and Dynamic Features of ECG Signals
Ye, C., Kumar, B. V. K. V., & Coimbra, M. T. (2012) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2012.2213253 · Cited by 526 · see citing works
On Combining Artificial Neural Nets
SHARKEY, A. J. C. (1996) · Connection Science · doi:10.1080/095400996116785 · Cited by 516 · see citing works
Estimation of QRS Complex Power Spectra for Design of a QRS Filter
Thakor, N. V., Webster, J. G., & Tompkins, W. J. (1984) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.1984.325393 · Cited by 427 · see citing works
Combining the results of several neural network classifiers
Rogova, G. L. (1994) · Neural Networks · doi:10.1016/0893-6080(94)90099-x · Cited by 404 · see citing works
Efficient classification for multiclass problems using modular neural networks
Anand, R., Mehrotra, K., Mohan, C. K., et al. (1995) · IEEE Transactions on Neural Networks · doi:10.1109/72.363444 · Cited by 395 · see citing works
Ensemble deep learning for regression and time series forecasting
Qiu, X., Zhang, L., Ren, Y., Suganthan, P. N., & Amaratunga, G. A. J. (2014) · doi:10.1109/ciel.2014.7015739 · Cited by 391 · see citing works
Boosting and Other Ensemble Methods
Drucker, H., Cortes, C., Jackel, L. D., LeCun, Y., & Vapnik, V. (1994) · Neural Computation · doi:10.1162/neco.1994.6.6.1289 · Cited by 357 · see citing works
A theoretical and experimental analysis of linear combiners for multiple classifier systems
Fumera, G., & Roli, F. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.109 · Cited by 308 · see citing works
Error Reduction through Learning Multiple Descriptions
Ali, K., & Pazzani, M. J. (1994) · Machine Learning · doi:10.1023/a:1018249309965 · Cited by 296 · see citing works
Randomizing Outputs to Increase Prediction Accuracy
Breiman, L. (2000) · Machine Learning · doi:10.1023/a:1007682208299 · Cited by 272 · see citing works
Back Propagation is Sensitive to Initial Conditions
Kolen, J. F., & Pollack, J. B. (1990) · Cited by 271 · see citing works
Ensemble deep learning for speech recognition
Deng, L., & Platt, J. C. (2014) · Interspeech 2014 · doi:10.21437/interspeech.2014-433 · Cited by 248 · see citing works
Experiments with Classifier Combining Rules
Duin, R. P. W., & Tax, D. M. J. (2000) · Lecture notes in computer science · doi:10.1007/3-540-45014-9_2 · Cited by 237 · see citing works
A Small Sphere and Large Margin Approach for Novelty Detection Using Training Data with Outliers
Wu, M., & Ye, J. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.24 · Cited by 176 · see citing works
Leave One Out Error, Stability, and Generalization of Voting Combinations of Classifiers
Evgeniou, T., Pontil, M., & Elisseeff, A. (2004) · Machine Learning · doi:10.1023/b:mach.0000019805.88351.60 · Cited by 132 · see citing works
Tumer, K., & Oza, N. C. (2003) · Pattern Analysis and Applications · doi:10.1007/s10044-002-0181-7 · Cited by 78 · see citing works
Reducing Variance of Committee Prediction with Resampling Techniques
Parmanto, B., Munro, P., & Doyle, H. R. (1996) · Connection Science · doi:10.1080/095400996116848 · Cited by 78 · see citing works
Using diversity measures for generating error-correcting output codes in classifier ensembles
Kuncheva, L. I. (2004) · Pattern Recognition Letters · doi:10.1016/j.patrec.2004.08.019 · Cited by 76 · see citing works
An ensemble of deep neural networks for object tracking
Zhou, X., Xie, L., Zhang, P., & Zhang, Y. (2014) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2014.7025169 · Cited by 58 · see citing works
Horizontal and Vertical Ensemble with Deep Representation for ClassificationPreprint
Xie, J., Xu, B., & Chuang, Z. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1306.2759 · Cited by 51 · see citing works
CCDD: AN ENHANCED STANDARD ECG DATABASE WITH ITS MANAGEMENT AND ANNOTATION TOOLS
Zhang, J., Liu, X., & Dong, J. (2012) · International Journal of Artificial Intelligence Tools · doi:10.1142/s0218213012400209 · Cited by 50 · see citing works
Self-citationHwang, I., Park, H., & Chang, J. (2015) · Computer Speech & Language · doi:10.1016/j.csl.2015.11.003 · Cited by 43 · see citing works
Learning ensemble classifiers via restricted Boltzmann machines
Zhang, C., Zhang, J., Ji, N., & Guo, G. (2013) · Pattern Recognition Letters · doi:10.1016/j.patrec.2013.10.009 · Cited by 35 · see citing works
A Remote Diagnosis Service Platform for Wearable ECG Monitors
Dong, J., Zhang, J., Zhu, H., et al. (2012) · IEEE Intelligent Systems · doi:10.1109/mis.2012.4 · Cited by 27 · see citing works
Self-citationClass-switching neural network ensembles
Martínez-Muñoz, G., Sánchez-Martínez, A., Hernández-Lobato, D., et al. (2008) · Neurocomputing · doi:10.1016/j.neucom.2007.11.041 · Cited by 26 · see citing works
Dong, J., & Linpeng, J. (2015) · Scientia Sinica Informationis · doi:10.1360/n112014-00060 · Cited by 21 · see citing works
Self-citationA New Multi-channels Sequence Recognition Framework Using Deep Convolutional Neural Network
Zhang, R., Li, C., & Jia, D. (2015) · Procedia Computer Science · doi:10.1016/j.procs.2015.07.315 · Cited by 13 · see citing works
A diversity-penalizing ensemble training method for deep learning
Zhang, X., Povey, D., & Khudanpur, S. P. (2015) · Interspeech (USB) · doi:10.21437/interspeech.2015-712 · Cited by 13 · see citing works
Improving deep neural network ensembles using reconstruction error
Huang, W., Hong, H., Bian, K., Zhou, X., Song, G., & Xie, K. (2015) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2015.7280524 · Cited by 11 · see citing works
An Effective and Novel Neural Network Ensemble for Shift Pattern Detection in Control Charts
Barghash, M. A. (2015) · Computational Intelligence and Neuroscience · doi:10.1155/2015/939248 · Cited by 8 · see citing works
Combining Fisher Linear Discriminants for Dissimilarity Representations
Pękalska, E., Skurichina, M., & Duin, R. P. W. (2000) · Lecture notes in computer science · doi:10.1007/3-540-45014-9_11 · Cited by 8 · see citing works
Flagged first, then by citations
Research works printed but not linked: 6
- [3]Zhou Z. H. Ensemble Learning Encyclopedia of Biometrics 2009 Berlin, Germany Springer 270 273
- [23]Kolen J. F. Pollack J. B. Back propagation is sensitiveto initial conditions Proceedings of the Conference on Advances in Neural Information Processing Systems (NIPS '91) 1991 San Francisco, Calif, USA 860 867
- [37]Romaszko L. A deep learning approach with an ensemble-based neural network classifier for black box ICML 2013 contest Proceedings of the IEEE 12th International Conference on Data Mining Workshops 2012 Brussels, Belgium 865 868
- [47]Dong J. Zhang J. W. Zhu H. H. Wang L. P. Liu X. Li Z. J. Wearable ECG monitors and its remote diagnosis service platform IEEE Intelligent Systems 2012 27 6 36 43
- [56]Zhou X. H. Obuchowski N. A. McClish D. K. Statistical Methods in Diagnostic Medicine 2011 2nd New York, NY, USA John Wiley & Sons
- [58]Liu X. Atlas of Classical Electrocardiograms 2011 1st Shanghai, China Shanghai Science and Technology Press
Cited by
Sorted by citations
Method for diagnosis of acute lymphoblastic leukemia based on vit-cnn ensemble model
Jiang, Z., Dong, Z., Wang, L., & Jiang, W. (2021) · Computational Intelligence and Neuroscience · doi:10.1155/2021/7529893 · Cited by 124 · see citing works
Deep Neural Network Ensembles for Time Series Classification
Ismail Fawaz, H., Forestier, G., Weber, J., Idoumghar, L., & Muller, P.-A. (2019) · 2019 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8852316 · Cited by 103 · see citing works
- Authors
- Jin, L.-P., & Dong, J.
- Affiliations
- Suzhou Institute of Nanotech and Nanobionics, Chinese Academy of Sciences, Suzhou 215123, China
- Chinese Academy of Sciences (CN)
- Corresponding author
- Dong, Jun
- Venue
- Computational Intelligence and Neuroscience
- Publisher
- Wiley
- Published
- 2016
- Volume
- 2016
- Pages
- 1-13
- ISSN
- 1687-5265 (ISSN-L)
- 1687-5273
- PMC
- PMC5048093
- OpenAlex
- W2522692516
- Cited by
- 60
- References
- 53
- Citations by year
- 2026: 1 · 2025: 5 · 2024: 6 · 2023: 3 · 2022: 10 · 2021: 14 · 2020: 5 · 2019: 6 · 2018: 7 · 2017: 3
- FWCI
- 4.40
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Computational Intelligence and Neuroscience (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Topics
- Health Sciences › Medicine › Cardiology and Cardiovascular Medicine › ECG Monitoring and Analysis
- Physical Sciences › Computer Science › Signal Processing › Time Series Analysis and Forecasting
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Keywords
- ensemble deep learning, electrocardiogram, cardiovascular disease, view integration, local views, simple average
- MeSH terms
- Algorithms, Animals, Cardiovascular Diseases, Electrocardiography, Humans, Learning, Predictive Value of Tests, Time Factors, Neural Networks, Computer, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review