The DOI matches its Crossref record; 66 of the 66 references it cites were found in a registry or an index.
Joint Classification and Prediction CNN Framework for Automatic Sleep Stage Classification
Open accessAbstract
Correctly identifying sleep stages is important in diagnosing and treating sleep disorders. This paper proposes a joint classification-and-prediction framework based on convolutional neural networks (CNNs) for automatic sleep staging, and, subsequently, introduces a simple yet efficient CNN architecture to power the framework. Given a single input epoch, the novel framework jointly determines its label (classification) and its neighboring epochs' labels (prediction) in the contextual output. While the proposed framework is orthogonal to the widely adopted classification schemes, which take one or multiple epochs as contextual inputs and produce a single classification decision on the target epoch, we demonstrate its advantages in several ways. First, it leverages the dependency among consecutive sleep epochs while surpassing the problems experienced with the common classification schemes. Second, even with a single model, the framework has the capacity to produce multiple decisions, which are essential in obtaining a good performance as in ensemble-of-models methods, with very little induced computational overhead. Probabilistic aggregation techniques are then proposed to leverage the availability of multiple decisions. To illustrate the efficacy of the proposed framework, we conducted experiments on two public datasets: Sleep-EDF Expanded (Sleep-EDF), which consists of 20 subjects, and Montreal Archive of Sleep Studies (MASS) dataset, which consists of 200 subjects. The proposed framework yields an overall classification accuracy of 82.3% and 83.6%, respectively. We also show that the proposed framework not only is superior to the baselines based on the common classification schemes but also outperforms existing deep-learning approaches. To our knowledge, this is the first work going beyond the standard single-output classification to consider multitask neural networks for automatic sleep staging. This framework provides avenues for further studies of different neural-network architectures for automatic sleep staging.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
(2014) · Cited by 33,419
Convolutional Neural Networks for Sentence Classification
Kim, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1181 · Cited by 14,831
Goldberger, A. L., Amaral, L. A. N., Glass, L., Hausdorff, J. M., Ivanov, P. C., Mark, R. G., Mietus, J. E., Moody, G. B., Peng, C.-K., & Stanley, H. E. (2000) · Circulation · doi:10.1161/01.cir.101.23.e215 · Cited by 14,809
Distilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204
(2010) · International Conference on Machine Learning · Cited by 13,995
Rechtschaffen, A. (1968) · Medical Entomology and Zoology · Cited by 11,772
TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G. S., Davis, A., Dean, J., Devin, M., et al. (2016) · arXiv · doi:10.48550/arxiv.1603.04467 · Cited by 9,408
Ensemble methods in machine learning
Dietterich, T. G. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-45014-9_1 · Cited by 8,408
(2007) · Cited by 6,530
Allan Hobson, J. (1969) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0013-4694(69)90021-2 · Cited by 5,192
DeepSleepNet: a model for automatic sleep stage scoring based on raw single-channel EEG
Supratak, A., Dong, H., Wu, C., & Guo, Y. (2017) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2017.2721116 · Cited by 1,376
(2017) · Encyclopedia of Machine Learning and Data Mining · doi:10.1007/978-1-4899-7687-1_100318 · Cited by 1,037
Analysis of a sleep-dependent neuronal feedback loop: the slow-wave microcontinuity of the EEG
Kemp, B., Zwinderman, A. H., Tuk, B., Kamphuisen, H. A. C., & Oberye, J. J. L. (2000) · IEEE Transactions on Biomedical Engineering · doi:10.1109/10.867928 · Cited by 953
Generalization and network design strategies
LeCun, Y. (1989) · Cited by 885
Chambon, S., Galtier, M. N., Arnal, P. J., Wainrib, G., & Gramfort, A. (2018) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2018.2813138 · Cited by 663
Pfeifer, R., Soulié, F. F., Steels, L., & Schreter, Z. (1989) · Elsevier eBooks · Cited by 514
EEG complexity as a measure of depth of anesthesia for patients
Zhang, X.-S., Roy, R. J., & Jensen, E. W. (2001) · IEEE Transactions on Biomedical Engineering · doi:10.1109/10.966601 · Cited by 495
Hobson, J. A. (1972) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0013-4694(72)90252-0 · Cited by 475
Neural network analysis of sleep stages enables efficient diagnosis of narcolepsy
Stephansen, J. B., Olesen, A. N., Olsen, M., Ambati, A., Leary, E. B., Moore, H. E., Carrillo, O., Lin, L., Han, F., Yan, H., et al. (2018) · Nature Communications · doi:10.1038/s41467-018-07229-3 · Cited by 413
Sleep Stage Classification Using EEG Signal Analysis: A Comprehensive Survey and New Investigation
Aboalayon, K., Faezipour, M., Almuhammadi, W., & Moslehpour, S. (2016) · Entropy · doi:10.3390/e18090272 · Cited by 382
O'Reilly, C., Gosselin, N., Carrier, J., & Nielsen, T. (2014) · Journal of Sleep Research · doi:10.1111/jsr.12169 · Cited by 356
Automatic Sleep Stage Scoring Using Time-Frequency Analysis and Stacked Sparse Autoencoders
Tsinalis, O., Matthews, P. M., & Guo, Y. (2016) · Annals of Biomedical Engineering · doi:10.1007/s10439-015-1444-y · Cited by 322
Lajnef, T., Chaibi, S., Ruby, P., Aguera, P.-E., Eichenlaub, J.-B., Samet, M., Kachouri, A., & Jerbi, K. (2015) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2015.01.022 · Cited by 318
A Novel Multi-Class EEG-Based Sleep Stage Classification System
Memar, P., & Faradji, F. (2018) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2017.2776149 · Cited by 318
A comparative review on sleep stage classification methods in patients and healthy individuals
Boostani, R., Karimzadeh, F., & Nami, M. (2017) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2016.12.004 · Cited by 316
Ensemble SVM Method for Automatic Sleep Stage Classification
Alickovic, E., & Subasi, A. (2018) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2018.2799059 · Cited by 313
Mixed Neural Network Approach for Temporal Sleep Stage Classification
Dong, H., Supratak, A., Pan, W., Wu, C., Matthews, P. M., & Guo, Y. (2018) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2017.2733220 · Cited by 295
An ensemble system for automatic sleep stage classification using single channel EEG signal
Koley, B., & Dey, D. (2012) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2012.09.012 · Cited by 291
Discrimination of sleep stages: a comparison between spectral and nonlinear EEG measures
Fell, J., Röschke, J., Mann, K., & Schäffner, C. (1996) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0013-4694(96)95636-9 · Cited by 290
Automatic Sleep Stage Scoring with Single-Channel EEG Using Convolutional Neural Networks
Tsinalis, O., Matthews, P. M., Guo, Y., & Zafeiriou, S. P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.01683 · Cited by 249
Sleep Stage Classification Using Unsupervised Feature Learning
Längkvist, M., Karlsson, L., & Loutfi, A. (2012) · Advances in Artificial Neural Systems · doi:10.1155/2012/107046 · Cited by 248
Cardiorespiratory-Based Sleep Staging in Subjects With Obstructive Sleep Apnea
Redmond, S. J., & Heneghan, C. (2006) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2005.869773 · Cited by 231
Neonatal Seizure Detection Using Deep Convolutional Neural Networks
Ansari, A. H., Cherian, P. J., Caicedo, A., Naulaers, G., De Vos, M., & Van Huffel, S. (2019) · International Journal of Neural Systems · doi:10.1142/s0129065718500119 · Cited by 231
Self-citationAutomatic sleep scoring using statistical features in the EMD domain and ensemble methods
Hassan, A. R., & Hassan Bhuiyan, M. I. (2016) · Biocybernetics and Biomedical Engineering · doi:10.1016/j.bbe.2015.11.001 · Cited by 220
(2001) · Lecture Notes in Computer Science · doi:10.1007/3-540-48219-9 · Cited by 197
Recent Developments in Home Sleep-Monitoring Devices
Kelly, J. M., Strecker, R. E., & Bianchi, M. T. (2012) · ISRN Neurology · doi:10.5402/2012/768794 · Cited by 180
Detrended fluctuation analysis of EEG in sleep apnea using MIT/BIH polysomnography data
Lee, J., Kim, D., Kim, I. Y., Park, K.-S., & Kim, S. I. (2002) · Computers in Biology and Medicine · doi:10.1016/s0010-4825(01)00031-2 · Cited by 155
A rule-based automatic sleep staging method
Liang, S., Kuo, C., Hu, Y.-H., & Cheng, Y. (2012) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2011.12.022 · Cited by 154
Phan, H., Andreotti, F., Cooray, N., Chén, O. Y., & Vos, M. D. (2018) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2018.8512480 · Cited by 152
Self-citationDiscrimination ability of individual measures used in sleep stages classification
Šušmáková, K., & Krakovská, A. (2008) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2008.07.005 · Cited by 151
The American Academy of Sleep Medicine Inter-scorer Reliability Program: Respiratory Events
Rosenberg, R. S., & Hout, S. V. (2014) · Journal of Clinical Sleep Medicine · doi:10.5664/jcsm.3630 · Cited by 147
Rodríguez-Sotelo, J. L., Osorio-Forero, A., Jiménez-Rodríguez, A., Cuesta–Frau, D., Cirugeda, E., & Peluffo-Ordóñez, D. H. (2014) · Entropy · doi:10.3390/e16126573 · Cited by 121
Automatic sleep scoring: A search for an optimal combination of measures
Krakovská, A., & Mezeiová, K. (2011) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2011.06.004 · Cited by 120
A New Method for Automatic Sleep Stage Classification
Zhang, J., & Wu, Y. X. (2017) · IEEE Transactions on Biomedical Circuits and Systems · doi:10.1109/tbcas.2017.2719631 · Cited by 112
Knowledge-based identification of sleep stages based on two forehead electroencephalogram channels
Huang, C.-S., Lin, C.-L., Liwei, K., Liu, S.-Y., Su, T.-P., & Lin, C.-T. (2014) · Frontiers in Neuroscience · doi:10.3389/fnins.2014.00263 · Cited by 99
Multichannel Sleep Stage Classification and Transfer Learning using Convolutional Neural Networks
Andreotti, F., Phan, H., Cooray, N., Lo, C., Hu, M. T. M., & Vos, M. D. (2018) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2018.8512214 · Cited by 95
Self-citationRobust Audio Event Recognition with 1-Max Pooling Convolutional Neural Networks
Phan, H., Hertel, L., Maaß, M., & Mertins, A. (2016) · Interspeech (USB) · doi:10.21437/interspeech.2016-123 · Cited by 94
Self-citationDimitriadis, S. I., Salis, C. I., & Linden, D. E. J. (2018) · Clinical Neurophysiology · doi:10.1016/j.clinph.2017.12.039 · Cited by 93
Phan, H., Andreotti, F., Cooray, N., Chén, O. Y., & Vos, M. D. (2018) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2018.8512286 · Cited by 91
Self-citationAn estimation of the first positive Lyapunov exponent of the EEG in patients with schizophrenia
Kim, D., Jeong, J., Chae, J., Park, S., Kim, S. Y., Go, H. J., Paik, I., Kim, K., & Choi, B. (2000) · Psychiatry Research Neuroimaging · doi:10.1016/s0925-4927(00)00052-4 · Cited by 76
Audio Scene Classification with Deep Recurrent Neural Networks
Phan, H., Koch, P., Katzberg, F., Maaß, M., Mazur, R., & Mertins, A. (2017) · Interspeech (USB) · doi:10.21437/interspeech.2017-101 · Cited by 73
Self-citationImproved Audio Scene Classification Based on Label-Tree Embeddings and Convolutional Neural Networks
Phan, H., Hertel, L., Maaß, M., et al. (2017) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2017.2690564 · Cited by 62
Self-citationSleep stage classification with cross frequency coupling
Sanders, T. H., McCurry, M., & Clements, M. A. (2014) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2014.6944643 · Cited by 55
A two-step automatic sleep stage classification method with dubious range detection
Sousa, T., Cruz, A., Khalighi, S., Pires, G., & Nunes, U. (2015) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2015.01.017 · Cited by 54
Automatic sleep staging using state machine-controlled decision trees
Imtiaz, S. A., & Rodriguez–Villegas, E. (2015) · doi:10.1109/embc.2015.7318378 · Cited by 42
Personalizing deep learning models for automatic sleep staging
Mikkelsen, K., & de Vos, M. (2018) · arXiv · doi:10.48550/arxiv.1801.02645 · Cited by 42
Self-citationAutomatic stage scoring of single-channel sleep EEG based on multiscale permutation entropy
Kuo, C., & Liang, S. (2011) · IEEE Biomedical Circuits and Systems Conference (BioCAS) · doi:10.1109/biocas.2011.6107824 · Cited by 38
An open-source toolbox for standardized use of PhysioNet Sleep EDF Expanded Database
Imtiaz, S. A., & Rodriguez–Villegas, E. (2015) · doi:10.1109/embc.2015.7319762 · Cited by 34
Recommendations for performance assessment of automatic sleep staging algorithms
Imtiaz, S. A., & Rodriguez–Villegas, E. (2014) · doi:10.1109/embc.2014.6944758 · Cited by 32
A rule-based automatic sleep staging method
Liang, S., Kuo, C., Hu, Y., & Cheng, Y. (2011) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/iembs.2011.6091499 · Cited by 29
Weighted and Multi-Task Loss for Rare Audio Event Detection
Phan, H., Krawczyk-Becker, M., Gerkmann, T., et al. (2018) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2018.8461353 · Cited by 27
Self-citationRecurrent Neural Network Based Early Prediction of Future Hand Movements
Koch, P., Phan, H., Maaß, M., Katzberg, F., & Mertins, A. (2018) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2018.8513145 · Cited by 22
Self-citationRecurrent Neural Networks with Weighting Loss for Early prediction of Hand Movements
Koch, P., Phan, H., Maaß, M., Katzberg, F., Mazur, R., & Mertins, A. (2018) · European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco.2018.8553483 · Cited by 20
Self-citation
Cited by
Deep learning-based electroencephalography analysis: a systematic review
Roy, Y., Banville, H., Albuquerque, I., Gramfort, A., Falk, T. H., & Faubert, J. (2019) · Journal of Neural Engineering · doi:10.1088/1741-2552/ab260c · Cited by 1,532
An Attention-Based Deep Learning Approach for Sleep Stage Classification With Single-Channel EEG
Eldele, E., Chen, Z., Liu, C., Wu, M., Kwoh, C.-K., Li, X., & Guan, C. (2021) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2021.3076234 · Cited by 693
Phan, H., Andreotti, F., Cooray, N., Chen, O. Y., & De Vos, M. (2019) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2019.2896659 · Cited by 623
Self-citationGu, X., Cao, Z., Jolfaei, A., Xu, P., Wu, D., Jung, T.-P., & Lin, C.-T. (2021) · IEEE/ACM Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2021.3052811 · Cited by 395
Automatic Human Sleep Stage Scoring Using Deep Neural Networks
Malafeev, A., Laptev, D., Bauer, S., Omlin, X., Wierzbicka, A., Wichniak, A., Jernajczyk, W., Riener, R., Buhmann, J., & Achermann, P. (2018) · Frontiers in Neuroscience · doi:10.3389/fnins.2018.00781 · Cited by 151
Metadata
- Authors
- Phan, H., Andreotti, F., Cooray, N., Chen, O. Y., & De Vos, M.
- Venue
- IEEE Transactions on Biomedical Engineering
- Published
- 2019-05
- Volume
- 66
- Issue
- 5
- Pages
- 1285-1296
- ISSN
- 0018-9294 (ISSN-L)
- 1558-2531
- OpenAlex
- W2805033630
- Cited by
- 464
- References
- 66
- FWCI
- 17.29
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.