The DOI matches its Crossref record; 66 of the 66 references it cites were found in a registry or an index.
XSleepNet: Multi-View Sequential Model for Automatic Sleep Staging
Open accessAbstract
Automating sleep staging is vital to scale up sleep assessment and diagnosis to serve millions experiencing sleep deprivation and disorders and enable longitudinal sleep monitoring in home environments. Learning from raw polysomnography signals and their derived time-frequency image representations has been prevalent. However, learning from multi-view inputs (e.g., both the raw signals and the time-frequency images) for sleep staging is difficult and not well understood. This work proposes a sequence-to-sequence sleep staging model, XSleepNet,1that is capable of learning a joint representation from both raw signals and time-frequency images. Since different views may generalize or overfit at different rates, the proposed network is trained such that the learning pace on each view is adapted based on their generalization/overfitting behavior. In simple terms, the learning on a particular view is speeded up when it is generalizing well and slowed down when it is overfitting. View-specific generalization/overfitting measures are computed on-the-fly during the training course and used to derive weights to blend the gradients from different views. As a result, the network is able to retain the representation power of different views in the joint features which represent the underlying distribution better than those learned by each individual view alone. Furthermore, the XSleepNet architecture is principally designed to gain robustness to the amount of training data and to increase the complementarity between the input views. Experimental results on five databases of different sizes show that XSleepNet consistently outperforms the single-view baselines and the multi-view baseline with a simple fusion strategy. Finally, XSleepNet also outperforms prior sleep staging methods and improves previous state-of-the-art results on the experimental databases.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
(2014) · Cited by 33,419
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545
Interrater reliability: The kappa statistic
McHugh, M. L. (2012) · Biochemia Medica · doi:10.11613/bm.2012.031 · Cited by 19,877
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
Goldberger, A. L., Amaral, L. A. N., Glass, L., Hausdorff, J. M., Ivanov, P. C., Mark, R. G., Mietus, J. E., Moody, G. B., Peng, C.-K., & Stanley, H. E. (2000) · Circulation · doi:10.1161/01.cir.101.23.e215 · Cited by 14,809
Rechtschaffen, A. (1968) · Medical Entomology and Zoology · Cited by 12,638
TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G. S., Davis, A., Dean, J., Devin, M., et al. (2016) · arXiv · doi:10.48550/arxiv.1603.04467 · Cited by 9,408
(2007) · Cited by 6,530
Allan Hobson, J. (1969) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0013-4694(69)90021-2 · Cited by 5,192
Multi-view 3D Object Detection Network for Autonomous Driving
Chen, X., Ma, H., Wan, J., Li, B., & Xia, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.691 · Cited by 3,450
A re-examination of text categorization methods
Yang, Y., & Liu, X. (1999) · Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/312624.312647 · Cited by 2,652
Fully Convolutional Networks for Semantic Segmentation
Long, J., Shelhamer, E., & Darrell, T. J. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1411.4038 · Cited by 2,489
Deep Speech 2: End-to-End Speech Recognition in English and Mandarin
Amodei, D., Anubhai, R., Battenberg, E., Case, C. T., Casper, J., Catanzaro, B., Chen, J., Chrzanowski, M., Coates, A., Diamos, G., et al. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1512.02595 · Cited by 2,110
Tian, Y., Krishnan, D., & Isola, P. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58621-8_45 · Cited by 1,997
DeepSleepNet: a model for automatic sleep stage scoring based on raw single-channel EEG
Supratak, A., Dong, H., Wu, C., & Guo, Y. (2017) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2017.2721116 · Cited by 1,376
The Sleep Heart Health Study: Design, Rationale, and Methods
(1997) · Sleep · doi:10.1093/sleep/20.12.1077 · Cited by 1,331
The role of sleep in learning and memory
Maquet, P. (2001) · Science · doi:10.1126/science.1062856 · Cited by 1,177
The Global Problem of Insufficient Sleep and Its Serious Public Health Implications
Chattu, V. K., Manzar, M. D., Kumary, S., Burman, D., Spence, D. W., & Pandi-Perumal, S. R. (2018) · Healthcare · doi:10.3390/healthcare7010001 · Cited by 1,028
Multi-view learning overview: Recent progress and new challenges
Zhao, J., Xie, X., Xu, X., & Sun, S. (2017) · Information Fusion · doi:10.1016/j.inffus.2017.02.007 · Cited by 1,002
Analysis of a sleep-dependent neuronal feedback loop: the slow-wave microcontinuity of the EEG
Kemp, B., Zwinderman, A. H., Tuk, B., Kamphuisen, H. A. C., & Oberye, J. J. L. (2000) · IEEE Transactions on Biomedical Engineering · doi:10.1109/10.867928 · Cited by 953
The National Sleep Research Resource: towards a sleep data commons
Zhang, G.-Q., Cui, L., Mueller, R., Tao, S., Kim, M., Rueschman, M., Mariani, S., Mobley, D., & Redline, S. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy064 · Cited by 917
Is Combining Classifiers with Stacking Better than Selecting the Best One?
Džeroski, S., & Ženko, B. (2004) · Machine Learning · doi:10.1023/b:mach.0000015881.36452.6e · Cited by 889
Sleep disorders and sleep deprivation: an unmet public health problem
(2007) · Choice Reviews Online · doi:10.5860/choice.44-5682 · Cited by 723
Phan, H., Andreotti, F., Cooray, N., Chen, O. Y., & De Vos, M. (2019) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2019.2896659 · Cited by 623
Self-citationWhat Makes Training Multi-modal Classification Networks Hard?
Wang, W., Tran, D., & Feiszli, M. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01271 · Cited by 588
SleepEEGNet: Automated sleep stage scoring with sequence to sequence deep learning approach
Mousavi, S., Afghah, F., & Acharya, U. R. (2019) · PLOS ONE · doi:10.1371/journal.pone.0216456 · Cited by 531
Hobson, J. A. (1972) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0013-4694(72)90252-0 · Cited by 475
Tian, Y., Krishnan, D., & Isola, P. (2019) · arXiv · doi:10.48550/arxiv.1906.05849 · Cited by 465
Joint Classification and Prediction CNN Framework for Automatic Sleep Stage Classification
Phan, H., Andreotti, F., Cooray, N., Chen, O. Y., & De Vos, M. (2019) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2018.2872652 · Cited by 464
Self-citationA convolutional neural network for sleep stage scoring from raw single-channel EEG
Sors, A., Bonnet, S., Mirek, S., Vercueil, L., & Payen, J.-F. (2018) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2017.12.001 · Cited by 424
Neural network analysis of sleep stages enables efficient diagnosis of narcolepsy
Stephansen, J. B., Olesen, A. N., Olsen, M., Ambati, A., Leary, E. B., Moore, H. E., Carrillo, O., Lin, L., Han, F., Yan, H., et al. (2018) · Nature Communications · doi:10.1038/s41467-018-07229-3 · Cited by 413
O'Reilly, C., Gosselin, N., Carrier, J., & Nielsen, T. (2014) · Journal of Sleep Research · doi:10.1111/jsr.12169 · Cited by 356
Automatic Sleep Stage Scoring Using Time-Frequency Analysis and Stacked Sparse Autoencoders
Tsinalis, O., Matthews, P. M., & Guo, Y. (2016) · Annals of Biomedical Engineering · doi:10.1007/s10439-015-1444-y · Cited by 322
Diversity in search strategies for ensemble feature selection
Tsymbal, A., Pechenizkiy, M., & Cunningham, P. (2005) · Information Fusion · doi:10.1016/j.inffus.2004.04.003 · Cited by 321
Mixed Neural Network Approach for Temporal Sleep Stage Classification
Dong, H., Supratak, A., Pan, W., Wu, C., Matthews, P. M., & Guo, Y. (2018) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2017.2733220 · Cited by 295
Expert-level sleep scoring with deep neural networks
Biswal, S., Sun, H., Goparaju, B., Westover, M. B., Sun, J., & Bianchi, M. T. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy131 · Cited by 290
Automatic Sleep Stage Scoring with Single-Channel EEG Using Convolutional Neural Networks
Tsinalis, O., Matthews, P. M., Guo, Y., & Zafeiriou, S. P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.01683 · Cited by 249
Sleep Stage Classification Using Unsupervised Feature Learning
Längkvist, M., Karlsson, L., & Loutfi, A. (2012) · Advances in Artificial Neural Systems · doi:10.1155/2012/107046 · Cited by 248
Seo, H., Back, S., Lee, S., Park, D., Kim, T., & Lee, K. (2020) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2020.102037 · Cited by 237
U-Time: A Fully Convolutional Network for Time Series Segmentation Applied to Sleep Staging
Perslev, M., Jensen, M. H., Darkner, S., Jennum, P., & Igel, C. (2019) · Research at the University of Copenhagen (University of Copenhagen) · doi:10.48550/arxiv.1910.11162 · Cited by 231
Performance of an Automated Polysomnography Scoring System Versus Computer-Assisted Manual Scoring
Malhotra, A., Younes, M., Kuna, S. T., Benca, R., Kushida, C. A., Walsh, J., Hanlon, A., Staley, B., Pack, A. I., & Pien, G. W. (2013) · Sleep · doi:10.5665/sleep.2548 · Cited by 222
You Snooze, You Win: The PhysioNet/Computing in Cardiology Challenge 2018
Ghassemi, M., Moody, B., Lehman, L.-W., Song, C., Li, Q., Sun, H., Westover, B., & Clifford, G. (2018) · Computing in Cardiology Conference (CinC) · doi:10.22489/cinc.2018.049 · Cited by 187
Convolutional Neural Networks-based continuous speech recognition using raw speech signal
Palaz, D., Magimai.-Doss, M., & Collobert, R. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178781 · Cited by 184
SLEEPNET: Automated Sleep Staging System via Deep LearningPreprint
Biswal, S., Kulas, J. A., Sun, H., Goparaju, B., Westover, M. B., Bianchi, M. T., & Sun, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.08262 · Cited by 180
Towards More Accurate Automatic Sleep Staging via Deep Transfer Learning
Phan, H., Chén, O. Y., Koch, P., Lu, Z., McLoughlin, I. V., Mertins, A., & Vos, M. D. (2020) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2020.3020381 · Cited by 179
Self-citationSleep Disorders and Sleep Deprivation: An Unmet Public Health Problem
(2006) · doi:10.17226/11617 · Cited by 167
Phan, H., Andreotti, F., Cooray, N., Chén, O. Y., & Vos, M. D. (2018) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2018.8512480 · Cited by 167
Self-citationDeep convolutional neural networks for interpretable analysis of EEG sleep stage scoring
Vilamala, A., Madsen, K. H., & Hansen, L. K. (2017) · 2017 IEEE 27th International Workshop on Machine Learning for Signal Processing (MLSP) · doi:10.1109/mlsp.2017.8168133 · Cited by 162
Gammatone Features and Feature Combination for Large Vocabulary Speech Recognition
Schlüter, R., Bezrukov, I., Wagner, H., & Ney, H. (2007) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2007.366996 · Cited by 158
Accurate whole-night sleep monitoring with dry-contact ear-EEG
Mikkelsen, K. B., Tabar, Y. R., Kappel, S. L., Christensen, C. B., Toft, H. O., Hemmsen, M. C., Rank, M. L., Otto, M., & Kidmose, P. (2019) · Scientific Reports · doi:10.1038/s41598-019-53115-3 · Cited by 151
Large-Scale Automated Sleep Staging
Sun, H., Jia, J., Goparaju, B., Huang, G.-B., Sourina, O., Bianchi, M. T., & Westover, M. B. (2017) · SLEEP · doi:10.1093/sleep/zsx139 · Cited by 124
Phan, H., Andreotti, F., Cooray, N., Chén, O. Y., & Vos, M. D. (2018) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2018.8512286 · Cited by 110
Self-citationMultichannel Sleep Stage Classification and Transfer Learning using Convolutional Neural Networks
Andreotti, F., Phan, H., Cooray, N., Lo, C., Hu, M. T. M., & Vos, M. D. (2018) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2018.8512214 · Cited by 109
Self-citationMikkelsen, K. B., Ebajemito, J. K., Bonmatí‐Carrión, M., Santhi, N., Revell, V. L., Atzori, G., della Monica, C., Debener, S., Dijk, D., Sterr, A., et al. (2018) · Journal of Sleep Research · doi:10.1111/jsr.12786 · Cited by 100
Zhai, B., Perez-Pozuelo, I., Clifton, E. A. D., Palotti, J., & Guan, Y. (2020) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3397325 · Cited by 96
Phan, H., Mikkelsen, K., Chén, O. Y., Koch, P., Mertins, A., Kidmose, P., & Vos, M. D. (2020) · Physiological Measurement · doi:10.1088/1361-6579/ab921e · Cited by 50
Self-citationAn open-source toolbox for standardized use of PhysioNet Sleep EDF Expanded Database
Imtiaz, S. A., & Rodriguez–Villegas, E. (2015) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2015.7319762 · Cited by 42
Personalizing deep learning models for automatic sleep staging
Mikkelsen, K., & de Vos, M. (2018) · arXiv · doi:10.48550/arxiv.1801.02645 · Cited by 42
Recommendations for performance assessment of automatic sleep staging algorithms
Imtiaz, S. A., & Rodriguez–Villegas, E. (2014) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2014.6944758 · Cited by 35
What Makes Training Multi-Modal Networks Hard?Preprint
Wang, W., Tran, D., & Feiszli, M. (2019) · arXiv (Cornell University) · Cited by 26
Fusion of End-to-End Deep Learning Models for Sequence-to-Sequence Sleep Staging
Phan, H., Chén, O. Y., Koch, P., Mertins, A., & Vos, M. D. (2019) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2019.8857348 · Cited by 13
Self-citationThe National Sleep Research Resource
Zhang, G., Cui, L., Mueller, R., et al. (2018) · ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics (ACM-BCB) · doi:10.1145/3233547.3233725 · Cited by 10
Olesen, A. N., Chambon, S., Thorey, V., Jennum, P., Mignot, E. J.-M., & Sørensen, H. B. D. (2019) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2019.8856570 · Cited by 9
Cited by
U-Sleep: resilient high-frequency sleep staging
Perslev, M., Darkner, S., Kempfner, L., Nikolic, M., Jennum, P. J., & Igel, C. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00440-5 · Cited by 362
SleepTransformer: Automatic Sleep Staging With Interpretability and Uncertainty Quantification
Phan, H., Mikkelsen, K., Chen, O. Y., Koch, P., Mertins, A., & De Vos, M. (2022) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2022.3147187 · Cited by 343
Self-citationEvaluating the structure of cognitive tasks with transfer learning
Aristimunha, B., de Camargo, R. Y., Pinaya, W. H. L., Chevallier, S., Gramfort, A., & Rommel, C. (2023) · arXiv · doi:10.48550/arxiv.2308.02408 · Cited by 4
Metadata
- Authors
- Phan, H., Chen, O. Y., Tran, M. C., Koch, P., Mertins, A., & De Vos, M.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2021
- Volume
- 44
- Issue
- 9
- Pages
- 1-1
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W3040939498
- Cited by
- 275
- References
- 66
- FWCI
- 22.94
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.