The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
SleepTransformer: Automatic Sleep Staging With Interpretability and Uncertainty Quantification
Open accessAbstract
BACKGROUND: Black-box skepticism is one of the main hindrances impeding deep-learning-based automatic sleep scoring from being used in clinical environments. METHODS: Towards interpretability, this work proposes a sequence-to-sequence sleep-staging model, namely SleepTransformer. It is based on the transformer backbone and offers interpretability of the model's decisions at both the epoch and sequence level. We further propose a simple yet efficient method to quantify uncertainty in the model's decisions. The method, which is based on entropy, can serve as a metric for deferring low-confidence epochs to a human expert for further inspection. RESULTS: Making sense of the transformer's self-attention scores for interpretability, at the epoch level, the attention scores are encoded as a heat map to highlight sleep-relevant features captured from the input EEG signal. At the sequence level, the attention scores are visualized as the influence of different neighboring epochs in an input sequence (i.e. the context) to recognition of a target epoch, mimicking the way manual scoring is done by human experts. CONCLUSION: Additionally, we demonstrate that SleepTransformer performs on par with existing methods on two databases of different sizes. SIGNIFICANCE: Equipped with interpretability and the ability of uncertainty quantification, SleepTransformer holds promise for being integrated into clinical settings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
Elements of Information Theory
Cover, T. M., & Thomas, J. A. (2001) · Wiley eBooks · doi:10.1002/0471200611 · Cited by 36,808
Interrater reliability: The kappa statistic
McHugh, M. L. (2012) · Biochemia Medica · doi:10.11613/bm.2012.031 · Cited by 19,877
Goldberger, A. L., Amaral, L. A. N., Glass, L., Hausdorff, J. M., Ivanov, P. C., Mark, R. G., Mietus, J. E., Moody, G. B., Peng, C.-K., & Stanley, H. E. (2000) · Circulation · doi:10.1161/01.cir.101.23.e215 · Cited by 14,809
Elements of Information Theory
Cover, T. M., & Thomas, J. A. (2005) · doi:10.1002/047174882x · Cited by 13,791
Rechtschaffen, A. (1968) · Medical Entomology and Zoology · Cited by 12,376
(2007) · Cited by 6,530
Allan Hobson, J. (1969) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0013-4694(69)90021-2 · Cited by 5,192
A re-examination of text categorization methods
Yang, Y., & Liu, X. (1999) · Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/312624.312647 · Cited by 2,652
Explainability for artificial intelligence in healthcare: a multidisciplinary perspective
the Precise4Q consortium, Amann, J., Blasimme, A., Vayena, E., Frey, D., & Madai, V. I. (2020) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-020-01332-6 · Cited by 2,203
DeepSleepNet: a model for automatic sleep stage scoring based on raw single-channel EEG
Supratak, A., Dong, H., Wu, C., & Guo, Y. (2017) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2017.2721116 · Cited by 1,376
The Sleep Heart Health Study: Design, Rationale, and Methods
(1997) · Sleep · doi:10.1093/sleep/20.12.1077 · Cited by 1,331
Nagendran, M., Chen, Y., Lovejoy, C. A., Gordon, A. C., Komorowski, M., Harvey, H., Topol, E. J., Ioannidis, J. P. A., Collins, G. S., & Maruthappu, M. (2020) · BMJ · doi:10.1136/bmj.m689 · Cited by 1,152
Analysis of a sleep-dependent neuronal feedback loop: the slow-wave microcontinuity of the EEG
Kemp, B., Zwinderman, A. H., Tuk, B., Kamphuisen, H. A. C., & Oberye, J. J. L. (2000) · IEEE Transactions on Biomedical Engineering · doi:10.1109/10.867928 · Cited by 953
The National Sleep Research Resource: towards a sleep data commons
Zhang, G.-Q., Cui, L., Mueller, R., Tao, S., Kim, M., Rueschman, M., Mariani, S., Mobley, D., & Redline, S. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy064 · Cited by 917
Artificial Intelligence and Human Trust in Healthcare: Focus on Clinicians
Asan, O., Bayrak, A. E., & Choudhury, A. (2020) · Journal of Medical Internet Research · doi:10.2196/15154 · Cited by 825
An Attention-Based Deep Learning Approach for Sleep Stage Classification With Single-Channel EEG
Eldele, E., Chen, Z., Liu, C., Wu, M., Kwoh, C.-K., Li, X., & Guan, C. (2021) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2021.3076234 · Cited by 693
Phan, H., Andreotti, F., Cooray, N., Chen, O. Y., & De Vos, M. (2019) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2019.2896659 · Cited by 623
Self-citationSleepEEGNet: Automated sleep stage scoring with sequence to sequence deep learning approach
Mousavi, S., Afghah, F., & Acharya, U. R. (2019) · PLOS ONE · doi:10.1371/journal.pone.0216456 · Cited by 531
Joint Classification and Prediction CNN Framework for Automatic Sleep Stage Classification
Phan, H., Andreotti, F., Cooray, N., Chen, O. Y., & De Vos, M. (2019) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2018.2872652 · Cited by 464
Self-citationA convolutional neural network for sleep stage scoring from raw single-channel EEG
Sors, A., Bonnet, S., Mirek, S., Vercueil, L., & Payen, J.-F. (2018) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2017.12.001 · Cited by 424
DANKER‐HOPFE, H., ANDERER, P., ZEITLHOFER, J., BOECK, M., DORN, H., GRUBER, G., HELLER, E., LORETZ, E., MOSER, D., PARAPATICS, S., et al. (2009) · Journal of Sleep Research · doi:10.1111/j.1365-2869.2008.00700.x · Cited by 417
Neural network analysis of sleep stages enables efficient diagnosis of narcolepsy
Stephansen, J. B., Olesen, A. N., Olsen, M., Ambati, A., Leary, E. B., Moore, H. E., Carrillo, O., Lin, L., Han, F., Yan, H., et al. (2018) · Nature Communications · doi:10.1038/s41467-018-07229-3 · Cited by 413
U-Sleep: resilient high-frequency sleep staging
Perslev, M., Darkner, S., Kempfner, L., Nikolic, M., Jennum, P. J., & Igel, C. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00440-5 · Cited by 362
O'Reilly, C., Gosselin, N., Carrier, J., & Nielsen, T. (2014) · Journal of Sleep Research · doi:10.1111/jsr.12169 · Cited by 356
Mixed Neural Network Approach for Temporal Sleep Stage Classification
Dong, H., Supratak, A., Pan, W., Wu, C., Matthews, P. M., & Guo, Y. (2018) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2017.2733220 · Cited by 295
Expert-level sleep scoring with deep neural networks
Biswal, S., Sun, H., Goparaju, B., Westover, M. B., Sun, J., & Bianchi, M. T. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy131 · Cited by 290
XSleepNet: Multi-View Sequential Model for Automatic Sleep Staging
Phan, H., Chen, O. Y., Tran, M. C., Koch, P., Mertins, A., & De Vos, M. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3070057 · Cited by 275
Self-citationAutomatic Sleep Stage Scoring with Single-Channel EEG Using Convolutional Neural Networks
Tsinalis, O., Matthews, P. M., Guo, Y., & Zafeiriou, S. P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.01683 · Cited by 249
Seo, H., Back, S., Lee, S., Park, D., Kim, T., & Lee, K. (2020) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2020.102037 · Cited by 237
U-Time: A Fully Convolutional Network for Time Series Segmentation Applied to Sleep Staging
Perslev, M., Jensen, M. H., Darkner, S., Jennum, P., & Igel, C. (2019) · Research at the University of Copenhagen (University of Copenhagen) · doi:10.48550/arxiv.1910.11162 · Cited by 231
Performance of an Automated Polysomnography Scoring System Versus Computer-Assisted Manual Scoring
Malhotra, A., Younes, M., Kuna, S. T., Benca, R., Kushida, C. A., Walsh, J., Hanlon, A., Staley, B., Pack, A. I., & Pien, G. W. (2013) · Sleep · doi:10.5665/sleep.2548 · Cited by 222
Towards More Accurate Automatic Sleep Staging via Deep Transfer Learning
Phan, H., Chén, O. Y., Koch, P., Lu, Z., McLoughlin, I. V., Mertins, A., & Vos, M. D. (2020) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2020.3020381 · Cited by 179
Self-citationDreem Open Datasets: Multi-Scored Sleep Datasets to Compare Human and Automated Sleep Staging
Guillot, A., Sauvet, F., During, E., & Thorey, V. (2020) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2020.3011181 · Cited by 175
Sleep Disorders and Sleep Deprivation: An Unmet Public Health Problem
(2006) · doi:10.17226/11617 · Cited by 167
Deep convolutional neural networks for interpretable analysis of EEG sleep stage scoring
Vilamala, A., Madsen, K. H., & Hansen, L. K. (2017) · 2017 IEEE 27th International Workshop on Machine Learning for Signal Processing (MLSP) · doi:10.1109/mlsp.2017.8168133 · Cited by 162
Phan, H., Andreotti, F., Cooray, N., Chén, O. Y., & Vos, M. D. (2018) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2018.8512480 · Cited by 152
Self-citationConvolution- and Attention-Based Neural Network for Automated Sleep Stage Classification
Zhu, T., Luo, W., & Yu, F. N. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17114152 · Cited by 143
Accurate whole-night sleep monitoring with dry-contact ear-EEG
Mikkelsen, K. B., Tabar, Y. R., Kappel, S. L., Christensen, C. B., Toft, H. O., Hemmsen, M. C., Rank, M. L., Otto, M., & Kidmose, P. (2019) · Scientific Reports · doi:10.1038/s41598-019-53115-3 · Cited by 139
Self-citationRobustSleepNet: Transfer Learning for Automated Sleep Staging at Scale
Guillot, A., & Thorey, V. (2021) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2021.3098968 · Cited by 135
Automatic sleep stage classification with deep residual networks in a mixed-cohort setting
Olesen, A. N., Jennum, P., Mignot, E. J.-M., & Sørensen, H. B. D. (2020) · SLEEP · doi:10.1093/sleep/zsaa161 · Cited by 119
Banluesombatkul, N., Ouppaphan, P., Leelaarporn, P., Lakhan, P., Chaitusaney, B., Jaimchariyatam, N., Chuangsuwanich, E., Chen, W., Phan, H., Dilokthanakul, N., et al. (2020) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.3037693 · Cited by 117
Self-citationLarge-Scale Automated Sleep Staging
Sun, H., Jia, J., Goparaju, B., Huang, G.-B., Sourina, O., Bianchi, M. T., & Westover, M. B. (2017) · SLEEP · doi:10.1093/sleep/zsx139 · Cited by 110
Mikkelsen, K. B., Ebajemito, J. K., Bonmatí‐Carrión, M., Santhi, N., Revell, V. L., Atzori, G., della Monica, C., Debener, S., Dijk, D., Sterr, A., et al. (2018) · Journal of Sleep Research · doi:10.1111/jsr.12786 · Cited by 95
Self-citationPhan, H., Andreotti, F., Cooray, N., Chén, O. Y., & Vos, M. D. (2018) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2018.8512286 · Cited by 91
Self-citationFan, J., Sun, C., Long, M., Chen, C., & Chen, W. (2021) · Frontiers in Neuroscience · doi:10.3389/fnins.2021.573194 · Cited by 81
Phan, H., Mikkelsen, K., Chén, O. Y., Koch, P., Mertins, A., Kidmose, P., & Vos, M. D. (2020) · Physiological Measurement · doi:10.1088/1361-6579/ab921e · Cited by 46
Self-citationDeep Transfer Learning for Single-Channel Automatic Sleep Staging with Channel Mismatch
Phan, H., Chén, O. Y., Koch, P., Mertins, A., & Vos, M. D. (2019) · European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco.2019.8902977 · Cited by 44
Self-citationPersonalizing deep learning models for automatic sleep staging
Mikkelsen, K., & de Vos, M. (2018) · arXiv · doi:10.48550/arxiv.1801.02645 · Cited by 42
Self-citationMikkelsen, K. B., Phan, H., Rank, M. L., Hemmsen, M. C., Vos, M. D., & Kidmose, P. (2021) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2021.3116274 · Cited by 39
Self-citationClassification with a Deferral Option and Low-Trust Filtering for Automated Seizure Detection
Becker, T., Vandecasteele, K., Chatzichristos, C., Paesschen, W. V., Valkenborg, D., Huffel, S. V., & Vos, M. D. (2021) · Sensors · doi:10.3390/s21041046 · Cited by 17
Predicting Sleep Classification Performance without Labels
Mikkelsen, K. B., Tabar, Y. R., & Kidmose, P. (2020) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc44109.2020.9175743 · Cited by 10
Self-citationLee, T., Hwang, J., & Lee, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.05407 · Cited by 6
Light-weight sleep monitoring: electrode distance matters more than placement for automatic scoringPreprint
Mikkelsen, K. B., Phan, H., Rank, M. L., Hemmsen, M. C., Vos, M. D., & Kidmose, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.04567 · Cited by 6
Self-citation
Cited by
Dynamic alignment and fusion of multimodal physiological patterns for stress recognition
Zhang, X., Wei, X., Zhou, Z., Zhao, Q., Zhang, S., Yang, Y., Li, R., & Hu, B. (2024) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2023.3290177 · Cited by 38
Metadata
- Authors
- Phan, H., Mikkelsen, K., Chen, O. Y., Koch, P., Mertins, A., & De Vos, M.
- Venue
- IEEE Transactions on Biomedical Engineering
- Published
- 2022-08
- Volume
- 69
- Issue
- 8
- Pages
- 2456-2467
- ISSN
- 0018-9294 (ISSN-L)
- 1558-2531
- OpenAlex
- W3165396901
- Cited by
- 343
- References
- 56
- FWCI
- 31.16
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.