The DOI matches its Crossref record; 76 of the 77 references it cites were found in a registry or an index.
A multimodal approach to estimating vigilance using EEG and forehead EOG
Open accessAbstract
Objective . Covert aspects of ongoing user mental states provide key context information for user-aware human computer interactions. In this paper, we focus on the problem of estimating the vigilance of users using EEG and EOG signals. Approach . The PERCLOS index as vigilance annotation is obtained from eye tracking glasses. To improve the feasibility and wearability of vigilance estimation devices for real-world applications, we adopt a novel electrode placement for forehead EOG and extract various eye movement features, which contain the principal information of traditional EOG. We explore the effects of EEG from different brain areas and combine EEG and forehead EOG to leverage their complementary characteristics for vigilance estimation. Considering that the vigilance of users is a dynamic changing process because the intrinsic mental states of users involve temporal evolution, we introduce continuous conditional neural field and continuous conditional random field models to capture dynamic temporal dependency. Main results . We propose a multimodal approach to estimating vigilance by combining EEG and forehead EOG and incorporating the temporal dependency of vigilance into model training. The experimental results demonstrate that modality fusion can improve the performance compared with a single modality, EOG and EEG contain complementary information for vigilance estimation, and the temporal dependency-based models can enhance the performance of vigilance estimation. From the experimental results, we observe that theta and alpha frequency activities are increased, while gamma frequency activities are decreased in drowsy states in contrast to awake states. Significance . The forehead setup allows for the simultaneous collection of EEG and EOG and achieves comparative performance using only four shared electrodes in comparison with the temporal and posterior sites.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The claim comes from somewhere else, not from this source.
In the citing paper
“Zheng and his colleges presented an emotion recognition method combining EEG signals and pupillary response collected from eye tracker and achieved average accuracies of 73.59% and 72.98% for three emotion states using feature level fusion strategy and decision-level fusion strategy, respectively.”
From Fusion of Facial Expressions and EEG for Multimodal Emotion Recognition (2017) · cites this paper as [32]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Most commercial biometric systems do not provide access to the feature sets nor the raw data which they use in their products [22].”
From Fusion of Facial Expressions and EEG for Multimodal Emotion Recognition (2017) · cites this paper as [22]
Experimental — accuracy not yet measuredIn the citing paper
“Superior performance was obtained compared to the results in the state-of-the-art results [3, 11, 32].”
From Fusion of Facial Expressions and EEG for Multimodal Emotion Recognition (2017) · cites this paper as [32]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Delorme, A., & Makeig, S. (2004) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2003.10.009 · Cited by 24,371 · cited 3×
“ICA is a blind source separation method proposed to decompose a multivariate signal into independent non-Gaussian signals (Delorme & Makeig 2004).”
MethodPan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387
Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
Lafferty, J., McCallum, A., & Pereira, F. C. N. (2001) · ScholarlyCommons (University of Pennsylvania) · Cited by 12,935
(1992) · Applied Ergonomics · doi:10.1016/0003-6870(92)90318-p · Cited by 5,774
Removing electroencephalographic artifacts by blind source separation
Jung, T., Makeig, S., Humphries, C., Lee, T.-W., McKeown, M. J., Iragui, V. J., & B, T. J. S. A. (2000) · Psychophysiology · doi:10.1111/1469-8986.3720163 · Cited by 3,342
Advances in Neural Information Processing Systems 20
Bonilla, E. V., Chai, K. M. A., & Williams, C. K. I. (2008) · neural information processing systems · Cited by 2,701
Zheng, W.-L., & Lu, B.-L. (2015) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2015.2431497 · Cited by 2,477 · cited 6×
“In this study, we adopt an automatic continuous vigilance annotation method using eye tracking glasses, which was proposed in our previous work (Gao, Zhang, Zheng & Lu 2015).”
BackgroundMethodInfluentialSelf-citationAffect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications
Calvo, R. A., & D'Mello, S. (2010) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2010.1 · Cited by 1,893
Decoding mental states from brain activity in humans
Haynes, J., & Rees, G. E. (2006) · Nature reviews. Neuroscience · doi:10.1038/nrn1931 · Cited by 1,868
Differential entropy feature for EEG-based emotion classification
Duan, R.-N., Zhu, J., & Lu, B. (2013) · International IEEE/EMBS Conference on Neural Engineering · doi:10.1109/ner.2013.6695876 · Cited by 1,225
Self-citation
Research works printed but not linked: 1
- Dinges, 1998, PERCLOS: a valid psychophysiological measure of alertness as assessed by psychomotor vigilance, US Department of Transportation, Federal Highway Administration, Publication Number FHWA-MCRT-98-006
Cited by
Sorted by citations
Items 401–420 of 420
State-Aware Cross-Modal Contrastive Learning for Multimodal Vigilance Estimation
Shu, W., & Li, W. (2026) · Journal of Computer and Communications · doi:10.4236/jcc.2026.147005
A Survey on Multimodal Human-Machine Interaction in Smart Cockpits
Wang, Y., Zhang, W., Wu, B., Liu, K., Yu, H. R., Wang, G., Li, X., Liu, Q. F., & Zhang, R. X. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-30228-1_19
EEG-FM-Compass: progress, benchmarking and future directions for EEG foundation models
Liu, D., Chen, Y., Chen, Z., Cui, Z., Wen, Y., An, J., Luo, J., & Wu, D. (2026) · National Science Review · doi:10.1093/nsr/nwag466 · Cited by 32
An End-to-End Multi-Scale Convolution–Attention Model for EEG-Based Fatigue Detection
Wang, Y., & Li, P. (2026) · International Conference on Artificial Intelligence and Big Data (ICAIBD) · doi:10.1109/icaibd69640.2026.11637338
Multimodal fusion classification of driving fatigue based on teacher–student model architecture
Li, C., Wang, C., Yang, B., et al. (2026) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2026.111238
Self-citationLi, Z., Xiang, X., Lan, Z., et al. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.116844
Sun, J., Chen, C., Liu, L., et al. (2026) · IEEE Access · doi:10.1109/access.2026.3721082
Kusnierz, J., Malek, R., Sołtysiak, S., et al. (2026) · Progress in Applied Electrical Engineering (PAEE) · doi:10.1109/paee71887.2026.11660679
Zhang, X., Zhao, R., Sun, T., et al. (2026) · AI · doi:10.3390/ai7090332
TelUP Driver Drowsiness Dataset: Robust Monitoring Under Occlusions and Variable Lighting
Ibrahim, A. M., Bashiran, H., Satrio, F., et al. (2026) · doi:10.1109/icoict71118.2026.11664863
Huang, Y., Li, M., Mao, J., & Dai, Q. (2026) · Building and Environment · doi:10.1016/j.buildenv.2026.115217
A dual-branch multidimensional attention fusion network for EEG-based fatigue classification
Lu, J., Liu, S., Li, W., Mu, C., Gong, D., & Yao, D. (2026) · Frontiers in Physiology · doi:10.3389/fphys.2026.1923970
Hafidi, H. E., Mamen, A., Rollo, D., et al. (2026) · International Conference on Smart and Sustainable Technologies (SpliTech) · doi:10.23919/splitech70133.2026.11685599
Alaeddine, H. (2026) · Biomedical Engineering Letters · doi:10.1007/s13534-026-00618-4
Real-Time Drowsiness Detection Using a Single-Channel EEG: An Applied Machine Learning Approach
Dominguez-Rodino, M., Civit, M., Domínguez-Morales, M., et al. (2026) · Applied Sciences · doi:10.3390/app16189287
EEG-Based Driver Fatigue Detection Using MS-CNN and CBAM Attention Mechanism
Xing, P., Ren, L., Han, Y., et al. (2026) · International Conference on Pattern Recognition and Machine Learning (PRML) · doi:10.1109/prml71097.2026.11687296
Ammar, S., Karray, M., & Ksantini, M. (2026) · Electronics · doi:10.3390/electronics15194432
Sun, S., Wang, L., Yang, K., et al. (2026) · Pattern Recognition · doi:10.1016/j.patcog.2026.115049
Lee, J., Lee, Y., Shin, J., Lee, D. J., Yoon, H., Lee, J. Y., Yu, K. J., & Sang, M. (2026) · Biosensors and Bioelectronics · doi:10.1016/j.bios.2026.119323
Fatigue Driving Detection Based On Multimodal EEG Feature FusionPreprint
Hong, Q., Xu, Z., Pan, L., et al. (2026) · Research Square · doi:10.21203/rs.3.rs-8385637/v1
Metadata
- Authors
- Zheng, W.-L., & Lu, B.-L.
- Affiliations
- Shanghai Jiao Tong University (CN)
- Corresponding author
- Zheng, Wei-Long
- Lu, Bao-Liang
- Venue
- Journal of Neural Engineering
- Publisher
- IOP Publishing
- Published
- 2017-02-22
- Volume
- 14
- Issue
- 2
- Pages
- 026017
- ISSN
- 1741-2552 (ISSN-L)
- 1741-2560
- OpenAlex
- W2558193840
- Semantic Scholar
- babe42b42bffd9029d7fef3d6c97ec0985fa6528
- Cited by
- 424
- References
- 77
- Citations by year
- 2026: 60 · 2025: 66 · 2024: 72 · 2023: 55 · 2022: 46 · 2021: 50 · 2020: 37 · 2019: 21 · 2018: 14 · 2017: 3
- FWCI
- 11.78
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- Journal of Neural Engineering (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Technology Research and Development Program of China Railway Corporation (2016Z003-B)
- National Basic Research Program of China (2013CB329401)
- National Natural Science Foundation of China (61272248)
- Major Basic Research Program of Shanghai Science and Technology Committee (15JC1400103)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › EEG and Brain-Computer Interfaces
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Sleep and Work-Related Fatigue
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Keywords
- EEG, multimodal fusion, PERCLOS, eye movement features, temporal dependencies, drowsiness detection, gamma oscillations, wearable EEG
- MeSH terms
- Adult, Algorithms, Arousal, Electroencephalography, Electrooculography, Female, Humans, Male, Pattern Recognition, Automated, Psychomotor Performance, Sensitivity and Specificity, Reproducibility of Results, Brain Waves
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
