The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Eye Movement Analysis for Activity Recognition Using Electrooculography
Open accessAbstract
In this work, we investigate eye movement analysis as a new sensing modality for activity recognition. Eye movement data were recorded using an electrooculography (EOG) system. We first describe and evaluate algorithms for detecting three eye movement characteristics from EOG signals-saccades, fixations, and blinks-and propose a method for assessing repetitive patterns of eye movements. We then devise 90 different features based on these characteristics and select a subset of them using minimum redundancy maximum relevance (mRMR) feature selection. We validate the method using an eight participant study in an office environment using an example set of five activity classes: copying a text, reading a printed paper, taking handwritten notes, watching a video, and browsing the Web. We also include periods with no specific activity (the NULL class). Using a support vector machine (SVM) classifier and person-independent (leave-one-person-out) training, we obtain an average precision of 76.1 percent and recall of 70.5 percent over all classes and participants. The work demonstrates the promise of eye-based activity recognition (EAR) and opens up discussion on the wider applicability of EAR to other activities that are difficult, or even impossible, to detect using common sensing modalities.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Peng, H., Long, F., & Ding, C. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.159 · Cited by 10,544
De-noising by soft-thresholding
Donoho, D. L. (1995) · IEEE Transactions on Information Theory · doi:10.1109/18.382009 · Cited by 9,619
Activity Recognition from User-Annotated Acceleration Data
Bao, L., & Intille, S. S. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24646-6_1 · Cited by 3,147
Eye Tracking Methodology: Theory and Practice
Duchowski, A. T. (2003) · Springer eBooks · doi:10.1007/978-1-4471-3750-4 · Cited by 2,242
Identifying fixations and saccades in eye-tracking protocols
Salvucci, D. D., & Goldberg, J. H. (2000) · Proceedings of the symposium on Eye tracking research & applications - ETRA '00 · doi:10.1145/355017.355028 · Cited by 2,203
Mitra, S., & Acharya, T. (2007) · IEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2007.893280 · Cited by 1,981
Human gaze control during real-world scene perception
Henderson, J. (2003) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2003.09.006 · Cited by 1,404
Machine Recognition of Human Activities: A Survey
Turaga, P., Chellappa, R., Subrahmanian, V. S., & Udrea, O. (2008) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2008.2005594 · Cited by 1,333
Eye movements in natural behavior
Hayhoe, M., & Ballard, D. (2005) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2005.02.009 · Cited by 1,326
Eye Tracking Methodology; Theory and Practice
(2007) · Qualitative Market Research: An International Journal · doi:10.1108/13522750710740862 · Cited by 1,313
Cited by
A tutorial on human activity recognition using body-worn inertial sensors
Bulling, A., Blanke, U., & Schiele, B. (2014) · ACM Computing Surveys · doi:10.1145/2499621 · Cited by 1,668
Self-citationEmotionMeter: A Multimodal Framework for Recognizing Human Emotions
Zheng, W.-L., Liu, W., Lu, Y., Lu, B.-L., & Cichocki, A. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2797176 · Cited by 1,276
Deep learning for healthcare applications based on physiological signals: A review
Faust, O., Hagiwara, Y., Hong, T. J., Lih, O. S., & Acharya, U. R. (2018) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2018.04.005 · Cited by 1,026
A Comprehensive Survey of Deep Learning for Image Captioning
Hossain, M. Z., Sohel, F., Shiratuddin, M. F., & Laga, H. (2019) · ACM Computing Surveys · doi:10.1145/3295748 · Cited by 879
Human Emotion Recognition: Review of Sensors and Methods
Dzedzickis, A., Kaklauskas, A., & Bucinskas, V. (2020) · Sensors · doi:10.3390/s20030592 · Cited by 582
Eye Tracking and Eye-Based Human–Computer Interaction
Majaranta, P., & Bulling, A. (2014) · Human–Computer Interaction Series · doi:10.1007/978-1-4471-6392-3_3 · Cited by 530
Self-citationA Survey on Activity Detection and Classification Using Wearable Sensors
Cornacchia, M., Ozcan, K., Zheng, Y., & Velipasalar, S. (2017) · IEEE Sensors Journal · doi:10.1109/jsen.2016.2628346 · Cited by 424
A multimodal approach to estimating vigilance using EEG and forehead EOG
Zheng, W.-L., & Lu, B.-L. (2017) · Journal of Neural Engineering · doi:10.1088/1741-2552/aa5a98 · Cited by 424
Wearable Soft Technologies for Haptic Sensing and Feedback
Yin, J., Hinchet, R., Shea, H., & Majidi, C. (2021) · Advanced Functional Materials · doi:10.1002/adfm.202007428 · Cited by 325
Yadav, S. K., Tiwari, K., Pandey, H. M., & Akbar, S. A. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.106970 · Cited by 311
Rendering of Eyes for Eye-Shape Registration and Gaze Estimation
Wood, E., Baltruaitis, T., Zhang, X., Sugano, Y., Robinson, P., & Bulling, A. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.428 · Cited by 308
Self-citationMonitoring Activities of Daily Living in Smart Homes: Understanding human behavior
Debes, C., Merentitis, A., Sukhanov, S., Niessen, M., Frangiadakis, N., & Bauer, A. (2016) · IEEE Signal Processing Magazine · doi:10.1109/msp.2015.2503881 · Cited by 301
Increasing trend of wearables and multimodal interface for human activity monitoring: A review
Kumari, P., Mathew, L., & Syal, P. (2017) · Biosensors and Bioelectronics · doi:10.1016/j.bios.2016.12.001 · Cited by 298
Emotion Recognition Using Eye-Tracking: Taxonomy, Review and Current Challenges
Lim, J. Z., Mountstephens, J., & Teo, J. (2020) · Sensors · doi:10.3390/s20082384 · Cited by 293
Varatharajan, R., Manogaran, G., Priyan, M. K., & Sundarasekar, R. (2018) · Cluster Computing · doi:10.1007/s10586-017-0977-2 · Cited by 277
Hong, K.-S., & Khan, M. J. (2017) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2017.00035 · Cited by 267
AttnSense: Multi-level Attention Mechanism For Multimodal Human Activity Recognition
Ma, H., Li, W., Zhang, X., Gao, S., & Lu, S. (2019) · Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/431 · Cited by 266
Ni, Q., García Hernando, A., & De la Cruz, I. (2015) · Sensors · doi:10.3390/s150511312 · Cited by 264
Klaib, A. F., Alsrehin, N. O., Melhem, W. Y., Bashtawi, H. O., & Magableh, A. A. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.114037 · Cited by 263
Steven Eyobu, O., & Han, D. S. (2018) · Sensors · doi:10.3390/s18092892 · Cited by 259
Imperceptible electrooculography graphene sensor system for human–robot interface
Ameri, S. K., Kim, M., Kuang, I. A., Perera, W. K., Alshiekh, M., Jeong, H., Topcu, U., Akinwande, D., & Lu, N. (2018) · npj 2D Materials and Applications · doi:10.1038/s41699-018-0064-4 · Cited by 162
Gerber, S. M., Jeitziner, M.-M., Wyss, P., Chesham, A., Urwyler, P., Müri, R. M., Jakob, S. M., & Nef, T. (2017) · Scientific Reports · doi:10.1038/s41598-017-13153-1 · Cited by 151
Driver-Activity Recognition in the Context of Conditionally Autonomous Driving
Braunagel, C., Kasneci, E., Stolzmann, W., & Rosenstiel, W. (2015) · 2015 IEEE 18th International Conference on Intelligent Transportation Systems · doi:10.1109/itsc.2015.268 · Cited by 109
Gerber, S. M., Jeitziner, M.-M., Knobel, S. E. J., Mosimann, U. P., Müri, R. M., Jakob, S. M., & Nef, T. (2019) · Frontiers in Medicine · doi:10.3389/fmed.2019.00287 · Cited by 59
Unsupervised Human Activity Representation Learning with Multi-task Deep Clustering
Ma, H., Zhang, Z., Li, W., & Lu, S. (2021) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3448074 · Cited by 48
Seeing with Humans: Gaze-Assisted Neural Image Captioning
Sugano, Y., & Bulling, A. (2016) · arXiv · doi:10.48550/arxiv.1608.05203 · Cited by 47
Self-citationMiao, S., Chen, L., Hu, R., & Luo, Y. (2022) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3550331 · Cited by 36
On the Generality of Codebook Approach for Sensor-Based Human Activity Recognition
Shirahama, K., & Grzegorzek, M. (2017) · Electronics · doi:10.3390/electronics6020044 · Cited by 29
Metadata
- Authors
- Bulling, A., Ward, J. A., Gellersen, H., & Tröster, G.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2011-04
- Volume
- 33
- Issue
- 4
- Pages
- 741-753
- ISSN
- 0162-8828 (ISSN-L)
- OpenAlex
- W2126698740
- Cited by
- 718
- References
- 49
- FWCI
- 41.30
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.