The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Eye Movement Analysis for Activity Recognition Using Electrooculography
Open accessAbstract
In this work, we investigate eye movement analysis as a new sensing modality for activity recognition. Eye movement data were recorded using an electrooculography (EOG) system. We first describe and evaluate algorithms for detecting three eye movement characteristics from EOG signals-saccades, fixations, and blinks-and propose a method for assessing repetitive patterns of eye movements. We then devise 90 different features based on these characteristics and select a subset of them using minimum redundancy maximum relevance (mRMR) feature selection. We validate the method using an eight participant study in an office environment using an example set of five activity classes: copying a text, reading a printed paper, taking handwritten notes, watching a video, and browsing the Web. We also include periods with no specific activity (the NULL class). Using a support vector machine (SVM) classifier and person-independent (leave-one-person-out) training, we obtain an average precision of 76.1 percent and recall of 70.5 percent over all classes and participants. The work demonstrates the promise of eye-based activity recognition (EAR) and opens up discussion on the wider applicability of EAR to other activities that are difficult, or even impossible, to detect using common sensing modalities.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Peng, H., Long, F., & Ding, C. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.159 · Cited by 10,544
De-noising by soft-thresholding
Donoho, D. L. (1995) · IEEE Transactions on Information Theory · doi:10.1109/18.382009 · Cited by 9,619
Activity Recognition from User-Annotated Acceleration Data
Bao, L., & Intille, S. S. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24646-6_1 · Cited by 3,147
Eye Tracking Methodology: Theory and Practice
Duchowski, A. T. (2003) · Springer eBooks · doi:10.1007/978-1-4471-3750-4 · Cited by 2,242
Identifying fixations and saccades in eye-tracking protocols
Salvucci, D. D., & Goldberg, J. H. (2000) · Proceedings of the symposium on Eye tracking research & applications - ETRA '00 · doi:10.1145/355017.355028 · Cited by 2,203
Mitra, S., & Acharya, T. (2007) · IEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2007.893280 · Cited by 1,981
Human gaze control during real-world scene perception
Henderson, J. (2003) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2003.09.006 · Cited by 1,404
Machine Recognition of Human Activities: A Survey
Turaga, P., Chellappa, R., Subrahmanian, V. S., & Udrea, O. (2008) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2008.2005594 · Cited by 1,333
Eye movements in natural behavior
Hayhoe, M., & Ballard, D. (2005) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2005.02.009 · Cited by 1,326
Eye Tracking Methodology; Theory and Practice
(2007) · Qualitative Market Research: An International Journal · doi:10.1108/13522750710740862 · Cited by 1,313
(2013) · Practical Psychology · doi:10.4324/9781315009810-7 · Cited by 1,066
Saccadic eye movements and cognition
Liversedge, S. P., & Findlay, J. M. (2000) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(99)01418-7 · Cited by 816
Najafi, B., Aminian, K., Paraschiv-Ionescu, A., Loew, F., Bula, C. J., & Robert, P. (2003) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2003.812189 · Cited by 762
Sensation and Perception: An Integrated Approach
Bartoshuk, L. M., & Schiffman, H. R. (1977) · The American Journal of Psychology · doi:10.2307/1421748 · Cited by 495
System for assisted mobility using eye movements based on electrooculography
Barea, R., Boquete, L., Mazo, M., & Lopez, E. (2002) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2002.806829 · Cited by 486
Blinks and saccades as indicators of fatigue in sleepiness warnings: looking tired?
Schleicher, R., Galley, N., Briest, S., & Galley, L. (2008) · Ergonomics · doi:10.1080/00140130701817062 · Cited by 476
Discovery of activity patterns using topic models
Huynh, T., Fritz, M., & Schiele, B. (2008) · Proceedings of the 10th international conference on Ubiquitous computing · doi:10.1145/1409635.1409638 · Cited by 442
Activity Recognition of Assembly Tasks Using Body-Worn Microphones and Accelerometers
Ward, J. A., Lukowicz, P., Troster, G., & Starner, T. E. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.197 · Cited by 431
Self-citation(2007) · Springer eBooks · doi:10.1007/978-1-84628-609-4 · Cited by 431
A Long-Term Evaluation of Sensing Modalities for Activity Recognition
Logan, B., Healey, J., Philipose, M., Tapia, E. M., & Intille, S. S. (2007) · Cited by 342
LIBLINEAR: A Library for Large Linear Classification
FanRong-En, ChangKai-Wei, HsiehCho-Jui, WangXiang-Rui, & LinChih-Jen (2008) · Journal of Machine Learning Research · doi:10.5555/1390681.1442794 · Cited by 328
Defining the temporal threshold for ocular fixation in free-viewing visuocognitive tasks
Manor, B. R., & Gordon, E. (2003) · Journal of Neuroscience Methods · doi:10.1016/s0165-0270(03)00151-1 · Cited by 300
Cardiac responses associated with affective processing of unpleasant film stimuli
Palomba, D., Sarlo, M., Angrilli, A., Mini, A., & Stegagno, L. (2000) · International Journal of Psychophysiology · doi:10.1016/s0167-8760(99)00099-9 · Cited by 280
A Long-Term Evaluation of Sensing Modalities for Activity Recognition
Logan, B., Healey, J., Philipose, M., Tapia, E. M., & Intille, S. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74853-3_28 · Cited by 222
Ultraconservative Online Algorithms for Multiclass Problems
Crammer, K., & Singer, Y. (2001) · Lecture Notes in Computer Science · doi:10.1007/3-540-44581-1_7 · Cited by 221
A unified information-theoretic framework for viewpoint selection and mesh saliency
Feixas, M., Sbert, M., & González, F. (2009) · ACM Transactions on Applied Perception · doi:10.1145/1462055.1462056 · Cited by 182
ISCEV Standard for Clinical Electro-oculography (EOG) 2006
Brown, M., Marmor, M., Vaegan, Zrenner, E., Brigell, M., & Bach, M. (2006) · Documenta Ophthalmologica · doi:10.1007/s10633-006-9030-0 · Cited by 174
Wearable EOG goggles: Seamless sensing and context-awareness in everyday environments
Bulling, A., Roggen, D., & Tröster, G. (2009) · Journal of Ambient Intelligence and Smart Environments · doi:10.3233/ais-2009-0020 · Cited by 166
Self-citationAutomated Eye-Movement Protocol Analysis
Salvucci, D. D., & Anderson, J. R. (2001) · Human-Computer Interaction · doi:10.1207/s15327051hci1601_2 · Cited by 161
Context-awareness in wearable and ubiquitous computing
Abowd, D., Dey, A. K., Orr, R., & Brotherton, J. A. (1998) · Virtual Reality · doi:10.1007/bf01408562 · Cited by 146
Speaking, thinking, and blinking
Karson, C. N., Berman, K. F., Donnelly, E. F., Mendelson, W. B., Kleinman, J. E., & Wyatt, R. J. (1981) · Psychiatry Research · doi:10.1016/0165-1781(81)90070-6 · Cited by 143
Robust Recognition of Reading Activity in Transit Using Wearable Electrooculography
Bulling, A., Ward, J. A., Gellersen, H. W., & Tröster, G. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-79576-6_2 · Cited by 141
Self-citationVisual perception and sequences of eye movement fixations: a stochastic modeling approach
Hacısalihzade, S. S., STARK, L. W., & Allen, J. S. (1992) · IEEE Transactions on Systems Man and Cybernetics · doi:10.1109/21.155948 · Cited by 129
Wavelet-Based Cascaded Adaptive Filter for Removing Baseline Drift in Pulse Waveforms
Xu, L., Zhang, D. D., & Wang, K. (2005) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2005.856296 · Cited by 124
Rapid Prototyping of Activity Recognition Applications
Bannach, D., Amft, O., & Lukowicz, P. (2008) · IEEE Pervasive Computing · doi:10.1109/mprv.2008.36 · Cited by 114
Wearable EOG goggles: eye-based interaction in everyday environments
Bulling, A., Roggen, D., & Tröster, G. (2009) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/1520340.1520468 · Cited by 109
Self-citationTotal Removal of Baseline Drift from ECG Signal
Chouhan, V. S., & Mehta, S. S. (2007) · International Conference on Computing: Theory and Applications · doi:10.1109/iccta.2007.126 · Cited by 104
It's in your eyes: towards context-awareness and mobile HCI using wearable EOG goggles
Bulling, A., Roggen, D., & Tröster, G. (2008) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/1409635.1409647 · Cited by 95
Self-citationEye movement analysis for activity recognition
Bulling, A., Ward, J. A., Gellersen, H. W., & Tröster, G. (2009) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/1620545.1620552 · Cited by 80
Self-citationStandard for clinical electro-oculography
Marmor, M. F., & Zrenner, E. (1993) · Documenta Ophthalmologica · doi:10.1007/bf01371127 · Cited by 77
A human-robot interface based on electrooculography
Chen, Y., & Newman, W. S. (2004) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2004.1307158 · Cited by 77
Recognizing context for annotating a live life recording
Kern, N., Schiele, B., & Schmidt, A. (2006) · Personal and Ubiquitous Computing · doi:10.1007/s00779-006-0086-3 · Cited by 74
Development of an EOG (Electro-Oculography) Based Human-Computer Interface
Ding, Q., Tong, R. K., & Li, G. (2005) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/iembs.2005.1616073 · Cited by 63
A Wavelet Packets Approach to Electrocardiograph Baseline Drift Cancellation
Tinati, M. A., & Tazehkand, B. M. (2006) · International Journal of Biomedical Imaging · doi:10.1155/ijbi/2006/97157 · Cited by 56
Accurate Removal of Baseline Wander in ECG Using Empirical Mode Decomposition
Na, P., Vai Mang, I., Un, M. P., & Hang, P. S. (2007) · Joint Meeting of International Symposium on Noninvasive Functional Source Imaging of Brain and Heart and International Conference on Functional Biomedical Imaging · doi:10.1109/nfsi-icfbi.2007.4387719 · Cited by 52
What's in the Eyes for Context-Awareness?
Bulling, A., Roggen, D., & Tröster, G. (2010) · IEEE Pervasive Computing · doi:10.1109/mprv.2010.49 · Cited by 51
Self-citationA gaze-based study for investigating the perception of visual realism in simulated scenes
Elhelw, M., Nicolaou, M., Chung, A. J., Yang, G., & Atkins, M. S. (2008) · ACM Transactions on Applied Perception · doi:10.1145/1279640.1279643 · Cited by 49
EOG based control of mobile assistive platforms for the severely disabled
Wijesoma, W. S., Wee, K. S., Wee, O. C., Balasuriya, A., San, K. T., & Soon, K. K. (2005) · IEEE International Conference on Robotics and Biomimetics (ROBIO) · doi:10.1109/robio.2005.246316 · Cited by 44
Real-world vision: Selective perception and task
Canosa, R. L. (2009) · ACM Transactions on Applied Perception · doi:10.1145/1498700.1498705 · Cited by 34
Cited by
A tutorial on human activity recognition using body-worn inertial sensors
Bulling, A., Blanke, U., & Schiele, B. (2014) · ACM Computing Surveys · doi:10.1145/2499621 · Cited by 1,668
Self-citationEmotionMeter: A Multimodal Framework for Recognizing Human Emotions
Zheng, W.-L., Liu, W., Lu, Y., Lu, B.-L., & Cichocki, A. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2797176 · Cited by 1,276
A Comprehensive Survey of Deep Learning for Image Captioning
Hossain, M. Z., Sohel, F., Shiratuddin, M. F., & Laga, H. (2019) · ACM Computing Surveys · doi:10.1145/3295748 · Cited by 879
Human Emotion Recognition: Review of Sensors and Methods
Dzedzickis, A., Kaklauskas, A., & Bucinskas, V. (2020) · Sensors · doi:10.3390/s20030592 · Cited by 582
Eye Tracking and Eye-Based Human–Computer Interaction
Majaranta, P., & Bulling, A. (2014) · Human–Computer Interaction Series · doi:10.1007/978-1-4471-6392-3_3 · Cited by 530
Self-citation
Metadata
- Authors
- Bulling, A., Ward, J. A., Gellersen, H., & Tröster, G.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2011-04
- Volume
- 33
- Issue
- 4
- Pages
- 741-753
- ISSN
- 0162-8828 (ISSN-L)
- OpenAlex
- W2126698740
- Cited by
- 718
- References
- 49
- FWCI
- 41.30
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.