The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Eye Tracking for Everyone
Abstract
From scientific research to commercial applications, eye tracking is an important tool across many domains. Despite its range of applications, eye tracking has yet to become a pervasive technology. We believe that we can put the power of eye tracking in everyone's palm by building eye tracking software that works on commodity hardware such as mobile phones and tablets, without the need for additional sensors or devices. We tackle this problem by introducing GazeCapture, the first large-scale dataset for eye tracking, containing data from over 1450 people consisting of almost 2:5M frames. Using GazeCapture, we train iTracker, a convolutional neural network for eye tracking, which achieves a significant reduction in error over previous approaches while running in real time (10-15fps) on a modern mobile device. Our model achieves a prediction error of 1.71cm and 2.53cm without calibration on mobile phones and tablets respectively. With calibration, this is reduced to 1.34cm and 2.12cm. Further, we demonstrate that the features learned by iTracker generalize well to other datasets, achieving state-of-the-art results. The code, data, and models are available at http://gazecapture.csail.mit.edu.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Self-citationRich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Distilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Eye movements in reading and information processing: 20 years of research
Rayner, K. (1998) · Psychological Bulletin · doi:10.1037/0033-2909.124.3.372 · Cited by 7,979
DeepFace: Closing the Gap to Human-Level Performance in Face Verification
Taigman, Y., Yang, M., Ranzato, M., & Wolf, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.220 · Cited by 6,542
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. J. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1408.5093 · Cited by 3,752
Eye Tracking Methodology: Theory and Practice
Duchowski, A. T. (2003) · Springer eBooks · doi:10.1007/978-1-4471-3750-4 · Cited by 2,242
State-of-the-Art in Visual Attention Modeling
Borji, A., & Itti, L. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.89 · Cited by 1,817
Eye Tracking in Human-Computer Interaction and Usability Research
Jacob, R. J. K., & Karn, K. S. (2003) · The Mind's Eye · doi:10.1016/b978-044451020-4/50031-1 · Cited by 1,567
In the Eye of the Beholder: A Survey of Models for Eyes and Gaze
Hansen, D. W., & Ji, Q. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.30 · Cited by 1,546
Eye Tracking Methodology; Theory and Practice
(2007) · Qualitative Market Research: An International Journal · doi:10.1108/13522750710740862 · Cited by 1,313
Appearance-based gaze estimation in the wild
Zhang, X., Sugano, Y., Fritz, M., & Bulling, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299081 · Cited by 763
Eye gaze tracking techniques for interactive applications
Morimoto, C. H., & Mimica, M. R. M. (2005) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2004.07.010 · Cited by 745
Eye Tracking and Eye-Based Human–Computer Interaction
Majaranta, P., & Bulling, A. (2014) · Human–Computer Interaction Series · doi:10.1007/978-1-4471-6392-3_3 · Cited by 530
The Psychology and Pedagogy of Reading
Samuels, S. J., & Huey, E. B. (1970) · American Educational Research Journal · doi:10.2307/1162167 · Cited by 498
Eye-Tracking Dysfunctions in Schizophrenic Patients and Their Relatives
Holzman, P. S. (1974) · Archives of General Psychiatry · doi:10.1001/archpsyc.1974.01760140005001 · Cited by 471
Appearance-Based Gaze Estimation in the Wild
Zhang, X., Sugano, Y., Fritz, M., & Bulling, A. (2015) · Cited by 418
Constrained Local Neural Fields for Robust Facial Landmark Detection in the Wild
Baltrusaitis, T., Robinson, P., & Morency, L.-P. (2013) · 2013 IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2013.54 · Cited by 415
Learning-by-Synthesis for Appearance-Based 3D Gaze Estimation
Sugano, Y., Matsushita, Y., & Sato, Y. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.235 · Cited by 404
Combining Head Pose and Eye Location Information for Gaze Estimation
Valenti, R., Sebe, N., & Gevers, T. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2162740 · Cited by 353
Understanding and Predicting Image Memorability at a Large Scale
Khosla, A., Raju, A. S., Torralba, A., & Oliva, A. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.275 · Cited by 348
Self-citationGaze locking: passive eye contact detection for human-object interaction
Smith, B. A., Yin, Q., Feiner, S. K., & Nayar, S. K. (2013) · Proceedings of the 26th annual ACM symposium on User interface software and technology · doi:10.1145/2501988.2501994 · Cited by 327
Non-Intrusive Gaze Tracking Using Artificial Neural Networks
Baluja, S., & Pomerleau, D. (1993) · Cited by 307
Appearance-based eye gaze estimation
Tan, K.-H., Kriegman, D. J., & Ahuja, N. (2003) · Sixth IEEE Workshop on Applications of Computer Vision, 2002. (WACV 2002). Proceedings. · doi:10.1109/acv.2002.1182180 · Cited by 241
Adaptive Linear Regression for Appearance-Based Gaze Estimation
Lu, F., Sugano, Y., Okabe, T., & Sato, Y. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2313123 · Cited by 238
Hansen, D. W., & Pece, A. E. C. (2005) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2004.07.013 · Cited by 235
TurkerGaze: Crowdsourcing Saliency with Webcam based Eye Tracking
Xu, P., Ehinger, K. A., Zhang, Y., Finkelstein, A., Kulkarni, S. R., & Xiao, J. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.06755 · Cited by 234
A single camera eye-gaze tracking system with free head motion
Hennessey, C., Noureddin, B., & Lawrence, P. (2006) · Proceedings of the 2006 symposium on Eye tracking research & applications - ETRA '06 · doi:10.1145/1117309.1117349 · Cited by 217
Appearance-Based Gaze Estimation Using Visual Saliency
Sugano, Y., Matsushita, Y., & Sato, Y. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.101 · Cited by 193
Recasens, A., Khosla, A., Vondrick, C., & Torralba, A. B. (2015) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 167
Self-citationPassive driver gaze tracking with active appearance models
Ishikawa, T. (2018) · doi:10.1184/r1/6557315 · Cited by 163
Eye Gaze Tracking under Natural Head Movements
Zhu, Z., & Ji, Q. (2005) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2005.148 · Cited by 158
Real-time eye gaze tracking with an unmodified commodity webcam employing a neural network
Sewell, W., & Komogortsev, O. (2010) · CHI '10 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/1753846.1754048 · Cited by 136
Nonlinear Eye Gaze Mapping Function Estimation via Support Vector Regression
Zhu, Z., Ji, Q., & Bennett, K. P. (2006) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2006.864 · Cited by 100
A neural-based remote eye gaze tracker under natural head motion
Torricelli, D., Conforto, S., Schmid, M., & D’Alessio, T. (2008) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2008.06.008 · Cited by 65
THE PSYCHOLOGY AND PEDAGOGY OF READING
JELLIFFE. (1908) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-190812000-00011 · Cited by 44
From Where and How to What We See
Karthikeyan, S., Jagadeesh, V., Shenoy, R., Ecksteinz, M., & Manjunath, B. S. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.83 · Cited by 33
Huang, Q., Veeraraghavan, A., & Sabharwal, A. (2015) · arXiv (Cornell University) · Cited by 16
Cited by
EmotionMeter: A Multimodal Framework for Recognizing Human Emotions
Zheng, W.-L., Liu, W., Lu, Y., Lu, B.-L., & Cichocki, A. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2797176 · Cited by 1,276
Gaze360: Physically Unconstrained Gaze Estimation in the Wild
Kellnhofer, P., Recasens, A., Stent, S., Matusik, W., & Torralba, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00701 · Cited by 470
Self-citationRT-GENE: Real-Time Eye Gaze Estimation in Natural Environments
Fischer, T., Chang, H. J., & Demiris, Y. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01249-6_21 · Cited by 388
Kar, A., & Corcoran, P. (2017) · IEEE Access · doi:10.1109/access.2017.2735633 · Cited by 279
Klaib, A. F., Alsrehin, N. O., Melhem, W. Y., Bashtawi, H. O., & Magableh, A. A. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.114037 · Cited by 263
Metadata
- Authors
- Krafka, K., Khosla, A., Kellnhofer, P., Kannan, H., Bhandarkar, S., Matusik, W., & Torralba, A.
- Venue
- 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2016-06
- Pages
- 2176-2184
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2468114283
- Cited by
- 917
- References
- 40
- FWCI
- 45.83
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.