The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
MPIIGaze: Real-World Dataset and Deep Appearance-Based Gaze Estimation
Abstract
Learning-based methods are believed to work well for unconstrained gaze estimation, i.e. gaze estimation from a monocular RGB camera without assumptions regarding user, environment, or camera. However, current gaze datasets were collected under laboratory conditions and methods were not evaluated across multiple datasets. Our work makes three contributions towards addressing these limitations. First, we present the MPIIGaze dataset, which contains 213,659 full face images and corresponding ground-truth gaze positions collected from 15 users during everyday laptop use over several months. An experience sampling approach ensured continuous gaze and head poses and realistic variation in eye appearance and illumination. To facilitate cross-dataset evaluations, 37,667 images were manually annotated with eye corners, mouth corners, and pupil centres. Second, we present an extensive evaluation of state-of-the-art gaze estimation methods on three current datasets, including MPIIGaze. We study key challenges including target gaze range, illumination conditions, and facial appearance variation. We show that image resolution and the use of both eyes affect gaze estimation performance, while head pose and pupil centre information are less informative. Finally, we propose GazeNet, the first deep appearance-based gaze estimation method. GazeNet improves on the state of the art by 22 percent (from a mean error of 13.9 degrees to 10.8 degrees) for the most challenging cross-dataset evaluation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Individual Comparisons by Ranking Methods
Wilcoxon, F. (1945) · Biometrics Bulletin · doi:10.2307/3001968 · Cited by 15,354
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Bradski, G. R. (2000) · Medical Entomology and Zoology · Cited by 5,994
EPnP: An Accurate O(n) Solution to the PnP Problem
Lepetit, V., Moreno-Noguer, F., & Fua, P. (2009) · International Journal of Computer Vision · doi:10.1007/s11263-008-0152-6 · Cited by 3,298
Dlib-ml: A Machine Learning Toolkit
King, D. E. (2009) · doi:10.5555/1577069.1755843 · Cited by 2,777
(2011) · Cited by 2,752
Torralba, A., & Efros, A. A. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995347 · Cited by 2,440
In the Eye of the Beholder: A Survey of Models for Eyes and Gaze
Hansen, D. W., & Ji, Q. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.30 · Cited by 1,546
The Secrets of Salient Object Segmentation
Li, Y., Hou, X., Koch, C., Rehg, J. M., & Yuille, A. L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.43 · Cited by 1,338
The Experience Sampling Method
Larson, R., & Csikszentmihalyi, M. (2014) · Flow and the Foundations of Positive Psychology · doi:10.1007/978-94-017-9088-8_2 · Cited by 1,034
Krafka, K., Khosla, A., Kellnhofer, P., Kannan, H., Bhandarkar, S., Matusik, W., & Torralba, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.239 · Cited by 917
Pupil: an open source platform for pervasive eye tracking and mobile gaze-based interaction
Kassner, M., Patera, W., & Bulling, A. (2014) · Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct Publication · doi:10.1145/2638728.2641695 · Cited by 764
Self-citationAppearance-based gaze estimation in the wild
Zhang, X., Sugano, Y., Fritz, M., & Bulling, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299081 · Cited by 763
Self-citationEye Tracking and Eye-Based Human–Computer Interaction
Majaranta, P., & Bulling, A. (2014) · Human–Computer Interaction Series · doi:10.1007/978-1-4471-6392-3_3 · Cited by 530
Self-citationIt’s Written All Over Your Face: Full-Face Appearance-Based Gaze Estimation
Zhang, X., Sugano, Y., Fritz, M., & Bulling, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.284 · Cited by 496
Self-citationAppearance-Based Gaze Estimation in the Wild
Zhang, X., Sugano, Y., Fritz, M., & Bulling, A. (2015) · Cited by 418
Self-citationJoint Cascade Face Detection and Alignment
Chen, D., Ren, S., Wei, Y., Cao, X., & Sun, J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10599-4_8 · Cited by 405
Learning-by-Synthesis for Appearance-Based 3D Gaze Estimation
Sugano, Y., Matsushita, Y., & Sato, Y. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.235 · Cited by 404
Self-citationCombining Head Pose and Eye Location Information for Gaze Estimation
Valenti, R., Sebe, N., & Gevers, T. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2162740 · Cited by 384
LIBLINEAR: A Library for Large Linear Classification
FanRong-En, ChangKai-Wei, HsiehCho-Jui, WangXiang-Rui, & LinChih-Jen (2008) · Journal of Machine Learning Research · doi:10.5555/1390681.1442794 · Cited by 328
Gaze locking: passive eye contact detection for human-object interaction
Smith, B. A., Yin, Q., Feiner, S. K., & Nayar, S. K. (2013) · Proceedings of the 26th annual ACM symposium on User interface software and technology · doi:10.1145/2501988.2501994 · Cited by 327
Rendering of Eyes for Eye-Shape Registration and Gaze Estimation
Wood, E., Baltruaitis, T., Zhang, X., Sugano, Y., Robinson, P., & Bulling, A. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.428 · Cited by 308
Self-citationNon-Intrusive Gaze Tracking Using Artificial Neural Networks
Baluja, S., & Pomerleau, D. (1993) · Cited by 307
A Novel Approach to 3-D Gaze Tracking Using Stereo Cameras
Shih, S.-W., & Liu, J. (2004) · IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2003.811128 · Cited by 290
Appearance-based eye gaze estimation
Tan, K.-H., Kriegman, D. J., & Ahuja, N. (2003) · Sixth IEEE Workshop on Applications of Computer Vision, 2002. (WACV 2002). Proceedings. · doi:10.1109/acv.2002.1182180 · Cited by 241
Adaptive Linear Regression for Appearance-Based Gaze Estimation
Lu, F., Sugano, Y., Okabe, T., & Sato, Y. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2313123 · Cited by 238
Self-citationTurkerGaze: Crowdsourcing Saliency with Webcam based Eye Tracking
Xu, P., Ehinger, K. A., Zhang, Y., Finkelstein, A., Kulkarni, S. R., & Xiao, J. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.06755 · Cited by 234
A single camera eye-gaze tracking system with free head motion
Hennessey, C., Noureddin, B., & Lawrence, P. (2006) · Proceedings of the 2006 symposium on Eye tracking research & applications - ETRA '06 · doi:10.1145/1117309.1117349 · Cited by 217
EyeTab: model-based gaze estimation on unmodified tablet computers
Wood, E., & Bulling, A. (2014) · Proceedings of the Symposium on Eye Tracking Research and Applications · doi:10.1145/2578153.2578185 · Cited by 215
Self-citationAppearance-Based Gaze Estimation Using Visual Saliency
Sugano, Y., Matsushita, Y., & Sato, Y. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.101 · Cited by 193
Self-citationHuang, Q., Veeraraghavan, A., & Sabharwal, A. (2017) · Machine Vision and Applications · doi:10.1007/s00138-017-0852-4 · Cited by 175
Passive driver gaze tracking with active appearance models
Ishikawa, T. (2018) · doi:10.1184/r1/6557315 · Cited by 163
Eye Gaze Tracking under Natural Head Movements
Zhu, Z., & Ji, Q. (2005) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2005.148 · Cited by 158
Real-time eye gaze tracking with an unmodified commodity webcam employing a neural network
Sewell, W., & Komogortsev, O. (2010) · CHI '10 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/1753846.1754048 · Cited by 136
Gaze estimation from multimodal Kinect data
Mora, K. A. F., & Odobez, J. (2012) · 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2012.6239182 · Cited by 115
Continuous Conditional Neural Fields for Structured Regression
Baltrušaitis, T., Robinson, P., & Morency, L. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10593-2_39 · Cited by 108
Nonlinear Eye Gaze Mapping Function Estimation via Support Vector Regression
Zhu, Z., Ji, Q., & Bennett, K. P. (2006) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2006.864 · Cited by 100
A 3D Morphable Eye Region Model for Gaze Estimation
Wood, E., Baltrušaitis, T., Morency, L., Robinson, P., & Bulling, A. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46448-0_18 · Cited by 98
Self-citationHybrid method based on topography for robust detection of iris center and eye corners
Villanueva, A., Ponz, V., Sesma-Sánchez, L., Ariz, M., Porta, S., & Cabeza, R. (2013) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/2501643.2501647 · Cited by 97
Geometric Generative Gaze Estimation (G3E) for Remote RGB-D Cameras
Mora, K. A. F., & Odobez, J. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.229 · Cited by 94
SideWays: a gaze interface for spontaneous interaction with situated displays
Zhang, Y., Bulling, A., & Gellersen, H. W. (2013) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2470775 · Cited by 90
Self-citationManifold Alignment for Person Independent Appearance-Based Gaze Estimation
Schneider, T., Schauerte, B., & Stiefelhagen, R. (2014) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2014.210 · Cited by 83
Everyday Eye Contact Detection Using Unsupervised Gaze Target Discovery
Zhang, X., Sugano, Y., & Bulling, A. (2017) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3126594.3126614 · Cited by 76
Self-citationGaze Estimation in the 3D Space Using RGB-D Sensors: Towards Head-Pose and User Invariance
Mora, K. A. F., & Odobez, J. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0863-4 · Cited by 67
Appearance-Based Gaze Estimation With Online Calibration From Mouse Operations
Sugano, Y., Matsushita, Y., Sato, Y., & Koike, H. (2015) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2015.2400434 · Cited by 63
Self-citationCalibration-Free Gaze Estimation Using Human Gaze Patterns
Alnajar, F., Gevers, T., Valenti, R., et al. (2013) · IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.24 · Cited by 57
AggreGaze: Collective Estimation of Audience Attention on Public Displays
Sugano, Y., Zhang, X., & Bulling, A. (2016) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/2984511.2984536 · Cited by 54
Self-citationPrediction of search targets from fixations in open-world settings
Sattar, H., Muller, S., Fritz, M., & Bulling, A. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298700 · Cited by 50
Self-citationPrediction of Search Targets From Fixations in Open-World Settings
Sattar, H., Müller, S., Fritz, M., & Bulling, A. (2015) · Cited by 39
Self-citationModel-based head pose-free gaze estimation for assistive communication
Cristina, S., & Camilleri, K. P. (2016) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2016.02.012 · Cited by 32
Person-Independent 3D Gaze Estimation Using Face Frontalization
Jeni, L. A., & Cohn, J. F. (2016) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2016.104 · Cited by 26
Appearance-based gaze estimation using kinect
Choi, J., Ahn, B., Parl, J., et al. (2013) · International Conference on Ubiquitous Robots and Ambient Intelligence · doi:10.1109/urai.2013.6677362 · Cited by 11
When Computer Vision Gazes at CognitionPreprint
Gao, T., Harari, D., Tenenbaum, J. B., & Ullman, S. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.2672 · Cited by 7
Cited by
Gaze360: Physically Unconstrained Gaze Estimation in the Wild
Kellnhofer, P., Recasens, A., Stent, S., Matusik, W., & Torralba, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00701 · Cited by 470
ETH-XGaze: A Large Scale Dataset for Gaze Estimation Under Extreme Head Pose and Gaze Variation
Zhang, X., Park, S., Beeler, T., Bradley, D., Tang, S., & Hilliges, O. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58558-7_22 · Cited by 315
Self-citationToward immersive communications in 6G
Shen, X. (., Gao, J., Li, M., Zhou, C., Hu, S., He, M., & Zhuang, W. (2023) · Frontiers in Computer Science · doi:10.3389/fcomp.2022.1068478 · Cited by 124
Hutt, S., Krasich, K., R. Brockmole, J., & K. D'Mello, S. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445269 · Cited by 60
Human Gaze Assisted Artificial Intelligence: A Review
Zhang, R., Saran, A., Liu, B., Zhu, Y., Guo, S., Niekum, S., Ballard, D., & Hayhoe, M. (2020) · Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/689 · Cited by 48
Metadata
- Authors
- Zhang, X., Sugano, Y., Fritz, M., & Bulling, A.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2019-01-01
- Volume
- 41
- Issue
- 1
- Pages
- 162-175
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W2765629358
- Cited by
- 588
- References
- 56
- FWCI
- 36.87
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.