The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
It’s Written All Over Your Face: Full-Face Appearance-Based Gaze Estimation
Open accessAbstract
Eye gaze is an important non-verbal cue for human affect analysis. Recent gaze estimation work indicated that information from the full face region can benefit performance. Pushing this idea further, we propose an appearance-based method that, in contrast to a long-standing line of work in computer vision, only takes the full face image as input. Our method encodes the face image using a convolutional neural network with spatial weights applied on the feature maps to flexibly suppress or enhance information in different facial regions. Through extensive evaluation, we show that our full-face method significantly outperforms the state of the art for both 2D and 3D gaze estimation, achieving improvements of up to 14.3% on MPIIGaze and 27.7% on EYEDIAP for person-independent 3D gaze estimation. We further show that this improvement is consistent across different illumination conditions and gaze directions and particularly pronounced for the most challenging extreme head poses.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2389824 · Cited by 11,971
Self-citationCaffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10578-9_23 · Cited by 3,034
Self-citationIn the Eye of the Beholder: A Survey of Models for Eyes and Gaze
Hansen, D. W., & Ji, Q. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.30 · Cited by 1,546
Efficient object localization using Convolutional Networks
Tompson, J., Goroshin, R., Jain, A., LeCun, Y., & Bregler, C. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298664 · Cited by 1,365
Krafka, K., Khosla, A., Kellnhofer, P., Kannan, H., Bhandarkar, S., Matusik, W., & Torralba, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.239 · Cited by 917
Appearance-based gaze estimation in the wild
Zhang, X., Sugano, Y., Fritz, M., & Bulling, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299081 · Cited by 763
Self-citationAppearance-Based Gaze Estimation in the Wild
Zhang, X., Sugano, Y., Fritz, M., & Bulling, A. (2015) · Cited by 418
Self-citationLearning-by-Synthesis for Appearance-Based 3D Gaze Estimation
Sugano, Y., Matsushita, Y., & Sato, Y. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.235 · Cited by 404
Self-citationFooting in human-robot conversations: how robots might shape participant roles using gaze cues
Mutlu, B., Shiwa, T., Kanda, T., Ishiguro, H., & Hagita, N. (2009) · Proceedings of the 4th ACM/IEEE international conference on Human robot interaction · doi:10.1145/1514095.1514109 · Cited by 392
Combining Head Pose and Eye Location Information for Gaze Estimation
Valenti, R., Sebe, N., & Gevers, T. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2162740 · Cited by 353
Gaze tutor: A gaze-reactive intelligent tutoring system
D'Mello, S., Olney, A., Williams, C., & Hays, P. (2012) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2012.01.004 · Cited by 335
Gaze locking: passive eye contact detection for human-object interaction
Smith, B. A., Yin, Q., Feiner, S. K., & Nayar, S. K. (2013) · Proceedings of the 26th annual ACM symposium on User interface software and technology · doi:10.1145/2501988.2501994 · Cited by 327
Rendering of Eyes for Eye-Shape Registration and Gaze Estimation
Wood, E., Baltruaitis, T., Zhang, X., Sugano, Y., Robinson, P., & Bulling, A. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.428 · Cited by 308
Self-citationNon-Intrusive Gaze Tracking Using Artificial Neural Networks
Baluja, S., & Pomerleau, D. (1993) · Cited by 307
Appearance-based eye gaze estimation
Tan, K.-H., Kriegman, D. J., & Ahuja, N. (2003) · Sixth IEEE Workshop on Applications of Computer Vision, 2002. (WACV 2002). Proceedings. · doi:10.1109/acv.2002.1182180 · Cited by 241
Adaptive Linear Regression for Appearance-Based Gaze Estimation
Lu, F., Sugano, Y., Okabe, T., & Sato, Y. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2313123 · Cited by 238
Self-citationEyeTab: model-based gaze estimation on unmodified tablet computers
Wood, E., & Bulling, A. (2014) · Proceedings of the Symposium on Eye Tracking Research and Applications · doi:10.1145/2578153.2578185 · Cited by 215
Self-citationSocial signal processing: state-of-the-art and future perspectives of an emerging domain
Vinciarelli, A., Pantić, M., Bourlard, H. A., & Pentland, A. (2008) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/1459359.1459573 · Cited by 142
Continuous Conditional Neural Fields for Structured Regression
Baltrušaitis, T., Robinson, P., & Morency, L. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10593-2_39 · Cited by 108
Gaze Estimation in the 3D Space Using RGB-D Sensors: Towards Head-Pose and User Invariance
Mora, K. A. F., & Odobez, J. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0863-4 · Cited by 67
Appearance-Based Gaze Estimation With Online Calibration From Mouse Operations
Sugano, Y., Matsushita, Y., Sato, Y., & Koike, H. (2015) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2015.2400434 · Cited by 63
Self-citationHuang, Q., Veeraraghavan, A., & Sabharwal, A. (2015) · arXiv (Cornell University) · Cited by 16
Cited by
MPIIGaze: Real-World Dataset and Deep Appearance-Based Gaze Estimation
Zhang, X., Sugano, Y., Fritz, M., & Bulling, A. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2778103 · Cited by 588
Self-citationGaze360: Physically Unconstrained Gaze Estimation in the Wild
Kellnhofer, P., Recasens, A., Stent, S., Matusik, W., & Torralba, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00701 · Cited by 470
RT-GENE: Real-Time Eye Gaze Estimation in Natural Environments
Fischer, T., Chang, H. J., & Demiris, Y. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01249-6_21 · Cited by 388
A High-Level Description and Performance Evaluation of Pupil Invisible
Tonsen, M., Baumann, C. K., & Dierkes, K. (2020) · arXiv · doi:10.48550/arxiv.2009.00508 · Cited by 34
Towards Understanding Perceptual Differences between Genuine and Face-Swapped Videos
Wöhler, L., Zembaty, M., Castillo, S., & Magnor, M. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445627 · Cited by 24
Metadata
- Authors
- Zhang, X., Sugano, Y., Fritz, M., & Bulling, A.
- Venue
- 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
- Publisher
- IEEE
- Published
- 2017-07
- Pages
- 2299-2308
- OpenAlex
- W2557669140
- Cited by
- 496
- References
- 28
- FWCI
- 25.44
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.