The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Appearance-based gaze estimation in the wild
Open accessAbstract
Appearance-based gaze estimation is believed to work well in real-world settings, but existing datasets have been collected under controlled laboratory conditions and methods have been not evaluated across multiple datasets. In this work we study appearance-based gaze estimation in the wild. We present the MPIIGaze dataset that contains 213,659 images we collected from 15 participants during natural everyday laptop use over more than three months. Our dataset is significantly more variable than existing ones with respect to appearance and illumination. We also present a method for in-the-wild appearance-based gaze estimation using multimodal convolutional neural networks that significantly outperforms state-of-the art methods in the most challenging cross-dataset evaluation. We present an extensive evaluation of several state-of-the-art image-based gaze estimation algorithms on three current datasets, including our own. This evaluation provides clear insights and allows us to identify key research challenges of gaze estimation in the wild.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Individual Comparisons by Ranking Methods
Wilcoxon, F. (1945) · Biometrics Bulletin · doi:10.2307/3001968 · Cited by 15,354
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
EPnP: An Accurate O(n) Solution to the PnP Problem
Lepetit, V., Moreno-Noguer, F., & Fua, P. (2009) · International Journal of Computer Vision · doi:10.1007/s11263-008-0152-6 · Cited by 3,298
Torralba, A., & Efros, A. A. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995347 · Cited by 2,440
In the Eye of the Beholder: A Survey of Models for Eyes and Gaze
Hansen, D. W., & Ji, Q. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.30 · Cited by 1,546
The Secrets of Salient Object Segmentation
Li, Y., Hou, X., Koch, C., Rehg, J. M., & Yuille, A. L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.43 · Cited by 1,338
Eye gaze tracking techniques for interactive applications
Morimoto, C. H., & Mimica, M. R. M. (2005) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2004.07.010 · Cited by 745
Eye Tracking and Eye-Based Human–Computer Interaction
Majaranta, P., & Bulling, A. (2014) · Human–Computer Interaction Series · doi:10.1007/978-1-4471-6392-3_3 · Cited by 530
Self-citationLearning-by-Synthesis for Appearance-Based 3D Gaze Estimation
Sugano, Y., Matsushita, Y., & Sato, Y. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.235 · Cited by 404
Self-citationCombining Head Pose and Eye Location Information for Gaze Estimation
Valenti, R., Sebe, N., & Gevers, T. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2162740 · Cited by 353
Gaze locking: passive eye contact detection for human-object interaction
Smith, B. A., Yin, Q., Feiner, S. K., & Nayar, S. K. (2013) · Proceedings of the 26th annual ACM symposium on User interface software and technology · doi:10.1145/2501988.2501994 · Cited by 327
A Novel Approach to 3-D Gaze Tracking Using Stereo Cameras
Shih, S.-W., & Liu, J. (2004) · IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2003.811128 · Cited by 290
Adaptive Linear Regression for Appearance-Based Gaze Estimation
Lu, F., Sugano, Y., Okabe, T., & Sato, Y. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2313123 · Cited by 238
Self-citationA single camera eye-gaze tracking system with free head motion
Hennessey, C., Noureddin, B., & Lawrence, P. (2006) · Proceedings of the 2006 symposium on Eye tracking research & applications - ETRA '06 · doi:10.1145/1117309.1117349 · Cited by 217
EyeTab: model-based gaze estimation on unmodified tablet computers
Wood, E., & Bulling, A. (2014) · Proceedings of the Symposium on Eye Tracking Research and Applications · doi:10.1145/2578153.2578185 · Cited by 215
Self-citationLearning SURF Cascade for Fast and Accurate Object Detection
Li, J., & Zhang, Y. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.445 · Cited by 204
Appearance-Based Gaze Estimation Using Visual Saliency
Sugano, Y., Matsushita, Y., & Sato, Y. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.101 · Cited by 193
Self-citationReal-time eye gaze tracking with an unmodified commodity webcam employing a neural network
Sewell, W., & Komogortsev, O. (2010) · CHI '10 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/1753846.1754048 · Cited by 136
Gaze estimation from multimodal Kinect data
Mora, K. A. F., & Odobez, J. (2012) · 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2012.6239182 · Cited by 115
Hybrid method based on topography for robust detection of iris center and eye corners
Villanueva, A., Ponz, V., Sesma-Sánchez, L., Ariz, M., Porta, S., & Cabeza, R. (2013) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/2501643.2501647 · Cited by 97
Manifold Alignment for Person Independent Appearance-Based Gaze Estimation
Schneider, T., Schauerte, B., & Stiefelhagen, R. (2014) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2014.210 · Cited by 83
Calibration-Free Gaze Estimation Using Human Gaze Patterns
Alnajar, F., Gevers, T., Valenti, R., et al. (2013) · IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.24 · Cited by 57
Appearance-based gaze estimation using kinect
Choi, J., Ahn, B., Parl, J., et al. (2013) · International Conference on Ubiquitous Robots and Ambient Intelligence · doi:10.1109/urai.2013.6677362 · Cited by 11
Cited by
Openface 2.0: facial behavior analysis toolkit
Baltrusaitis, T., Zadeh, A., Lim, Y. C., & Morency, L.-P. (2018) · 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018) · doi:10.1109/fg.2018.00019 · Cited by 1,861
Learning from Simulated and Unsupervised Images through Adversarial Training
Shrivastava, A., Pfister, T., Tuzel, O., Susskind, J., Wang, W., & Webb, R. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.241 · Cited by 1,814
OpenFace: An open source facial behavior analysis toolkit
Baltrusaitis, T., Robinson, P., & Morency, L.-P. (2016) · 2016 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2016.7477553 · Cited by 1,747
Krafka, K., Khosla, A., Kellnhofer, P., Kannan, H., Bhandarkar, S., Matusik, W., & Torralba, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.239 · Cited by 917
Nguyen, D., Hong, H., Kim, K., & Park, K. (2017) · Sensors · doi:10.3390/s17030605 · Cited by 790
Metadata
- Authors
- Zhang, X., Sugano, Y., Fritz, M., & Bulling, A.
- Venue
- 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2015-06
- Pages
- 4511-4520
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2027879843
- Cited by
- 763
- References
- 24
- FWCI
- 30.38
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.