The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Rendering of Eyes for Eye-Shape Registration and Gaze Estimation
Abstract
Images of the eye are key in several computer vision problems, such as shape registration and gaze estimation. Recent large-scale supervised methods for these problems require time-consuming data collection and manual annotation, which can be unreliable. We propose synthesizing perfectly labelled photo-realistic training data in a fraction of the time. We used computer graphics techniques to build a collection of dynamic eye-region models from head scan geometry. These were randomly posed to synthesize close-up eye images for a wide range of head poses, gaze directions, and illumination conditions. We used our model's controllability to verify the importance of realistic illumination and shape variations in eye-region training data. Finally, we demonstrate the benefits of our synthesized training data (SynthesEyes) by out-performing state-of-the-art methods for eye-shape registration as well as cross-dataset appearance-based gaze estimation in the wild.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Real-time human pose recognition in parts from single depth images
Shotton, J., Fitzgibbon, A., Cook, M., Sharp, T., Finocchio, M., Moore, R., Kipman, A., & Blake, A. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995316 · Cited by 3,491
(2014) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 2,534
Face detection, pose estimation, and landmark localization in the wild
Zhu, X., & Ramanan, D. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248014 · Cited by 2,120
Supervised Descent Method and Its Applications to Face Alignment
Xiong, X., & De la Torre, F. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.75 · Cited by 1,896
Eye-Contact, Distance and Affiliation
Argyle, M., & Dean, J. (1965) · Sociometry · doi:10.2307/2786027 · Cited by 1,779
300 Faces in-the-Wild Challenge: The First Facial Landmark Localization Challenge
Sagonas, C., Tzimiropoulos, G., Zafeiriou, S., & Pantic, M. (2013) · 2013 IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2013.59 · Cited by 1,119
Appearance-based gaze estimation in the wild
Zhang, X., Sugano, Y., Fritz, M., & Bulling, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299081 · Cited by 763
Self-citationEye Movement Analysis for Activity Recognition Using Electrooculography
Bulling, A., Ward, J. A., Gellersen, H., & Tröster, G. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.86 · Cited by 718
Self-citationRobust Discriminative Response Map Fitting with Constrained Local Models
Asthana, A., Zafeiriou, S., Cheng, S., & Pantic, M. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.442 · Cited by 557
Eye Tracking and Eye-Based Human–Computer Interaction
Majaranta, P., & Bulling, A. (2014) · Human–Computer Interaction Series · doi:10.1007/978-1-4471-6392-3_3 · Cited by 530
Self-citationReal time head pose estimation with random regression forests
Fanelli, G., Gall, J., & Van Gool, L. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995458 · Cited by 436
Appearance-Based Gaze Estimation in the Wild
Zhang, X., Sugano, Y., Fritz, M., & Bulling, A. (2015) · Cited by 418
Self-citationConstrained Local Neural Fields for Robust Facial Landmark Detection in the Wild
Baltrusaitis, T., Robinson, P., & Morency, L.-P. (2013) · 2013 IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2013.54 · Cited by 415
Self-citationLearning-by-Synthesis for Appearance-Based 3D Gaze Estimation
Sugano, Y., Matsushita, Y., & Sato, Y. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.235 · Cited by 404
Self-citationDisplaced subdivision surfaces
Lee, A., Moreton, H., & Hoppe, H. (2000) · Proceedings of the 27th annual conference on Computer graphics and interactive techniques - SIGGRAPH '00 · doi:10.1145/344779.344829 · Cited by 348
3D Constrained Local Model for rigid and non-rigid facial tracking
Baltrusaitis, T., Robinson, P., & Morency, L. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247980 · Cited by 313
Self-citationRobust real-time pupil tracking in highly off-axis images
Świrski, L., Bulling, A., & Dodgson, N. (2012) · Proceedings of the Symposium on Eye Tracking Research and Applications · doi:10.1145/2168556.2168585 · Cited by 270
Self-citationEyeTab: model-based gaze estimation on unmodified tablet computers
Wood, E., & Bulling, A. (2014) · Proceedings of the Symposium on Eye Tracking Research and Applications · doi:10.1145/2578153.2578185 · Cited by 215
Self-citationMulti-view object class detection with a 3D geometric model
Liebelt, J., & Schmid, C. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539836 · Cited by 183
Dense 3D face alignment from 2D videos in real-time
Jeni, L. A., Cohn, J. F., & Kanade, T. (2015) · 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) · doi:10.1109/fg.2015.7163142 · Cited by 179
Training Object Class Detectors from Eye Tracking Data
Papadopoulos, D. P., Clarke, A. D. F., Keller, F., & Ferrari, V. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10602-1_24 · Cited by 160
A virtual environment and model of the eye for surgical simulation
Sagar, M. A., Bullivant, D., Mallinson, G. D., & Hunter, P. J. (1994) · Proceedings of the 21st annual conference on Computer graphics and interactive techniques - SIGGRAPH '94 · doi:10.1145/192161.192200 · Cited by 160
Look me in the Eyes: A Survey of Eye and Gaze Animation for Virtual Agents and Artificial Systems
Ruhland, K., Andrist, S., Badler, J. B., Peters, C., Badler, N. I., Gleicher, M. L., Mutlu, B., & McDonnell, R. (2014) · HAL · doi:10.2312/egst.20141036 · Cited by 88
Manifold Alignment for Person Independent Appearance-Based Gaze Estimation
Schneider, T., Schauerte, B., & Stiefelhagen, R. (2014) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2014.210 · Cited by 83
Bérard, P., Bradley, D., Nitti, M., Beeler, T., & Groß, M. H. (2014) · ACM Transactions on Graphics · doi:10.1145/2661229.2661285 · Cited by 81
Relevant Feature Selection for Human Pose Estimation and Localization in Cluttered Images
Okada, R., & Soatto, S. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-88688-4_32 · Cited by 79
Evaluation of image features using a photorealistic virtual world
Kaneva, B., Torralba, A. B., & Freeman, W. T. (2011) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2011.6126508 · Cited by 73
Effect of illumination on automatic expression recognition: A novel 3D relightable facial database
Stratou, G., Ghosh, A., Debevec, P. E., & Morency, L. (2011) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2011.5771467 · Cited by 69
Rendering synthetic ground truth images for eye tracker evaluation
Świrski, L., & Dodgson, N. A. (2014) · ACM Symposium on Eye Tracking Research and Applications (ETRA) · doi:10.1145/2578153.2578188 · Cited by 60
Prediction of search targets from fixations in open-world settings
Sattar, H., Muller, S., Fritz, M., & Bulling, A. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298700 · Cited by 50
Self-citationPrediction of Search Targets From Fixations in Open-World Settings
Sattar, H., Müller, S., Fritz, M., & Bulling, A. (2015) · Cited by 39
Self-citationOrvalho, V., Bastos, P., Parke, F., Oliveira, B., & Alvarez, X. (2012) · The Eurographics Association · doi:10.2312/conf/eg2012/stars/183-204 · Cited by 38
Neural network-based symbol recognition using a few labeled samples
Fu, L., & Kara, L. B. (2011) · Computers & Graphics · doi:10.1016/j.cag.2011.07.001 · Cited by 18
Improving person detection using synthetic training data
Yu, J., Farin, D., Kruger, C., et al. (2010) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2010.5650143 · Cited by 16
Cited by
Openface 2.0: facial behavior analysis toolkit
Baltrusaitis, T., Zadeh, A., Lim, Y. C., & Morency, L.-P. (2018) · 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018) · doi:10.1109/fg.2018.00019 · Cited by 1,861
OpenFace: An open source facial behavior analysis toolkit
Baltrusaitis, T., Robinson, P., & Morency, L.-P. (2016) · 2016 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2016.7477553 · Cited by 1,747
Self-citationMPIIGaze: Real-World Dataset and Deep Appearance-Based Gaze Estimation
Zhang, X., Sugano, Y., Fritz, M., & Bulling, A. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2778103 · Cited by 588
Self-citationIt’s Written All Over Your Face: Full-Face Appearance-Based Gaze Estimation
Zhang, X., Sugano, Y., Fritz, M., & Bulling, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.284 · Cited by 496
Self-citationSynthetic Data for Deep Learning
Nikolenko, S. I. (2021) · Springer Optimization and Its Applications · doi:10.1007/978-3-030-75178-4 · Cited by 423
Metadata
- Authors
- Wood, E., Baltruaitis, T., Zhang, X., Sugano, Y., Robinson, P., & Bulling, A.
- Venue
- 2015 IEEE International Conference on Computer Vision (ICCV)
- Publisher
- IEEE
- Published
- 2015-12
- Pages
- 3756-3764
- OpenAlex
- W1769933788
- Cited by
- 308
- References
- 35
- FWCI
- 9.01
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.