The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Gaze360: Physically Unconstrained Gaze Estimation in the Wild
Open accessAbstract
Understanding where people are looking is an informative social cue. In this work, we present Gaze360, a large-scale remote gaze-tracking dataset and method for robust 3D gaze estimation in unconstrained images. Our dataset consists of 238 subjects in indoor and outdoor environments with labelled 3D gaze across a wide range of head poses and distances. It is the largest publicly available dataset of its kind by both subject and variety, made possible by a simple and efficient collection method. Our proposed 3D gaze model extends existing models to include temporal information and to directly output an estimate of gaze uncertainty. We demonstrate the benefits of our model via an ablation study, and show its generalization performance via a cross-dataset evaluation against other recent gaze benchmark datasets. We furthermore propose a simple self-supervised approach to improve cross-dataset domain adaptation. Finally, we demonstrate an application of our model for estimating customer attention in a supermarket setting. Our dataset and models will be made available at http://gaze360.csail.mit.edu.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Realtime Multi-person 2D Pose Estimation Using Part Affinity Fields
Cao, Z., Simon, T., Wei, S.-E., & Sheikh, Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.143 · Cited by 7,539 · cited 2×
“As evidenced by the success of 2D body and face tracking models in the wild [2], to improve in-the-wild robustness it is important to collect data with a large number of different subjects, large variation in natural illumination and a wide range of head poses and gaze directions.”
BackgroundAdversarial Discriminative Domain Adaptation
Tzeng, E., Hoffman, J., Saenko, K., & Darrell, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.316 · Cited by 5,154
Koenker, R. (2005) · Cambridge University Press eBooks · doi:10.1017/cbo9780511754098 · Cited by 4,551
Wei, S.-E., Ramakrishna, V., Kanade, T., & Sheikh, Y. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.511 · Cited by 2,966
RMPE: Regional Multi-person Pose Estimation
Fang, H.-S., Xie, S., Tai, Y.-W., & Lu, C. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.256 · Cited by 1,884
DensePose: Dense Human Pose Estimation in the Wild.
Güler, R. A., Neverova, N., & Kokkinos, I. (2018) · UCL Discovery (University College London) · Cited by 1,421
Temporal Relational Reasoning in Videos
Zhou, B., Andonian, A., Oliva, A., & Torralba, A. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01246-5_49 · Cited by 1,067
Self-citationBidirectional LSTM Networks for Improved Phoneme Classification and Recognition
Graves, A., Fernández, S., & Schmidhuber, J. (2005) · Lecture Notes in Computer Science · doi:10.1007/11550907_126 · Cited by 925
Krafka, K., Khosla, A., Kellnhofer, P., Kannan, H., Bhandarkar, S., Matusik, W., & Torralba, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.239 · Cited by 917
Self-citationAprilTag 2: Efficient and robust fiducial detection
Wang, J., & Olson, E. (2016) · 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2016.7759617 · Cited by 822
Appearance-based gaze estimation in the wild
Zhang, X., Sugano, Y., Fritz, M., & Bulling, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299081 · Cited by 763
Hu, P., & Ramanan, D. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.166 · Cited by 705
MPIIGaze: Real-World Dataset and Deep Appearance-Based Gaze Estimation
Zhang, X., Sugano, Y., Fritz, M., & Bulling, A. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2778103 · Cited by 588
It’s Written All Over Your Face: Full-Face Appearance-Based Gaze Estimation
Zhang, X., Sugano, Y., Fritz, M., & Bulling, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.284 · Cited by 496
Appearance-Based Gaze Estimation in the Wild
Zhang, X., Sugano, Y., Fritz, M., & Bulling, A. (2015) · Cited by 418
RT-GENE: Real-Time Eye Gaze Estimation in Natural Environments
Fischer, T., Chang, H. J., & Demiris, Y. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01249-6_21 · Cited by 388
Gaze locking: passive eye contact detection for human-object interaction
Smith, B. A., Yin, Q., Feiner, S. K., & Nayar, S. K. (2013) · Proceedings of the 26th annual ACM symposium on User interface software and technology · doi:10.1145/2501988.2501994 · Cited by 327
MultiPoseNet: Fast Multi-Person Pose Estimation Using Pose Residual Network
Kocabas, M., Karagoz, S., & Akbas, E. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01252-6_26 · Cited by 314
DensePose: Dense Human Pose Estimation in the Wild
Guler, R. A., Neverova, N., & Kokkinos, I. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00762 · Cited by 290
TurkerGaze: Crowdsourcing Saliency with Webcam based Eye Tracking
Xu, P., Ehinger, K. A., Zhang, Y., Finkelstein, A., Kulkarni, S. R., & Xiao, J. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.06755 · Cited by 234
A single camera eye-gaze tracking system with free head motion
Hennessey, C., Noureddin, B., & Lawrence, P. (2006) · Proceedings of the 2006 symposium on Eye tracking research & applications - ETRA '06 · doi:10.1145/1117309.1117349 · Cited by 217
Social cognition in the first year
Striano, T., & Reid, V. M. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.08.006 · Cited by 197
Huang, Q., Veeraraghavan, A., & Sabharwal, A. (2017) · Machine Vision and Applications · doi:10.1007/s00138-017-0852-4 · Cited by 175
Eye Gaze Tracking under Natural Head Movements
Zhu, Z., & Ji, Q. (2005) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2005.148 · Cited by 158
Monocular Free-Head 3D Gaze Tracking with Deep Learning and Geometry Constraints
Deng, H., & Zhu, W. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.341 · Cited by 136
Palinko, O., Rea, F., Sandini, G., & Sciutti, A. (2016) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2016.7759741 · Cited by 113
Seeing with Humans: Gaze-Assisted Neural Image Captioning
Sugano, Y., & Bulling, A. (2016) · arXiv · doi:10.48550/arxiv.1608.05203 · Cited by 47
Cited by
Ego4D: Around the World in 3,000 Hours of Egocentric Video
Grauman, K., Westbury, A., Byrne, E., Chavis, Z., Furnari, A., Girdhar, R., Hamburger, J., Jiang, H., Liu, M., Liu, X., et al. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01842 · Cited by 630
Self-citationETH-XGaze: A Large Scale Dataset for Gaze Estimation Under Extreme Head Pose and Gaze Variation
Zhang, X., Park, S., Beeler, T., Bradley, D., Tang, S., & Hilliges, O. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58558-7_22 · Cited by 315
Strazdas, D., Hintz, J., Khalifa, A., Abdelrahman, A. A., Hempel, T., & Al-Hamadi, A. (2022) · Sensors · doi:10.3390/s22030923 · Cited by 53
Metadata
- Authors
- Kellnhofer, P., Recasens, A., Stent, S., Matusik, W., & Torralba, A.
- Venue
- 2019 IEEE/CVF International Conference on Computer Vision (ICCV)
- Publisher
- IEEE
- Published
- 2019-10
- Pages
- 6911-6920
- OpenAlex
- W2981785948
- Cited by
- 470
- References
- 29
- FWCI
- 23.24
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.