The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Gaze locking: passive eye contact detection for human-object interaction
Abstract
Eye contact plays a crucial role in our everyday social interactions. The ability of a device to reliably detect when a person is looking at it can lead to powerful human-object interfaces. Today, most gaze-based interactive systems rely on gaze tracking technology. Unfortunately, current gaze tracking techniques require active infrared illumination, calibration, or are sensitive to distance and pose. In this work, we propose a different solution-a passive, appearance-based approach for sensing eye contact in an image. By focusing on gaze *locking* rather than gaze tracking, we exploit the special appearance of direct eye gaze, achieving a Matthews correlation coefficient (MCC) of over 0.83 at long distances (up to 18 m) and large pose variations (up to ±30° of head yaw rotation) using a very basic classifier and without calibration. To train our detector, we also created a large publicly available gaze data set: 5,880 images of 56 people over varying gaze directions and head poses. We demonstrate how our method facilitates human-object interaction, user analytics, image filtering, and gaze-triggered photography.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918
Comparison of the predicted and observed secondary structure of T4 phage lysozyme
Matthews, B. W. (1975) · Biochimica et Biophysica Acta (BBA) - Protein Structure · doi:10.1016/0005-2795(75)90109-9 · Cited by 5,399 · cited 2×
“We again use the Matthews correlation coefficient (MCC) [22] to represent accuracy since it is widely used in machine learning for assessing binary classification performance with uneven class sizes.”
MethodFace recognition using eigenfaces
Turk, M. A., & Pentland, A. P. (2002) · Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1991.139758 · Cited by 5,197
Human photoreceptor topography
Curcio, C. A., Sloan, K. R., Kalina, R. E., & Hendrickson, A. E. (1990) · Journal of Comparative Neurology · doi:10.1002/cne.902920402 · Cited by 3,167
Some functions of gaze-direction in social interaction
Kendon, A. (1967) · Acta Psychologica · doi:10.1016/0001-6918(67)90005-4 · Cited by 2,508
Eye-Contact, Distance and Affiliation
Argyle, M., & Dean, J. (1965) · Sociometry · doi:10.2307/2786027 · Cited by 1,779
In the Eye of the Beholder: A Survey of Models for Eyes and Gaze
Hansen, D. W., & Ji, Q. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.30 · Cited by 1,546
“Put-that-there”: Voice and gesture at the graphics interface
Bolt, R. A. (1980) · Proceedings of the 7th annual conference on Computer graphics and interactive techniques - SIGGRAPH '80 · doi:10.1145/800250.807503 · Cited by 1,445
Department of Computer Science
(1993) · Journal of Computational and Applied Mathematics · doi:10.1016/0377-0427(93)90083-n · Cited by 1,210
Contrast Thresholds of the Human Eye
Blackwell, H. R. (1946) · Journal of the Optical Society of America · doi:10.1364/josa.36.000624 · Cited by 869
Eye gaze tracking techniques for interactive applications
Morimoto, C. H., & Mimica, M. R. M. (2005) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2004.07.010 · Cited by 745
Manual and gaze input cascaded (MAGIC) pointing
Zhai, S., Morimoto, C., & Ihde, S. (1999) · Proceedings of the SIGCHI conference on Human factors in computing systems the CHI is the limit - CHI '99 · doi:10.1145/302979.303053 · Cited by 680
Eye gaze patterns in conversations: there is more to conversational agents than meets the eyes
Vertegaal, R., Slagter, R., van der Veer, G., & Nijholt, A. (2001) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/365024.365119 · Cited by 415
Pupil detection and tracking using multiple light sources
Morimoto, C. H., Koons, D., Amir, A., & Flickner, M. (2000) · Image and Vision Computing · doi:10.1016/s0262-8856(99)00053-0 · Cited by 401
Perception of Another Person's Looking Behavior
Gibson, J. J., & Pick, A. D. (1963) · The American Journal of Psychology · doi:10.2307/1419779 · Cited by 396
Non-Intrusive Gaze Tracking Using Artificial Neural Networks
Baluja, S., & Pomerleau, D. (1993) · Cited by 307
Eye gaze tracking using an active stereo head
Beymer, D., & Flickner, M. (2003) · 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings. · doi:10.1109/cvpr.2003.1211502 · Cited by 244
Appearance-based eye gaze estimation
Tan, K.-H., Kriegman, D. J., & Ahuja, N. (2003) · Sixth IEEE Workshop on Applications of Computer Vision, 2002. (WACV 2002). Proceedings. · doi:10.1109/acv.2002.1182180 · Cited by 241
Hansen, D. W., & Pece, A. E. C. (2005) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2004.07.013 · Cited by 235
The Perception of Where a Person Is Looking
Cline, M. G. (1967) · The American Journal of Psychology · doi:10.2307/1420539 · Cited by 202
Are you looking at me? Measuring the cone of gaze.
Gamer, M., & Hecht, H. (2007) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/0096-1523.33.3.705 · Cited by 181
Detecting eye contact using wearable eye-tracking glasses
Ye, Z., Li, Y., Fathi, A., Han, Y., Rozga, A., Abowd, G. D., & Rehg, J. M. (2012) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2370216.2370368 · Cited by 137
Leveraging the asymmetric sensitivity of eye contact for videoconference
Chen, M. (2002) · ACM SIGCHI Conference on Human Factors in Computing Systems (CHI) · doi:10.1145/503376.503386 · Cited by 136
Vertegaal, R. (2003) · Communications of the ACM · doi:10.1145/636772.636794 · Cited by 124
What are you looking at? Acuity for triadic eye gaze.
Symons, L. A., Lee, K., Cedrone, C. C., & Nishimura, M. (2004) · PubMed · Cited by 120
ViewPointer: lightweight calibration-free eye tracking for ubiquitous handsfree deixis
Smith, J. D., Vertegaal, R., & Sohn, C. (2005) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/1095034.1095043 · Cited by 64
Attentive user interfaces: the surveillance and sousveillance of gaze-aware objects
Vertegaal, R., & Shell, J. S. (2008) · Social Science Information · doi:10.1177/0539018408092574 · Cited by 36
Shell, J. S., Vertegaal, R., Cheng, D., Skaburskis, A. W., Sohn, C., Stewart, A. J., Aoudeh, O., & Dickie, C. (2004) · ACM Symposium on Eye Tracking Research and Applications (ETRA) · doi:10.1145/968363.968384 · Cited by 34
Cited by
Krafka, K., Khosla, A., Kellnhofer, P., Kannan, H., Bhandarkar, S., Matusik, W., & Torralba, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.239 · Cited by 917
Appearance-based gaze estimation in the wild
Zhang, X., Sugano, Y., Fritz, M., & Bulling, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299081 · Cited by 763
MPIIGaze: Real-World Dataset and Deep Appearance-Based Gaze Estimation
Zhang, X., Sugano, Y., Fritz, M., & Bulling, A. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2778103 · Cited by 588
It’s Written All Over Your Face: Full-Face Appearance-Based Gaze Estimation
Zhang, X., Sugano, Y., Fritz, M., & Bulling, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.284 · Cited by 496
Gaze360: Physically Unconstrained Gaze Estimation in the Wild
Kellnhofer, P., Recasens, A., Stent, S., Matusik, W., & Torralba, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00701 · Cited by 470
Metadata
- Authors
- Smith, B. A., Yin, Q., Feiner, S. K., & Nayar, S. K.
- Venue
- Proceedings of the 26th annual ACM symposium on User interface software and technology
- Publisher
- ACM
- Published
- 2013-10-08
- Pages
- 271-280
- OpenAlex
- W1988798713
- Cited by
- 327
- References
- 28
- FWCI
- 9.49
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.