The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Gaze + pinch interaction in virtual reality
Abstract
Virtual reality affords experimentation with human abilities beyond what's possible in the real world, toward novel senses of interaction. In many interactions, the eyes naturally point at objects of interest while the hands skilfully manipulate in 3D space. We explore a particular combination for virtual reality, the Gaze + Pinch interaction technique. It integrates eye gaze to select targets, and indirect freehand gestures to manipulate them. This keeps the gesture use intuitive like direct physical manipulation, but the gesture's effect can be applied to any object the user looks at --- whether located near or far. In this paper, we describe novel interaction concepts and an experimental system prototype that bring together interaction technique variants, menu interfaces, and applications into one unified virtual experience. Proof-of-concept application examples were developed and informally tested, such as 3D manipulation, scene navigation, and image zooming, illustrating a range of advanced interaction capabilities on targets at any distance, without relying on extra controller devices.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2013) · Encyclopedia of Creativity, Invention, Innovation and Entrepreneurship · doi:10.1007/978-1-4614-3858-8_100431 · Cited by 4,799
Asymmetric Division of Labor in Human Skilled Bimanual Action: The Kinematic Chain as a Model
Guiard, Y. (1987) · Journal of Motor Behavior · doi:10.1080/00222895.1987.10735426 · Cited by 1,134 · cited 2×
“This combination of UI and interaction technique takes advantage of the following concepts: • Asynchronous bimanual interaction [11]: the nonpreferred hand sets the spatial frame for precise interactions of the preferred hand.”
BackgroundVirtual reality on a WIM: interactive worlds in miniature
Stoakley, R., Conway, M. J., & Pausch, R. (1995) · Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '95 · doi:10.1145/223904.223938 · Cited by 909
The go-go interaction technique: non-linear mapping for direct manipulation in VR
Poupyrev, I., Billinghurst, M., Weghorst, S., & Ichikawa, T. (1996) · Proceedings of the 9th annual ACM symposium on User interface software and technology - UIST '96 · doi:10.1145/237091.237102 · Cited by 872 · cited 4×
“Poupyrev et al’s Go-go interaction technique [32] uses a non-linear mapping function to extend the user’s area of reach — but keeps a linear mapping when interacting with nearby objects.”
MethodInfluentialBowman, D. A., & Hodges, L. F. (1997) · Proceedings of the 1997 symposium on Interactive 3D graphics - SI3D '97 · doi:10.1145/253284.253301 · Cited by 714
What you look at is what you get: eye movement-based interaction techniques
Jacob, R. J. K. (1990) · Proceedings of the SIGCHI conference on Human factors in computing systems Empowering people - CHI '90 · doi:10.1145/97243.97246 · Cited by 712
Manual and gaze input cascaded (MAGIC) pointing
Zhai, S., Morimoto, C., & Ihde, S. (1999) · Proceedings of the SIGCHI conference on Human factors in computing systems the CHI is the limit - CHI '99 · doi:10.1145/302979.303053 · Cited by 680
Moving objects in space: exploiting proprioception in virtual-environment interaction
Mine, M. R., Brooks, F. P., & Sequin, C. H. (1997) · Proceedings of the 24th annual conference on Computer graphics and interactive techniques - SIGGRAPH '97 · doi:10.1145/258734.258747 · Cited by 677
Evaluation of eye gaze interaction
Sibert, L. E., & Jacob, R. J. K. (2000) · Proceedings of the SIGCHI conference on Human Factors in Computing Systems · doi:10.1145/332040.332445 · Cited by 539
Image plane interaction techniques in 3D immersive environments
Pierce, J. S., Forsberg, A. S., Conway, M. J., Hong, S., Zeleznik, R. C., & Mine, M. R. (1997) · Proceedings of the 1997 symposium on Interactive 3D graphics - SI3D '97 · doi:10.1145/253284.253303 · Cited by 427
An evaluation of an eye tracker as a device for computer input2
Ware, C., & Mikaelian, H. H. (1986) · Proceedings of the SIGCHI/GI Conference on Human Factors in Computing Systems and Graphics Interface · doi:10.1145/29933.275627 · Cited by 382
JDCAD: A highly interactive 3D modeling system
Liang, J., & Green, M. (1994) · Computers & Graphics · doi:10.1016/0097-8493(94)90062-0 · Cited by 364
A survey of design issues in spatial input
Hinckley, K., Pausch, R., Goble, J. C., & Kassell, N. F. (1994) · Proceedings of the 7th annual ACM symposium on User interface software and technology - UIST '94 · doi:10.1145/192426.192501 · Cited by 360
Poupyrev, I., Ichikawa, T., Weghorst, S., & Billinghurst, M. (1998) · Computer Graphics Forum · doi:10.1111/1467-8659.00252 · Cited by 353
User learning and performance with marking menus
Kurtenbach, G., & Buxton, W. (1994) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/191666.191759 · Cited by 340
Rapid controlled movement through a virtual 3D workspace
Mackinlay, J. D., Card, S. K., & Robertson, G. G. (1990) · Proceedings of the 17th annual conference on Computer graphics and interactive techniques · doi:10.1145/97879.97898 · Cited by 316
Interacting with eye movements in virtual environments
Tanriverdi, V., & Jacob, R. J. K. (2000) · Proceedings of the SIGCHI conference on Human Factors in Computing Systems · doi:10.1145/332040.332443 · Cited by 276
Eye Movement-Based Human-Computer Interaction Techniques: Toward Non-Command Interfaces
Jacob, R. J. K. (2003) · Cited by 258
Toward Everyday Gaze Input: Accuracy and Precision of Eye Tracking and Implications for Design
Feit, A. M., Williams, S., Toledo, A., Paradiso, A., Kulkarni, H., Kane, S., & Morris, M. R. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025599 · Cited by 234
Testbed evaluation of virtual environment interaction techniques
Bowman, D. A., Johnson, D. B., & Hodges, L. F. (1999) · Proceedings of the ACM symposium on Virtual reality software and technology · doi:10.1145/323663.323667 · Cited by 223
Design and evaluation of menu systems for immersive virtual environments
Bowman, D. A., & Wingrave, C. A. (2002) · Proceedings IEEE Virtual Reality 2001 · doi:10.1109/vr.2001.913781 · Cited by 213
Exploring natural eye-gaze-based interaction for immersive virtual reality
Piumsomboon, T., Lee, G., Lindeman, R. W., & Billinghurst, M. (2017) · 2017 IEEE Symposium on 3D User Interfaces (3DUI) · doi:10.1109/3dui.2017.7893315 · Cited by 205
CHUNKING AND PHRASING AND THE DESIGN OF HUMAN-COMPUTER DIALOGUES
BUXTON, W. (1995) · Readings in Human–Computer Interaction · doi:10.1016/b978-0-08-051574-8.50051-0 · Cited by 199
Chatterjee, I., Xiao, R., & Harrison, C. (2015) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/2818346.2820752 · Cited by 134
Pfeuffer, K., Alexander, J., Chong, M. K., & Gellersen, H. W. (2014) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/2642918.2647397 · Cited by 118
Self-citationA Survey of Interaction Techniques for Interactive 3D Environments
Jankowski, J. A., & Hachet, M. (2012) · HAL · doi:10.2312/conf/eg2013/stars/065-093 · Cited by 115
Using Pinch Gloves(TM) for both Natural and Abstract Interaction Techniques in Virtual Environments
Bowman, D. A., Wingrave, C. A., Campbell, J. B., et al. (2001) · VTechWorks (Virginia Tech) · Cited by 114
Gaze-Shifting: Direct-Indirect Input with Pen and Touch Modulated by Gaze
Pfeuffer, K., Alexander, J., Chong, M. K., Zhang, Y., & Gellersen, H. W. (2015) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/2807442.2807460 · Cited by 100
Self-citationGaze and Touch Interaction on Tablets
Pfeuffer, K., & Gellersen, H. W. (2016) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/2984511.2984514 · Cited by 98
Self-citationAdvances in Human-Computer Interaction
(2008) · Advances in Human-Computer Interaction · doi:10.1155/ahci · Cited by 94
Investigating gaze-supported multimodal pan and zoom
Stellmach, S., & Dachselt, R. (2012) · ACM Symposium on Eye Tracking Research and Applications (ETRA) · doi:10.1145/2168556.2168636 · Cited by 48
Touching the Sphere: Leveraging Joint-Centered Kinespheres for Spatial User Interaction
Lubos, P., Bruder, G., Ariza, O., & Steinicke, F. (2016) · Symposium on Spatial User Interaction · doi:10.1145/2983310.2985753 · Cited by 45
An Empirical Investigation of Gaze Selection in Mid-Air Gestural 3D Manipulation
Velloso, E., Turner, J., Alexander, J., Bulling, A., & Gellersen, H. W. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-22668-2_25 · Cited by 41
Self-citationPartially-indirect Bimanual Input with Gaze, Pen, and Touch for Pan, Zoom, and Ink Interaction
Pfeuffer, K., Alexander, J., & Gellersen, H. W. (2016) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858201 · Cited by 41
Self-citationDeng, S., Jiang, N., Chang, J. M., Guo, S., & Zhang, J. (2017) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2017.04.002 · Cited by 36
Serim, B., & Jacucci, G. (2016) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858480 · Cited by 19
Cited by
Eye Tracking in Virtual Reality: a Broad Review of Applications and Challenges
Adhanom, I. B., MacNeilage, P., & Folmer, E. (2023) · Virtual Reality · doi:10.1007/s10055-022-00738-z · Cited by 325
Exploring Eye Gaze Visualization Techniques for Identifying Distracted Students in Educational VR
Rahman, Y., Asish, S. M., Fisher, N. P., Bruce, E. C., Kulshreshth, A. K., & Borst, C. W. (2020) · 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR) · doi:10.1109/vr46266.2020.00009 · Cited by 45
Natural interaction in virtual reality: impact on the cognitive load
Galais, T., Delmas, A., & Alonso, R. (2019) · Adjunct Proceedings of the 31st Conference on l'Interaction Homme-Machine · doi:10.1145/3366551.3370342 · Cited by 22
Elgohary, O., & Zhu-Tien (2025) · arXiv · doi:10.48550/arxiv.2509.05898 · Cited by 4
Metadata
- Authors
- Pfeuffer, K., Mayer, B., Mardanbegi, D., & Gellersen, H.
- Venue
- Proceedings of the 5th Symposium on Spatial User Interaction
- Publisher
- ACM
- Published
- 2017-10-16
- Pages
- 99-108
- OpenAlex
- W2764065835
- Cited by
- 331
- References
- 36
- FWCI
- 8.97
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.