User-Defined Gestures for Gestural Interaction: Extending from Hands to Other Body Parts
Abstract
Most gestural interaction studies on gesture elicitation have focused on hand gestures, and few have considered the involvement of other body parts. Moreover, most of the relevant studies used the frequency of the proposed gesture as the main index, and the participants were not familiar with the design space. In this study, we developed a gesture set that includes hand and non-hand gestures by combining the indices of gesture frequency, subjective ratings, and physiological risk ratings. We first collected candidate gestures in Experiment 1 through a user-defined method by requiring participants to perform gestures of their choice for 15 most commonly used commands, without any body part limitations. In Experiment 2, a new group of participants evaluated the representative gestures obtained in Experiment 1. We finally obtained a gesture set that included gestures made with the hands and other body parts. Three user characteristics were exhibited in this set: a preference for one-handed movements, a preference for gestures with social meaning, and a preference for dynamic gestures over static gestures.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Functionalized CNTs can be used as diagnostic instruments for early identification of cancer.
“As diagnostic instruments for the early identification of cancer, functionalized CNTs can also be used.116”
From Smart nanoparticles for cancer therapy (2023) · cites this paper as [116]
Cites
Hand and mind: what gestures reveal about thought
(1993) · Choice Reviews Online · doi:10.5860/choice.30-2492 · Cited by 5,090 · see citing works
Engineering Psychology and Human Performance
Wickens, C. D., Hollands, J. G., Banbury, S. P., & Parasuraman, R. (2015) · Psychology Press eBooks · doi:10.4324/9781315665177 · Cited by 4,998 · see citing works
IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use
Lewis, J. R. (1995) · International Journal of Human-Computer Interaction · doi:10.1080/10447319509526110 · Cited by 2,429 · see citing works
Rapid entire body assessment (REBA)
Hignett, S., & McAtamney, L. (2000) · Applied Ergonomics · doi:10.1016/s0003-6870(99)00039-3 · Cited by 2,260 · cited 1× · see citing works
“Because this study allowed participants to make full-body gestures, we used Rapid Entire Body Assessment (REBA; Hignett & McAtamney, 2000) to evaluate the potential physiological risk embedded in the proposed posture.”
MethodHand and Mind: What Gestures Reveal about Thought
Feyereisen, P., & McNeill, D. M. (1994) · The American Journal of Psychology · doi:10.2307/1423299 · Cited by 1,713 · see citing works
User-defined gestures for surface computing
Wobbrock, J. O., Morris, M. R., & Wilson, A. D. (2009) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518866 · Cited by 1,339 · see citing works
Alvarez, G. A., & Cavanagh, P. (2004) · Psychological Science · doi:10.1111/j.0963-7214.2004.01502006.x · Cited by 1,330 · see citing works
Analysis of the Accuracy and Robustness of the Leap Motion Controller
Weichert, F., Bachmann, D., Rudak, B., & Fisseler, D. (2013) · Sensors · doi:10.3390/s130506380 · Cited by 913 · see citing works
Preece, J. J., Rogers, Y., & Sharp, H. (2002) · Cited by 887 · see citing works
Psychometric Evaluation of the PSSUQ Using Data from Five Years of Usability Studies
Lewis, J. R. (2002) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2002.9669130 · Cited by 626 · see citing works
Accuracy of the Microsoft Kinect sensor for measuring movement in people with Parkinson's disease
Galna, B., Barry, G., Jackson, D., Mhiripiri, D., Olivier, P. L., & Rochester, L. (2014) · Gait & Posture · doi:10.1016/j.gaitpost.2014.01.008 · Cited by 536 · see citing works
Natural user interfaces are not natural
Norman, D. A. (2010) · interactions · doi:10.1145/1744161.1744163 · Cited by 479 · see citing works
Baudel, T., & Beaudouin-Lafon, M. (1993) · Communications of the ACM · doi:10.1145/159544.159562 · Cited by 474 · see citing works
Distant freehand pointing and clicking on very large, high resolution displays
Vogel, D., & Balakrishnan, R. (2005) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/1095034.1095041 · Cited by 432 · see citing works
Maximizing the guessability of symbolic input
Wobbrock, J. O., Aung, H. H., Rothrock, B., & Myers, B. A. (2005) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/1056808.1057043 · Cited by 418 · see citing works
A Procedure for Developing Intuitive and Ergonomic Gesture Interfaces for HCI
Nielsen, M., Störring, M., Moeslund, T. B., & Granum, E. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-24598-8_38 · Cited by 346 · see citing works
Human Computing and Machine Understanding of Human Behavior: A Survey
Pantić, M., Pentland, A., Nijholt, A., & Huang, T. S. (2007) · Springer eBooks · doi:10.1007/978-3-540-72348-6_3 · Cited by 318 · see citing works
Memorability of pre-designed and user-defined gesture sets
Nacenta, M. A., Kamber, Y., Qiang, Y., & Kristensson, P. O. (2013) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2466142 · Cited by 292 · see citing works
Reducing legacy bias in gesture elicitation studies
Morris, M. R., Danielescu, A., Drucker, S. M., Fisher, D., Lee, B., schraefel, M. C., & Wobbrock, J. O. (2014) · interactions · doi:10.1145/2591689 · Cited by 254 · see citing works
Formalizing Agreement Analysis for Elicitation Studies
Vatavu, R.-D., & Wobbrock, J. O. (2015) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702223 · Cited by 245 · see citing works
User-defined gestures for free-hand TV control
Vatavu, R.-D. (2012) · European Conference on Interactive TV and Video (EuroITV) · doi:10.1145/2325616.2325626 · Cited by 220 · see citing works
Design and evaluation of menu systems for immersive virtual environments
Bowman, D. A., & Wingrave, C. A. (2002) · IEEE Virtual Reality (VR) · doi:10.1109/vr.2001.913781 · Cited by 212 · see citing works
Norman, D. A., & Nielsen, J. (2010) · interactions · doi:10.1145/1836216.1836228 · Cited by 208 · see citing works
I'm home: Defining and evaluating a gesture set for smart-home control
Kühnel, C., Westermann, T., Hemmert, F., et al. (2011) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2011.04.005 · Cited by 186 · see citing works
Using Kinect™ sensor in observational methods for assessing postures at work
Diego-Más, J. A., & Alcaide-Marzal, J. (2013) · Applied Ergonomics · doi:10.1016/j.apergo.2013.12.001 · Cited by 180 · see citing works
Correlates of user satisfaction with end user computing
Igbaria, M., & Nachman, S. A. (1990) · Information & Management · doi:10.1016/0378-7206(90)90017-c · Cited by 179 · see citing works
Validity of the Microsoft Kinect for providing lateral trunk lean feedback during gait retraining
Clark, R. A., Pua, Y., Bryant, A. L., & Hunt, M. A. (2013) · Gait & Posture · doi:10.1016/j.gaitpost.2013.03.029 · Cited by 177 · see citing works
Schmitz, A., Ye, M., Shapiro, R., Yang, R., & Noehren, B. W. (2013) · Journal of Biomechanics · doi:10.1016/j.jbiomech.2013.11.031 · Cited by 163 · see citing works
User-Defined Gestures for Augmented Reality
Piumsomboon, T., Clark, A., Billinghurst, M., et al. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-40480-1_18 · Cited by 131 · see citing works
Vatavu, R.-D., & Zaiţi, I.-A. (2014) · ACM International Conference on Interactive Experiences for TV and Online Video · doi:10.1145/2602299.2602316 · Cited by 111 · see citing works
On free-hand TV control: experimental results on user-elicited gestures with Leap Motion
Zaiţi, I.-A., Pentiuc, Š. G., & Vatavu, R.-D. (2015) · Personal and Ubiquitous Computing · doi:10.1007/s00779-015-0863-y · Cited by 106 · see citing works
User-Defined Game Input for Smart Glasses in Public Space
Tung, Y.-C., Hsu, C., Wang, H.-Y., et al. (2015) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702214 · Cited by 100 · see citing works
Suitability of Kinect for measuring whole body movement patterns during exergaming
van Diest, M., Stegenga, J., Wörtche, H. J., et al. (2014) · Journal of Biomechanics · doi:10.1016/j.jbiomech.2014.07.017 · Cited by 96 · see citing works
Accuracy of Kinect’s skeleton tracking for upper body rehabilitation applications
Mobini, A., Behzadipour, S., & Foumani, M. S. (2013) · Disability and Rehabilitation Assistive Technology · doi:10.3109/17483107.2013.805825 · Cited by 84 · see citing works
Storing fine detailed information in visual working memory--Evidence from event-related potentials
Gao, Z., Li, J., Liang, J., Chen, H., Yin, J., & Shen, M. (2009) · Journal of Vision · doi:10.1167/9.7.17 · Cited by 81 · see citing works
Self-citationPatrizi, A., Pennestrı̀, E., & Valentini, P. P. (2015) · Ergonomics · doi:10.1080/00140139.2015.1057238 · Cited by 78 · see citing works
Body-centric interaction techniques for very large wall displays
Shoemaker, G. B. D., Tsukitani, T., Kitamura, Y., & Booth, K. S. (2010) · Nordic Conference on Human-Computer Interaction · doi:10.1145/1868914.1868967 · Cited by 76 · see citing works
Designing Mid-Air TV Gestures for Blind People Using User- and Choice-Based Elicitation Approaches
Dim, N. K., Silpasuwanchai, C., Sarcar, S., & Ren, X. (2016) · Designing Interactive Systems Conference · doi:10.1145/2901790.2901834 · Cited by 62 · see citing works
A User-Developed 3-D Hand Gesture Set for Human–Computer Interaction
Pereira, A., Wachs, J. P., Park, K., et al. (2014) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720814559307 · Cited by 60 · see citing works
Designing concurrent full-body gestures for intense gameplay
Silpasuwanchai, C., & Ren, X. (2015) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2015.02.010 · Cited by 56 · see citing works
User-Defined Body Gestures for Navigational Control of a Humanoid Robot
Obaid, M., Häring, M., Kistler, F., et al. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-34103-8_37 · Cited by 43 · see citing works
Touchless Interaction-Novel Chances and Challenges
de la Barré, R., Chojecki, P., Leiner, U., et al. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-02577-8_18 · Cited by 40 · see citing works
The accuracy of the Microsoft Kinect in joint angle measurement
Choppin, S. B., Lane, B., & Wheat, J. S. (2014) · Sports Technology · doi:10.1080/19346182.2014.968165 · Cited by 37 · see citing works
3D Gesture Recognition: An Evaluation of User and System Performance
Wright, M., Lin, C.-J., O'Neill, E. J., et al. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-21726-5_19 · Cited by 20 · see citing works
Choi, E., Kwon, S., Lee, D., et al. (2012) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1071181312561222 · Cited by 14 · see citing works
An Empirical Study on the Interaction Capability of Arm Stretching
Tian, F., Lyu, F., Zhang, X., et al. (2016) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2016.1265782 · Cited by 12 · see citing works
Design of Bare-hand Gestures for Object Manipulation in Virtual Reality
Wu, H. (2013) · Journal of Information and Computational Science · doi:10.12733/jics20102747 · Cited by 5 · see citing works
Human Factor Studies on Gestural Interaction:Past,Present,and Future
Xiao-yu, P. (2014) · Yingyong xinlixue · Cited by 5 · see citing works
Control with Hand Gestures in Home Environment: A Review
Liang, S. M. (2013) · Springer eBooks · doi:10.1007/978-981-4451-98-7_100 · Cited by 4 · see citing works
Yang-fa, Z. (2014) · Yingyong xinlixue · Cited by 2 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Smart nanoparticles for cancer therapy
Sun, L., Liu, H., Ye, Y., Lei, Y., Islam, R., Tan, S., Tong, R., Miao, Y.-B., & Cai, L. (2023) · Signal Transduction and Targeted Therapy · doi:10.1038/s41392-023-01642-x · Cited by 1,073 · see citing works
- Authors
- Chen, Z., Ma, X., Peng, Z., Zhou, Y., Yao, M., Ma, Z., Wang, C., Gao, Z., & Shen, M.
- Affiliations
- Zhejiang University (CN)
- Corresponding author
- Shen, Mowei
- Venue
- International Journal of Human–Computer Interaction
- Publisher
- Informa UK Limited
- Published
- 2017-08-30
- Volume
- 34
- Issue
- 3
- Pages
- 238-250
- ISSN
- 1044-7318 (ISSN-L)
- 1532-7590
- OpenAlex
- W2660336915
- Cited by
- 57
- References
- 50
- Citations by year
- 2026: 1 · 2025: 5 · 2024: 6 · 2023: 7 · 2022: 8 · 2021: 8 · 2020: 9 · 2019: 7 · 2018: 6
- FWCI
- 7.44
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- International Journal of Human-Computer Interaction (publishedVersion)
- Funders
- Project of Ministry of Science and Technology of the People's Republic of China (2016YFE0130400)
- National Natural Science Foundation of China (31271089)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Interactive and Immersive Displays
- Physical Sciences › Computer Science › Human-Computer Interaction › Hand Gesture Recognition Systems
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- user-defined gestures, gesture-based interaction, gesture elicitation, gesture frequency, subjective ratings
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review