LightGuide: projected visualizations for hand movement guidance
The DOI matches its Crossref record; 33 of the 34 references it cites were found in a registry or an index.
Abstract
LightGuide is a system that explores a new approach to gesture guidance where we project guidance hints directly on a user's body. These projected hints guide the user in completing the desired motion with their body part which is particularly useful for performing movements that require accuracy and proper technique, such as during exercise or physical therapy. Our proof-of-concept implementation consists of a single low-cost depth camera and projector and we present four novel interaction techniques that are focused on guiding a user's hand in mid-air. Our visualizations are designed to incorporate both feedback and feedforward cues to help guide users through a range of movements. We quantify the performance of LightGuide in a user study comparing each of our on-body visualizations to hand animation videos on a computer display in both time and accuracy. Exceeding our expectations, participants performed movements with an average error of 21.6mm, nearly 85% more accurately than when guided by video.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The papers collectively suggest that Pick-to-Light visual guidance systems can be effective in various applications.”
From Poka Yoke in Smart Production Systems with Pick-to-Light Implementation to Increase Efficiency (2023) · cites this paper as [14]
Citations
Cites
Journal of personality and social psychology
Armstrong, J. S. (1988) · International Journal of Forecasting · doi:10.1016/0169-2070(88)90126-4 · Cited by 10,485
Iterative point matching for registration of free-form curves and surfaces
Zhang, Z. (1994) · International Journal of Computer Vision · doi:10.1007/bf01427149 · Cited by 2,402 · cited 1×
“To help analyze shape, we use the Iterative Closest Point (ICP) algorithm to register the user’s movements to our model paths [34].”
MethodModel-based object pose in 25 lines of code
Dementhon, D. F., & Davis, L. S. (1995) · International Journal of Computer Vision · doi:10.1007/bf01450852 · Cited by 1,009 · cited 1×
“Once we establish correspondences between the 2D points of the projector and the 3D points of the camera, we use the POSIT algorithm [7] to find the position and orientation of the projector.”
MethodKnowledge-based augmented reality
Feiner, S., Macintyre, B., & Seligmann, D. (1993) · Communications of the ACM · doi:10.1145/159544.159587 · Cited by 972 · cited 1×
“Task Guidance in Augmented Reality The field of Augmented Reality (AR) has shown a number of methods to provide guidance by using head-mounted displays or mobile devices to convey instructions that are superimposed on virtual or real world video feeds [1,8].”
BackgroundRaskar, R., Welch, G., Cutts, M., Lake, A., Stesin, L., & Fuchs, H. (1998) · Proceedings of the 25th annual conference on Computer graphics and interactive techniques - SIGGRAPH '98 · doi:10.1145/280814.280861 · Cited by 833 · cited 1×
“Augmenting Environments with Projectors Recent advancements in projection technology have made it possible to imbue user’s environments with projection capabilities [24,26,27,33].”
BackgroundSkinput: appropriating the body as an input surface
Harrison, C., Tan, D., & Morris, D. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753394 · Cited by 694
OmniTouch: wearable multitouch interaction everywhere
Harrison, C., Benko, H., & Wilson, A. D. (2011) · Proceedings of the 24th annual ACM symposium on User interface software and technology · doi:10.1145/2047196.2047255 · Cited by 562 · cited 4×
“To ensure that the visual hints do not move off of the user’s hand, we followed the same procedure as [12] in which we compute a derivative map of the depth image to check for large changes in the boundaries at the contours of the hand.”
BackgroundMethodResultInfluentialSelf-citationDistance Transforms of Sampled Functions
Felzenszwalb, P. F., & Huttenlocher, D. P. (2004) · eCommons (Cornell University) · Cited by 397
WUW - wear Ur world: a wearable gestural interface
Mistry, P., Maes, P., & Chang, L. (2009) · CHI '09 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/1520340.1520626 · Cited by 372
Shader Lamps: Animating Real Objects With Image-Based Illumination
Raskar, R., Welch, G., Low, K., & Bandyopadhyay, D. (2001) · doi:10.2312/egwr/egwr01/089-101 · Cited by 327
Research works printed but not linked: 1
- 10.5555/647653.732300 · doi:10.5555/647653.732300
Cited by
A Systematic Review of 10 Years of Augmented Reality Usability Studies: 2005 to 2014
Dey, A., Billinghurst, M., Lindeman, R. W., & Swan, J. E. (2018) · Frontiers in Robotics and AI · doi:10.3389/frobt.2018.00037 · Cited by 434
YouMove: enhancing movement training with an augmented reality mirror
Anderson, F., Grossman, T., Matejka, J., & Fitzmaurice, G. (2013) · Proceedings of the 26th annual ACM symposium on User interface software and technology · doi:10.1145/2501988.2502045 · Cited by 315
“LightGuide used on-body projections to guide a user’s hand through 3D space [31].”
MethodMemorability of pre-designed and user-defined gesture sets
Nacenta, M. A., Kamber, Y., Qiang, Y., & Kristensson, P. O. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2466142 · Cited by 285
AIREAL: interactive tactile experiences in free air
Sodhi, R., Poupyrev, I., Glisson, M., & Israr, A. (2013) · ACM Transactions on Graphics · doi:10.1145/2461912.2462007 · Cited by 276
Self-citationAugmented reality tools for sports education and training
Soltani, P., & Morice, A. H. P. (2020) · Computers & Education · doi:10.1016/j.compedu.2020.103923 · Cited by 195
“Sodhi et al. (2012) created a real-time guiding system that projected the hints directly on the users’ hands.”
BackgroundStrikeAPose: revealing mid-air gestures on public displays
Walter, R., Bailly, G., & Müller, J. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2470774 · Cited by 171
“Only LightGuide [30] has been proposed in the context of mid-air gestures by projecting guidance hints directly onto the user’s hands.”
BackgroundThoravi Kumaravel, B., Anderson, F., Fitzmaurice, G., Hartmann, B., & Grossman, T. (2019) · Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3332165.3347872 · Cited by 168
“Within the HCI community, researchers have leveraged novel interfaces such as AR, VR and other modalities to guide or teach physical skills and activities [1, 13, 43, 48, 51].”
BackgroundRecent Advances in Projection Mapping Algorithms, Hardware and Applications
Grundhöfer, A., & Iwai, D. (2018) · Computer Graphics Forum · doi:10.1111/cgf.13387 · Cited by 124
“Hand augmentation was also applied to visually guide a hand movement [SBW12].”
MethodPhysio@Home: Exploring Visual Guidance and Feedback Techniques for Physiotherapy Exercises
Tang, R., Yang, X.-D., Bateman, S., Jorge, J., & Tang, A. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702401 · Cited by 122
“Table 1: Summary of guidance characteristics than relying on the interaction surface as the output space for the feedback, LightGuide [21] projects guidance on”
BackgroundSteerable augmented reality with the beamatron
Wilson, A. D., Benko, H., Izadi, S., & Hilliges, O. (2012) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/2380116.2380169 · Cited by 101
“Finally, LightGuide [29] demonstrates the use of projected graphics in the hand to guide the user to perform a particular motion in three dimensions.”
MethodSelf-citationArchitecture-scale human-assisted additive manufacturing
Yoshida, H., Igarashi, T., Obuchi, Y., Takami, Y., Sato, J., Araki, M., Miki, M., Nagata, K., Sakai, K., & Igarashi, S. (2015) · ACM Transactions on Graphics · doi:10.1145/2766951 · Cited by 94
Gurevich, P., Lanir, J., & Cohen, B. (2015) · Computer Supported Cooperative Work (CSCW) · doi:10.1007/s10606-015-9232-7 · Cited by 81
“Similarly, In Lightguide (Sodhi et al. 2012), user’s hands were tracked and automatic instructions were projected on top of the hands, mainly for the purpose of movement guidance such as in exercise or physical therapy.”
BackgroundPervasive Displays: Understanding the Future of Digital Signage
Davies, N., Clinch, S., & Alt, F. (2014) · Synthesis lectures on mobile and pervasive computing · doi:10.2200/s00558ed1v01y201312mpc011 · Cited by 110
TransceiVR: Bridging Asymmetrical Communication Between VR Users and External Collaborators
Kumaravel, B. T., Nguyen, C., DiVerdi, S., & Hartmann, B. (2020) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3379337.3415827 · Cited by 103
An Exploratory Study of Augmented Reality Presence for Tutoring Machine Tasks
Cao, Y., Qian, X., Wang, T., Lee, R., Huo, K., & Ramani, K. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376688 · Cited by 84
How to Communicate Robot Motion Intent: A Scoping Review
Pascher, M., Gruenefeld, U., Schneegaß, S., & Gerken, J. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580857 · Cited by 116
SleeveAR: Augmented Reality for Rehabilitation using Realtime Feedback
Sousa, M., Vieira, J., Medeiros, D., Arsenio, A. M., & Jorge, J. A. (2016) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/2856767.2856773 · Cited by 74
My Tai-Chi coaches: an augmented-learning tool for practicing Tai-Chi Chuan
Han, P.-H., Chen, Y.-S., Zhong, Y., Wang, H.-L., & Hung, Y. (2017) · Augmented Human International Conference · doi:10.1145/3041164.3041194 · Cited by 70
“LightGuide [13] and SleeveAR [8] also show the potential of projector-based guiding system can guide the user hand movement.”
BackgroundKumaravel, B. T., Nguyen, C., DiVerdi, S., & Hartmann, B. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300514 · Cited by 55
“Tutorial system for VR/AR Tutorial systems designed for VR and AR environments primarily focus on harnessing spatial tracking and feedback to help users learn motor tasks [3, 24, 36, 40, 42].”
Xiao, R., Cao, T., Guo, N., Zhuo, J., Zhang, Y., & Harrison, C. (2018) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173669 · Cited by 53
“In the HCI literature, LightSpace [48], LightGuide [42] and Armura [15] all used overhead setups to enable a variety of on-body projected interactions.”
BackgroundAR-Arm: Augmented Visualization for Guiding Arm Movement in the First-Person Perspective
Han, P.-H., Chen, K., Hsieh, C.-H., Huang, Y., & Hung, Y. (2016) · Augmented Human International Conference · doi:10.1145/2875194.2875237 · Cited by 52
“Also, AR systems are used in training [6, 7, 8] or guiding hand movement [9].”
BackgroundMethodWinkler, C., Seifert, J., Dobbelstein, D., & Rukzio, E. (2014) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2557365 · Cited by 53
“Previous works [10, 9, 23] have demonstrated that various interactions can be performed in people’s hands.”
BackgroundGannon, M., Grossman, T., & Fitzmaurice, G. W. (2016) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858576 · Cited by 48
“Projection-based skin interfaces have also been explored as a method to spatially guide the movement of a user [33], as well as a way of overlaying medical information directly on patients [26].”
MethodKosmalla, F., Daiber, F., Wiehr, F., & Krüger, A. (2017) · ACM International Conference on Interactive Surfaces and Spaces (ISS) · doi:10.1145/3132272.3134119 · Cited by 48
Projection-Based AR: Effective Visual Feedback in Gait Rehabilitation
Sekhavat, Y. A., & Namani, M. S. (2018) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2018.2860579 · Cited by 55
“In light-guide [23], a depth-sensor camera and a projector are used to project information on the hands of a user.”
BackgroundLafreniere, B. J., Grossman, T., Anderson, F., Matejka, J., Kerrick, H., Nagy, D., Vasey, L., Atherton, E., Beirne, N., Coelho, M., et al. (2016) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/2984511.2984553 · Cited by 52
“Overall, we believe the use of visual guidance mechanisms is extremely important for this type of system, but it is worth exploring alternative mechanisms for providing this guidance, such as external projection [29, 42], or augmented reality techniques [20, 50].”
BackgroundAn adaptive framework for the creation of exergames for intangible cultural heritage (ICH) education
Grammatikopoulou, A., Laraba, S., Sahbenderoglu, O., Dimitropoulos, K., Douka, S., & Grammalidis, N. (2018) · Journal of Computers in Education · doi:10.1007/s40692-018-0115-z · Cited by 45
“Sodhi et al. (2012) proposed the LightGuide system using on-body projections to guide a user’s hand through 3D space.”
MethodJo, H.-Y., Seidel, L., Pahud, M., Sinclair, M., & Bianchi, A. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580897 · Cited by 54
“problem, researchers proposed interfaces based on movable [46] or projected displays [35, 60].”
BackgroundOwnership and control of point of view in remote assistance
Lanir, J., Stone, R., Cohen, B., & Gurevich, P. (2013) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2481309 · Cited by 41
“In Lightguide [25], user’s hands were tracked and instructions were projected on top of the hands, mainly for the purpose of movement guidance such as in exercise or physical therapy.”
BackgroundDesigning 3D Gesture Guidance: Visual Feedback and Feedforward Design Options
Delamare, W., Janssoone, T., Coutrix, C., & Nigay, L. (2016) · International Conference on Advanced Visual Interfaces (AVI) · doi:10.1145/2909132.2909260 · Cited by 48
“Other examples include gestures that are presented one by one to users using on-screen videos [8,10] or animations [23].”
BackgroundMethodInfluentialPerspective Matters: Design Implications for Motion Guidance in Mixed Reality
Yu, X., Angerbauer, K., Mohr, P., Kalkofen, D., & Sedlmair, M. (2020) · Proceedings - International Symposium on Mixed and Augmented Reality, ISMAR · doi:10.1109/ismar50242.2020.00085 · Cited by 42
“Due to the inability to visualize movement depth, traditional display techniques like TVs [37] and projectors [34, 35] can only visualize a movement trajectory on surfaces, which is likely not suitable for in-air 6-DOF motions.”
BackgroundDesigning guiding systems for gesture-based interaction
Delamare, W., Coutrix, C., & Nigay, L. (2015) · Engineering Interactive Computing System · doi:10.1145/2774225.2774847 · Cited by 44
“If the user deviates from the intended trajectory while being guided by the Follow Spot [27], the system will guide the hand according to the projection option.”
BackgroundMethodInfluentialPocket6: A 6DoF Controller Based On A Simple Smartphone Application
Babic, T., Reiterer, H., & Haller, M. (2018) · Symposium on Spatial User Interaction · doi:10.1145/3267782.3267785 · Cited by 46
Using Feedforward to Reveal Interaction Possibilities in Virtual Reality
Muresan, A., McIntosh, J., & Hornbæk, K. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3603623 · Cited by 54
“Users of LightGuide had similar issues with projected visualizations [78].”
BackgroundInfluentialUser-defined Interface Gestures: Dataset and Analysis
Grijincu, D., Nacenta, M. A., & Kristensson, P. O. (2014) · ACM International Conference on Interactive Tabletops and Surfaces (ITS) · doi:10.1145/2669485.2669511 · Cited by 33
Conveying spatial awareness cues in xR collaborations
Irlitti, A., Piumsomboon, T., Jackson, D., & Thomas, B. H. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2019.2932173 · Cited by 33
“The key concept for this quadrant is the design consideration to provide all information within the local space, such as the wedge [1], the master direction cue [38], or LightGuide [40].”
BackgroundAugmented Reality for Rehabilitation Using Multimodal Feedback
Vieira, J., Sousa, M., Arsenio, A. M., & Jorge, J. A. (2015) · Workshop on ICTs for improving Patients Rehabilitation Research Techniques (REHAB) · doi:10.1145/2838944.2838954 · Cited by 28
“LightGuide [5] does not rely on interactive mirrors or screens to apply its visual feedback.”
BackgroundButz, B., Jussen, A., Rafi, A., Lux, G., & Gerken, J. (2022) · Healthcare · doi:10.3390/healthcare10040646 · Cited by 36
Roumen, T. J., Kruck, B., Dürschmid, T., Nack, T., & Baudisch, P. (2016) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/2984511.2984586 · Cited by 27
“LightGuide [31] projects directly on users’ hands, instructing them what to do.”
BackgroundFreeman, E., Vo, D.-B., & Brewster, S. A. (2019) · IEEE World Haptics Conference (WHC) · doi:10.1109/whc.2019.8816092 · Cited by 26
“Different haptic technologies also cover a broad range ( mm [6], cm [2], [3], or m [4], [9]), requiring different hand positions to feel strong feedback.”
BackgroundGuideband: Intuitive 3d multilevel force guidance on a wristband in virtual reality.
Tsai, H.-R., Chang, Y.-C., Wei, T.-Y., Tsao, C.-A., Koo, X. C.-Y., Wang, H.-C., & Chen, B.-Y. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445262 · Cited by 25
“Previous studies leverage visual feedback for guidance or remote assistance [36, 40, 47, 48, 55], but the limited field of view (FoV), occlusion problem, or viewing angle limitation are the potential restrictions.”
BackgroundVermeulen, J., Luyten, K., Coninx, K., Marquardt, N., & Bird, J. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-22723-8_22 · Cited by 25
“LightGuide [28] uses a projector and depth cameras to project visualizations on”
MethodOctoPocus in VR: Using a Dynamic Guide for 3D Mid-Air Gestures in Virtual Reality
Fennedy, K., Hartmann, J., Roy, Q., Perrault, S. T., & Vogel, D. (2021) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2021.3101854 · Cited by 29
“For instance, a SAR setting could rely on multiple 2D planes like surrounding walls and floors to simulate 3D, or on-body projections like LightGuide [13] to render dynamic feedforward for multiple gestures simultaneously.”
BackgroundInfluentialGestu-Wan - An Intelligible Mid-Air Gesture Guidance System for Walk-up-and-Use Displays
Rovelo, G., Degraen, D., Vanacken, D., Luyten, K., & Coninx, K. (2015) · IFIP TC13 International Conference on Human-Computer Interaction · doi:10.1007/978-3-319-22668-2_28 · Cited by 27
“Some notable examples that we will discuss in this section are LightGuide [15], YouMove [2], and StrikeAPose [20].”
Juggling the Effects of Latency
Knibbe, J., Benko, H., & Wilson, A. D. (2015) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/2815585.2815735 · Cited by 23
“However, latency is a problem for the experience; constraining movement speeds [6] or resulting in image misalignment, as can be seen in the video for [1].”
BackgroundMethodSelf-citationDürr, M., Weber, R., Pfeil, U., & Reiterer, H. (2020) · International Conference on Tangible, Embedded, and Embodied Interaction (TEI) · doi:10.1145/3374920.3374945 · Cited by 25
“But, how should egocentric guidance visualizations look and behave? Existing research found benefits for the use of superimposed egocentric guidance visualizations in contrast to the use of common resources like videos to support the learning and conduct of movements [10, 22].”
InfluentialCorrection of Avatar Hand Movements Supports Learning of a Motor Skill
Lilija, K., Kyllingsbæk, S., & Hornbæk, K. (2021) · IEEE Conference on Virtual Reality and 3D User Interfaces (VR) · doi:10.1109/vr50410.2021.00069 · Cited by 23
“LightGuide projected visualizations on users’ real hands to guide their movement [22].”
BackgroundObject-based touch manipulation for remote guidance of physical tasks
Adcock, M., Ranatunga, D., Smith, R., & Thomas, B. H. (2014) · ACM Symposium on Spatial User Interaction (SUI) · doi:10.1145/2659766.2659768 · Cited by 22
“LightGuide is a system that projected guidance cues onto a moving hand to follow a particular path [29].”
BackgroundTang, R., Alizadeh, H., Tang, A., Bateman, S., & Jorge, J. A. (2014) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/2559206.2581197 · Cited by 22
“Physiotherapy is a post-injury rehabilitation activity that promotes good health, physical well-being and Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or…”
BackgroundInteractive and Situated Guidelines to Help Users Design a Personal Desk that Fits Their Bodies
Lee, B., Shin, J., Bae, H., & Saakes, D. P. (2018) · Designing Interactive Systems Conference · doi:10.1145/3196709.3196725 · Cited by 23
“Other systems employ augmented reality to annotate the real world with instructions or feedback on motion [17, 52, 54].”
BackgroundPoka Yoke in Smart Production Systems with Pick-to-Light Implementation to Increase Efficiency
Trojanowska, J., Husár, J., Hrehova, S., & Knapčíková, L. (2023) · Applied Sciences · doi:10.3390/app132111715 · Cited by 23
“Sodhi [14] presents LightGuide, a system that projects guidance hints directly on a user’s body to guide hand movements with high accuracy.”
BackgroundDesigning a gaze gesture guiding system
Delamare, W., Han, T., & Irani, P. (2017) · International Conference on Human-Computer Interaction with Mobile Devices and Services · doi:10.1145/3098279.3098561 · Cited by 22
“For instance, the 3D Follow Arrow condition of LightGuide projects a 3D arrow onto the hand [43].”
BackgroundavaTTAR: Table Tennis Stroke Training with Embodied and Detached Visualization in Augmented Reality
Ma, D., Hu, X., Shi, J., Patel, M., Jain, R., Liu, Z., Zhu, Z., & Ramani, K. (2024) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3654777.3676400 · Cited by 37
“According to [75], based on the level of indirection there are three types of motion guidance visualization which are explicit (e.g. YouMove [1]), implicit (e.g. SleeveAR [61]), and abstract (e.g. LightGuide [59]).”
Visualization of off-surface 3D viewpoint locations in spatial augmented reality
Adcock, M., Feng, D. D., & Thomas, B. H. (2013) · Symposium on Spatial User Interaction · doi:10.1145/2491367.2491378 · Cited by 21
“LightGuide: projected visualizations for hand movement guidance.”
BackgroundInfluentialXia, C., Fang, X., Arakawa, R., & Sugiura, Y. (2022) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3534576 · Cited by 25
Design Space of Visual Feedforward And Corrective Feedback in XR-Based Motion Guidance Systems
Yu, X., Lee, B., & Sedlmair, M. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642143 · Cited by 19
Kim, M., & Lee, J. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300625 · Cited by 20
“In addition, several researchers projected hints using a variety of graphical representations directly on a user’s body to guide a user to complete the desired movement and gesture [7, 34].”
BackgroundPrecueing Object Placement and Orientation for Manual Tasks in Augmented Reality
Liu, J.-S., Tversky, B., & Feiner, S. (2022) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2022.3203111 · Cited by 17
“Sodhi et al. [33] project cues directly on a user’s hand.”
BackgroundHigh-Speed Dynamic Projection Mapping onto Human Arm with Realistic Skin Deformation
Peng, H.-L., & Watanabe, Y. (2021) · Applied Sciences · doi:10.3390/app11093753 · Cited by 21
Cao, Y., Fusté, A., & Heun, V. (2022) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3491101.3519639 · Cited by 16
“Numerous research works have attempted to apply 2D video with AR interfaces for spatially situated tutoring and skill training, including projecting video tutorials onto a nearby physical surface [13, 23, 25, 41, 45–47], or a floating virtual canvas [9, 21, 29, 36, 51, 54].”
BackgroundProviding Assistance for Orienting 3D Objects Using Monocular Eyewear
Sukan, M., Elvezio, C., Feiner, S., & Tversky, B. (2016) · Symposium on Spatial User Interaction · doi:10.1145/2983310.2985764 · Cited by 16
“Sodhi et al. [22] guide a user in translating a single hand using a 3 D arrow, a 3 D path, or colored regions indicating movement direction projected directly on the user’s hand.”
MethodJeanne, F., Thouvenin, I., & Lenglet, A. (2017) · ACM Symposium on Virtual Reality Software and Technology (VRST) · doi:10.1145/3139131.3139144 · Cited by 21
“Likewise, Sodhi et al. proposed AR visual cues for hand movement guidance [Sodhi et al. 2012].”
BackgroundAuda, J., Busse, L., Pfeuffer, K., Gruenefeld, U., Rivu, R., Alt, F., & Schneegaß, S. (2021) · Symposium on Spatial User Interaction · doi:10.1145/3485279.3485287 · Cited by 15
“Others have explored how hand gestures and sketches can be integrated in collaboration scenarios [18, 49].”
BackgroundPoster: 3D referencing for remote task assistance in augmented reality
Oda, O., Sukan, M., Feiner, S., & Tversky, B. (2013) · IEEE Symposium on 3D User Interfaces (3DUI) · doi:10.1109/3dui.2013.6550237 · Cited by 15
Exploring Visualizations for Precisely Guiding Bare Hand Gestures in Virtual Reality
Wang, X., Lafreniere, B., & Zhao, J. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642935 · Cited by 14
“We then invited them to participate in a co-design session to explore potential visual guidance and criticize three initial visualization designs that were inspired by some visualizations in previous studies [11, 43, 49] using mock-ups and sketches (Figure 1).”
BackgroundMethodCasper DPM: Cascaded Perceptual Dynamic Projection Mapping onto Hands
Erel, Y., Kozlovsky-Mordenfeld, O., Iwai, D., Sato, K., & Bermano, A. H. (2024) · SIGGRAPH Asia Conference Papers · doi:10.1145/3680528.3687624 · Cited by 14
“Early attempts to perform projection mapping onto human hands began to appear with the emergence of new depth sensors and advances in classical computer vision techniques [Harrison et al. 2011; Mistry and Maes 2009; Sodhi et al. 2012; Yamamoto and Sato 2007].”
Ihara, K., Monteiro, K., Faridan, M., Kazi, R. H., & Suzuki, R. (2025) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3708359.3712159 · Cited by 14
Wei, W., Lu, Y., Rhoden, E., & Dey, S. (2017) · Multimedia Tools and Applications · doi:10.1007/s11042-017-5278-5 · Cited by 14
“LightGuide [28] projects guidance hints directly on a user’s body to guide the user in completing the desired motion.”
Applying Vision-Based Pose Estimation in a Telerehabilitation Application
Rosique, F., Losilla, F., & Navarro, P. (2021) · Applied Sciences · doi:10.3390/app11199132 · Cited by 19
“In this sense, we can find works such as [15–17], where they make use of the Microsoft Kinect sensors [18] of the Xbox console.”
MethodAugmented Reality for Rehabilitative Therapy: Patient experiences and Practitioner perspectives
Williams, A., Alikhademi, K., Drobina, E., Gilbert, J. E., & Sutor, T. W. (2019) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1071181319631140 · Cited by 14
“Embodied feedback, such as the combination of tactile feedback with visual information projected onto the body (Sodhi et al., 2012; Vieira et al., 2015), may be more effective than the mirror approaches common in most work.”
MethodUnderstanding Perspectives for Single- and Multi-Limb Movement Guidance in Virtual 3D Environments
Elsayed, H., Kartono, K., Schön, D., Schmitz, M., Mühlhäuser, M., & Weigel, M. (2022) · ACM Symposium on Virtual Reality Software and Technology (VRST) · doi:10.1145/3562939.3565635 · Cited by 12
“Our work extends prior work on posture [2, 9, 12], path [6, 16, 21], and movement guidance [5, 7, 13].”
BackgroundAlt, F., Geiger, S., & Höhl, W. (2018) · ACM International Symposium on Pervasive Displays (PerDis) · doi:10.1145/3205873.3205887 · Cited by 12
“[22] proposed LightGuide, a dynamic guide for mid-air hand gestures.”
BackgroundInfluentialStudying the Visual Representation of Microgestures
Lambert, V., Caillet, A. C., Goguey, A., Malacria, S., & Nigay, L. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3604272 · Cited by 12
“Inspired by LightGuide [58] and Physio@Home [61] we chose to use an in-context approach and mapped our visual cues directly onto the participant’s hand as visible on Figure 9 In addition and as opposed to the previous study, we also verify that our representations are correctly interpreted by the participants before a…”
Design principles of hand gesture interfaces for microinteractions
Golod, I., Heidrich, F., Möllering, C., & Ziefle, M. (2013) · Conference on Designing Pleasurable Products and Interfaces (DPPI) · doi:10.1145/2513506.2513508 · Cited by 12
“Other self-revealing techniques use the visualization of possible gesture completion paths: on-surface [4, 14] or mid-air [49].”
BackgroundMethodHigh-speed transition patterns for video projection, 3D reconstruction, and copyright protection
Boisvert, J., Drouin, M.-A., & Jodoin, P. (2014) · Pattern Recognition · doi:10.1016/j.patcog.2014.06.001 · Cited by 11
“An infrared 3D reconstruction system similar to the Kinect could also be used to reconstruct the scene in the context of augmented reality applications [9,22,24,12].”
MethodChacon, D. A., Velloso, E., Hoang, T. N., & Wolf, K. (2019) · International Conference on Tangible, Embedded, and Embodied Interaction (TEI) · doi:10.1145/3294109.3295626 · Cited by 11
“For instance, in LightGuide [27], which projects images on users hands to guide them actively through specific motion activities.”
BackgroundUsing Artificial Vision for Measuring the Range of Motion
Rosique, F., Losilla, F., & Navarro, P. (2021) · IEEE Latin America Transactions · doi:10.1109/tla.2021.9461841 · Cited by 10
“En algunos de ellos [5] – [7], han adoptado dispositivos y tecnologías propias de las videoconsolas para gestionar la estimación de la postura humana.”
BackgroundSpatial augmented reality to enhance physical artistic creation
Laviole, J., & Hachet, M. (2012) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/2380296.2380316 · Cited by 10
“In [10], a similar idea is explored: the projection guides the user’s movement by projecting on the user’s hand.”
BackgroundLim, Z. H., & Kristensson, P. O. (2019) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/3338286.3340127 · Cited by 10
Gesture-based guidance for navigation in virtual environments
Rehman, I. U., Ullah, S., Ali, N., Rabbi, I., & Khan, R. U. (2022) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-022-00395-1 · Cited by 11
“Some studies used upcoming gestures’ portions for gesture guidance [49,50].”
BackgroundUnderstanding and supporting modality choices
Jameson, A., & Kristensson, P. O. (2017) · ACM eBooks · doi:10.1145/3015783.3015790 · Cited by 10
EBAGG: Error-Based Assistance for Gesture Guidance in Virtual Environments
Jeanne, F., Soullard, Y., Oker, A., & Thouvenin, I. (2017) · IEEE International Conference on Advanced Learning Technologies (ICALT) · doi:10.1109/icalt.2017.32 · Cited by 9
“For hand movement guidance, Sodhi et al. [10] projected AR guidance hints on users’ body.”
BackgroundHamanishi, N., & Rekimoto, J. (2020) · Augmented Humans International Conference (AHs) · doi:10.1145/3384657.3384658 · Cited by 10
“Our work is re-lated to research projects focusing on rehabilitation and motor skill learning and movement guidance [2, 11, 12, 32–34].”
MethodAudioMove: Applying the Spatial Audio to Multi-Directional Limb Exercise Guidance
Xia, C., Min, T., & Sugiura, Y. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3676489 · Cited by 11
“For example, the multiple perspectives in Physio@Home [74], instructive sign [11], and arrow information in LightGuide [70].”
LightPaintAR: Assist Light Painting Photography with Augmented Reality
Wang, T., Qian, X., He, F., & Karthik Ramani, A. (2021) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3411763.3451672 · Cited by 8
“More importantly, users can leverage AR contents as spatial reference [3, 9] and perform predefined body movement by following the AR guidance [6, 17].”
BackgroundMixed-reality human-machine-interface for motor learning of physical activities
Gutierrez, S. F. C., Luces, J. V. S., & Hirata, Y. (2022) · Advanced Robotics · doi:10.1080/01691864.2022.2076569 · Cited by 9
Dynamic-Interaction UI/UX Design for the AREIS
Park, H. S., Kim, H. W., & Park, C.-J. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-39516-6_39 · Cited by 8
Zhu, H., & Vidal, L. T. (2021) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3411763.3451676 · Cited by 8
“ecution on body alignment [36] and performing movements that require accurate technique [32].”
MethodTowards object based manipulation in remote guidance
Ranatunga, D., Feng, D. D., Adcock, M., & Thomas, B. H. (2013) · Proceedings - International Symposium on Mixed and Augmented Reality, ISMAR · doi:10.1109/ismar.2013.6671839 · Cited by 8
“LightGuide is a system that projected guidance cues onto a moving hand to follow a particular path [11].”
BackgroundStillness Moves: Exploring Body Weight-Transfer Learning in Physical Training for Tai-Chi Exercise
Lin, H., Han, P.-H., Lu, K.-Y., Sun, C.-H., Lee, P.-Y., Yao, F.-J., Lee, A. M. S., Sun, W.-Z., & Hung, Y.-P. (2018) · MMSports@MM · doi:10.1145/3265845.3265856 · Cited by 8
“Several research projects provided guidance along with correction feedback [5, 8, 9, 11, 18]: real-time feedback can help users fix their errors immediately, and summary feedback allow users to see systemic errors in their performances and their process of improvement, which could be encouraging…”
BackgroundExploring Cross-Modal Training via Touch to Learn a Mid-Air Marking Menu Gesture Set
Henderson, J., Mizobuchi, S., Li, W., & Lank, E. (2019) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/3338286.3340119 · Cited by 8
Ambient Gesture-Recognizing Surfaces with Visual Feedback
Große-Puppendahl, T., Beck, S., Wilbers, D., Zeiß, S., von Wilmsdorff, J., & Kuijper, A. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-07788-8_10 · Cited by 7
“The authors of [13] project a visual feedback directly on the user’s body.”
BackgroundAssisting viewpoint to understand own posture as an avatar in-situation
Hamanishi, N., Miyaki, T., & Rekimoto, J. (2019) · International HCI and UX Conference in Indonesia (CHIuXiD) · doi:10.1145/3328243.3328244 · Cited by 7
VirtualLadder: Using Interactive Projections for Agility Ladder Training
Kosmalla, F., Hupperich, F., Hirsch, A., Daiber, F., & Krüger, A. (2021) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3411763.3451638 · Cited by 8
“Similarily, Sodhi et al. compared diferent visualizations projected directly on the participants hand to guide them through several movements [25].”
BackgroundCameraReady: Assessing the Influence of Display Types and Visualizations on Posture Guidance
Elsayed, H., Hoffmann, P. P., Günther, S., Schmitz, M., Weigel, M., Mühlhäuser, M., & Müller, F. (2021) · Designing Interactive Systems Conference · doi:10.1145/3461778.3462026 · Cited by 7
“Use-cases range from physiotherapy [35], sports [16, 18, 38] and dance training [8, 29] to learning gestures for interaction [6, 32, 40].”
BackgroundTowards the design of augmented feedforward and feedback for sensorimotor learning of motor skills
Kritopoulou, P., Manitsaris, S., & Moutarde, F. (2016) · International Conference on Movement and Computing (MOCO) · doi:10.1145/2948910.2948959 · Cited by 8
“are projected on the limbs of the user, a technique proposed by the LightGuide system [11], with acoustic tones and vibrations, the strive to achieve fruitful instruct ion, proceeds.”
MethodRevealable Volume Displays: 3D Exploration of Mixed-Reality Public Exhibitions
Guefrech, F. B., Berthaut, F., Plénacoste, P., Peter, Y., & Grisoni, L. (2021) · IEEE Conference on Virtual Reality and 3D User Interfaces (VR) · doi:10.1109/vr50410.2021.00023 · Cited by 6
“[32] explore how on-body projected visual hints could be used for movement guidance.”
BackgroundRevgest: Augmenting Gestural Musical Instruments With Revealed Virtual Objects
Berthaut, F., Arslan, C., & Grisoni, L. (2017) · HAL · doi:10.5281/zenodo.1176212 · Cited by 6
Runtime Generation and Delivery of Guidance for Smart Object Ensembles
Burmeister, D., & Schräder, A. (2018) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-94866-9_29 · Cited by 5
ViRgilites: Multilevel Feedforward for Multimodal Interaction in VR
Artizzu, V., Luyten, K., Ruiz, G. A. R., & Spano, L. D. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3658645 · Cited by 9
Metadata
- Authors
- Sodhi, R., Benko, H., & Wilson, A.
- Affiliations
- University of Illinois Urbana-Champaign (US)
- Microsoft (United States) (US)
- Venue
- Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2012-05-05
- Pages
- 179-188
- OpenAlex
- W2120860586
- Semantic Scholar
- 1473939a714d2ff5e9ab925e69fd2e1037fd5d83
- Cited by
- 144
- References
- 34
- Citations by year
- 2026: 4 · 2025: 7 · 2024: 8 · 2023: 7 · 2022: 10 · 2021: 13 · 2020: 9 · 2019: 16 · 2018: 11 · 2017: 11 · 2016: 12 · 2015: 13 · 2014: 9 · 2013: 11 · 2012: 3
- FWCI
- 8.09
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- Funders
- Microsoft Research
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Interactive and Immersive Displays
- Physical Sciences › Computer Science › Human-Computer Interaction › Hand Gesture Recognition Systems
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Augmented Reality Applications
- Keywords
- physiotherapy, physical activity, movement accuracy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.