LightGuide: projected visualizations for hand movement guidance
The DOI matches its Crossref record; 33 of the 34 references it cites were found in a registry or an index.
Abstract
LightGuide is a system that explores a new approach to gesture guidance where we project guidance hints directly on a user's body. These projected hints guide the user in completing the desired motion with their body part which is particularly useful for performing movements that require accuracy and proper technique, such as during exercise or physical therapy. Our proof-of-concept implementation consists of a single low-cost depth camera and projector and we present four novel interaction techniques that are focused on guiding a user's hand in mid-air. Our visualizations are designed to incorporate both feedback and feedforward cues to help guide users through a range of movements. We quantify the performance of LightGuide in a user study comparing each of our on-body visualizations to hand animation videos on a computer display in both time and accuracy. Exceeding our expectations, participants performed movements with an average error of 21.6mm, nearly 85% more accurately than when guided by video.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The papers collectively suggest that Pick-to-Light visual guidance systems can be effective in various applications.”
From Poka Yoke in Smart Production Systems with Pick-to-Light Implementation to Increase Efficiency (2023) · cites this paper as [14]
Citations
Cites
Journal of personality and social psychology
Armstrong, J. S. (1988) · International Journal of Forecasting · doi:10.1016/0169-2070(88)90126-4 · Cited by 10,485
Iterative point matching for registration of free-form curves and surfaces
Zhang, Z. (1994) · International Journal of Computer Vision · doi:10.1007/bf01427149 · Cited by 2,402 · cited 1×
“To help analyze shape, we use the Iterative Closest Point (ICP) algorithm to register the user’s movements to our model paths [34].”
MethodModel-based object pose in 25 lines of code
Dementhon, D. F., & Davis, L. S. (1995) · International Journal of Computer Vision · doi:10.1007/bf01450852 · Cited by 1,009 · cited 1×
“Once we establish correspondences between the 2D points of the projector and the 3D points of the camera, we use the POSIT algorithm [7] to find the position and orientation of the projector.”
MethodKnowledge-based augmented reality
Feiner, S., Macintyre, B., & Seligmann, D. (1993) · Communications of the ACM · doi:10.1145/159544.159587 · Cited by 972 · cited 1×
“Task Guidance in Augmented Reality The field of Augmented Reality (AR) has shown a number of methods to provide guidance by using head-mounted displays or mobile devices to convey instructions that are superimposed on virtual or real world video feeds [1,8].”
BackgroundRaskar, R., Welch, G., Cutts, M., Lake, A., Stesin, L., & Fuchs, H. (1998) · Proceedings of the 25th annual conference on Computer graphics and interactive techniques - SIGGRAPH '98 · doi:10.1145/280814.280861 · Cited by 833 · cited 1×
“Augmenting Environments with Projectors Recent advancements in projection technology have made it possible to imbue user’s environments with projection capabilities [24,26,27,33].”
BackgroundSkinput: appropriating the body as an input surface
Harrison, C., Tan, D., & Morris, D. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753394 · Cited by 694
OmniTouch: wearable multitouch interaction everywhere
Harrison, C., Benko, H., & Wilson, A. D. (2011) · Proceedings of the 24th annual ACM symposium on User interface software and technology · doi:10.1145/2047196.2047255 · Cited by 562 · cited 4×
“To ensure that the visual hints do not move off of the user’s hand, we followed the same procedure as [12] in which we compute a derivative map of the depth image to check for large changes in the boundaries at the contours of the hand.”
BackgroundMethodResultInfluentialSelf-citationDistance Transforms of Sampled Functions
Felzenszwalb, P. F., & Huttenlocher, D. P. (2004) · eCommons (Cornell University) · Cited by 397
WUW - wear Ur world: a wearable gestural interface
Mistry, P., Maes, P., & Chang, L. (2009) · CHI '09 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/1520340.1520626 · Cited by 372
Shader Lamps: Animating Real Objects With Image-Based Illumination
Raskar, R., Welch, G., Low, K., & Bandyopadhyay, D. (2001) · doi:10.2312/egwr/egwr01/089-101 · Cited by 327
Combining multiple depth cameras and projectors for interactions on, above and between surfaces
Wilson, A. D., & Benko, H. (2010) · Proceedings of the 23nd annual ACM symposium on User interface software and technology · doi:10.1145/1866029.1866073 · Cited by 316
Self-citationThe Everywhere Displays Projector: A Device to Create Ubiquitous Graphical Interfaces
Pinhanez, C. S. (2001) · Cited by 312
OctoPocus: a dynamic guide for learning gesture-based command sets
Bau, O., & Mackay, W. E. (2008) · Proceedings of the 21st annual ACM symposium on User interface software and technology · doi:10.1145/1449715.1449724 · Cited by 278 · cited 3×
“, [3]), or their error or deviation from the path, to name a few.”
BackgroundNeumann, U., & Majoros, A. (2002) · Proceedings. IEEE 1998 Virtual Reality Annual International Symposium (Cat. No.98CB36180) · doi:10.1109/vrais.1998.658416 · Cited by 274
Multi-user interaction using handheld projectors
Cao, X., Forlines, C., & Balakrishnan, R. (2007) · Proceedings of the 20th annual ACM symposium on User interface software and technology · doi:10.1145/1294211.1294220 · Cited by 181 · cited 1×
“In addition to body-worn projection systems, handheld [5,6] and head-mounted projectors [15] also allow users to be mobile, without requiring their environments to be permanently instrumented with projectors and cameras [18,20,25].”
BackgroundRFIG lamps: interacting with a self-describing world via photosensing wireless tags and projectors
Raskar, R., Beardsley, P., van Baar, J., Wang, Y., Dietz, P., Lee, J., Leigh, D., & Willwacher, T. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015738 · Cited by 171
Comparing remote gesture technologies for supporting collaborative physical tasks
Kirk, D. S., & Fraser, D. S. (2006) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1124772.1124951 · Cited by 149
Evaluating the effectiveness of augmented reality displays for a manual assembly task
Baird, K. M., & Barfield, W. (1999) · Virtual Reality · doi:10.1007/bf01421808 · Cited by 144 · cited 1×
“The field of Augmented Reality (AR) has shown a number of methods to provide guidance by using head-mounted displays or mobile devices to convey instructions that are superimposed on virtual or real world video feeds [1,8].”
BackgroundShadowGuides: visualizations for in-situ learning of multi-touch and whole-hand gestures
Freeman, D., Benko, H., Morris, M. R., & Wigdor, D. (2009) · Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces · doi:10.1145/1731903.1731935 · Cited by 138 · cited 2×
“As described in [3,11], the feedforward can come in the form of showing the user where to go next, a segment of the movement path ahead, or simply show the user the entire movement path.”
BackgroundSelf-citationInteracting with dynamically defined information spaces using a handheld projector and a pen
Cao, X. S., & Balakrishnan, R. (2006) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/1166253.1166289 · Cited by 116 · cited 2×
“Using a standard ANOVA, we found that there was a significant difference between our visual hints (F[5, 894] = 276.”
BackgroundMethodThe perceptual structure of multidimensional input device selection
Jacob, R. J. K., & Sibert, L. E. (1992) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/142750.142792 · Cited by 110
Kane, S. K., Avrahami, D., Wobbrock, J. O., Harrison, B. L., Rea, A. D., Philipose, M., & LaMarca, A. (2009) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/1622176.1622202 · Cited by 108
Flagg, M., & Rehg, J. M. (2006) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/1166253.1166290 · Cited by 91 · cited 1×
“Projection-Based Guidance The use of projection-based augmented reality AR for guiding users through tasks has been a research vision in recent years [10].”
BackgroundAn evaluation of animated demonstrations of learning computer-based tasks
Palmiter, S. L., & Elkerton, J. (1991) · doi:10.1145/108844.108906 · Cited by 79
Support system for guitar playing using augmented reality display
Motokawa, Y., & Saitô, H. (2006) · IEEE/ACM International Symposium on Mixed and Augmented Reality (ISMAR) · doi:10.1109/ismar.2006.297825 · Cited by 77
Scape: supporting stereoscopic collaboration in augmented and projective environments
Hua, H., Brown, L. D., & Gao, C.-Y. (2004) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.2004.1255811 · Cited by 72
Holz, C., & Wilson, A. D. (2011) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979060 · Cited by 65 · cited 2×
“To extract the user’s hand, we assume a constant hand length [14] which worked well in our tests.”
MethodResultSelf-citationRaskar, R., Beardsley, P. A., van Baar, J., Wang, Y., Dietz, P., Lee, J., Leigh, D., & Willwacher, T. (2004) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1186562.1015738 · Cited by 56
Visual Hints for Tangible Gestures in Augmented Reality
White, S., Lister, L., & Feiner, S. (2007) · Proceedings - International Symposium on Mixed and Augmented Reality, ISMAR · doi:10.1109/ismar.2007.4538824 · Cited by 55
Exploiting the cognitive and social benefits of physically large displays
Tan, D. S., & Pausch, R. F. (2004) · Defense Technical Information Center (DTIC) · Cited by 27
Augmenting on-screen instructions with micro-projected guides: when it works, and when it fails
Rosenthal, S. L., Kane, S. K., Wobbrock, J. O., & Avrahami, D. (2010) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/1864349.1864391 · Cited by 22
Watson, G. L., Curran, R., Butterfield, J., & Craig, C. (2008) · Advanced concurrent engineering · doi:10.1007/978-1-84800-972-1_51 · Cited by 15
Stevens, Stanley Smith (1906–73)
Teghtsoonian, R. (2015) · Elsevier eBooks · doi:10.1016/b978-0-08-097086-8.61128-5 · Cited by 6
Research works printed but not linked: 1
- 10.5555/647653.732300 · doi:10.5555/647653.732300
Cited by
A Systematic Review of 10 Years of Augmented Reality Usability Studies: 2005 to 2014
Dey, A., Billinghurst, M., Lindeman, R. W., & Swan, J. E. (2018) · Frontiers in Robotics and AI · doi:10.3389/frobt.2018.00037 · Cited by 434
YouMove: enhancing movement training with an augmented reality mirror
Anderson, F., Grossman, T., Matejka, J., & Fitzmaurice, G. (2013) · Proceedings of the 26th annual ACM symposium on User interface software and technology · doi:10.1145/2501988.2502045 · Cited by 315
“LightGuide used on-body projections to guide a user’s hand through 3D space [31].”
MethodMemorability of pre-designed and user-defined gesture sets
Nacenta, M. A., Kamber, Y., Qiang, Y., & Kristensson, P. O. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2466142 · Cited by 285
AIREAL: interactive tactile experiences in free air
Sodhi, R., Poupyrev, I., Glisson, M., & Israr, A. (2013) · ACM Transactions on Graphics · doi:10.1145/2461912.2462007 · Cited by 276
Self-citationAugmented reality tools for sports education and training
Soltani, P., & Morice, A. H. P. (2020) · Computers & Education · doi:10.1016/j.compedu.2020.103923 · Cited by 195
“Sodhi et al. (2012) created a real-time guiding system that projected the hints directly on the users’ hands.”
Background
Metadata
- Authors
- Sodhi, R., Benko, H., & Wilson, A.
- Affiliations
- University of Illinois Urbana-Champaign (US)
- Microsoft (United States) (US)
- Venue
- Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2012-05-05
- Pages
- 179-188
- OpenAlex
- W2120860586
- Semantic Scholar
- 1473939a714d2ff5e9ab925e69fd2e1037fd5d83
- Cited by
- 144
- References
- 34
- Citations by year
- 2026: 4 · 2025: 7 · 2024: 8 · 2023: 7 · 2022: 10 · 2021: 13 · 2020: 9 · 2019: 16 · 2018: 11 · 2017: 11 · 2016: 12 · 2015: 13 · 2014: 9 · 2013: 11 · 2012: 3
- FWCI
- 8.09
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- Funders
- Microsoft Research
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Interactive and Immersive Displays
- Physical Sciences › Computer Science › Human-Computer Interaction › Hand Gesture Recognition Systems
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Augmented Reality Applications
- Keywords
- physiotherapy, physical activity, movement accuracy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.