The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Digits: freehand 3D interactions anywhere using a wrist-worn gloveless sensor
Abstract
Digits is a wrist-worn sensor that recovers the full 3D pose of the user's hand. This enables a variety of freehand interactions on the move. The system targets mobile settings, and is specifically designed to be low-power and easily reproducible using only off-the-shelf hardware. The electronics are self-contained on the user's wrist, but optically image the entirety of the user's hand. This data is processed using a new pipeline that robustly samples key parts of the hand, such as the tips and lower regions of each finger. These sparse samples are fed into new kinematic models that leverage the biomechanical constraints of the hand to recover the 3D pose of the user's hand. The proposed system works without the need for full instrumentation of the hand (for example using data gloves), additional sensors in the environment, or depth cameras which are currently prohibitive for mobile scenarios due to power and form-factor considerations. We demonstrate the utility of Digits for a variety of application scenarios, including 3D spatial interaction with mobile devices, eyes-free interaction on-the-move, and gaming. We conclude with a quantitative and qualitative evaluation of our system, and discussion of strengths, limitations and future work.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A flexible new technique for camera calibration
Zhang, Z. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.888718 · Cited by 15,004
KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera
Izadi, S., Kim, D., Hilliges, O., Molyneaux, D., Newcombe, R., Kohli, P., Shotton, J., Hodges, S., Freeman, D., Davison, A., et al. (2011) · Proceedings of the 24th annual ACM symposium on User interface software and technology · doi:10.1145/2047196.2047270 · Cited by 2,110
Self-citationSeam carving for content-aware image resizing
Avidan, S., & Shamir, A. (2007) · ACM SIGGRAPH 2007 papers · doi:10.1145/1275808.1276390 · Cited by 1,362
Seam carving for content-aware image resizing
Avidan, S., & Shamir, A. (2007) · ACM Transactions on Graphics · doi:10.1145/1276377.1276390 · Cited by 1,092
Vision-based hand pose estimation: A review
Erol, A., Bebis, G., Nicolescu, M., Boyle, R. D., & Twombly, X. (2007) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2006.10.012 · Cited by 866
Skinput: appropriating the body as an input surface
Harrison, C., Tan, D., & Morris, D. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753394 · Cited by 694
A Survey of Glove-Based Systems and Their Applications
Dipietro, L., Sabatini, A. M., & Dario, P. (2008) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2008.923862 · Cited by 691
Handbook of Mathematical Models in Computer Vision
(2006) · doi:10.1007/0-387-28831-7 · Cited by 574
OmniTouch: wearable multitouch interaction everywhere
Harrison, C., Benko, H., & Wilson, A. D. (2011) · Proceedings of the 24th annual ACM symposium on User interface software and technology · doi:10.1145/2047196.2047255 · Cited by 562
GestureWrist and GesturePad: unobtrusive wearable interaction devices
Rekimoto, J. (2002) · Proceedings Fifth International Symposium on Wearable Computers · doi:10.1109/iswc.2001.962092 · Cited by 410
Enabling always-available input with muscle-computer interfaces
Saponas, T. S., Tan, D. S., Morris, D., Balakrishnan, R., Turner, J., & Landay, J. A. (2009) · Proceedings of the 22nd annual ACM symposium on User interface software and technology · doi:10.1145/1622176.1622208 · Cited by 328
SixthSense: a wearable gestural interface
Mistry, P., & Maes, P. (2009) · ACM SIGGRAPH ASIA 2009 Art Gallery & Emerging Technologies: Adaptation · doi:10.1145/1665137.1665204 · Cited by 319
Oikonomidis, I., Kyriazis, N., & Argyros, A. A. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126483 · Cited by 274
Self-citationStarner, T., Auxier, J., Ashbrook, D., & Gandy, M. (2002) · Digest of Papers. Fourth International Symposium on Wearable Computers · doi:10.1109/iswc.2000.888469 · Cited by 267
6D hands: markerless hand-tracking for computer aided design
Wang, R., Paris, S., & Popović, J. (2011) · Proceedings of the 24th annual ACM symposium on User interface software and technology · doi:10.1145/2047196.2047269 · Cited by 226
HoloDesk: direct 3d interactions with a situated see-through display
Hilliges, O., Kim, D., Izadi, S., Weiss, M., & Wilson, A. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208405 · Cited by 219
Self-citationHandy AR: Markerless Inspection of Augmented Reality Objects Using Fingertip Tracking
Lee, T., & Hollerer, T. (2007) · 2007 11th IEEE International Symposium on Wearable Computers · doi:10.1109/iswc.2007.4373785 · Cited by 205
Imaginary interfaces: spatial interaction with empty hands and without visual feedback
Gustafson, S., Bierwirth, D., & Baudisch, P. (2010) · Proceedings of the 23nd annual ACM symposium on User interface software and technology · doi:10.1145/1866029.1866033 · Cited by 189
SixthSense: a wearable gestural interface
Mistry, P., & Maes, P. (2009) · ACM SIGGRAPH ASIA 2009 Sketches · doi:10.1145/1667146.1667160 · Cited by 185
Evaluation of an instrumented glove for hand-movement acquisition
Dipietro, L., Sabatini, A. M., & Dario, P. (2003) · The Journal of Rehabilitation Research and Development · doi:10.1682/jrrd.2003.03.0181 · Cited by 158
The Gesture Watch: A Wireless Contact-free Gesture based Wrist Interface
Kim, J., He, J., Lyons, K., & Starner, T. E. (2007) · Proceedings · doi:10.1109/iswc.2007.4373770 · Cited by 157
Evaluation of a fiber optic glove for semi-automated goniometric measurements
Wise, S., Gardner, W., Sabelman, E. E., Valainis, E., Wong, Y., Glass, K., DRACE, J. E., & Rosen, J. M. (1990) · The Journal of Rehabilitation Research and Development · doi:10.1682/jrrd.1990.10.0411 · Cited by 126
Hands in action: real-time 3D reconstruction of hands in interaction with objects
Romero, J., Kjellström, H., & Kragić, D. (2010) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2010.5509753 · Cited by 126
ShoeSense: a new perspective on gestural interaction and wearable applications
Bailly, G., Müller, J., Rohs, M., Wigdor, D., & Kratz, S. (2012) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208576 · Cited by 122
Metcalf, C., Notley, S. V., Chappell, P. H., Burridge, J. H., & Yule, V. (2008) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2007.908087 · Cited by 119
Prados, E., & Faugeras, O. D. (2005) · Springer eBooks · doi:10.1007/0-387-28831-7_23 · Cited by 106
Enabling mobile microinteractions
Starner, T. E., & Ashbrook, D. (2010) · SMARTech Repository (Georgia Institute of Technology) · Cited by 104
A wearable computer-based American sign Language Recogniser
Starner, T. E., Weaver, J., & Pentland, A. (1997) · Personal and Ubiquitous Computing · doi:10.1007/bf01682027 · Cited by 77
Vardy, A., Robinson, J. A., & Cheng, L.-T. (2003) · International Symposium on Wearable Computers · doi:10.1109/iswc.1999.806928 · Cited by 69
Interactive Environment-Aware Handheld Projectors for Pervasive Computing Spaces
Molyneaux, D., Izadi, S., Kim, D., Hilliges, O., Hodges, S. E., Cao, X. G., Butler, A., & Gellersen, H. W. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-31205-2_13 · Cited by 60
Self-citationOn the Choice and Placement of Wearable Vision Sensors
Mayol-Cuevas, W. W., Tordoff, B. J., & Murray, D. W. (2009) · IEEE Transactions on Systems Man and Cybernetics - Part A Systems and Humans · doi:10.1109/tsmca.2008.2010848 · Cited by 45
Touch interface on back of the hand
(2011) · doi:10.1145/2037715.2037760 · Cited by 31
Lee, S. C., Li, B., & Starner, T. E. (2011) · International Symposium on Wearable Computers · doi:10.1109/iswc.2011.27 · Cited by 31
ShoeSense: A New Perspective on Hand Gestures and Wearable Applications
Bailly, G., Müller, J., Rohs, M., Wigdor, D., & Kratz, S. (2012) · Cited by 10
Cited by
Whole-home gesture recognition using wireless signals
Pu, Q., Gupta, S., Gollakota, S., & Patel, S. (2013) · Proceedings of the 19th annual international conference on Mobile computing & networking - MobiCom '13 · doi:10.1145/2500423.2500436 · Cited by 1,109
Romero (2017) · doi:10.1145/3130800.3130883 · Cited by 1,056
Soli: ubiquitous gesture sensing with millimeter wave radar
Lien, J., Gillian, N., Karagozler, M. E., Amihood, P., Schwesig, C., Olson, E., Raja, H., & Poupyrev, I. (2016) · ACM Transactions on Graphics · doi:10.1145/2897824.2925953 · Cited by 957
“…and a multitude of sensors embedded in various objects, the human body, clothes and environments or distributed as 3D interfaces (see for example [Kim et al. 2012; Harrison et al. 2010; Rekimoto 2001; Saponas et al. 2009; Smith et al. 1998; Strickon and Paradiso 1998; Dietz and Leigh 2001;…”
BackgroundWiGest: A ubiquitous WiFi-based gesture recognition system
Abdelnasser, H., Youssef, M., & Harras, K. A. (2015) · 2015 IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom.2015.7218525 · Cited by 552
Ensembles of Deep LSTM Learners for Activity Recognition using Wearables
Guan, Y., & Plötz, T. (2017) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3090076 · Cited by 511
“…innovative sensing and analysis approaches that target a plethora of application areas, including but not limited to novel interaction techniques [Kim et al. 2012], situated support in smart environments [Hoey et al. 2011], automated health [Plötz et al. 2012] and wellbeing assessments [Kranz…”
Background
Metadata
- Authors
- Kim, D., Hilliges, O., Izadi, S., Butler, A. D., Chen, J., Oikonomidis, I., & Olivier, P.
- Venue
- Proceedings of the 25th annual ACM symposium on User interface software and technology
- Publisher
- ACM
- Published
- 2012-10-07
- Pages
- 167-176
- OpenAlex
- W2099800354
- Cited by
- 428
- References
- 34
- FWCI
- 29.91
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.