MAGIC 2.0: A web tool for false positive prediction and prevention for gesture recognition systems
The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
False positives are a common problem for interfaces that rely on gesture recognition. Often a gesture can seem fine in development but is found to trigger accidentally during an initial deployment of the interface, restarting development and increasing expense. In this work we introduce MAGIC 2.0, a technique for false positive prediction and prevention that can be used interactively during the interface design process. To ground our research, we implement MAGIC 2.0 as a web service and develop gesture interfaces using sensors on common Android mobile phone platforms. We use iSAX (indexable Symbolic Aggregate approXimation) to enable interactive searching (;1,500,000 sec) of everyday user movements on a standard workstation to determine if a candidate gesture will trigger accidentally during use of an interface. We perform a user-independent study that suggests that the number of matches to this Everyday Gesture Library (EGL) database is indeed predictive of a candidate gesture's suitability. We compare iSAX to hidden Markov models (HMMs) and nearest neighbor with respect to accuracy and speed for the EGL search. Using iSAX on the EGL, we also develop a “garbage” class and show that including this class in recognition reduces errors.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Data Mining: Practical Machine Learning Tools and Techniques
(2011) · Elsevier eBooks · doi:10.1016/c2009-0-19715-5 · Cited by 25,437
i SAX: indexing and mining terabyte sized time series
Shieh, J., & Keogh, E. (2008) · Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1401890.1401966 · Cited by 323
Gestural and audio metaphors as a means of control for mobile devices
Pirhonen, A., Brewster, S., & Holguin, C. (2002) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/503376.503428 · Cited by 251
a CAPpella: programming by demonstration of context-aware applications
Dey, A. K., Hamid, R., Beckmann, C., Li, I., & Hsu, D. (2004) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/985692.985697 · Cited by 235
Suede: a Wizard of Oz prototyping tool for speech user interfaces
Klemmer, S. R., Sinha, A. K., Chen, J., Landay, J. A., Aboobaker, N., & Wang, A. (2000) · Proceedings of the 13th annual ACM symposium on User interface software and technology - UIST '00 · doi:10.1145/354401.354406 · Cited by 230 · cited 1×
“SUEDE [12], another design tool, focuses on speech-based user interfaces.”
MethodScaling and time warping in time series querying
Fu, A. W.-C., Keogh, E., Lau, L. Y. H., Ratanamahatana, C. A., & Wong, R. C.-W. (2008) · The VLDB Journal · doi:10.1007/s00778-006-0040-z · Cited by 219
MAGIC: a motion gesture design tool
Ashbrook, D., & Starner, T. E. (2010) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753653 · Cited by 149
Self-citation(2008) · doi:10.1145/1357054.1357092 · Cited by 105
Self-citationEnabling mobile microinteractions
Starner, T. E., & Ashbrook, D. (2010) · SMARTech Repository (Georgia Institute of Technology) · Cited by 104
Self-citationA design tool for camera-based interaction
Fails, J. A., & Olsen, D. R. (2003) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/642611.642690 · Cited by 82
Maynes-Aminzade, D., Winograd, T. A., & Igarashi, T. (2007) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/1294211.1294219 · Cited by 53
Quill: a gesture design tool for pen-based user interfaces
Long, A. C., & Landay, J. A. (2001) · Cited by 52
GART: The Gesture and Activity Recognition Toolkit
Lyons, K., Brashear, H., Westeyn, T. L., Kim, J. S., & Starner, T. E. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-73110-8_78 · Cited by 51
Self-citationAugmenting conversations using dual-purpose speech
Lyons, K., Skeels, C., Starner, T. E., Snoeck, C. M., Wong, B. A., & Ashbrook, D. (2004) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/1029632.1029674 · Cited by 43
Self-citationUse of mobile appointment scheduling devices
Starner, T. E., Snoeck, C. M., Wong, B. A., & McGuire, R. M. (2004) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/985921.986100 · Cited by 40
Self-citationA gesture based user interface prototyping system
Dannenberg, R. B., & Amon, D. (1989) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/73660.73676 · Cited by 15
Enabling mobile microinteractions
Ashbrook, D. L. (2010) · SMARTech Repository (Georgia Institute of Technology) · Cited by 7
Self-citation(1995) · DSpace@MIT (Massachusetts Institute of Technology)
Self-citationSUEDE: iterative, informal prototyping for speech interfaces
Sinha, A. K., Klemmer, S. R., Chen, J., Landay, J. A., & Chen, C. (2001) · CHI '01 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/634067.634189
Research works printed but not linked: 2
- witt, 2007, Human-Computer Interfaces for Wearable Computers, PhD thesis
- gales, 2005, The HTK Book
Cited by
Camerra, A., Shieh, J., Palpanas, T., Rakthanmanon, T., & Keogh, E. (2013) · Knowledge and Information Systems · doi:10.1007/s10115-012-0606-6 · Cited by 115
Xia, H., Glueck, M., Annett, M., Wang, M. S.-Y., & Wigdor, D. (2022) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3503537 · Cited by 90
Leiva, L. A., Martín-Albo, D., & Plamondon, R. (2015) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/2799648 · Cited by 56
A dynamic gesture recognition and prediction system using the convexity approach
Barros, P. V. A., Maciel-Junior, N. T., Fernandes, B., Bezerra, B. L. D., & Fernandes, S. M. M. (2016) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2016.10.006 · Cited by 54
SoloFinger: Robust Microgestures while Grasping Everyday Objects
Sharma, A., Hedderich, M. A., Bhardwaj, D., Fruchard, B., McIntosh, J., Nittala, A. S., Klakow, D., Ashbrook, D., & Steimle, J. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445197 · Cited by 49
Self-citation
Metadata
- Authors
- Kohlsdorf, D., Starner, T., & Ashbrook, D.
- Affiliations
- University of Bremen (DE)
- Georgia Institute of Technology (US)
- Nokia (United States) (US)
- Venue
- Face and Gesture 2011
- Publisher
- IEEE
- Published
- 2011-03
- Pages
- 1-6
- ISSN
- 1541-5058 (ISSN-L)
- OpenAlex
- W1996802381
- Cited by
- 24
- References
- 19
- Citations by year
- 2025: 3 · 2022: 6 · 2021: 2 · 2019: 2 · 2017: 2 · 2016: 4 · 2015: 2 · 2013: 3
- FWCI
- 0.72
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Conference on Automatic Face and Gesture Recognition (publishedVersion)
- Funders
- National Science Foundation
- Electronics and Telecommunications Research Institute
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Hand Gesture Recognition Systems
- Physical Sciences › Computer Science › Human-Computer Interaction › Interactive and Immersive Displays
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- gesture recognition, false positives, gesture design, smartphone sensors, symbolic aggregate approximation, hidden Markov models, nearest neighbor search, gesture classification, web services
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.