The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
ViBand: High-Fidelity Bio-Acoustic Sensing Using Commodity Smartwatch Accelerometers
Abstract
Smartwatches and wearables are unique in that they reside on the body, presenting great potential for always-available input and interaction. Their position on the wrist makes them ideal for capturing bio-acoustic signals. We developed a custom smartwatch kernel that boosts the sampling rate of a smartwatch's existing accelerometer to 4 kHz. Using this new source of high-fidelity data, we uncovered a wide range of applications. For example, we can use bio-acoustic data to classify hand gestures such as flicks, claps, scratches, and taps, which combine with on-device motion tracking to create a wide range of expressive input modalities. Bio-acoustic sensing can also detect the vibrations of grasped mechanical or motor-powered objects, enabling passive object recognition that can augment everyday experiences with context-aware functionality. Finally, we can generate structured vibrations using a transducer, and show that data can be transmitted through the human body. Overall, our contributions unlock user interface techniques that previously relied on special-purpose and/or cumbersome instrumentation, making such interactions considerably more feasible for inclusion in future consumer devices.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Object recognition from local scale-invariant features
Lowe, D. G. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790410 · Cited by 16,472
Face recognition: A literature survey
Zhao, W., Chellappa, R., Phillips, P. J., & Rosenfeld, A. (2003) · ACM Computing Surveys · doi:10.1145/954339.954342 · Cited by 6,163
Polynomial Codes Over Certain Finite Fields
Reed, I. S., & Solomon, G. (1960) · Journal of the Society for Industrial and Applied Mathematics · doi:10.1137/0108018 · Cited by 3,662
Personal Area Networks: Near-field intrabody communication
Zimmerman, T. G. (1996) · IBM Systems Journal · doi:10.1147/sj.353.0609 · Cited by 974
Context-based vision system for place and object recognition
Torralba, Murphy, Freeman, & Rubin (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238354 · Cited by 867
Fisheries Acoustics: Theory and Practice
Simmonds, E. J., & MacLennan, D. N. (2005) · Cited by 822
Fisheries Acoustics: Theory and Practice
(2005) · Wiley eBooks · doi:10.1002/9780470995303 · Cited by 749
Skinput: appropriating the body as an input surface
Harrison, C., Tan, D., & Morris, D. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753394 · Cited by 694
Self-citationFundamentals of Acoustical Oceanography
(1998) · Elsevier eBooks · doi:10.1016/b978-0-12-487570-8.x5000-4 · Cited by 643
Activity Recognition of Assembly Tasks Using Body-Worn Microphones and Accelerometers
Ward, J. A., Lukowicz, P., Troster, G., & Starner, T. E. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.197 · Cited by 431
CyberCode: designing augmented reality environments with visual tags
Rekimoto, J., & Ayatsuka, Y. (2000) · Proceedings of DARE 2000 on Designing augmented reality environments · doi:10.1145/354666.354667 · Cited by 429
Digits: freehand 3D interactions anywhere using a wrist-worn gloveless sensor
Kim, D., Hilliges, O., Izadi, S., Butler, A. D., Chen, J., Oikonomidis, I., & Olivier, P. (2012) · Proceedings of the 25th annual ACM symposium on User interface software and technology · doi:10.1145/2380116.2380139 · Cited by 428
GestureWrist and GesturePad: unobtrusive wearable interaction devices
Rekimoto, J. (2002) · Proceedings Fifth International Symposium on Wearable Computers · doi:10.1109/iswc.2001.962092 · Cited by 410
Enabling always-available input with muscle-computer interfaces
Saponas, T. S., Tan, D. S., Morris, D., Balakrishnan, R., Turner, J., & Landay, J. A. (2009) · Proceedings of the 22nd annual ACM symposium on User interface software and technology · doi:10.1145/1622176.1622208 · Cited by 328
Touché: enhancing touch interaction on humans, screens, liquids, and everyday objects
Sato, M., Poupyrev, I., & Harrison, C. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2207743 · Cited by 322
Self-citationRecognizing daily activities with RFID-based sensors
Buettner, M., Prasad, R., Philipose, M., & Wetherall, D. (2009) · Proceedings of the 11th international conference on Ubiquitous computing · doi:10.1145/1620545.1620553 · Cited by 301
Tomo: Wearable, Low-Cost Electrical Impedance Tomography for Hand Gesture Recognition
Zhang, Y., & Harrison, C. (2015) · Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology · doi:10.1145/2807442.2807480 · Cited by 283
Self-citationDemonstrating the feasibility of using forearm electromyography for muscle-computer interfaces
Saponas, T. S., Tan, D. S., Morris, D., & Balakrishnan, R. (2008) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1357054.1357138 · Cited by 275
Finger-writing with Smartwatch: A Case for Finger and Hand Gesture Recognition using Smartwatch
Xu, C., Pathak, P. H., & Mohapatra, P. (2015) · Proceedings of the 16th International Workshop on Mobile Computing Systems and Applications · doi:10.1145/2699343.2699350 · Cited by 235
Sensing from the basement: a feasibility study of unobtrusive and low-cost home activity recognition
Fogarty, J., Au, C., & Hudson, S. E. (2006) · Proceedings of the 19th annual ACM symposium on User interface software and technology · doi:10.1145/1166253.1166269 · Cited by 230
Computational auditory scene recognition
Peltonen, V., Tuomi, J., Klapuri, A., Huopaniemi, J., & Sorsa, T. (2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2002.5745009 · Cited by 215
WristFlex: low-power gesture input with wrist-worn pressure sensors
Dementyev, A., & Paradiso, J. A. (2014) · Proceedings of the 27th annual ACM symposium on User interface software and technology · doi:10.1145/2642918.2647396 · Cited by 203
Serendipity: Finger Gesture Recognition using an Off-the-Shelf Smartwatch
Wen, H., Ramos Rojas, J., & Dey, A. K. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858466 · Cited by 182
A Novel Accelerometer-Based Gesture Recognition System
Akl, A., Feng, C., & Valaee, S. (2011) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2011.2165707 · Cited by 170
Jung, P.-G., Lim, G., Kim, S., & Kong, K. (2015) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2015.2405413 · Cited by 166
IDSense: A Human Object Interaction Detection System Based on Passive UHF RFID
Li, H., Ye, C., & Sample, A. P. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702178 · Cited by 160
Acceleration sensing glove (ASG)
Perng, J. K., Fisher, B., Hollar, S. E.-A., & Pister, K. S. J. (2003) · International Symposium on Wearable Computers · doi:10.1109/iswc.1999.806717 · Cited by 153
Egocentric recognition of handled objects: Benchmark and analysis
Ren, X., & Philipose, M. (2009) · 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2009.5204360 · Cited by 114
EM-Sense: Touch Recognition of Uninstrumented, Electrical and Electromechanical Objects
Laput, G., Yang, C. J., Xiao, R., Sample, A. P., & Harrison, C. (2015) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/2807442.2807481 · Cited by 112
Self-citationA wearable system that knows who wears it
Cornelius, C. T., Peterson, R., Skinner, J., Halter, R. J., & Kotz, D. F. (2014) · International Conference on Mobile Systems, Applications, and Services · doi:10.1145/2594368.2594369 · Cited by 110
Auditory Context Awareness via Wearable Computing
Clarkson, B., Sawhney, N., & Pentland, A. (1998) · Cited by 109
Mujibiya, A., Cao, X. G., Tan, D. S., Morris, D., Patel, S., & Rekimoto, J. (2013) · ACM International Conference on Interactive Tabletops and Surfaces (ITS) · doi:10.1145/2512349.2512821 · Cited by 103
Investigation of the mechanism of the bioacoustic effect
Qian, Z., Sagers, R. D., & Pitt, W. G. (1999) · Journal of Biomedical Materials Research · doi:10.1002/(sici)1097-4636(199902)44:2<198::aid-jbm10>3.0.co;2-p · Cited by 93
(2013) · doi:10.1145/2501988.2502039 · Cited by 88
Amento, B. S., Hill, W., & Terveen, L. (2002) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/506443.506566 · Cited by 87
Hambone: A Bio-Acoustic Gesture Interface
Deyle, T., Palinko, S., Poole, E. S., & Starner, T. E. (2007) · Proceedings · doi:10.1109/iswc.2007.4373768 · Cited by 70
SkinWatch: skin gesture interaction for smart watch
Ogata, M., & Imai, M. (2015) · Augmented Human International Conference · doi:10.1145/2735711.2735830 · Cited by 69
Ripple: communicating through physical vibration
Roy, N., Gowda, M., & Choudhury, R. R. (2015) · Networked Systems Design and Implementation · Cited by 59
MagnifiSense: inferring device interaction using wrist-worn passive magneto-inductive sensors
Wang, E. J., Lee, T.-J., Mariakakis, A. T., Goel, M., Gupta, S., & Patel, S. (2015) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2750858.2804271 · Cited by 57
Algorithms for sound classification in hearing instruments
Büchler, M. (2002) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-a-004281408 · Cited by 45
Ripple II: faster communication through physical vibration
Roy, N., & Choudhury, R. R. (2016) · Networked Systems Design and Implementation · Cited by 42
Bernaerts, Y., Druwé, M., Steensels, S., Vermeulen, J., & Schöning, J. (2014) · ACM Conference Companion Publication on Designing Interactive Systems (DIS Companion) · doi:10.1145/2598784.2602777 · Cited by 39
A Usability User Study Concerning Free-Hand Microgesture and Wrist-Worn Sensors
Way, D., & Paradiso, J. A. (2014) · Wearable and Implantable Body Sensor Networks · doi:10.1109/bsn.2014.32 · Cited by 32
OsteoConduct: wireless body-area communication based on bone conduction
Zhong, L., Daye, D., Kaufman, B., Tobaoda, N., Mohamed, T., & Liebschner, M. A. K. (2007) · International Conference on Body Area Networks · doi:10.4108/bodynets.2007.181 · Cited by 27
A battery-free object localization and motion sensing platform
Zhao, Y., LaMarca, A., & Smith, J. R. (2014) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2632048.2632078 · Cited by 18
Cited by
Deep Learning in Human Activity Recognition with Wearable Sensors: A Review on Advances
Zhang, S., Li, Y., Zhang, S., Shahabi, F., Xia, S., Deng, Y., & Alshurafa, N. (2022) · Sensors · doi:10.3390/s22041476 · Cited by 625
“For example, the projects presented in [161, 162] utilize sampling rates above the typical rate.”
BackgroundSensing Fine-Grained Hand Activity with Smartwatches
Laput, G., & Harrison, C. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300568 · Cited by 147
Self-citationToward fairness in AI for people with disabilities SBG@a research roadmap
Guo, A., Kamar, E., Vaughan, J. W., Wallach, H., & Morris, M. R. (2020) · ACM SIGACCESS Accessibility and Computing · doi:10.1145/3386296.3386298 · Cited by 128
FingerPing: Recognizing Fine-grained Hand Poses using Active Acoustic On-body Sensing
Zhang, C., Xue, Q., Waghmare, A., Meng, R., Jain, S., Han, Y., Li, X., Cunefare, K., Ploetz, T., Starner, T., et al. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174011 · Cited by 82
“Therefore, many researchers have developed wrist-mounted devices to recognize finger gestures by capturing different types of changes around the wrist area with respect to a number of different sensing modalities, from inertial movement [12, 23, 12], computer vision [13], forces [5], proximity [8], electrical signals…”
BackgroundLimbMotion: Decimeter-level Limb Tracking for Wearable-based Human-Computer Interaction
Zhou, H., Gao, Y., Song, X., Liu, W., & Dong, W. (2019) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3369836 · Cited by 27
Metadata
- Authors
- Laput, G., Xiao, R., & Harrison, C.
- Venue
- Proceedings of the 29th Annual Symposium on User Interface Software and Technology
- Publisher
- ACM
- Published
- 2016-10-16
- Pages
- 321-333
- OpenAlex
- W2538172027
- Cited by
- 265
- References
- 45
- FWCI
- 10.10
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.