BodyScope: a wearable acoustic sensor for activity recognition
The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
Accurate activity recognition enables the development of a variety of ubiquitous computing applications, such as context-aware systems, lifelogging, and personal health systems. Wearable sensing technologies can be used to gather data for activity recognition without requiring sensors to be installed in the infrastructure. However, the user may need to wear multiple sensors for accurate recognition of a larger number of different activities. We developed a wearable acoustic sensor, called BodyScope, to record the sounds produced in the user's throat area and classify them into user activities, such as eating, drinking, speaking, laughing, and coughing. The F-measure of the Support Vector Machine classification of 12 activities using only our BodyScope sensor was 79.5%. We also conducted a small-scale in-the-wild study, and found that BodyScope was able to identify four activities (eating, drinking, speaking, and laughing) at 71.5% accuracy.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Although the proposed model has high accuracy and brief architecture, it was only evaluated on one dataset which has just six activities, which does not prove that the proposed model has good generalization ability.”
From LSTM-CNN Architecture for Human Activity Recognition (2020) · cites this paper as [28]
Citations
Cites
LIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
Pattern Recognition and Machine Learning
(2006) · doi:10.1007/978-0-387-45528-0 · Cited by 9,824
Textbook of Medical Physiology
(1966) · Annals of Internal Medicine · doi:10.7326/0003-4819-64-6-1363_2 · Cited by 9,749
(2006) · Springer eBooks · Cited by 8,123
A comparison of methods for multiclass support vector machines
Hsu, C.-W., & Lin, C.-J. (2002) · IEEE Transactions on Neural Networks · doi:10.1109/72.991427 · Cited by 6,838 · cited 1×
“The mathematical details of a SVM and different strategies for a multi-class classification are available at [5, 16].”
MethodActivity Recognition from User-Annotated Acceleration Data
Bao, L., & Intille, S. S. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24646-6_1 · Cited by 3,147 · cited 1×
“Bao and Intille also tested a similar method with five 2-axis accelerometers and classified 20 activities with a C4.5 decision tree at 70 – 90% accuracy [4].”
MethodTextbook of Medical Physiology
Andreiss, I. A. P., Banfíƈ, H., Barac-Latas, V., Crljen, V., Čulo, F., Ćuk, M., Dujić, Ž., Đogaš, Z., Grčević, D., Kučić, N., et al. (2006) · Cited by 1,654
Inferring Activities from Interactions with Objects
Philipose, M., Fishkin, K. P., Perkowitz, M., Patterson, D. J., Fox, D., Kautz, H., & Hahnel, D. (2004) · IEEE Pervasive Computing · doi:10.1109/mprv.2004.7 · Cited by 875 · cited 1×
“employed radio frequency identification (RFID) tags to determine which objects the user interacts with, and used this information to infer the activity [27].”
BackgroundSenseCam: A Retrospective Memory Aid
Hodges, S., Williams, L., Berry, E., Izadi, S., Srinivasan, J., Butler, A., Smyth, G., Kapur, N., & Wood, K. (2006) · Lecture Notes in Computer Science · doi:10.1007/11853565_11 · Cited by 753 · cited 4×
“Because cameras have become low-cost and small enough that the user can always wear them ( e.g., SenseCam [15]), computer vision can also be used to determine user activity.”
BackgroundMethodInfluentialComputational auditory scene analysis
Brown, G. J., & Cooke, M. (1994) · Computer Speech & Language · doi:10.1006/csla.1994.1016 · Cited by 707 · cited 2×
“Most related to activity recognition is computational auditory scene recognition (CASR) [26], which differs from computational auditory scene analysis (CASA) [6].”
BackgroundSoundSense: scalable sound sensing for people-centric applications on mobile phones
Lu, H., Pan, W., Lane, N. D., Choudhury, T., & Campbell, A. T. (2009) · Proceedings of the 7th international conference on Mobile systems, applications, and services · doi:10.1145/1555816.1555834 · Cited by 581 · cited 8×
“’s work [19] to automatically find such activities.”
BackgroundMethodInfluentialThe Jigsaw continuous sensing engine for mobile phone applications
Lu, H., Yang, J., Liu, Z., Lane, N. D., Choudhury, T., & Campbell, A. T. (2010) · Proceedings of the 8th ACM Conference on Embedded Networked Sensor Systems · doi:10.1145/1869983.1869992 · Cited by 560
Detection of posture and motion by accelerometry: a validation study in ambulatory monitoring
Foerster, F., Smeja, M., & Fahrenberg, J. (1999) · Computers in Human Behavior · doi:10.1016/s0747-5632(99)00037-0 · Cited by 480
Content-based audio classification and retrieval by support vector machines
Guo, G., & Li, S. Z. (2003) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2002.806626 · Cited by 443
Platemate: crowdsourcing nutritional analysis from food photographs
Noronha, J., Hysen, E., Zhang, H., & Gajos, K. Z. (2011) · Proceedings of the 24th annual ACM symposium on User interface software and technology · doi:10.1145/2047196.2047198 · Cited by 247 · cited 1×
“developed Platemate, which allows the user to analyze her food consumption by taking a picture of the food with a mobile phone and getting food annotations through a crowdsourcing system [24].”
BackgroundWearable sensor badge and sensor jacket for context awareness
Farringdon, J., Moore, A. J., Tilbury, N., Church, J., & Biemond, P. D. (2003) · Digest of Papers. Third International Symposium on Wearable Computers · doi:10.1109/iswc.1999.806681 · Cited by 239 · cited 1×
“[11] developed a wearable device with a built-in accelerometer that recognized the user’s posture and movement (e.”
BackgroundAccurate and privacy preserving cough sensing using a low-cost microphone
Larson, E. C., Lee, T., Liu, S., Rosenfeld, M., & Patel, S. N. (2011) · Proceedings of the 13th international conference on Ubiquitous computing · doi:10.1145/2030112.2030163 · Cited by 217
Analysis of Chewing Sounds for Dietary Monitoring
Amft, O., Stäger, M., Lukowicz, P., & Tröster, G. (2005) · Lecture Notes in Computer Science · doi:10.1007/11551201_4 · Cited by 216 · cited 1×
“investigated the chewing sounds of different food with an inner-ear microphone [1].”
BackgroundLocation-Based Activity Recognition
Fox, D. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74565-5_6 · Cited by 215 · cited 1×
“examined a method for recognizing activities related to locations, such as working, and sleeping, based on GPS data [18].”
MethodComputational auditory scene recognition
Peltonen, V., Tuomi, J., Klapuri, A., Huopaniemi, J., & Sorsa, T. (2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2002.5745009 · Cited by 215 · cited 2×
“Most related to activity recognition is computational auditory scene recognition (CASR) [26], which differs from computational auditory scene analysis (CASA) [6].”
BackgroundBathroom Activity Monitoring Based on Sound
Chen, J., Kam, A. H., Zhang, J., Liu, N., & Shue, L. (2005) · Lecture Notes in Computer Science · doi:10.1007/11428572_4 · Cited by 202 · cited 2×
“, taking a shower, hand washing, and brushing teeth) could be recognized through the sound recorded by a microphone installed in the room [7].”
BackgroundOn-Body Sensing Solutions for Automatic Dietary Monitoring
Amft, O., & Troster, G. (2009) · IEEE Pervasive Computing · doi:10.1109/mprv.2009.32 · Cited by 175 · cited 3×
“They also integrated multiple sensors to recognize dietary activities in a more holistic manner [3].”
BackgroundInfluentialActive Capacitive Sensing: Exploring a New Wearable Sensing Modality for Activity Recognition
Cheng, J., Amft, O., & Lukowicz, P. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-12654-3_19 · Cited by 171 · cited 1×
“[8] developed a capacitive sensor that can be worn around the user’s neck.”
BackgroundMel Frequency Cepstral Coefficients: An Evaluation Of Robustness Of Mp3 Encoded Music.
Sigurdsson, S. O., Petersen, K. B., & Lehn-Schiøler, T. (2006) · doi:10.5281/zenodo.1417148 · Cited by 144
Patel, S., Kientz, J. A., Hayes, G. R., Bhat, S., & Abowd, G. D. (2006) · Lecture notes in computer science · doi:10.1007/11853565_8 · Cited by 128 · cited 1×
“Mobile phones could be a good platform for daily activity recognition [19, 20, 21]; however, they may not be always with the user [25], and therefore may miss some activities.”
BackgroundAuditory Context Awareness via Wearable Computing
Clarkson, B., Sawhney, N., & Pentland, A. (1998) · Cited by 109
Methods for Detection and Classification of Normal Swallowing from Muscle Activation and Sound
Amft, O., & Troster, G. (2006) · 2006 Pervasive Health Conference and Workshops · doi:10.1109/pcthealth.2006.361624 · Cited by 99 · cited 1×
“Amit and Troster used EMG sensors and a microphone to further classify the human swallowing activities [2].”
MethodNon-audible murmur recognition input interface using stethoscopic microphone attached to the skin
Nakajima, Y., Kashioka, H., Shikano, K., & Campbell, N. (2004) · 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03). · doi:10.1109/icassp.2003.1200069 · Cited by 95
Automatic detection of laughter
Truong, K. P., & Leeuwen, D. A. V. (2005) · Interspeech 2005 · doi:10.21437/interspeech.2005-322 · Cited by 63 · cited 1×
“Audio-based detection of laughing [28, 31], coughing [17], and sighing [7] has been explored separately in the past.”
BackgroundSelf-citationPocket, Bag, Hand, etc. - Automatically Detecting Phone Context through Discovery
Miluzzo, E., Papandrea, M., Lane, N. D., Lu, H., & Campbell, A. T. (2010) · doi:10.71910/supsi.7225 · Cited by 53
High level activity recognition using low resolution wearable vision
Sundaram, S., & Mayol-Cuevas, W. W. (2009) · 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2009.5204355 · Cited by 53 · cited 1×
“For example, Sundaram and Cuevas developed an activity recognition method that uses low-resolution images recorded by a wearable camera [30].”
MethodFrequency-dependent Modulation of Rhythmic Human Jaw Movements
Morimoto, T., Inoue, T., Nakamura, T., & Kawamura, Y. (1984) · Journal of Dental Research · doi:10.1177/00220345840630111201 · Cited by 50 · cited 1×
“This is in line with the findings in the field of dental research [22], showing that the average frequency of chewing is about 1.”
ResultThe Roles of the Posterior Cricoarytenoid and Thyropharyngeus Muscles in Whispered Speech
Tsunoda, K., Niimi, S., & Hirose, H. (2009) · Folia Phoniatrica et Logopaedica · doi:10.1159/000266306 · Cited by 28 · cited 1×
“On the other hand, whispering sounds are generated mainly by a turbulent noise in and above the larynx, but not vibration of the vocal folds [32].”
BackgroundDiscrimination of speech and non-linguistic vocalizations by Non-Negative Matrix Factorization
Schuller, B. W., & Weninger, F. J. (2010) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2010.5495061 · Cited by 24 · cited 1×
“Audio-based detection of laughing [28, 31], coughing [17], and sighing [7] has been explored separately in the past.”
Background
Research works printed but not linked: 2
- 10.5555/1162264 · doi:10.5555/1162264
- 10.5555/519309.856485 · doi:10.5555/519309.856485
Cited by
Understanding and Modeling of WiFi Signal Based Human Activity Recognition
Wang, W., Liu, A. X., Shahzad, M., Ling, K., & Lu, S. (2015) · Proceedings of the 21st Annual International Conference on Mobile Computing and Networking · doi:10.1145/2789168.2790093 · Cited by 1,110
“Traditional approaches use cameras [6], radars [2], or wearable sensors [7, 33].”
MethodSoli: ubiquitous gesture sensing with millimeter wave radar
Lien, J., Gillian, N., Karagozler, M. E., Amihood, P., Schwesig, C., Olson, E., Raja, H., & Poupyrev, I. (2016) · ACM Transactions on Graphics · doi:10.1145/2897824.2925953 · Cited by 957
LSTM-CNN Architecture for Human Activity Recognition
Xia, K., Huang, J., & Wang, H. (2020) · IEEE Access · doi:10.1109/access.2020.2982225 · Cited by 851
“The methods based on fixed sensors mean that the information is obtained from sensors mounted at a fixed position, involving acoustic sensors [7], radars [8], static cameras [9], and other ambient-based sensors.”
MethodE-eyes: device-free location-oriented activity identification using fine-grained WiFi signatures
Wang, Y., Liu, J., Chen, Y., Gruteser, M., Yang, J., & Liu, H. (2014) · Proceedings of the 20th annual international conference on Mobile computing and networking · doi:10.1145/2639108.2639143 · Cited by 817
“While traditional activity identification is more location independent [16, 42], our approach prioritizes device-free operation and detection of more loosely-defined daily activities involving a series of motions as opposed to gestures or basic sitting, walking, running classification.”
BackgroundMethodInfluentialPersonal Sensing: Understanding Mental Health Using Ubiquitous Sensors and Machine Learning
Mohr, D. C., Zhang, M., & Schueller, S. M. (2017) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-032816-044949 · Cited by 802
Metadata
- Authors
- Yatani, K., & Truong, K. N.
- Affiliations
- University of Toronto (CA)
- Venue
- Proceedings of the 2012 ACM Conference on Ubiquitous Computing
- Publisher
- ACM
- Published
- 2012-09-05
- Pages
- 341-350
- OpenAlex
- W2144685889
- Cited by
- 310
- References
- 34
- Citations by year
- 2026: 4 · 2025: 15 · 2024: 20 · 2023: 18 · 2022: 22 · 2021: 23 · 2020: 34 · 2019: 39 · 2018: 33 · 2017: 33 · 2016: 26 · 2015: 21 · 2014: 14 · 2013: 7 · 2012: 1
- FWCI
- 9.76
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Health Sciences › Medicine › Pulmonary and Respiratory Medicine › Phonocardiography and Auscultation Techniques
- Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
- Keywords
- activity recognition, eating detection, cough detection, ubiquitous computing, lifelogging, context-aware systems
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.