The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
SoundSense: scalable sound sensing for people-centric applications on mobile phones
Abstract
Top end mobile phones include a number of specialized (e.g., accelerometer, compass, GPS) and general purpose sensors (e.g., microphone, camera) that enable new people-centric sensing applications. Perhaps the most ubiquitous and unexploited sensor on mobile phones is the microphone - a powerful sensor that is capable of making sophisticated inferences about human activity, location, and social events from sound. In this paper, we exploit this untapped sensor not in the context of human communications but as an enabler of new sensing applications. We propose SoundSense, a scalable framework for modeling sound events on mobile phones. SoundSense is implemented on the Apple iPhone and represents the first general purpose sound sensing system specifically designed to work on resource limited phones. The architecture and algorithms are designed for scalability and Soundsense uses a combination of supervised and unsupervised learning techniques to classify both general sound types (e.g., music, voice) and discover novel sound events specific to individual users. The system runs solely on the mobile phone with no back-end interactions. Through implementation and evaluation of two proof of concept people-centric sensing applications, we demostrate that SoundSense is capable of recognizing meaningful sound events that occur in users' everyday lives.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
(2006) · Springer eBooks · Cited by 8,123
Fundamentals of speech recognition
Rabiner, L. R., & Juang, B.-H. F. (1993) · Cited by 7,680
On the use of windows for harmonic analysis with the discrete Fourier transform
Harris, F. J. (1978) · Proceedings of the IEEE · doi:10.1109/proc.1978.10837 · Cited by 7,326
Communication in the presence of noise
Shannon, C. E. (1949) · Proceedings of the IRE · doi:10.1109/jrproc.1949.232969 · Cited by 6,539
Communication In The Presence Of Noise
Shannon, C. E. (1998) · Proceedings of the IEEE · doi:10.1109/jproc.1998.659497 · Cited by 4,804
Activity Recognition from User-Annotated Acceleration Data
Bao, L., & Intille, S. S. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24646-6_1 · Cited by 3,147
Musical genre classification of audio signals
Tzanetakis, G., & Cook, P. (2002) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/tsa.2002.800560 · Cited by 2,798
Miluzzo, E., Lane, N. D., Fodor, K., Peterson, R., Lu, H., Musolesi, M., Eisenman, S. B., Zheng, X., & Campbell, A. T. (2008) · Proceedings of the 6th ACM conference on Embedded network sensor systems · doi:10.1145/1460412.1460445 · Cited by 1,032
Self-citation(2019) · 2019 International Conference "Quality Management, Transport and Information Security, Information Technologies" (IT&QM&IS) · doi:10.1109/itqmis.2019.8928339 · Cited by 954
Construction and evaluation of a robust multifeature speech/music discriminator
Scheirer, E., & Slaney, M. (2002) · 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1997.596192 · Cited by 873
Burke, J., Estrin, D., Hansen, M., Parker, A., Ramanathan, N., Reddy, S., & Srivastava, M. B. (2006) · eScholarship (California Digital Library) · Cited by 664
Weka: Practical machine learning tools and techniques with Java implementations
Witten, I. H., Frank, E., Trigg, L. E., Hall, M. A., Holmes, G., & Cunningham, S. J. (1999) · Research Commons (University of Waikato) · Cited by 629
The Mobile Sensing Platform: An Embedded Activity Recognition System
Choudhury, T., Borriello, G., Consolvo, S., Haehnel, D., Harrison, B., Hemingway, B., Hightower, J., Klasnja, P. "., Koscher, K., LaMarca, A., et al. (2008) · IEEE Pervasive Computing · doi:10.1109/mprv.2008.39 · Cited by 598
Self-citationComparison of different implementations of MFCC
Zheng, F., Zhang, G., & Song, Z. (2001) · Journal of Computer Science and Technology · doi:10.1007/bf02943243 · Cited by 591
An overview of automatic speaker recognition technology
Reynolds, D. A. (2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2002.5745552 · Cited by 501
Osthaus, K. E. (1920) · doi:10.5479/sil.182252.39088008237430 · Cited by 493
Campbell, A. T., Eisenman, S. B., Lane, N. D., Miluzzo, E., & Peterson, R. A. (2006) · Proceedings of the 2nd annual international workshop on Wireless internet - WICON '06 · doi:10.1145/1234161.1234179 · Cited by 484
Self-citationAdvanced Interaction in Context
Schmidt, A., Adoo, K. A., Takaluoma, A., Tuomela, U., Laerhoven, K. V., & de Velde, W. V. (1999) · Cited by 482
Extracting Places and Activities from GPS Traces Using Hierarchical Conditional Random Fields
Liao, L., Fox, D., & Kautz, H. (2007) · The International Journal of Robotics Research · doi:10.1177/0278364907073775 · Cited by 412
An overview of audio information retrieval
Foote, J. (1999) · Multimedia Systems · doi:10.1007/s005300050106 · Cited by 338
Abdelzaher, T., Anokwa, Y., Boda, P., Burke, J., Estrin, D., Guibas, L., Kansal, A., Madden, S., & Reich, J. (2007) · IEEE Pervasive Computing · doi:10.1109/mprv.2007.38 · Cited by 258
Classification of general audio data for content-based retrieval
Li, D., Sethi, I. K., Dimitrova, N., & McGee, T. (2001) · Pattern Recognition Letters · doi:10.1016/s0167-8655(00)00119-7 · Cited by 252
Analysis of Chewing Sounds for Dietary Monitoring
Amft, O., Stäger, M., Lukowicz, P., & Tröster, G. (2005) · Lecture Notes in Computer Science · doi:10.1007/11551201_4 · Cited by 216
Computational auditory scene recognition
Peltonen, V., Tuomi, J., Klapuri, A., Huopaniemi, J., & Sorsa, T. (2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2002.5745009 · Cited by 215
Opportunity Knocks: A System to Provide Cognitive Assistance with Transportation Services
Patterson, D. J., Liao, L., Gajos, K., Collier, M., Livic, N., Olson, K., Wang, S., Fox, D., & Kautz, H. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-30119-6_26 · Cited by 189
Lifelogging memory appliance for people with episodic memory impairment
Lee, M. L., & Dey, A. K. (2008) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/1409635.1409643 · Cited by 126
Shafran, I., Riley, M., & Mohri, M. (2004) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru.2003.1318399 · Cited by 126
Auditory Context Awareness via Wearable Computing
Clarkson, B., Sawhney, N., & Pentland, A. (1998) · Cited by 109
Sensing and modeling human networks
Choudhury, T., & Pentland, A. (2004) · Cited by 98
Self-citationLi, K. A., Sohn, T. Y., Huang, S., & Griswold, W. G. (2008) · International Conference on Mobile Systems, Applications, and Services · doi:10.1145/1378600.1378619 · Cited by 86
An Audio-Based Personal Memory Aid
Vemuri, S., Schmandt, C., Bender, W. R., Tellex, S., & Lassey, B. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-30119-6_24 · Cited by 76
A linked-HMM model for robust voicing and speech detection
Basu, S. (2003) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2003.1198906 · Cited by 56
Cooperative Techniques Supporting Sensor-Based People-Centric Inferencing
Lane, N. D., Lu, H., Eisenman, S. B., & Campbell, A. T. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-79576-6_5 · Cited by 32
Self-citation
Cited by
A survey of mobile phone sensing
Lane, N., Miluzzo, E., Lu, H., Peebles, D., Choudhury, T., & Campbell, A. (2010) · IEEE Communications Magazine · doi:10.1109/mcom.2010.5560598 · Cited by 2,292
Self-citationA tutorial on human activity recognition using body-worn inertial sensors
Bulling, A., Blanke, U., & Schiele, B. (2014) · ACM Computing Surveys · doi:10.1145/2499621 · Cited by 1,668
The Smartphone Psychology Manifesto
Miller, G. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612441215 · Cited by 624
A Survey on Mobile Crowdsensing Systems: Challenges, Solutions, and Opportunities
Capponi, A., Fiandrino, C., Kantarci, B., Foschini, L., Kliazovich, D., & Bouvry, P. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2914030 · Cited by 594
The Jigsaw continuous sensing engine for mobile phone applications
Lu, H., Yang, J., Liu, Z., Lane, N. D., Choudhury, T., & Campbell, A. T. (2010) · Proceedings of the 8th ACM Conference on Embedded Networked Sensor Systems · doi:10.1145/1869983.1869992 · Cited by 560
Self-citation
Metadata
- Authors
- Lu, H., Pan, W., Lane, N. D., Choudhury, T., & Campbell, A. T.
- Venue
- Proceedings of the 7th international conference on Mobile systems, applications, and services
- Publisher
- ACM
- Published
- 2009-06-22
- Pages
- 165-178
- OpenAlex
- W2108950108
- Cited by
- 581
- References
- 34
- FWCI
- 52.35
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.