Crowd++: unsupervised speaker count with smartphones
The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
Smartphones are excellent mobile sensing platforms, with the microphone in particular being exercised in several audio inference applications. We take smartphone audio inference a step further and demonstrate for the first time that it's possible to accurately estimate the number of people talking in a certain place -- with an average error distance of 1.5 speakers -- through unsupervised machine learning analysis on audio segments captured by the smartphones. Inference occurs transparently to the user and no human intervention is needed to derive the classification model. Our results are based on the design, implementation, and evaluation of a system called Crowd++, involving 120 participants in 10 very different environments. We show that no dedicated external hardware or cumbersome supervised learning approaches are needed but only off-the-shelf smartphones used in a transparent manner. We believe our findings have profound implications in many research fields, including social sensing and personal wellbeing assessment.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Davis, S., & Mermelstein, P. (1980) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/tassp.1980.1163420 · Cited by 5,465
Passive and In-Situ assessment of mental and physical well-being using mobile sensors
Rabbi, M., Ali, S., Choudhury, T., & Berke, E. (2011) · Proceedings of the 13th international conference on Ubiquitous computing · doi:10.1145/2030112.2030164 · Cited by 243
Modeling dominance in group conversations using nonverbal activity cues
Jayagopi, D. B., Hung, H., Yeo, C., & Gatica-Perez, D. (2009) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2008.2008238 · Cited by 217
Low cost crowd counting using audio tones
Kannan, P. G., Venkatagiri, S. P., Chan, M. C., Ananda, A. L., & Peh, L.-S. (2012) · Proceedings of the 10th ACM Conference on Embedded Network Sensor Systems · doi:10.1145/2426656.2426673 · Cited by 97
Cited by
DeepSense: A Unified Deep Learning Framework for Time-Series Mobile Sensing Data Processing
Yao, S., Hu, S., Zhao, Y., Zhang, A., & Abdelzaher, T. (2017) · Proceedings of the 26th International Conference on World Wide Web · doi:10.1145/3038912.3052577 · Cited by 667
“Using these sensors, mobile devices are able to infer user activities and states [35, 39] and recognize surrounding context [31, 42].”
BackgroundDeepEar: robust smartphone audio sensing in unconstrained acoustic environments using deep learning
Lane, N. D., Georgiev, P., & Qendro, L. (2015) · Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing · doi:10.1145/2750858.2804262 · Cited by 310
DeepCount: Crowd Counting with WiFi via Deep Learning
Liu, S., Zhao, Y., Xue, F., Chen, B., & Chen, X. (2019) · arXiv · doi:10.48550/arxiv.1903.05316 · Cited by 105
“Some researchers also used smart phones [14]– [16] to infer the number of speakers in a dialog.”
BackgroundGeorgiev, P., Bhattacharya, S., Lane, N. D., & Mascolo, C. (2017) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3131895 · Cited by 67
“Examples are song recognition [4], speaker identification [38], emotion recognition [39, 48], speaker counting [56], conversation analysis [34], voice commands [14], ambient sound analysis [40, 42].”
BackgroundSurvey of Non-Image-Based Approaches for Counting People
Kouyoumdjieva, S. T., Danielis, P., & Karlsson, G. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2902824 · Cited by 61
Metadata
- Authors
- Xu, C., Li, S., Liu, G., Zhang, Y., Miluzzo, E., Chen, Y.-F., Li, J., & Firner, B.
- Venue
- Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing
- Publisher
- ACM
- Published
- 2013-09-08
- Pages
- 43-52
- OpenAlex
- W2171679232
- Cited by
- 122
- References
- 4
- FWCI
- 13.07
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.