The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
VocalSketch: Vocally Imitating Audio Concepts
Abstract
A natural way of communicating an audio concept is to imitate it with one's voice. This creates an approximation of the imagined sound (e.g. a particular owl's hoot), much like how a visual sketch approximates a visual concept (e.g a drawing of the owl). If a machine could understand vocal imitations, users could communicate with software in this natural way, enabling new interactions (e.g. programming a music synthesizer by imitating the desired sound with one's voice). In this work, we collect thousands of crowd-sourced vocal imitations of a large set of diverse sounds, along with data on the crowd's ability to correctly label these vocal imitations. The resulting data set will help the research community understand which audio concepts can be effectively communicated with this approach. We have released the data set so the community can study the related issues and build systems that leverage vocal imitation as an interaction modality.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In comparison with the proposed dataset, existing imitated vocal sound datasets [19, 20] are much smaller in size.”
From Vocalsound: A Dataset for Improving Human Vocal Sounds Recognition (2022) · cites this paper as [20]
Citations
Cites
Eitz, M., Hays, J. H., & Alexa, M. (2012) · ACM Transactions on Graphics · doi:10.1145/2185520.2185540 · Cited by 890
Ghias, A., Logan, J., Chamberlin, D., et al. (1995) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/217279.215273 · Cited by 693
Confrontation Naming of Environmental Sounds
Marcell, M. M., Borella, D., Greene, M., Kerr, E., & Rogers, S. (2000) · Journal of Clinical and Experimental Neuropsychology · doi:10.1076/jcen.22.6.830.949 · Cited by 185
Separation by “humming”: User-guided sound extraction from monophonic mixtures
Smaragdis, P., & Mysore, G. J. (2009) · IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA) · doi:10.1109/aspaa.2009.5346542 · Cited by 93
On the effectiveness of vocal imitations and verbal descriptions of sounds
Lemaître, G., & Rocchesso, D. (2014) · The Journal of the Acoustical Society of America · doi:10.1121/1.4861245 · Cited by 65
Using vocal sketching for designing sonic interactions
Ekman, I., & Rinott, M. (2010) · ACM Conference on Designing Interactive Systems (DIS) · doi:10.1145/1858171.1858195 · Cited by 65
Vocal Imitations and the Identification of Sound Events
Lemaître, G., Dessein, A., Susini, P., et al. (2011) · Ecological Psychology · doi:10.1080/10407413.2011.617225 · Cited by 40
Drum Loops Retrieval from Spoken Queries
Gillet, O., & Richard, G. (2005) · Journal of Intelligent Information Systems · doi:10.1007/s10844-005-0321-9 · Cited by 37
Making music through real-time voice timbre analysis: machine learning and timbral control
Stowell, D. (2010) · OpenGrey (Institut de l'Information Scientifique et Technique) · Cited by 29
SOUND RETRIEVAL FROM VOICE IMITATION QUERIES IN COLLABORATIVE DATABASES
Blancas, D. S., & Janer, J. (2014) · Cited by 19
Research works printed but not linked: 4
- Blancas D. S., 2014, Proc. of Audio Engineering Society 53rd Int'l Conf.
- Cartwright M., 2014, Conference on New Interfaces for Musical Expression
- Fritts L., 2012, University of iowa musical instrument samples
- Sundaram S., 2006, Proc. of AAAI
Cited by
Sorted by citations
Vocalsound: A Dataset for Improving Human Vocal Sounds Recognition
Gong, Y., Yu, J., & Glass, J. (2022) · ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp43922.2022.9746828 · Cited by 43
“In comparison with the proposed dataset, existing imitated vocal sound datasets [19, 20] are much smaller in size.”
Metadata
- Authors
- Cartwright, M., & Pardo, B.
- Affiliations
- Northwestern University (US)
- Venue
- Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2015-04-18
- Pages
- 43-46
- OpenAlex
- W2167700723
- Cited by
- 43
- References
- 13
- Citations by year
- 2026: 1 · 2025: 4 · 2024: 5 · 2022: 1 · 2021: 1 · 2020: 4 · 2019: 9 · 2018: 5 · 2017: 4 · 2016: 5 · 2015: 4
- FWCI
- 2.46
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- Funders
- National Science Foundation (IIS-1116384,DGE-0824162)
- Topics
- Social Sciences › Arts and Humanities › Music › Music Technology and Sound Studies
- Physical Sciences › Computer Science › Signal Processing › Music and Audio Processing
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- vocal imitation, sound synthesis, voice interaction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
