A Large Inclusive Study of Human Listening Rates
The DOI matches its Crossref record; 54 of the 56 references it cites were found in a registry or an index.
Abstract
As conversational agents and digital assistants become increasingly pervasive, understanding their synthetic speech becomes increasingly important. Simultaneously, speech synthesis is becoming more sophisticated and manipulable, providing the opportunity to optimize speech rate to save users time. However, little is known about people's abilities to understand fast speech. In this work, we provide the first large-scale study on human listening rates. Run on LabintheWild, it used volunteer participants, was screen reader accessible, and measured listening rate by accuracy at answering questions spoken by a screen reader at various rates. Our results show that blind and low-vision people, who often rely on audio cues and access text aurally, generally have higher listening rates than sighted people. The findings also suggest a need to expand the range of rates available on personal devices. These results demonstrate the potential for users to learn to listen to faster rates, expanding the possibilities for human-conversational agent interaction.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, prior work shows that blind people can comprehend speech at higher listening rates [6,12], and that blind VAPA users find speech rates frustratingly slow [1].”
From Reading Between the Guidelines: How Commercial Voice Assistant Guidelines Hinder Accessibility for Blind Users (2019) · cites this paper as [6]
In the citing paper
“To our knowledge, this study and our report of early findings [6] are the first to explore voice design guidelines that are published by industry leaders in the VAPA domain.”
From Reading Between the Guidelines: How Commercial Voice Assistant Guidelines Hinder Accessibility for Blind Users (2019) · cites this paper as [6]
In the citing paper
“Studies conducted by various researchers have shown that many blind people can easily comprehend speech at higher listening rates than sighted people [6,12].”
From Reading Between the Guidelines: How Commercial Voice Assistant Guidelines Hinder Accessibility for Blind Users (2019) · cites this paper as [6]
Citations
Cites
Running experiments on Amazon Mechanical Turk
Paolacci, G., Chandler, J., & Ipeirotis, P. G. (2010) · Judgment and Decision Making · doi:10.1017/s1930297500002205 · Cited by 3,767
The TRACE model of speech perception
McClelland, J. L., & Elman, J. L. (1986) · Cognitive Psychology · doi:10.1016/0010-0285(86)90015-0 · Cited by 2,956
Labeling images with a computer game
von Ahn, L., & Dabbish, L. (2004) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/985692.985733 · Cited by 2,204
Functional parallelism in spoken word-recognition
Marslen-Wilson, W. D. (1987) · Cognition · doi:10.1016/0010-0277(87)90005-9 · Cited by 1,752
The Online Laboratory: Conducting Experiments in a Real Labor Market∗Preprint
Zeckhauser, R. J. (2016) · Cited by 1,530
Processing interactions and lexical access during word recognition in continuous speech
Marslen-Wilson, W. D., & Welsh, A. (1978) · Cognitive Psychology · doi:10.1016/0010-0285(78)90018-x · Cited by 1,426
Pitch-synchronous waveform processing techniques for text-to-speech synthesis using diphones
Moulines, E., & Charpentier, F. (1990) · Speech Communication · doi:10.1016/0167-6393(90)90021-z · Cited by 1,244
Speech parameter generation algorithms for HMM-based speech synthesis
Tokuda, K., Yoshimura, T., Masuko, T., Kobayashi, T., & Kitamura, T. (2002) · 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100) · doi:10.1109/icassp.2000.861820 · Cited by 999
Synthesis of Voiced Sounds From a Two-Mass Model of the Vocal Cords
Ishizaka, K., & Flanagan, J. L. (1972) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1972.tb02651.x · Cited by 899
Crowdsourcing graphical perception: using mechanical turk to assess visualization design
Heer, J., & Bostock, M. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753357 · Cited by 816
Germine, L., Nakayama, K., Duchaine, B. C., Chabris, C. F., Chatterjee, G., & Wilmer, J. B. (2012) · Psychonomic Bulletin & Review · doi:10.3758/s13423-012-0296-9 · Cited by 669 · cited 1×
“Researchers have demonstrated the validity of online experiments by replicating in-lab results using online participants (e.g., [25, 44, 17]).”
BackgroundImproved auditory spatial tuning in blind humans
Röder, B., Teder-Sälejärvi, W., Sterr, A., Rösler, F., Hillyard, S. A., & Neville, H. J. (1999) · Nature · doi:10.1038/22106 · Cited by 644
A Positron Emission Tomographic Study of Auditory Localization in the Congenitally Blind
Weeks, R., Horwitz, B., Aziz-Sultan, A., Tian, B., Wessinger, C. M., Cohen, L. G., Hallett, M., & Rauschecker, J. P. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-07-02664.2000 · Cited by 490
Pitch discrimination in the early blind
Gougoux, F., Lepore, F., Lassonde, M., Voss, P., Zatorre, R. J., & Belin, P. (2004) · Nature · doi:10.1038/430309a · Cited by 422
Speech processing activates visual cortex in congenitally blind humans
Röder, B., Stock, O., Bien, S., Neville, H., & Rösler, F. (2002) · European Journal of Neuroscience · doi:10.1046/j.1460-9568.2002.02147.x · Cited by 373
Cognitive Models of Speech Processing: Psycholinguistic and Computational Perspectives
(1991) · The MIT Press eBooks · doi:10.7551/mitpress/1889.001.0001 · Cited by 357
What Frustrates Screen Reader Users on the Web: A Study of 100 Blind Users
Lazar, J., Allen, A., Kleinman, J., & Malarkey, C. (2007) · International Journal of Human-Computer Interaction · doi:10.1080/10447310709336964 · Cited by 354 · cited 1×
“Screen readers, which emit synthetic speech, are this group’s most popular assistive technology [33].”
BackgroundEarly- and Late-Onset Blind Individuals Show Supra-Normal Auditory Abilities in Far-Space
Voss, P., Lassonde, M., Gougoux, F., Fortin, M., Guillemot, J.-P., & Lepore, F. (2004) · Current Biology · doi:10.1016/j.cub.2004.09.051 · Cited by 308
Speed of speech and persuasion.
Miller, N., Maruyama, G., Beaber, R. J., & Valone, K. (1976) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.34.4.615 · Cited by 294
Cognitive models of speech processing: psycholinguistics and computational perspectives
Altmann, G. T. M. (1989) · AI Magazine · doi:10.1609/aimag.v10i4.969 · Cited by 293
Action Dynamics Reveal Parallel Competition in Decision Making
McKinstry, C., Dale, R., & Spivey, M. J. (2008) · Psychological Science · doi:10.1111/j.1467-9280.2008.02041.x · Cited by 280
A summary of research investigating echolocation abilities of blind and sighted humans
Kolarik, A. J., Cirstea, S., Pardhan, S., & Moore, B. C. J. (2014) · Hearing Research · doi:10.1016/j.heares.2014.01.010 · Cited by 270
Review of research on the intelligibility and comprehension of accelerated speech.
Foulke, E., & Sticht, T. G. (1969) · Psychological Bulletin · doi:10.1037/h0027575 · Cited by 224
More than meets the eye: a survey of screen-reader browsing strategies
Borodin, Y., Bigham, J. P., Dausch, G., & Ramakrishnan, I. V. (2010) · Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A) · doi:10.1145/1805986.1806005 · Cited by 222
Conversations with AutoTutor Help Students Learn
Graesser, A. C. (2016) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-015-0086-4 · Cited by 201
Early but not late-blindness leads to enhanced auditory perception
Wan, C. Y., Wood, A. G., Reutens, D. C., & Wilson, S. J. (2010) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2009.08.016 · Cited by 192
Röder, B., Rösler, F., Hennighausen, E., & Näcker, F. (1996) · Cognitive Brain Research · doi:10.1016/0926-6410(96)00024-9 · Cited by 180
Optimising selection of units from speech databases for concatenative synthesis
Black, A. W., & Campbell, N. (1995) · 4th European Conference on Speech Communication and Technology (Eurospeech 1995) · doi:10.21437/eurospeech.1995-148 · Cited by 175
Röder, B., & Rösler, F. (2003) · International Journal of Psychophysiology · doi:10.1016/s0167-8760(03)00122-3 · Cited by 174
Théoret, H., Merabet, L. B., & Pascual‐Leone, Á. (2004) · Journal of Physiology-Paris · doi:10.1016/j.jphysparis.2004.03.009 · Cited by 159
WebinSitu: a comparative analysis of blind and sighted browsing behavior
Bigham, J. P., Cavender, A. C., Brudvik, J. T., Wobbrock, J. O., & Ladner, R. E. (2007) · Proceedings of the 9th international ACM SIGACCESS conference on Computers and accessibility · doi:10.1145/1296843.1296854 · Cited by 153
Self-citationAbsolute pitch in blind musicians
Hamilton, R. H., Pascual-Leone, A., & Schlaug, G. (2004) · NeuroReport · doi:10.1097/00001756-200404090-00012 · Cited by 133
Learning Perceptual Kernels for Visualization Design
Demiralp, Ç., Bernstein, M. S., & Heer, J. (2014) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2014.2346978 · Cited by 128
Auditory and auditory-tactile processing in congenitally blind humans
Hötting, K., & Röder, B. (2009) · Hearing Research · doi:10.1016/j.heares.2009.07.012 · Cited by 120
LabintheWild: Conducting Large-Scale Online Experiments With Uncompensated Samples
Reinecke, K., & Gajos, K. Z. (2015) · Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing · doi:10.1145/2675133.2675246 · Cited by 120
Self-citationZyskowski, K., Morris, M. R., Bigham, J. P., Gray, M. L., & Kane, S. K. (2015) · Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing · doi:10.1145/2675133.2675158 · Cited by 116
Ultrafine spatial acuity of blind expert human echolocators
Teng, S., Puri, A., & Whitney, D. (2012) · Experimental Brain Research · doi:10.1007/s00221-011-2951-1 · Cited by 111
Duolingo: learn a language for free while helping to translate the web
von Ahn, L. (2013) · Proceedings of the 2013 international conference on Intelligent user interfaces · doi:10.1145/2449396.2449398 · Cited by 105
Performance of Blind Children on Digit-Span Tests
Hull, T., & Mason, H. (1995) · Journal of Visual Impairment & Blindness · doi:10.1177/0145482x9508900213 · Cited by 103
Real-Time Corpus-Based Concatenative Synthesis with CataRT
Schwarz, D., Beller, G., Verbrugghe, B., & Britton, S. R. (2006) · Cited by 92
The Time Course of Interpretation in Speech Comprehension
Dahan, D. (2010) · Current Directions in Psychological Science · doi:10.1177/0963721410364726 · Cited by 82
Psychoacoustic Speech Tests: A Modified Rhyme Test
House, A. S., Williams, C., Hecker, M. H. L., & Kryter, K. D. (1963) · The Journal of the Acoustical Society of America · doi:10.1121/1.2142744 · Cited by 62
Maximum listening speeds for the blind
Asakawa, C., Takagi, H., Ino, S., & Ifukube, T. (2003) · SMARTech Repository (Georgia Institute of Technology) · Cited by 59
Semantic and morpho-syntactic priming in auditory word recognition in congenitally blind adults
Röder, B., Demuth, L., Streb, J., & Rösler, F. (2003) · Language and Cognitive Processes · doi:10.1080/01690960143000407 · Cited by 51
Communication Acoustics: An Introduction to Speech, Audio and Psychoacoustics
Pulkki, V., & Karjalainen, M. (2015) · Cited by 49
Pulkki, V., & Karjalainen, M. (2015) · Wiley eBooks · doi:10.1002/9781119825449 · Cited by 48
COMPREHENSION OF ULTRA-FAST SPEECH - BLIND VS. "NORMALLY HEARING" PERSONS
Moos, A., & Trouvain, J. (2007) · Cited by 45
Respeak: A Voice-based, Crowd-powered Speech Transcription System
Vashistha, A., Sethi, P., & Anderson, R. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025640 · Cited by 45
Faster Text-to-Speeches: Enhancing Blind People's Information Scanning with Faster Concurrent Speech
Guerreiro, J., & Gonçalves, D. (2015) · Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility - ASSETS '15 · doi:10.1145/2700648.2809840 · Cited by 41 · cited 1×
“Studies have also compared the intelligibility of speech produced by different mechanisms, including natural speech, formant synthesis, and concatenative synthesis (e.g., [41]), and compared effciency of single vs multi-track speech (e.g., [22]).”
BackgroundCortical plasticity in an early blind musician: an fMRl study
Ross, D. A., Olson, I. R., & Gore, J. C. (2003) · Magnetic Resonance Imaging · doi:10.1016/s0730-725x(03)00103-6 · Cited by 35
On the intelligibility of fast synthesized speech for individuals with early-onset blindness
Stent, A., Syrdal, A., & Mishra, T. (2011) · The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility · doi:10.1145/2049536.2049574 · Cited by 34
On the comprehension of extremely fast synthetic speech
Trouvain, J. (2007) · doi:10.22028/d291-23497 · Cited by 25
Legion scribe: real-time captioning by non-experts
Lasecki, W. S., Kushalnagar, R., & Bigham, J. P. (2014) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/2661334.2661352 · Cited by 16
Internationale Studienergebnisse
(2017) · neuroreha · doi:10.1055/s-0043-107138 · Cited by 2
Research works printed but not linked: 8
- NV Access. 2017. NVDA 2017. http://www.nvaccess.org/. (2017). (Accessed 2017-09-02).
- Amir Amedi. 2004. Visual and Multisensory Processing and Plasticity in the Human Brain. PhD thesis. Hebrew University Jerusalem Israel.
- Marialena Barouti, Konstantinos Papadopoulos, and Georgios Kouroupetroglou. 2013. Synthetic and Natural Speech Intelligibility in Individuals with Visual Impairments: Effects of Experience and Presentation Rate. In European AAATE Conference. Vilamoura, Portugal, 695--699.
- Ronald A Cole and Jola Jakimik. 1980. A Model of Speech Perception. Perception and Production of Fluent Speech (1980), 133--163.
- M Furmankiewicz, A So tysik-Piorunkiewicz, and P Ziuzia´ nski. 2014. Artifcial Intelligence Systems for Knowledge Management in E-Health: the Study of Intelligent Software Agents. Latest Trends on Systems 2 (2014), 551--556.
- 10.1007/s10683-011-9273-9 · DOI
- 10.1037/0022-3514.34.4.615 · doi:10.1037/0022-3514.34.4.615 · Paper page
- Konstantinos Papadopoulos and Eleni Koustriava. 2015. Comprehension of Synthetic and Natural Speech: Differences among Sighted and Visually Impaired Young Adults. Proceedings of the International Conference on Enabling Access for Persons with Visual Impairment (ICEAPVI) (2015), 147--151.
Cited by
The impact of low vision on social function: The potential importance of lost visual social cues
Klauke, S., Sondocie, C., & Fine, I. (2022) · Journal of Optometry · doi:10.1016/j.optom.2022.03.003 · Cited by 118
Review of Quantitative Empirical Evaluations of Technology for People with Visual Impairments
Brulé, E., Tomlinson, B. J., Metatla, O., Jouffrais, C., & Serrano, M. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376749 · Cited by 76
Branham, S. M., & Mukkath Roy, A. R. (2019) · Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3308561.3353797 · Cited by 75
Choice of Voices: A Large-Scale Evaluation of Text-to-Speech Voice Quality for Long-Form Content
Cambre, J., Colnago, J., Maddock, J., Tsai, J., & Kaye, J. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376789 · Cited by 65
Choi, D., Kwak, D., Cho, M., & Lee, S. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376569 · Cited by 54
Metadata
- Authors
- Bragg, D., Bennett, C., Reinecke, K., & Ladner, R.
- Affiliations
- University of Washington (US)
- Venue
- Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2018-04-21
- Pages
- 1-12
- OpenAlex
- W2795676171
- Cited by
- 43
- References
- 56
- Citations by year
- 2026: 3 · 2025: 2 · 2024: 10 · 2023: 4 · 2022: 7 · 2021: 3 · 2020: 7 · 2019: 5 · 2018: 2
- FWCI
- 1.73
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- Funders
- NSF (IiS-1702751, IIS-1651487)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- speech rate, speech understanding, fast speech, screen readers, blind and visually impaired users, chatbots, virtual assistants, synthetic speech, speech synthesis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.