The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Sasayaki: augmented voice web browsing experience
Abstract
Auditory user interfaces have great Web-access potential for billions of people with visual impairments, with limited literacy, who are driving, or who are otherwise unable to use a visual interface. However a sequential speech-based representation can only convey a limited amount of information. In addition, typical auditory user interfaces lose the visual cues such as text styles and page structures, and lack effective feedback about the current focus. To address these limitations, we created Sasayaki (from whisper in Japanese), which augments the primary voice output with a secondary whisper of contextually relevant information, automatically or in response to user requests. It also offers new ways to jump to semantically meaningful locations. A prototype was implemented as a plug-in for an auditory Web browser. Our experimental results show that the Sasayaki can reduce the task completion times for finding elements in webpages and increase satisfaction and confidence.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Agents that reduce work and information overload
Maes, P. (1994) · Communications of the ACM · doi:10.1145/176789.176792 · Cited by 2,321
Measuring the information society
(1989) · Choice Reviews Online · doi:10.5860/choice.26-3322 · Cited by 610
What Frustrates Screen Reader Users on the Web: A Study of 100 Blind Users
Lazar, J., Allen, A., Kleinman, J., & Malarkey, C. (2007) · International Journal of Human-Computer Interaction · doi:10.1080/10447310709336964 · Cited by 354 · cited 1×
“Lazar et al. [7] collected users' reports of the causes of frustration when using screen readers, with confusing page layout being ranked as the leading problem.”
BackgroundNomadic radio: speech and audio interaction for contextual messaging in nomadic environments
Sawhney, N., & Schmandt, C. (2000) · ACM Transactions on Computer-Human Interaction · doi:10.1145/355324.355327 · Cited by 298 · cited 2×
“Sawhney and Schmandt [10] worked on ‘Nomadic Radio’, a wearable system which allows users to access information by using voices and textual information in a nomadic environment.”
BackgroundAn Augmented Reality museum guide
Miyashita, T., Meier, P., Tachikawa, T., Orlic, S., Eble, T., Scholz, V., Gapel, A., Gerl, O., Arnaudov, S., & Lieberknecht, S. (2008) · 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality · doi:10.1109/ismar.2008.4637334 · Cited by 210 · cited 1×
“Kalantari et al. [12] and Miyashita et al. [13] wrote about their voice-based augmented reality systems for visitors at museums.”
BackgroundSWAN: System for Wearable Audio Navigation
Wilson, J., Walker, B. N., Lindsay, J., Cambias, C., & Dellaert, F. (2007) · 2007 11th IEEE International Symposium on Wearable Computers · doi:10.1109/iswc.2007.4373786 · Cited by 200
Audio augmented reality: a prototype automated tour guide
Bederson, B. B. (1995) · Conference companion on Human factors in computing systems - CHI '95 · doi:10.1145/223355.223526 · Cited by 182 · cited 1×
“Bederson [9] created an automated tour guide prototype that uses audio to guide tourists.”
BackgroundThe NavBelt-a computerized travel aid for the blind based on mobile robotics technology
Shoval, S., Borenstein, J., & Koren, Y. (1998) · IEEE Transactions on Biomedical Engineering · doi:10.1109/10.725334 · Cited by 172 · cited 2×
“Shoval et al. [14] introduced NAVBELT and GUIDECANE, which are voice and touch-based tools that can use a stereo earphone with a tactile stimulator to help blind people navigate in real environments.”
BackgroundDeeper sentiment analysis using machine translation technology
Kanayama, H., Nasukawa, T., & Hideo, W. (2004) · International Conference on Computational Linguistics · doi:10.3115/1220355.1220426 · Cited by 167
Analysis of navigability of web applications for improving blind usability
Takagi, H., Saito, S., Fukuda, K., & Asakawa, C. (2007) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1279700.1279703 · Cited by 116 · cited 1×
“Due to these limitations, people who use auditory interfaces to browse webpages find it slow and also tend to lose their places, making their browsing experience less reliable and less satisfying [5].”
BackgroundSelf-citationStylos, J., Myers, B. A., & Faulring, A. (2004) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/1029632.1029665 · Cited by 108 · cited 1×
“Stylos et al. [16] introduced an intelligent clipboard monitoring agent that helps to identify formatted data (such as addresses or appointments) for smart pasting into webforms.”
BackgroundTakagi, H., Kawanaka, S., Kobayashi, M., Itoh, T., & Asakawa, C. (2008) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/1414471.1414507 · Cited by 106 · cited 2×
“Many studies tried to improve accessibility by using external metadata [27, 28, 29, 30].”
BackgroundSelf-citationMahmud, J., Borodin, Y., & Ramakrishnan, I. V. (2007) · International World Wide Web Conference (WWW) · doi:10.1145/1242572.1242578 · Cited by 90
The travails of visually impaired web travellers
Goble, C., Harper, S., & Stevens, R. (2000) · ACM Conference on Hypertext and Social Media (HT) · doi:10.1145/336296.336304 · Cited by 81 · cited 1×
“Webpages need similar signals for easier navigation [31].”
BackgroundONTRACK: Dynamically adapting music playback to support navigation
Jones, M., Jones, S., Bradley, G., Warren, N., Bainbridge, D., & Holmes, G. (2008) · Personal and Ubiquitous Computing · doi:10.1007/s00779-007-0155-2 · Cited by 81 · cited 1×
“Jones et al. [15] described the ONTRACK system which uses adaptive music playback to support navigation in a 3D virtual space.”
BackgroundEvaluating DANTE: Semantic transcoding for visually disabled users
Yeşilada, Y., Stevens, R., Harper, S., & Goble, C. (2007) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1279700.1279704 · Cited by 80
Gist summaries for visually impaired surfers
Harper, S., & Patel, N. (2005) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/1090785.1090804 · Cited by 75 · cited 1×
“Harper and Patel [26] described the effects when visually impaired people are unable to scan webpages.”
BackgroundSummarizing personal web browsing sessions
Dontcheva, M., Drucker, S. M., Wade, G., Salesin, D., & Cohen, M. F. (2006) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/1166253.1166273 · Cited by 67 · cited 1×
“Dontcheva et al. [20] created a Web agent that can help record and organize user sessions for comparison and analysis.”
BackgroundAxsJAX: a talking translation bot using google IM
Chen, C. L., & Raman, T. V. (2008) · International Cross-Disciplinary Conference on Web Accessibility (W4A) · doi:10.1145/1368044.1368056 · Cited by 55 · cited 2×
“Chen and Ramen [30] created AxsJAX, which lets programmers dynamically insert ARIA statements into webpage content so that screen reader users can handle dynamic pages.”
BackgroundAibrowser for multimedia: introducing multimedia content accessibility for visually impaired users
Miyashita, H., Sato, D., Takagi, H., & Asakawa, C. (2007) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/1296843.1296860 · Cited by 52 · cited 2×
“Many studies tried to improve accessibility by using external metadata [27, 28, 29, 30].”
BackgroundSelf-citationUsability testing with screen reading technology in a Windows environment
Barnicle, K. (2000) · Conference on Universal Usability · doi:10.1145/355460.355543 · Cited by 51 · cited 1×
“Barnicle [6] evaluated screen reader users’ experiences with thirteen visually impaired people and identified 58 unique obstacles that are not problematic to the same degree for sighted people.”
BackgroundImmersive audio-augmented environments: the LISTEN project
Eckel, G. (2002) · Proceedings · doi:10.1109/iv.2001.942112 · Cited by 46
Accessibility commons: a metadata infrastructure for web accessibility
Kawanaka, S., Borodin, Y., Bigham, J. P., Lunn, D. R., Takagi, H., & Asakawa, C. (2008) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/1414471.1414500 · Cited by 39 · cited 1×
“To provide users with contextual support, the Sasayaki plug-in retrieves pre-defined role-based data about a webpage from an Accessibility Commons [33] server.”
MethodSelf-citationBorodin, Y., Bigham, J. P., Raman, R., & Ramakrishnan, I. V. (2008) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/1414471.1414499 · Cited by 38
Auditory browser for blind and visually impaired users
Roth, P., Petrucci, L. S., Pun, T., & Assimacopoulos, A. (1999) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/632716.632852 · Cited by 35 · cited 1×
“Roth et al. [18] created an agent to provide audio feedback for the user’s cursor location.”
BackgroundSupporting user hypotheses in problem diagnosis
Wagner, E. J., & Lieberman, H. A. (2004) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/964442.964450 · Cited by 19 · cited 2×
“As in Web browsing scenarios, they found that user behavior, cursor location, and webpage layout were the most important contextual clues for analysis [17, 19, 21, 23].”
BackgroundMethodParente, P. (2006) · ACM SIGACCESS Accessibility and Computing · doi:10.1145/1127564.1127571 · Cited by 18 · cited 1×
“Parente [22] introduced Clique, an auditory interface with four assistants and distinct voices.”
BackgroundSasayaki: an augmented voice-based web browsing experience
Zhu, S., Sato, D., Takagi, H., & Asakawa, C. (2010) · Proceedings of the 12th international ACM SIGACCESS conference on Computers and accessibility · doi:10.1145/1878803.1878870 · Cited by 14 · cited 1×
“A pilot study [35] was done before the main experiment with three blind people (2 males and 1 female from 37 to 44 years old).”
BackgroundSelf-citationThe SADIe transcoding platform
Lunn, D. R., Bechhofer, S., & Harper, S. (2008) · International Cross-Disciplinary Conference on Web Accessibility (W4A) · doi:10.1145/1368044.1368073 · Cited by 12 · cited 2×
“Many studies tried to improve accessibility by using external metadata [27, 28, 29, 30].”
BackgroundMethodAUGUR: providing context-aware interaction support
Hartmann, M., Schreiber, D., & Mühlhäuser, M. (2009) · ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS) · doi:10.1145/1570433.1570458 · Cited by 10 · cited 2×
“As in Web browsing scenarios, they found that user behavior, cursor location, and webpage layout were the most important contextual clues for analysis [17, 19, 21, 23].”
BackgroundMethodImproving web accessibility using content-aware plug-ins
Yu, W. M., McAllister, G., Strain, P., Kuber, R., & Murphy, E. (2005) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/1056808.1057049 · Cited by 8 · cited 2×
“As in Web browsing scenarios, they found that user behavior, cursor location, and webpage layout were the most important contextual clues for analysis [17, 19, 21, 23].”
BackgroundMethodUsing semantic web approach in augmented audio reality system for museum visitors
Kalantari, L., Hatala, M., & Willms, J. (2004) · doi:10.1145/1013367.1013488 · Cited by 1 · cited 1×
“Kalantari et al. [12] and Miyashita et al. [13] wrote about their voice-based augmented reality systems for visitors at museums.”
Background
Research works printed but not linked: 1
- 10.5555/876872.878476 · doi:10.5555/876872.878476
Cited by
The State of Speech in HCI: Trends, Themes and Challenges
Clark, L., Doyle, P., Garaialde, D., Gilmartin, E., Schlögl, S., Edlund, J., Aylett, M., Cabral, J., Munteanu, C., Edwards, J., et al. (2019) · Interacting with Computers · doi:10.1093/iwc/iwz016 · Cited by 193
“For example, asking users to evaluate voices (Dahlbäck, Wang, Nass, & Alwin, 2007) or assess an auditory web-browser (Sato, Zhu, Kobayashi, Takagi, & Asakawa, 2011).”
BackgroundDas, M., Gergle, D., & Piper, A. M. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359293 · Cited by 108
Giraud, S., Thérouanne, P., & Steiner, D. D. (2017) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2017.10.011 · Cited by 129
Faster Text-to-Speeches: Enhancing Blind People's Information Scanning with Faster Concurrent Speech
Guerreiro, J., & Gonçalves, D. (2015) · Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility - ASSETS '15 · doi:10.1145/2700648.2809840 · Cited by 41
Das, M., McHugh, T. B., Piper, A. M., & Gergle, D. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501918 · Cited by 40
Metadata
- Authors
- Sato, D., Zhu, S., Kobayashi, M., Takagi, H., & Asakawa, C.
- Affiliations
- IBM Research - Tokyo (JP)
- University of Maryland, Baltimore County (US)
- Venue
- Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2011-05-07
- Pages
- 2769-2778
- OpenAlex
- W2011134482
- Cited by
- 20
- References
- 32
- Citations by year
- 2023: 1 · 2022: 2 · 2021: 3 · 2020: 1 · 2019: 2 · 2018: 2 · 2017: 1 · 2016: 3 · 2015: 2 · 2014: 1 · 2012: 1
- FWCI
- 1.92
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- Topics
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Keywords
- auditory user interface, web accessibility, visual impairment, Whisper, semantic navigation, visually impaired users
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.