Towards large scale evaluation of novel sonification techniques for non visual shape exploration.
The DOI matches its Crossref record; 14 of the 15 references it cites were found in a registry or an index.
Abstract
There are several situations in which a person with visual impairment or blindness needs to extract information from an image. Examples include everyday activities, like reading a map, as well as educational activities, like exercises to develop visuospatial skills. In this contribution we propose a set of 6 sonification techniques to recognize simple shapes on touchscreen devices. The effectiveness of these sonification techniques is evaluated though Invisible Puzzle, a mobile application that makes it possible to conduct non-supervised evaluation sessions. Invisible Puzzle adopts a gamification approach and is a preliminary step in the development of a complete game that will make it possible to conduct a large scale evaluation with hundreds or thousands of blind users. With Invisible Puzzle we conducted 131 tests with sighted subjects and 18 tests with subjects with blindness. All subjects involved in the process successfully completed the evaluation session, with high engagement, hence showing the effectiveness of the evaluation procedure. Results give interesting insights on the differences among the sonification techniques and, most importantly, show that, after a short training, subjects are able to identify many different shapes.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Still, sonification solutions have been considered beneficial in other applications for BVI (29, 57–60).”
From SONOICE! a Sonar–Voice dynamic user interface for assisting individuals with blindness and visual impairment in pinpointing elements in 2D tactile readers (2024) · cites this paper as [58]
In the citing paper
“These findings underscore the influence of participants’ prior experiences and contextual factors in shaping their preference for a particular navigation UI, aligning with similar observations in related research (29, 58).”
From SONOICE! a Sonar–Voice dynamic user interface for assisting individuals with blindness and visual impairment in pinpointing elements in 2D tactile readers (2024) · cites this paper as [58]
Citations
Cites
An Introduction to the Psychology of Hearing: Fourth Edition
Moore, B. (1997) · BRILL eBooks · doi:10.1163/9789004658820 · Cited by 2,646
Gamification. using game-design elements in non-gaming contexts
Deterding, S., Sicart, M., Nacke, L., O'Hara, K., & Dixon, D. (2011) · CHI '11 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/1979742.1979575 · Cited by 2,413
An experimental system for auditory image representations
Meijer, P. B. L. (1992) · IEEE Transactions on Biomedical Engineering · doi:10.1109/10.121642 · Cited by 900
Subdivision of the Audible Frequency Range into Critical Bands (Frequenzgruppen)
Zwicker, E. (1961) · The Journal of the Acoustical Society of America · doi:10.1121/1.1908630 · Cited by 833
Remote evaluation: the network as an extension of the usability laboratory
Hartson, H. R., Castillo, J. C., Kelso, J., & Neale, W. C. (1996) · Proceedings of the SIGCHI conference on Human factors in computing systems common ground - CHI '96 · doi:10.1145/238386.238511 · Cited by 195
Listen to your Data: Model-Based Sonification for Data Analysis
Hermann, T. M., & Ritter, H. J. (1999) · Publikationen an der Universität Bielefeld (Universität Bielefeld) · Cited by 131
Timbremap: enabling the visually-impaired to use maps on touch-enabled devices
Su, J., Rosenzweig, A., Goel, A., de Lara, E., & Truong, K. N. (2010) · Proceedings of the 12th international conference on Human computer interaction with mobile devices and services · doi:10.1145/1851600.1851606 · Cited by 104
EdgeSonic: image feature sonification for the visually impaired
Yoshida, T., Kitani, K. M., Koike, H., Belongie, S., & Schlei, K. (2011) · Proceedings of the 2nd Augmented Human International Conference · doi:10.1145/1959826.1959837 · Cited by 55
Spatial Audio Applied to Research with the Blind
Katz, B. F. G., & Picinali, L. (2011) · InTech eBooks · doi:10.5772/15206 · Cited by 48
Self-citationSonification of range information for 3-D space perception
Milios, E., Kapralos, B., Kopinska, A., & Stergiopoulos, S. (2003) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2003.819645 · Cited by 34
Cited by
Accessible Interactive Maps for Visually Impaired Users
Ducasse, J., Brock, A. M., & Jouffrais, C. (2018) · Mobility of Visually Impaired People · doi:10.1007/978-3-319-54446-5_17 · Cited by 111
“Other prototypes (Gerino, Picinali, Bernareggi, Alabastro, & Mascetti, 2015; Yoshida, Kitani, Koike, Belongie, & Schlei, 2011) enable visually impaired users to identify simple shapes displayed on a touch-screen device.”
BackgroundTowards Understanding Sensory Substitution for Accessible Visualization: An Interview Study
Chundury, P., Patnaik, B., Reyazuddin, Y., Tang, C., Lazar, J., & Elmqvist, N. (2022) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2021.3114829 · Cited by 55
Revisiting Blind Photography in the Context of Teachable Object Recognizers
Lee, K., Hong, J., Pimento, S., Jarjue, E., & Kacorri, H. (2019) · Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3308561.3353799 · Cited by 37
Sharif, A., Wang, O. H., & Muongchan, A. T. (2022) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3517428.3550360 · Cited by 30
Accessibility-Related Publication Distribution in HCI Based on a Meta-Analysis
Colley, M., Kränzle, T., & Rukzio, E. (2022) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3491101.3519701 · Cited by 17
Metadata
- Authors
- Gerino, A., Picinali, L., Bernareggi, C., Alabastro, N., & Mascetti, S.
- Affiliations
- University of Milan (IT)
- Imperial College London (GB)
- Venue
- Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility - ASSETS '15
- Publisher
- ACM Press
- Published
- 2015
- Pages
- 13-21
- OpenAlex
- W2071969679
- Cited by
- 22
- References
- 15
- Citations by year
- 2026: 1 · 2025: 2 · 2024: 3 · 2023: 1 · 2022: 4 · 2021: 4 · 2019: 2 · 2017: 2 · 2016: 2 · 2015: 1
- FWCI
- 2.78
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- sonification, non-visual perception, shape recognition, visual impairment, blindness, touchscreen interaction, gamification, visuospatial ability, assistive technology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Towards large scale evaluation of novel sonification techniques for non visual shape exploration. https://app.cochat.ai/papers/10.1145/2700648.2809848
- The paper
- Gerino, A., Picinali, L., Bernareggi, C., Alabastro, N., & Mascetti, S. (2015). Towards large scale evaluation of novel sonification techniques for non visual shape exploration. Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility - ASSETS '15. https://doi.org/10.1145/2700648.2809848
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.