Making Math Graphs More Accessible in Remote Learning: Using Sonification to Introduce Discontinuity in Calculus
The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
Math graphs need to be accessible to People with Visual Impairments (PVI). While tactile graphics are a common way for PVI to access math graphs, their use becomes complicated in remote learning. To make math graphs more accessible in remote education, we focused on sonification, the use of non-speech sound. In this study, we designed techniques of sonification of math graphs to introduce the concept of discontinuity in calculus to PVI. First, we conducted a remote interview with six participants to understand their experiences with math education using graphs. Based on these findings, we developed a series of sonifications of math graphs that we remotely evaluated with three participants from our initial interviews. Our findings reveal that sonification can intuitively convey simple patterns and trends in math graphs with a little practice, be useful to introduce the discontinuities, and be more effective with descriptions of the sound and graphs.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“VoxLens relies on the Web Speech API [60], and is therefore only fully functional on browsers with established support for the API such as Google Chrome.”
From VoxLens: Making Online Data Visualizations Accessible with an Interactive JavaScript Plug-In (2022) · cites this paper as [60]
Citations
Cites
Serafin, S., Franinović, K., Hermann, T. M., Lemaître, G., Rinott, M., & Rocchesso, D. (2011) · Cited by 572
Online education in the post-COVID era
Lockee, B. B. (2021) · Nature Electronics · doi:10.1038/s41928-020-00534-0 · Cited by 430 · cited 1×
“Given the growing demand for online education due to COVID-19 [20], we feel it is important to develop sustainable and practical solutions for accessible math education.”
BackgroundSound graphs: A numerical data analysis method for the blind
Mansur, D. L., Blattner, M. M., & Joy, K. I. (1985) · Journal of Medical Systems · doi:10.1007/bf00996201 · Cited by 145 · cited 3×
“Making Math Graphs More Accessible in Remote Learning: Using Sonification to Introduce Discontinuity in Calculus.”
BackgroundEffects of differences in timbre on sequential grouping
Cusack, R., & Roberts, B. (2000) · Perception & Psychophysics · doi:10.3758/bf03212092 · Cited by 135 · cited 1×
“Since then, various sonification techniques such as the presentation of two lines [5], comparison of the continuous and discrete sound [13], differences of timbre [7], and panning [3] have been studied and summarized in guidelines and handbooks [4, 14, 26, 30, 34].”
Background(2003) · ENLIGHTEN (Jurnal Bimbingan dan Konseling Islam) · Cited by 124
(2005) · Lincoln (University of Nebraska) · Cited by 86
Access to Math and Science Content for Youth Who Are Blind or Visually Impaired
Bell, E. C., & Silverman, A. M. (2019) · Journal of Blindness Innovation and Research · doi:10.5241/9-152 · Cited by 49 · cited 1×
“Graphs of mathematical equations are commonly used visual information, but their inaccessibility can hinder People with Visual Impairments (PVI)’s education [2].”
BackgroundNees, M. A., & Berry, L. F. (2013) · Performance Enhancement & Health · doi:10.1016/j.peh.2013.08.016 · Cited by 45 · cited 1×
“The application of sonification to math education also shows encouraging potential [24, 25] such as its effectiveness of teaching PVI in middle school [8, 9, 31, 32].”
BackgroundBrowsing Modes For Exploring Sonified Line Graphs
Brown, L., Brewster, S. A., Ramloll, R., Yu, W. M., & Riedel, B. (2002) · Cited by 42
Research works printed but not linked: 12
- Terri L. Bonebright, Mike A. Nees, Tayla T. Connerley, and Glenn R. McCain. 2001. Testing the effectiveness of sonified graphs for education: A programmatic research project. Georgia Institute of Technology.
- Desmos, Inc. 2021. Desmos | Beautiful, Free Math. Retrieved June 20, 2021 from https://www.desmos.com/.
- Polly Edman. 1992. Tactile Graphics. American Foundation for the Blind.
- Steven M. Hetzler and Robert M. Tardiff. 2006. Two tools for integrating sonifications into calculus instruction. Georgia Institute of Technology.
- Eric Hsu and David Bressoud. 2015. Placement and student performance in Calculus I. Insights and recommendations from the MAA national study of college calculus (2015), 59–67.
- 10.1038/s41928-020- · doi:10.1038/s41928-020-
- Al Maneki. 2015. Guidelines for Collegiate Faculty to Teach Mathematics to Blind or Visually Impaired Students. 2015 CUPM Curriculum Guide. Retrieved June 21, 2021 from https://www.maa.org/sites/default/files/cupm/FacultyGuidelinesForTeachingVisuallyImpairedStudents.pdf.
- National Federation of the Blind. 2021. Homepage. Retrieved June 20, 2021 from https://www.nfb.org/.
- Processing Foundation. 2021. p5.js. Retrieved June 20, 2021 from https://p5js.org/.
- Robert Upson. 2001. Sonifications as mathematics teaching tools. In Proceedings of the 7th International Conference on Auditory Display (ICAD2001), Espoo, Finland, July-August. pp. 222-226.
- Bruce N. Walker and Michael A. Nees. 2011. Theory of Sonification. The sonification handbook, 9–39. Logos Verlag, Berlin.
- WGBH Educational Foundation. 2020. Guidelines for Describing STEM Images. Retrieved June 20, 2021 from https://www.wgbh.org/foundation/ncam/guidelines/guidelines-for-describing-stem-images.
Cited by
VoxLens: Making Online Data Visualizations Accessible with an Interactive JavaScript Plug-In
Sharif, A., Wang, O. H., Muongchan, A. T., Reinecke, K., & Wobbrock, J. O. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517431 · Cited by 86
Supporting Accessible Data Visualization Through Audio Data Narratives
Siu, A., S-H Kim, G., O'Modhrain, S., & Follmer, S. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517678 · Cited by 64
“series data [12, 21, 42], georeferenced data [80], and mathematical functions [2, 56, 77].”
BackgroundBeyond Vision Impairments: Redefining the Scope of Accessible Data Representations
Wimer, B. L., South, L., Wu, K., Szafir, D. A., Borkin, M. A., & Metoyer, R. (2024) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2024.3356566 · Cited by 26
“The range of these methods is vast, extending from auditory encoding techniques, such as textual descriptions conveyed through speech [91], [95], [96], [97], to sonification, the use of non-speech sounds [42], [91], [98], [99], [100], [101].”
BackgroundLee, S., Kohga, M., Landau, S., O'Modhrain, S., & Subramonyam, H. (2024) · The 26th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3663548.3675600 · Cited by 25
“MathGraphs developed a series of sonification of math graphs [45].”
Ramôa, G., Moured, O., Schwarz, T., Müller, K., & Stiefelhagen, R. (2023) · International Conference on PErvasive Technologies Related to Assistive Environments (PETRA) · doi:10.1145/3594806.3594818 · Cited by 16
“Others have used sonification to distinguish quadrants [8] and for representing discontinuity points in mathematical charts [11].”
MethodShaheen, N. L. (2024) · ACM Transactions on Accessible Computing · doi:10.1145/3688805 · Cited by 10
“…that HCI scholars have developed demonstrate many novel approaches to nonvisual digital learning including sonification [Lahav et al., 2016; Ohshiro et al., 2021; Tomlinson et al., 2020], tangible user interfaces [McGookin et al., 2010], haptic or kinetic output [Guinness et al., 2018;…”
Li, H., Bellona, J., Smith, L., Bower, A. S., & Roberts, J. (2023) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3597638.3614482 · Cited by 9
“Studies have shown that sonifcation supports various learning domains [10, 31], including physics [35, 41], astronomy [24, 27, 42, 49], computer science [3, 32, 37] and mathematics [1, 5, 23, 30, 46].”
BackgroundZhao, K., Mulet, J., Sorita, C., Oriola, B., Serrano, M., & Jouffrais, C. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3567733 · Cited by 7
“Oshiro et al. [27] recently presented a preliminary investigation on the specific problem of making mathematical graphs accessible during remote learning.”
BackgroundPerceptually congruent sonification of auditory line charts
Fitzpatrick, J., & Neff, F. (2023) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-023-00413-w · Cited by 5
“Another example is the Desmos calculator which includes an accessibility feature that can sonify mathematical functions [18].”
BackgroundRamôa, G., & Müller, K. (2025) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3663547.3746398 · Cited by 4
“[3, 12, 43, 63, 84, 92].”
Cro-Create: Weaving Sound Using Crochet Gestures
Bruen, J. E., Kwon, H., & Jeon, M. (2023) · Creativity and Cognition · doi:10.1145/3591196.3596816 · Cited by 2
“The benefits of sonification have been explored in multiple contexts such as to improve performance in training for sports [10] and to make visual elements more accessible for the visually impaired [5, 8].”
BackgroundJariwala, A., Jamshidi, F., Marghitu, D., & Chapman, R. (2023) · Universal Access in the Information Society · doi:10.1007/s10209-023-01068-w · Cited by 1
“While tactile methods fail to accommodate students with graphs and visual cues, sonification is an effective way of conveying them [22].”
Exploring Universal Design for Learning Through Sound: A Survey Study
Li, H., Bellona, J., Smith, L., Bower, A. S., & Roberts, J. (2025) · IEEE Integrated STEM Education Conference (ISEC) · doi:10.1109/isec64801.2025.11147401 · Cited by 1
“Previous research has implemented and evaluated the use of auditory displays encompassing sonification to support the learning of mathematics [22], oceanography [23], astronomy [24], computer science [25], and physics [26].”
Figueira, I., Cisneros, J. M., & Branham, S. M. (2026) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3797867.3829050 · Cited by 1
“Existing work on math access for BLV students has largely focused on Nemeth braille [60], tactile graphs [8, 30, 52, 103, 105, 108, 117, 140], virtual graphs [73, 98, 112], and digital equation editors [51].”
Spagnuolo, A., Ducci, M., Scholch, L., Burgos, M., Tizón-Escamilla, N., & Müller, K. (2025) · Repository KITopen (Karlsruhe Institute of Technology) · doi:10.5445/ir/1000186056
Li, H., Bellona, J., Smith, L., Bower, A. S., & Roberts, J. (2025) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie63693.2025.11328644
“While prior work has explored sonification in various subjects such as astronomy [15], computer science [16], and math [17], its application for supporting learning scientific concepts and data in informal learning environments remains underexplored.”
Sharif, A. (2026) · Springer eBooks · doi:10.1007/978-3-032-07186-6_7
Touchable Sound: Exploring Spatial Ocean Data Through Tangible and Auditory Displays
Amspoker, E., Berge, S., Lee, R. H., Bellona, J., Smith, L., Bower, A. S., & Roberts, J. (2026) · International Conference on Tangible, Embedded, and Embodied Interaction (TEI) · doi:10.1145/3731459.3779335
“Sonification—mapping quantitative values to sound—has demonstrated affordances for conveying relationships and trends over time through non-visual means, including marine and geospatial data [2, 19, 20, 25, 35].”
How Grade 11 Students Match Audio to Function Graphs: Distractor Patterns and Error Pathways
Parreño, S. J., & Gicale, A. K. (2026) · Journal of Research Innovation and Strategies for Education (RISE) · doi:10.70148/rise.v3i4.14
“…sound, and prior work has shown that it can support scientific and mathematical interpretation when mapping rules are explicit and listeners know what sound features represent (Dubus & Bresin, 2013; Grond & Hermann, 2012; Hermann et al., 2011; Ohshiro et al., 2021; Tomlinson & Walker, 2020).”
Parreño, S. J. (2026) · Ibero-American Journal of Education & Society Research · doi:10.56183/iberoeds.v6i1.716
“Sonification studies likewise suggest that audio graphs can communicate structure, but successful use depends on clear mappings and interpretive training (Vines et al., 2019; Ohshiro et al., 2021).”
Hassan, S., Khalaila, A., Cashman, D., Sharif, A., & Faust, R. (2026) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3797867.3829030
Challenges of sonification in the teaching and learning of functions
Burgos, M., Tizón-Escamilla, N., Spagnuolo, A., Brunetto, E., & Manolino, C. (2026) · International Electronic Journal of Mathematics Education · doi:10.29333/iejme/19969
Metadata
- Authors
- Ohshiro, K., Hurst, A., & DuBois, L.
- Affiliations
- New York University (US)
- New York University, United States
- Venue
- Proceedings of the 23rd International ACM SIGACCESS Conference on Computers and Accessibility
- Publisher
- ACM
- Published
- 2021-10-17
- Pages
- 1-4
- OpenAlex
- W3205073065
- Cited by
- 17
- References
- 23
- Citations by year
- 2026: 3 · 2025: 3 · 2024: 3 · 2023: 5 · 2022: 3
- FWCI
- 4.41
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Data Visualization and Analytics
- Keywords
- sonification, visual impairment, accessibility, distance education, discontinuities, calculus, tactile graphics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.