Cross-Modal Equivalence of Visual and Auditory Scatterplots for Exploring Bivariate Data Samples
Abstract
The equivalence of visual and auditory scatterplots was examined in two experiments. Experiment 1 examined the relationship between actual Pearson's r and visual and auditory judgments of direction and magnitude of correlation for 24 bivariate data samples. Experiment 2 directly evaluated visual and auditory perceptual sensitivity to outliers by examining changes in perceived magnitude and direction of correlation estimates for scatterplots from Experiment 1 that were altered by the addition of outlier points. Results suggest that the information conveyed by visual and auditory scatterplots is used very similarly by the two modalities. Both visual and auditory scatterplots are quite efficient in conveying sign and magnitude of correlation, and the effect of outliers on judged magnitude of correlation is similar for the two types of data display.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cited by
Sorted by citations
VoxLens: Making Online Data Visualizations Accessible with an Interactive JavaScript Plug-In
Sharif, A., Wang, O. H., Muongchan, A. T., Reinecke, K., & Wobbrock, J. O. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517431 · Cited by 86 · see citing works
“Prior research eforts have explored several techniques to make data visualizations more accessible to BLV users, including automatically generating alternative text for visualization elements [48, 59, 70], sonifcation [3, 5, 16, 27, 39, 58, 83], haptic graphs [33, 76, 81], 3-”
MethodUnderstanding Screen-Reader Users’ Experiences with Online Data Visualizations
Sharif, A., Chintalapati, S. S., Wobbrock, J. O., & Reinecke, K. (2021) · Proceedings of the 23rd International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3441852.3471202 · Cited by 85 · see citing works
Pitch and loudness interact in auditory displays: Can the data get lost in the map?
Neuhoff, J. G., Wayand, J., & Kramer, G. (2002) · Journal of Experimental Psychology: Applied · doi:10.1037/1076-898x.8.1.17 · Cited by 80 · see citing works
How accessible is my visualization? Evaluating visualization accessibility with Chartability
Elavsky, F., Bennett, C., & Moritz, D. (2022) · Computer Graphics Forum · doi:10.1111/cgf.14522 · Cited by 68 · see citing works
Evaluating a Tool for Improving Accessibility to Charts and Graphs
Ferres, L., Lindgaard, G., Sumegi, L., & Tsuji, B. (2013) · ACM Transactions on Computer-Human Interaction · doi:10.1145/2533682.2533683 · Cited by 67 · see citing works
Infosonics: Accessible Infographics for People who are Blind using Sonification and Voice
Holloway, L. M., Goncu, C., Ilsar, A., Butler, M., & Marriott, K. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517465 · Cited by 57 · see citing works
Sharif, A., Zhang, A. M., Reinecke, K., & Wobbrock, J. O. (2023) · 20th International Web for All Conference · doi:10.1145/3587281.3587284 · Cited by 21 · see citing works
“Several researchers have developed solutions to enhance the experiences of SRUs in extracting information from data visualizations, including auto-generation of alt-text [44, 53, 58, 69], sonification [2, 4, 13, 26, 36, 57, 83], data summarization [43], tables [21], andmulti-modality [70].”
BackgroundiSonic: interactive sonification for non-visual data exploration
Zhao, H., Plaisant, C., & Shneiderman, B. (2005) · Proceedings of the 7th international ACM SIGACCESS conference on Computers and accessibility · doi:10.1145/1090785.1090826 · Cited by 14 · see citing works
- Authors
- Flowers, J. H., Buhman, D. C., & Turnage, K. D.
- Affiliations
- University of Nebraska–Lincoln (US)
- Venue
- Human Factors: The Journal of the Human Factors and Ergonomics Society
- Publisher
- SAGE Publications
- Published
- 1997-09
- Volume
- 39
- Issue
- 3
- Pages
- 341-351
- ISSN
- 0018-7208 (ISSN-L)
- 1547-8181
- OpenAlex
- W2111197100
- Cited by
- 107
- References
- 0
- Citations by year
- 2024: 4 · 2023: 2 · 2022: 4 · 2021: 2 · 2020: 2 · 2019: 8 · 2018: 4 · 2017: 2 · 2016: 3 · 2015: 2 · 2014: 1 · 2013: 4 · 2012: 4
- FWCI
- 0.48
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Human Factors The Journal of the Human Factors and Ergonomics Society (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Data Visualization and Analytics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Keywords
- scatter plots, auditory display, visual presentation, Pearson correlation, outlier detection, bivariate data, perceptual sensitivity, data visualization
- MeSH terms
- Auditory Perception, Data Interpretation, Statistical, Humans, Models, Biological, Visual Perception
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review