Design Guidelines and Recommendations for Multimodal, Touchscreen-based Graphics
Open accessAbstract
With content rapidly moving to the electronic space, access to graphics for individuals with visual impairments is a growing concern. Recent research has demonstrated the potential for representing basic graphical content on touchscreens using vibrations and sounds, yet few guidelines or processes exist to guide the design of multimodal, touchscreen-based graphics. In this work, we seek to address this gap by synergizing our collective research efforts over the past eight years and implementing our findings into a compilation of recommendations, which we validate through an iterative design process and user study. We start by reviewing previous work and then collate findings into a set of design guidelines for generating basic elements of touchscreen-based multimodal graphics. We then use these guidelines to generate exemplary graphics in mathematics, specifically bar charts and geometry concepts. We discuss the iterative design process of moving from guidelines to actual graphics and highlight challenges. We then present a formal user study with 22 participants with visual impairments, comparing learning performance on using touchscreen-rendered graphics to embossed graphics. We conclude with qualitative feedback from participants on the touchscreen-based approach and offer areas of future investigation as these recommendation are expanded to include more complex graphical concepts.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
12 of 72 cited sources checked · 5 supported · 0 flagged · accuracy not yet measured
- Findingcitation
Switching vibratory signals at vertex points aids in shape identification accuracy for basic shapes up to five vertices.
“we investigated the identification of basic shapes (up to five vertices) on a vibratory touchscreen and found that switching vibratory signals (e.g., increasing the intensity of the vibration) at the vertex points aids in shape identification accuracy [72].”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [72] 72. Jennifer L. Tennison and Jenna L. Gorlewicz. 2019. Non-visual perception of lines on a multimodal touchscreen tablet. ACM Trans. Appl. Percept. 16, 1 (2019), 6. source
Sections 3.2 and 4.3 (pages unavailable) describe line-tracing studies: one used different vibration patterns at line endpoints, while the other used auditory cues at bends. The Results in section 3.4 report line-recreation accuracy, not identification of basic shapes. Searches for shapes, five vertices, and vibratory cues at vertices found no passage testing the claimed effect on shape-identification accuracy. (LLM, conf=0.76)
Experimental — accuracy not yet measured
- Premisecitation
Vibrations have been shown to aid in non-visual panning and zooming of information on the screen.
“vibrations have been shown to aid in non-visual panning and zooming of information on the screen [52,54].”
Quote in the paperSubstantial claim1 of 2 sources checked- cites [52] 52. Hari Prasath Palani and Nicholas A. Giudice. 2014. Evaluation of non-visual panning operations using touch-screen devices. In Proceedings of the 16th International ACM SIGACCESS Conference on Computers & Accessibility. ACM, 293-294. source
- cites [54] 54. Hari Prasath Palani, Uro Giudice, and Nicholas A. Giudice. 2016. Evaluation of non-visual zooming operations on touchscreen devices. In Proceedings of the International Conference on Universal Access in Human-Computer Interaction. Springer, 162-174. source
The Experimental Stimuli and Apparatus section describes vibrations representing map features, and the Results section reports that participants used non-visual zooming and panning to learn the maps. The study tested a multimodal interface, however, and does not establish that vibration itself aided the panning and zooming operations; zoom levels were indicated by speech, while panning used a two-finger drag. (LLM, conf=0.84)
Experimental — accuracy not yet measured
- Interpretationreasoning
Saturation of sensation can lead to sensory fatigue and adaptation, making it difficult to continue to sense vibrating features on the touchscreen.
“This saturation of sensation can then lead to sensory fatigue and adaptation, making it difficult to continue to sense vibrating features on the touchscreen.”
Quote in the paperSubstantial claim1 of 3 sources checked- cites [26] 26. Jenna L. Gorlewicz, Jennifer L. Tennison, Hari Prasath Palani, and Nicholas A. Giudice. 2018. The graphical ac- cess challenge for people with visual impairments: Positions and pathways forward. In Interactive Multimedia. IntechOpen. source
Section 2.1 (p. 2) discusses how touchscreen vibrations differ from raised tactile graphics, while section 2.4 (p. 7) discusses uses of vibrotactile feedback. Neither addresses whether sensation becomes saturated, causes sensory fatigue or adaptation, or makes vibrating features harder to sense. Searches for those terms found no supporting passage in our copy. (LLM, conf=0.72)
Experimental — accuracy not yet measured - cites [39] 39. Roberta L. Klatzky, Nicholas A. Giudice, Christopher R. Bennett, and Jack M. Loomis. 2014. Touch-screen technology for the dynamic display of 2D spatial information without vision: Promise and progress.Multisens. Res. 27 (2014), 359-378. source
- cites [55] 55. Hari Prasath Palani, Jennifer L. Tennison, G. Bernard Giudice, and Nicholas A. Giudice. 2018. Touchscreen-based hap- tic information access for assisting blind and visually-impaired users: Perceptual parameters and design guidelines. In Proceedings of the International Conference on Applied Human Factors and Ergonomics. Springer, 837-847.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
If the frequency of a vibration is below 3 Hz, it is perceived as slow kinesthetic motion.
“If the frequency of a vibration is below 3 Hz, it is perceived as slow kinesthetic motion [68].”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [68] 68. Hong Z. Tan, Nathaniel I. Durlach, Charlotte M. Reed, and William M. Rabinowitz. 1999. Information transmission with a multifinger tactual display. Percept. Psychophys. 61, 6 (1999), 993-1008. source
- Premisecitation
Using a different feedback modality at vertices helps with shape identification.
“This approach carries over into shape exploration, where marking vertices with a different modality of feedback aids in shape identification [24,72].”
Quote in the paperSubstantial claim1 of 2 sources checked- cites [24] 24. Cagatay Goncu and Kim Marriott. 2011. GraVVITAS: Generic multi-touch presentation of accessible graphics. In Proceedings of the Conference on Human-Computer Interaction. Springer, 30-48. source
- cites [72] 72. Jennifer L. Tennison and Jenna L. Gorlewicz. 2019. Non-visual perception of lines on a multimodal touchscreen tablet. ACM Trans. Appl. Percept. 16, 1 (2019), 6. source
Section 1.1.1 reports prior work in which stronger vibrations or different sounds at vertices facilitated shape recognition. Section 4.3 uses auditory cues at key points on vibrating lines, but describes improved performance from separating the cues by modality as an expectation; this paper does not establish that switching modality at vertices improves shape identification. (LLM, conf=0.78)
Experimental — accuracy not yet measured
- Findingcitation
Users could accurately integrate and relate graphical elements even when those elements were presented across different zoom levels.
“Findings also suggested that users were able to accurately integrate and relate graphical elements even when presented across zoom levels [54].”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [54] 54. Hari Prasath Palani, Uro Giudice, and Nicholas A. Giudice. 2016. Evaluation of non-visual zooming operations on touchscreen devices. In Proceedings of the International Conference on Universal Access in Human-Computer Interaction. Springer, 162-174. source
- Premisecitation
From 100 to 300 Hz, one feels smooth vibration.
“and from 100 to 300 Hz, smooth vibration [68].”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [68] 68. Hong Z. Tan, Nathaniel I. Durlach, Charlotte M. Reed, and William M. Rabinowitz. 1999. Information transmission with a multifinger tactual display. Percept. Psychophys. 61, 6 (1999), 993-1008. source
The Method Stimuli passage describes smooth vibration as occurring above about 150 Hz, and the Motion Flutter/Vibration passage describes the 150- and 300-Hz stimuli as vibrations. The source does not establish that smooth vibration begins at 100 Hz, so it supports only part of the claimed range. (LLM, conf=0.87)
Experimental — accuracy not yet measured
- Premisecitation
From 10 to 70 Hz, one feels rough motion or fluttering.
“From 10 to 70 Hz, one feels rough motion or fluttering”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [68] 68. Hong Z. Tan, Nathaniel I. Durlach, Charlotte M. Reed, and William M. Rabinowitz. 1999. Information transmission with a multifinger tactual display. Percept. Psychophys. 61, 6 (1999), 993-1008. source
- Findingcitation
For nonlinear profiles, marking notable points (inflection points or start/end points) with additional feedback significantly increases accuracy of following such profiles.
“If a profile is nonlinear, we found that marking notable points (e.g., inflection points or start/end points) with additional feedback significantly increases the accuracy of being able to follow such profiles.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [73] 73. Jennifer L. Tennison, P. Merlin Uesbeck, Nicholas A. Giudice, Andreas Stefik, Derrick W. Smith, and Jenna L. Gorlewicz. 2020. Establishing vibration-based tactile line profiles for use in multimodal graphics. Trans. Appl. Per- cept. 17, 2 (2020), 1-14. source
- Findingcitation
No statistically significant differences were found between single and multi-point approaches.
“no statistically significant differences found between the two cases.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [73] 73. Jennifer L. Tennison, P. Merlin Uesbeck, Nicholas A. Giudice, Andreas Stefik, Derrick W. Smith, and Jenna L. Gorlewicz. 2020. Establishing vibration-based tactile line profiles for use in multimodal graphics. Trans. Appl. Per- cept. 17, 2 (2020), 1-14. source
- Findingcitation
Providing borders of differing feedback (auditory borders with a vibratory line or vice versa) are helpful in supporting fine-tracing tasks.
“We found that providing borders of a differing feedback (auditory borders with a vibratory line or vice versa) are helpful in supporting fine-tracing tasks”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [73] 73. Jennifer L. Tennison, P. Merlin Uesbeck, Nicholas A. Giudice, Andreas Stefik, Derrick W. Smith, and Jenna L. Gorlewicz. 2020. Establishing vibration-based tactile line profiles for use in multimodal graphics. Trans. Appl. Per- cept. 17, 2 (2020), 1-14. source
- Findingcitation
Appropriate gap spacing between vibrotactile lines should be at least 4mm to ensure each element can be identified as a distinct entity.
“We have also established that the appropriate gap spacing between vibrotactile lines should be at least 4mm, which ensures that each element can be identified as a distinct entity [55].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [55] 55. Hari Prasath Palani, Jennifer L. Tennison, G. Bernard Giudice, and Nicholas A. Giudice. 2018. Touchscreen-based hap- tic information access for assisting blind and visually-impaired users: Perceptual parameters and design guidelines. In Proceedings of the International Conference on Applied Human Factors and Ergonomics. Springer, 837-847.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Findingown data
All line profiles were traced with average deviations between 7-9mm.
“all line profiles being traced with average deviations between 7-9mm”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [73] 73. Jennifer L. Tennison, P. Merlin Uesbeck, Nicholas A. Giudice, Andreas Stefik, Derrick W. Smith, and Jenna L. Gorlewicz. 2020. Establishing vibration-based tactile line profiles for use in multimodal graphics. Trans. Appl. Per- cept. 17, 2 (2020), 1-14. source
- Findingreasoning
Conveying more than four vertex points in this manner makes the task overly complex.
“We note that conveying more than four vertex points in this manner makes the task overly complex.”
Quote in the paperSubstantial claim - Findingown data
The functional line width for supporting vibrotactile information extraction should be 4mm.
“we have determined that the functional line width for supporting vibrotactile information extraction should be 4mm”
Quote in the paperSubstantial claim - Findingcitation
Single modality lines are sufficient for most other tasks.
“but single modality lines are sufficient for most other tasks.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [73] 73. Jennifer L. Tennison, P. Merlin Uesbeck, Nicholas A. Giudice, Andreas Stefik, Derrick W. Smith, and Jenna L. Gorlewicz. 2020. Establishing vibration-based tactile line profiles for use in multimodal graphics. Trans. Appl. Per- cept. 17, 2 (2020), 1-14. source
- Findingown data
Both single and multi-point inflection point approaches were successful in illustrating impending changes in direction.
“From a performance standpoint, both the single and multi-point approach were successful, with all line profiles being traced with average deviations between 7-9mm and no statistically significant differences found between the two cases.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [73] 73. Jennifer L. Tennison, P. Merlin Uesbeck, Nicholas A. Giudice, Andreas Stefik, Derrick W. Smith, and Jenna L. Gorlewicz. 2020. Establishing vibration-based tactile line profiles for use in multimodal graphics. Trans. Appl. Per- cept. 17, 2 (2020), 1-14. source
- Findingcitation
A minimum cord length (and by extension angular separation) of 4mm should be maintained for accurate detection and discrimination of oriented vibrotactile lines.
“In Reference [55], we identified that a minimum cord length (and by extension the angular separation between two oriented lines) of 4mm should be maintained for accurate detection and discrimination of oriented vibrotactile lines.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [55] 55. Hari Prasath Palani, Jennifer L. Tennison, G. Bernard Giudice, and Nicholas A. Giudice. 2018. Touchscreen-based hap- tic information access for assisting blind and visually-impaired users: Perceptual parameters and design guidelines. In Proceedings of the International Conference on Applied Human Factors and Ergonomics. Springer, 837-847.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Findingown data
The minimal line width should be 1mm to support detection of vibrotactile elements.
“the minimal line width should be 1mm to support detection of vibrotactile elements.”
Quote in the paperSubstantial claim - Findingcitation
Compacting graphical features and making them smaller to fit a mobile phone display does not necessarily negatively impact a user's interpretation of the graphic.
“a recent investigation from our group comparing screen size effects on a pattern matching task demonstrated that compacting graphical features and making them smaller to fit a mobile phone display does not necessarily negatively impact a user's interpretation of the graphic [71].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [71] 71. Jennifer L. Tennison and Jenna L. Gorlewicz. 2016. Toward non-visual graphics representations on vibratory touch- screens: Shape exploration and identification. In Proceedings of the International Conference on Human Haptic Sensing and Touch Enabled Computer Applications. Springer, 384-395. source
- Findingcitation
In a recent study, users best distinguished three vibration profiles for traditionally embossed lines: 2.5 Hz for slow or dashed, 10 Hz for quick or dotted, and 50 Hz for constant or solid.
“In a recent study [74], we found users were able to best distinguish the following vibration profiles in terms of traditionally embossed lines: (1) 2.5 Hz to represent slow or dashed sensations; (2) 10 Hz to represent quick or dotted sensations; (3) 50 Hz to represent constant or solid sensations.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [74] 74. American Thermoform. 2019. Swell Touch Paper. Retrieved from http://www.americanthermoform.com/product/ swell-touch-paper/.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Findingcitation
Vibrations at 2.5 Hz best mapped to embossed dashed lines.
“we found vibrations at 2.5 Hz best mapped to embossed dashed lines”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [74] 74. American Thermoform. 2019. Swell Touch Paper. Retrieved from http://www.americanthermoform.com/product/ swell-touch-paper/.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Findingown data
Pseudo-multitouch can be programmed into some commercial Android touchscreen phones and tablets to account for multitouch in a narrow way.
“a pseudo-multitouch can be programmed into some commercial Android touchscreen phones and tablets to account for multitouch in a narrow way.”
Quote in the paperSubstantial claim - Findingown data
Reference markers and pop-sockets support comfortable ease of use in exploring the tablet on a table-top or desk environment.
“While we have found that the reference markers and pop-sockets support comfortable ease of use in exploring the tablet on a table-top or desk environment”
Quote in the paperNot a substantial claim - Findingreasoning
On a mobile phone, a simple graphic can often be identified much quicker than on a tablet, given the smaller amount of space that must be explored.
“On a mobile phone, a simple graphic can often be identified much quicker than on a tablet, given the smaller amount of space that must be explored.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [71] 71. Jennifer L. Tennison and Jenna L. Gorlewicz. 2016. Toward non-visual graphics representations on vibratory touch- screens: Shape exploration and identification. In Proceedings of the International Conference on Human Haptic Sensing and Touch Enabled Computer Applications. Springer, 384-395. source
- Findingown data
Speech and auditory cuing tend to be more effective for semantic information.
“whereas speech and auditory cuing for semantic information.”
Quote in the paperSubstantial claim - Findingown data
In a comparison of fixed-zoom and functional-zoom methods, the functional-zoom method was most efficient for non-visual zooming across cognitive and usability measures.
“Results found that across cognitive and usability measures, the functional-zoom method was most efficient for supporting non-visual zooming operations, which was congruent with earlier work that evaluated level-based zooming operations on tactile diagrams [61,63].”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [61] 61. Ravi Rastogi and Dianne T. V. Pawluk. 2010. Automatic, intuitive zooming for people who are blind or visually impaired. In Proceedings of the 12th International ACM SIGACCESS Conference on Computers and Accessibility. ACM, 239-240. source
- cites [63] 63. Ravi Rastogi, T. V. Dianne Pawluk, and Jessica Ketchum. 2013. Intuitive tactile zooming for graphics accessed by individuals who are blind and visually impaired. IEEE Trans. Neural Syst. Rehab. Eng. 21, 4 (2013), 655-663. source
- Findingown data
Vibration cuing tends to be more effective for spatial information.
“We have found that vibration cuing tends to be more effective for spatial information”
Quote in the paperSubstantial claim - Findingown data
In a comparison of four panning techniques on map learning performance across cognitive and usability measures, the two-finger drag technique was best for nonvisual panning.
“By comparing map learning performance with four different panning techniques across cognitive and usability measures, we have found that a two-finger drag technique is best served for performing nonvisual panning operations.”
Quote in the paperSubstantial claim - Findingcitation
Vibrations at 50 Hz best mapped to embossed solid lines.
“and 50 Hz to embossed solid lines.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [74] 74. American Thermoform. 2019. Swell Touch Paper. Retrieved from http://www.americanthermoform.com/product/ swell-touch-paper/.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Findingcitation
Vibrations at 10 Hz best mapped to embossed dotted lines.
“10 Hz to embossed dotted lines”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [74] 74. American Thermoform. 2019. Swell Touch Paper. Retrieved from http://www.americanthermoform.com/product/ swell-touch-paper/.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Findingcitation
Multi-stroke or multi-finger gestures can be difficult for VI users to perform because of timing and spatial constraints.
“We have observed (along with References [13,15,27]) that executing these types of gestures can be difficult for a VI user to perform due to the timing and spatial constraints of the gesture.”
Quote in the paperSubstantial claim0 of 3 sources checked- cites [13] 13. Maria Claudia Buzzi, Marina Buzzi, Barbara Leporini, and Amaury Trujillo. 2017. Analyzing visually impaired peo- ple's touch gestures on smartphones. Multimedia Tools Applic. 76, 4 (2017), 5141-5169. source
- cites [15] 15. Rafael Jeferson Pezzuto Damaceno, Juliana Cristina Braga, and Jesús Pascual Mena-Chalco. 2018. Mobile device ac- cessibility for the visually impaired: Problems mapping and recommendations. Univ. Access Inf. Soc. 17, 2 (2018), 421-435. source
- cites [27] 27. W. Grussenmeyer and E. Folmer. 2017. Accessible touchscreen technology for people with visual impairments: A survey. Trans. Access. Comput. 9, 2 (2017), 6:1-6:31. source
- Findingown data
From bar-chart heatmaps, participants spent most exploration at the top of bars, especially corners.
“From the bar-chart renderings, participants spent most of their exploration at the top of the bars, especially at the corners.”
Quote in the paperSubstantial claim- Rests on an assumption: Finger-location heatmaps accurately indicate the most important features and exploration behavior.
- Findingown data
Many participants reported difficulty creating a mental image of the shape because they had to hold much information in memory during exploration.
“Many remarked it was difficult to create a mental image of the shape due to the amount of information that was required to have in memory throughout the exploration.”
Quote in the paperSubstantial claim- Rests on an assumption: The evaluation questions and scoring validly measure participant knowledge and performance on the graphics.
- Findingown data
Very little time was spent at labels because participants did not need to explore entire text strings to obtain immediate audio messages.
“Very little time was spent at the labels, as participants did not need to explore the entirety of the text strings to obtain immediate audio messages of the labels.”
Quote in the paperSubstantial claim- Rests on an assumption: Finger-location heatmaps accurately indicate the most important features and exploration behavior.
- Findingown data
The double-tap gesture was difficult for several users to trigger.
“Another area that was observed as limiting the study was the double-tap gesture.Several users found the double-tap gesture difficult to trigger.”
Quote in the paperNot a substantial claim - Findingown data
The difference in performance between bar charts and geometric figures was statistically significant (t(37)=-2.99, p=.005, 95% CI -13.07%--2.511%, d=0.430).
“The difference was found to be statistically significant (t(37) = -2.99,p = .005,95% CI = -13.07%--2.511%,Cohen's d = 0.430).”
Quote in the paperNot a substantial claim- Rests on an assumption: The evaluation questions and scoring validly measure participant knowledge and performance on the graphics.
- Findingown data
Users frequently revisited important locations, using measured angles and segments as anchors for deciding where to explore next.
“Participants often returned to key points of interest, anchoring to angles and segments with defined measurements, to make their next exploration decisions.”
Quote in the paperSubstantial claim- Rests on an assumption: Finger-location heatmaps accurately indicate the most important features and exploration behavior.
- Findingown data
When exploring large spaces represented haptically, participants often remained at the boundary of vibratory feedback, tracing the edge between haptic and non-haptic areas.
“Participants tended to stay on the cusp of vibratory feedback when exploring large, haptically represented spaces, preferring to trace along the edge between haptics and no haptics.”
Quote in the paperSubstantial claim- Rests on an assumption: Finger-location heatmaps accurately indicate the most important features and exploration behavior.
- Findingown data
Geometric figure evaluations yielded higher scores than bar-chart evaluations: embossed geometry M=85.53%, multimodal geometry M=86.44%, embossed bar charts M=81.82%, multimodal bar charts M=76.56%.
“Participants performed better on geometric figure evaluations (embossed: M = 85.53%; multimodal: M = 86.44%)than on the bar-chart evaluations (embossed: M = 81.82%;multimodal: M = 76.56%).”
Quote in the paperNot a substantial claim- Rests on an assumption: The evaluation questions and scoring validly measure participant knowledge and performance on the graphics.
- Findingown data
Geometric figure representations were frustrating to participants.
“Geometric figure representations, while simpler and more successfully evaluated, were frustrating to the participants.”
Quote in the paperSubstantial claim- Rests on an assumption: The evaluation questions and scoring validly measure participant knowledge and performance on the graphics.
- Findingreasoning
The color-based feedback approach did not support more complicated interactions such as overlapping areas.
“Third, it does not support more complicated interactions, such as overlapping areas.”
Quote in the paperNot a substantial claim - Findingown data
For geometric figures, heatmaps show majority of exploration time was spent learning the outline of the shape.
“For rendering of geometric figures, the heatmaps demonstrate a majority of the exploration time spent by participants was to learn the outline of the shape.”
Quote in the paperSubstantial claim- Rests on an assumption: Finger-location heatmaps accurately indicate the most important features and exploration behavior.
- Findingown data
The study found no significant performance difference between the two media.
“No significant difference in performance was found between mediums.”
Quote in the paperSubstantial claim- Rests on an assumption: The evaluation questions and scoring validly measure participant knowledge and performance on the graphics.
- Findingown data
Paired-sample t-tests found no statistically significant difference between embossed and touchscreen bar charts in percent correct (t(18)=1.68, p=.11, 95% CI -1.32-11.85, d=0.269).
“The analysis revealed no statistically significant differences between the percent means of embossed and touchscreen bar charts (t(18) = 1.68, p = .11,95% CI = -1.32-11.85,Cohen's d = 0.269)”
Quote in the paperSubstantial claim- Rests on an assumption: The evaluation questions and scoring validly measure participant knowledge and performance on the graphics.
- Findingown data
The text-to-speech rate was too quick for some users.
“Additionally, after some testing, our team discovered that the text-to-speech rate was too quick for some users.”
Quote in the paperNot a substantial claim - Findingown data
Paired-sample t-tests found no statistically significant difference between embossed and touchscreen geometric images in percent correct (t(21)=-.366, p=.718, 95% CI -8.14--5.71, d=0.073).
“nor geometric images (t(21) = -.366,p = .718,95% CI = -8.14--5.71,Cohen's d = 0.073)”
Quote in the paperSubstantial claim- Rests on an assumption: The evaluation questions and scoring validly measure participant knowledge and performance on the graphics.
- Findingown data
Users appreciated the immediacy with which they could obtain basic information about the bar chart.
“They appreciated the immediacy in which they were able to obtain basic information about the chart.”
Quote in the paperNot a substantial claim- Rests on an assumption: The evaluation questions and scoring validly measure participant knowledge and performance on the graphics.
- Findingreasoning
Even without direct timing data, the experimenters noted that embossed graphics were still faster to evaluate.
“Although direct time comparisons were not measured, experimenters observed that embossed graphics remained quicker to evaluate.”
Quote in the paperNot a substantial claim- Rests on an assumption: The evaluation questions and scoring validly measure participant knowledge and performance on the graphics.
- Premisecitation
Vision is estimated to have 500 times greater sensory bandwidth than touch.
“vision is estimated to have 500 times greater sensory bandwidth than touch [43].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [43] 43. Jack M. Loomis, Roberta L. Klatzky, and Nicholas A. Giudice. 2018. Sensory substitution of vision: Importance of perceptual and cognitive processing. In Assistive Technology for Blindness and Low Vision. CRC Press, 179-210. source
- Interpretationreasoning
The touchscreen approach can almost immediately reach a high percentage of end-users.
“it can almost immediately reach the hands of a high percentage of end-users.”
Quote in the paperSubstantial claim- Rests on an assumption: Recent estimates suggest that 70%-90% of VI cell phone users have smart phones in the United States.
- Premisecitation
Vibrations can support navigation, education, and everyday tasks for individuals with visual impairments.
“recent research demonstrating the use of vibrations for supporting navigation, education, and everyday tasks for individuals with VI [23][24][25]39].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [23][24][25]39]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationreasoning
Vibrotactile perception differs in several ways compared to stimuli received from physical tactile graphics.
“vibrotactile perception differs in several ways compared to the stimuli received from physical tactile graphics.”
Quote in the paperSubstantial claim- Rests on an assumption: Physical stimuli are often cutaneous cues perceived via pressure-based mechanoreceptors, whereas vibration cues innervate pacinian corpuscles, which are functionally different.
- Interpretationreasoning
Because of this distinction, findings from previous research using physical stimuli are not necessarily relevant for rendering touchscreen-based vibrotactile graphics.
“Because of this distinction, findings from previous research using physical stimuli are not necessarily relevant for rendering touchscreen-based vibrotactile graphics.”
Quote in the paperSubstantial claim- Rests on an assumption: Physical stimuli are often cutaneous cues perceived via pressure-based mechanoreceptors, whereas vibration cues innervate pacinian corpuscles, which are functionally different.
- Interpretationreasoning
This high penetration of the VI assistive technology market is challenging to attain with single-purpose, hardware solutions.
“This high penetration of the VI AT market is incredibly challenging to attain with single-purpose, hardware solutions.”
Quote in the paperSubstantial claim- Rests on an assumption: Recent estimates suggest that 70%-90% of VI cell phone users have smart phones in the United States.
- Premisecitation
Using feedback across modalities to help differentiate important points is supported by other research.
“The concept of using feedback across modalities to help differentiate important points is supported by other research, including References [24,60].”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [24] 24. Cagatay Goncu and Kim Marriott. 2011. GraVVITAS: Generic multi-touch presentation of accessible graphics. In Proceedings of the Conference on Human-Computer Interaction. Springer, 30-48. source
- cites [60] 60. Monoj Kumar Raja. 2011. The Development and Validation of a New Smartphone Based Non-visual Spatial Interface for Learning Indoor Layouts. Master's Thesis. The University of Maine.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
Haptic and visual modalities differ in how information is accessed, the type and amount of access to data, sensory adaptation, spatial resolving power, temporal integration, spatial localization, and vulnerability to systematic distortion.
“Differences between these modalities occur in aspects such as how the information is accessed, the type and amount of access to data that is available, sensory adaptation, spatial resolving power, temporal integration, spatial localization, and vulnerability to systematic distortion [31,39].”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [31] 31. Yvette Hatwell, Arlette Streri, and Edouard Gentaz. 2003. Touching for Knowing: Cognitive Psychology of Haptic Manual Perception. Vol. 53. John Benjamins Publishing. source
- cites [39] 39. Roberta L. Klatzky, Nicholas A. Giudice, Christopher R. Bennett, and Jack M. Loomis. 2014. Touch-screen technology for the dynamic display of 2D spatial information without vision: Promise and progress.Multisens. Res. 27 (2014), 359-378. source
- Interpretationreasoning
A large number of vertices seems to cause users to lose their place or lose track of previously accessed points, limiting ability to accurately identify the shape.
“A large number of vertices seems to cause users to lose their place or to lose track of previously accessed points, thus limiting the ability to accurately identify the shape.”
Quote in the paperSubstantial claim - Premisecitation
Physical media exploration relies on three primary procedures: lateral scanning, edge following, and whole-hand global exploration.
“With physical media, there are three main exploratory procedures users employ to access and extract graphical information: (1) lateral scanning, (2) edge following, and (3) global exploration with the whole hand [36,41,44,50].”
Quote in the paperNot a substantial claim0 of 4 sources checked- cites [36] 36. Lynette A. Jones and Susan J. Lederman. 2006. Human Hand Function. Oxford University Press. source
- cites [41] 41. Susan J. Lederman and Roberta L. Klatzky. 1987. Hand movements: A window into haptic object recognition. Cog. Psychol. 19 (1987), 342-368. source
- cites [44] 44. Jack M. Loomis and Susan J. Lederman. 1986. Tactual perception. Handbook Percept. Hum. Perform. 2 (1986), 2.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [50] 50. Uran Oh, Stacy Branham, Leah Findlater, and Shaun K. Kane. 2015. Audio-based feedback techniques for teaching touchscreen gestures. ACM Trans. Access. Comput. 7, 3 (2015), 9. source
- Interpretationreasoning
Traditional exploration strategies using multiple fingers or hands as a frame of reference are not yet technically possible.
“traditional exploration strategies using multiple fingers or hands as a frame of reference are not yet technically possible”
Quote in the paperSubstantial claim- Rests on an assumption: Vibration feedback is not localized, resulting in the majority of exploration needing to be done via a single finger.
- Premisereasoning
Evaluations on non-visual panning and zooming techniques (two-finger panning and functional zooming) were based on pseudo-multitouch techniques.
“The aforementioned evaluations on non-visual panning and zooming techniques (i.e., two-finger panning and functional zooming) were also based on such pseudo-multitouch techniques.”
Quote in the paperSubstantial claim - Interpretationown data
Large touchscreens do not necessarily have inherent benefit over small touchscreens such as mobile phones.
“This does not necessarily indicate that large touchscreens have inherent benefit over small touchscreens, such as mobile phones.”
Quote in the paperSubstantial claim - Premisecitation
In the perceptual space of vibrotactile stimuli, qualitative differences are expressed by two distinct perceptual axes: 40-100 Hz vibrations categorized as smooth and clear, and 100-250 Hz vibrations categorized as jagged and bumpy.
“In the perceptual space of vibrotactile stimuli, such qualitative differences are expressed by two distinct perceptual axes composed of 40-100 Hz vibrations (categorized as smooth and clear) and 100-250 Hz vibrations (categorized as jagged and bumpy), respectively [33].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [33] 33. Inwook Hwang and Seungmoon Choi. 2010. Perceptual space and adjective rating of sinusoidal vibrations perceived via mobile device. In Proceedings of the IEEE Haptics Symposium. IEEE, 1-8. source
- Premisecitation
Lack of physical boundaries on the active screen area of a touchscreen makes it very difficult to know whether one is exploring in the active working area or on the borders.
“the lack of physical boundaries on the active screen area of a touchscreen make it very difficult to know whether one is exploring in the active working area of the screen or if one is on the borders (see Reference [15] for a brief discussion).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [15] 15. Rafael Jeferson Pezzuto Damaceno, Juliana Cristina Braga, and Jesús Pascual Mena-Chalco. 2018. Mobile device ac- cessibility for the visually impaired: Problems mapping and recommendations. Univ. Access Inf. Soc. 17, 2 (2018), 421-435. source
- Interpretationreasoning
This limits one's ability to quickly capture a global view of the on-screen content.
“This limits one's ability to quickly capture a global view of the on-screen content.”
Quote in the paperSubstantial claim- Rests on an assumption: Vibration feedback is not localized, resulting in the majority of exploration needing to be done via a single finger.
- Premisecitation
Auditory feedback at inflection points has been successful in signaling orientation changes.
“Marking inflection points with auditory feedback has also been successful in letting users know that there is a change in orientation of the profile [73].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [73] 73. Jennifer L. Tennison, P. Merlin Uesbeck, Nicholas A. Giudice, Andreas Stefik, Derrick W. Smith, and Jenna L. Gorlewicz. 2020. Establishing vibration-based tactile line profiles for use in multimodal graphics. Trans. Appl. Per- cept. 17, 2 (2020), 1-14. source
- Study design and conductreasoning
All of the above studies have been conducted on Android-powered hardware platforms.
“Finally, all of the above studies have been conducted on Android-powered hardware platforms.”
Quote in the paperSubstantial claim - Premisecitation
High-intensity, constant buzzing for extended lengths of time can increase the risk for sensory fatigue in the fingertips.
“The latter can often increase the risk for sensory fatigue in the fingertips [60].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [60] 60. Monoj Kumar Raja. 2011. The Development and Validation of a New Smartphone Based Non-visual Spatial Interface for Learning Indoor Layouts. Master's Thesis. The University of Maine.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationreasoning
The study cannot show what extended training and use of multimodal graphics might make possible.
“We acknowledge that this study does not capture what may be possible with multimodal graphics over extended training and use.”
Quote in the paperNot a substantial claim - Interpretationown data
For non-visual rendering, a wide bar area might not be needed provided users can locate and trace the bar without difficulty.
“Therefore a large bar space, while visually appealing, may be unnecessary in a non-visual rendering as long as the bar can be readily found and easily traced by users.”
Quote in the paperSubstantial claim- Rests on an assumption: Finger-location heatmaps accurately indicate the most important features and exploration behavior.
- Study design and conductnone given
The information evaluated with the graphics was lower level than many participants had recent experience with or could remember from school.
“Third, the information being evaluated with the graphics was lowerlevel than many participants had recent experience with or could remember from their primary and secondary school experience.”
Quote in the paperNot a substantial claim - Study design and conductreasoning
The study was constrained by time, resulting in low within-subjects trials.
“First, we were constrained by time, and thus our within subjects trials were low.”
Quote in the paperNot a substantial claim - Interpretationown data
Performance with multimodal graphics following the article's guidelines is within the statistical margin of error of traditional embossed tactile graphics.
“These results show that performance when using the multimodal graphics as informed by the guidelines put forth in this article is within the statistical margin of error observed with traditional, embossed tactile graphics.”
Quote in the paperSubstantial claim- Rests on an assumption: The evaluation questions and scoring validly measure participant knowledge and performance on the graphics.
- Rests on an assumption: The study's findings can be generalized to students and adults with visual impairments in classroom and data-reading contexts.
- Rests on an assumption: The multimodal touchscreen graphics tested were implemented in accordance with the article's guidelines.
- May combine two claims. 48
- Classified as probably not a substantial claim. 52
May combine two claims.
PremisecitationVibrations are effective in representing maps, building floor plans, lines, graphs, shapes, and simple graphic entities.
“recent investigations have demonstrated that vibrations are effective in representing maps [59] and building floor plans [22], accurately perceiving and following lines and graphs [23,55,73], representing graphical shapes [24,72], and representing simple graphic entities [30].”
Quote in the paperSubstantial claim1 of 5 sources checked- cites [59] 59. Benjamin Poppinga, Charlotte Magnusson, Martin Pielot, and Kirsten Rassmus-Gröhn. 2011. TouchOver map: Audio- tactile exploration of interactive maps. In Proceedings of the 13th International Conference on Human Computer Inter- action with Mobile Devices and Services. ACM, 545-550. source
- cites [22] 22. Nicholas A. Giudice, Benjamin A. Guenther, Nicholas A. Jensen, and Kaitlyn N. Haase. 2020. Cognitive mapping without vision: Comparing wayfinding performance after learning from digital touchscreen-based multimodal maps vs. embossed tactile overlays. Front. Hum. Neurosci. 14 (2020), 87. source
- cites [23] 23. Nicholas A. Giudice, Hari Prasath Palani, Eric Brenner, and Kevin M. Kramer. 2012. Learning non-visual graphi- cal information using a touch-based vibro-audio interface. In Proceedings of the 14th International ACM SIGACCESS Conference on Computers & Accessibility. ACM, 103-110. source
- cites [55] 55. Hari Prasath Palani, Jennifer L. Tennison, G. Bernard Giudice, and Nicholas A. Giudice. 2018. Touchscreen-based hap- tic information access for assisting blind and visually-impaired users: Perceptual parameters and design guidelines. In Proceedings of the International Conference on Applied Human Factors and Ergonomics. Springer, 837-847. source
- cites [73] 73. Jennifer L. Tennison, P. Merlin Uesbeck, Nicholas A. Giudice, Andreas Stefik, Derrick W. Smith, and Jenna L. Gorlewicz. 2020. Establishing vibration-based tactile line profiles for use in multimodal graphics. Trans. Appl. Per- cept. 17, 2 (2020), 1-14. source
May combine two claims.
PremisecitationTouch is a fundamental part of perception but is not an all-encompassing substitute for vision.
“While touch is a fundamental part of our perception [42,45], it is not an all-encompassing substitute for vision.”
Quote in the paperSubstantial claim1 of 2 sources checked- cites [42] 42. Susan J. Lederman and Roberta L. Klatzky. 2009. Haptic perception: A tutorial. Atten. Percept. Psychophys. 71, 7 (2009), 1439-1459. source
- cites [45] 45. James Minogue and M. Gail Jones. 2006. Haptics in education: Exploring an untapped sensory modality. Rev. Educ. Res. 76, 3 (2006), 317-348. source
May combine two claims.
InterpretationcitationLack of localized vibration provides users with no gradient of direction and can trigger sensory adaptation, fatiguing a user's finger.
“This is problematic, because it provides users with no gradient of direction and can trigger sensory adaptation of feedback, fatiguing a user's finger of the vibration sensation [26,39,55].”
Quote in the paperSubstantial claim1 of 3 sources checked- cites [26] 26. Jenna L. Gorlewicz, Jennifer L. Tennison, Hari Prasath Palani, and Nicholas A. Giudice. 2018. The graphical ac- cess challenge for people with visual impairments: Positions and pathways forward. In Interactive Multimedia. IntechOpen. source
Section 2.1 (p. 2) says flat-touchscreen vibrations lack the direct cutaneous cues of raised graphics, but it does not say they lack a directional gradient. Searches for localized vibration, sensory adaptation, and finger fatigue found no passage in our copy addressing those claims. (LLM, conf=0.72)
Experimental — accuracy not yet measured - cites [39] 39. Roberta L. Klatzky, Nicholas A. Giudice, Christopher R. Bennett, and Jack M. Loomis. 2014. Touch-screen technology for the dynamic display of 2D spatial information without vision: Promise and progress.Multisens. Res. 27 (2014), 359-378. source
- cites [55] 55. Hari Prasath Palani, Jennifer L. Tennison, G. Bernard Giudice, and Nicholas A. Giudice. 2018. Touchscreen-based hap- tic information access for assisting blind and visually-impaired users: Perceptual parameters and design guidelines. In Proceedings of the International Conference on Applied Human Factors and Ergonomics. Springer, 837-847. source
- Rests on an assumption: Commercially available touchscreens are featureless glass panes currently incapable of delivering localized vibration.
May combine two claims.
FindingcitationAcross multiple experiments, users also used techniques such as making crosses at vertices to locate connecting segments and scanning horizontally to find symmetry.
“We have also aggregated shape and line exploration strategies observed across multiple experiments and found that users employed additional techniques including making crosses at vertex points to find connecting line segments (B) and scanning horizontally across the shape to uncover symmetry (C) [29,72].”
Quote in the paperNot a substantial claim1 of 2 sources checked- cites [29] 29. Tiago Guerreiro, Kyle Montague, João Guerreiro, Rafael Nunes, Hugo Nicolau, and Daniel J. V. Gonçalves. 2015. Blind people interacting with large touch surfaces: Strategies for one-handed and two-handed exploration. In Proceedings of the International Conference on Interactive Tabletops & Surfaces. 25-34. source
- cites [72] 72. Jennifer L. Tennison and Jenna L. Gorlewicz. 2019. Non-visual perception of lines on a multimodal touchscreen tablet. ACM Trans. Appl. Percept. 16, 1 (2019), 6. source
Section 4.6 (page unavailable) reports that two participants used zigzag or circular movements to follow lines, but it does not describe making crosses at vertices or scanning horizontally to find symmetry. Searches for those techniques, including “vertex” and “symmetry,” found no passage in our copy addressing them. (LLM, conf=0.75)
Experimental — accuracy not yet measured
May combine two claims.
Findingcitation4mm ensures discrimination of vibrotactile lines rendered parallel to each other, but is not generalizable to oriented lines that subtend an angle.
“While 4mm ensures discrimination of vibrotactile lines rendered parallel to each other, they are not generalizable to oriented lines that subtend an angle between each other.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
FindingreasoningThe above techniques are best suited for traditional tablet sizes (approximately 9-10 inches).
“The above techniques are best suited for traditional tablet sizes (≈ 9-10 ).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataAlternative poses such as holding the tablet in one hand and exploring with the other are viable options.
“alternative poses such as holding the tablet in one hand and exploring with the other are also viable options.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Findingown dataNew users of multimodal graphics may need some training on how to best perceive and extract vibrotactile information.
“we have found new users of multimodal graphics may need some training on how to best perceive and extract vibrotactile information.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S4 (based).
Findingown dataUsers exploring onscreen content often look for some type of feedback semi-frequently, otherwise concerns arise of having drifted off the object of interest or out of the active screen areas.
“We have anecdotally observed that users who are exploring onscreen content often look for some type of feedback semi-frequently, otherwise concerns arise of having drifted off of the object of interest or out of the active screen areas.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataThis process is most useful in teaching individuals to use complementary fingers as anchoring and referencing points.
“From a practical implementation, we have found this process to be most useful in teaching individuals to use complementary fingers as anchoring and referencing points.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable).
Findingown dataWhile authoring multimodal graphics, we have discovered the importance of being cognizant of the user's approach to interpreting them.
“While authoring multimodal graphics, we have discovered the importance of being cognizant of the user's approach to interpreting them.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataAdding small rubber dots along the vertical sides of the screen, or placing thin plastic tape across the perimeter of the active screen area, helps users remain in the active screen area and access easily identifiable reference points.
“We have found that adding small, rubber dots along the vertical sides of the screen, or placing thin plastic tape across the perimeter of the active screen area, helps users in both ensuring that they remain in the active screen area and that they can also access easily identifiable reference points.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S4 (based).
Findingnone givenSimple tones tend to be preferred over highly stimulating auditory profiles.
“From an auditory perspective, simple tones tend to be preferred over highly stimulating profiles.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
FindingreasoningUsing more than three to five vibration profiles total is ineffective from a perceptual and cognitive standpoint.
“we have not found a need for more than this, and more importantly, acknowledge the ineffectiveness of using too many signals of the same modality from a perceptual and cognitive standpoint.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
FindingreasoningProviding cues (a low-level clicking sound or a verbal cue stating no information) is preferred over leaving open white space without feedback.
“we have found that providing cues (a low-level clicking sound or even a verbal cue stating “no information”) is preferred rather than leaving a lot of open, white space that does not provide any feedback.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
FindingreasoningReference fingers should not come too close together, as a new centroid point would then be calculated between the two fingers and could result in spurious triggering of feedback.
“These reference fingers, however, should not come too close together, as a new centroid point would then be calculated between the two fingers and could result in spurious triggering of feedback.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataOther fingers cannot trigger feedback but can act as guides and reference points to remember key places on the screen.
“While other fingers cannot trigger feedback, they can act as guides and reference points to remember key places on the screen.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S4 (based).
Findingnone givenAffixing stands or mounts to the bottom of the tablet prevents vibration dampening from vibrations dissipating from the device to other surfaces.
“To prevent vibration dampening from vibrations dissipating from the device to other surfaces, we recommend an additional hardware modification-affixing stands or mounts to the bottom of the tablet when possible”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
Findingnone givenIt is best to have text read aloud when a user's finger is over the text in the diagram.
“Currently, we have found it best to have text read aloud when a user's finger is over the text in the diagram.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Findingown dataTwenty-two participants with visual impairment took part, recruited from the National Federation of the Blind national convention in 2019.
“Twenty-two participants with visual impairment participated in this experiment, recruited from the National Federation of the Blind (NFB) national convention in 2019.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataSome participants could not remember the difference between y- or x-axes or how to differentiate types of triangles.
“For instance, some participants could not remember the difference between the y-or x-axes nor could some remember how to differentiate between different types of triangles (right, acute, obtuse).”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataMany users described the multimodal bar-chart representations as the strongest and easiest to understand, even though those graphics had slightly worse performance.
“Despite having slightly worse performance of the two graphics, many users remarked that the multimodal bar-chart representations were the strongest and easiest to understand.”
Quote in the paperSubstantial claim- Rests on an assumption: The evaluation questions and scoring validly measure participant knowledge and performance on the graphics.
May combine two claims.
FindingreasoningNot much time was spent tracing middle sections of long lines; if participants remembered a key point nearby, they chose to find it from another spatial reference rather than trace the line all the way down.
“Because of this, not much time was spent tracing the middle sections of long lines-if participants remembered there was a key point nearby, they chose to find the key point from another spatial reference rather than trace the line all the way down.”
Quote in the paperSubstantial claim- Rests on an assumption: Finger-location heatmaps accurately indicate the most important features and exploration behavior.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataTen of the 22 participants reported some light perception, and all but one reported no residual vision and complete blindness.
“Ten of the 22 participants stated that they had some form of light perception and all but 1 individual (who chose not to respond) stated that they had no residual vision and were completely blind.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataIn the study, the issue with double-tap was positioning rather than speed; users sometimes did not tap twice on the exact same location.
“However, in this study, speed was not the issue encountered, but rather positioning.It was observed that users would sometimes not tap twice on the exact same location.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataUsers pressed strongly on the screen when following vibrating lines or bars, causing the tablet to move slightly on the table.
“We also note that it was observed that users pressed quite strongly on the screen when following vibrating lines or bars.This caused the tablet to move slightly on the table during exploration.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataOf the 22 participants, 16 had enough tactile diagram experience to need almost no additional assistance, while 6 requested assistance.
“Of the 22 participants, 16 participants had sufficient experience with tactile diagrams to require almost no additional assistance, but 6 requested assistance reading the tactile diagrams.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe menu bar implementation reduced screen real estate and caused accidental presses by users.
“It quickly became apparent, however, that this implementation reduced screen real estate and introduced accidental presses from users.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe double-tap gesture was not always activated correctly within the study, causing confusion for participants.
“As such, the gesture was not always activated correctly within the study, which caused confusion for participants.”
Quote in the paperNot a substantial claim- Rests on an assumption: AndroidOS cannot register two finger touchdowns as a double-tap unless they occur within a couple of millimeters of each other.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataMost participants (N=22; average age 41) were female (N=13) and highly educated (N=16 had finished college or held graduate degrees).
“A majority of these participants (N = 22; average age = 41 years) were female (N = 13) and highly educated (N = 16 finished college or had graduate degrees).”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataAverage participant performance on multimodal touchscreen graphics was 80.09%, comparable to 81.83% on traditional embossed graphics.
“On average, a participant's performance on multimodal, touchscreen-based graphics (M = 80.09%) was on par with their performance on the traditional embossed graphic (M = 81.83%).”
Quote in the paperSubstantial claim- Rests on an assumption: The evaluation questions and scoring validly measure participant knowledge and performance on the graphics.
Probably not a substantial claim: may not pass S3 (load-bearing).
Findingnone givenThe color-based feedback approach required each image's distinct components to be differentiated in a graphics program.
“First, every image must have its distinct components differentiated using a graphics program.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataParticipants had a wide range of diagnoses, most commonly Leber Congenital Amerosis (N=4), Glaucoma (N=3), and Retinitis Pigmentosa (N=3).
“Participants represented a wide range of diagnoses, the most common being Leber Congenital Amerosis (N = 4), Glaucoma (N = 3), and Retinitis Pigmentosa (N = 3) (see Table 6 for complete demographics).”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationcitationThese findings illustrate the potential for vibrations to be a primary interaction modality for all individuals and a critical piece in closing the graphical access gap for individuals with visual impairments.
“These findings have illustrated the potential for vibrations to not only be a primary interaction modality for all individuals, but to be a critical piece in closing the graphical access gap for individuals with VI.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown dataSignaling can be done within modality using different vibration patterns, but this comes with limitations.
“This work illustrates that signaling can also be done within modality (as was done in this case by using different vibration patterns), but this comes with limitations.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
PremisecitationThere is significant literature on tactile thresholds for physical stimuli, the effect of aging on tactile ability, and the tactile science supporting Braille reading and pattern recognition.
“there is significant literature on tactile thresholds for physical stimuli [20,36], the effect of aging on tactile ability [66], and the tactile “science” supporting Braille reading and pattern recognition [76]”
Quote in the paperSubstantial claim0 of 4 sources checked- cites [20] 20. George A. Gescheider, John H. Wright, and Ronald T. Verrillo. 2010. Information-processing Channels in the Tactile Sensory System: A Psychophysical and Physiological Analysis. Psychology Press.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [36] 36. Lynette A. Jones and Susan J. Lederman. 2006. Human Hand Function. Oxford University Press. source
- cites [66] 66. Joseph C. Stevens, Emerson Foulke, and Matthew Q. Patterson. 1996. Tactile acuity, aging, and Braille reading in long-term blindness.J. Exper. Psychol.: Appl. 2, 2 (1996), 91. source
- cites [76] 76. Yasemin Vardar, Burak Güçlü, and Cagatay Basdogan. 2017. Effect of waveform on tactile perception by electrovibra- tion displayed on touch screens. IEEE Trans. Haptics 10, 4 (2017), 488-499. source
May combine two claims.
InterpretationreasoningVibratory touchscreens do not offer fine distinction and vibrate the entirety of the fingertip no matter what part is in contact with an object.
“vibratory touchscreens do not offer such fine distinction and, instead, vibrate the entirety of the fingertip no matter what part is in contact with an object.”
Quote in the paperSubstantial claim- Rests on an assumption: Commercially available touchscreens are featureless glass panes currently incapable of delivering localized vibration.
May combine two claims.
InterpretationreasoningThis change in vibration patterns gives users key points to identify and salient landmarks to count and return to during exploration.
“This change in vibration patterns gives users key points to identify and salient landmarks to count and to return to during their exploration.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningThese limitations challenge designers of multimodal, tactile graphics.
“These limitations undoubtedly challenge designers of multimodal, tactile graphics.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationGuidelines and standards for tactile graphics such as those developed by the Braille Authority of North America and Braille Literacy Canada have formalized hard-copy tactile graphics and provided a framework for consistency in presentation of information that can be widely adopted.
“guidelines and standards for tactile graphics such as those developed by the Braille Authority of North America [8] and Braille Literacy Canada [9] have formalized hard-copy tactile graphics and have provided a framework for consistency in presentation of information that can be widely adopted.”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [8] 8. BANA. 2019. Code Books and Guidelines. Retrieved from http://www.brailleauthority.org/publications-area.html.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [9] 9. BLC. 2019. Braille Literacy Canada. Retrieved from http://www.brailleliteracycanada.ca/en/.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
PremisereasoningPrinciples for creating hard-copy tactile graphics exist, but only a subset apply to touchscreen-based graphics because of fundamental differences in how these graphics are conveyed.
“While there are principles that exist for creating hard-copy tactile graphics [8], only a subset of them apply here, because of the fundamental differences in the way these graphics are conveyed.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [8] 8. BANA. 2019. Code Books and Guidelines. Retrieved from http://www.brailleauthority.org/publications-area.html.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S4 (based). May combine two claims.
InterpretationreasoningBecause vibration actuation is common in commercially available touch-based platforms, the necessary hardware capabilities are already present and adopted within the VI community, making the potential for adoption and widespread use high.
“Namely, because vibration actuation is common in commercially available, touch-based platforms, the necessary hardware capabilities are already present and adopted within the VI community, making the potential for adoption and widespread use high.”
Quote in the paperNot a substantial claim- Rests on an assumption: Touchscreens are now often outfitted with vibration capabilities.
May combine two claims.
PremisecitationUsers must keep track of all important kinesthetic and spatial cues to perceive content correctly, highlighting the haptic system's spatial bandwidth and temporal processing limitations.
“Users must keep track of all important kinesthetic and spatial cues to perceive content correctly, highlighting the haptic system's spatial bandwidth and temporal processing limitations [39].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [39] 39. Roberta L. Klatzky, Nicholas A. Giudice, Christopher R. Bennett, and Jack M. Loomis. 2014. Touch-screen technology for the dynamic display of 2D spatial information without vision: Promise and progress.Multisens. Res. 27 (2014), 359-378. source
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationApple has recently released Core Haptics for newer iOS devices (iPhone 8 and above), which promises to provide more flexibility to developers using tactile feedback in their applications.
“Apple has recently released Core Haptics for newer iOS devices (iPhone 8 and above), which promises to provide more flexibility to developers using tactile feedback in their applications [16].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [16] 16. Core Haptics | Apple Developer. 2020. Retrieved from https://developer.apple.com/documentation/corehaptics.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
PremisecitationHuman recorded speech may be preferred over TTS engines.
“It is acknowledged that human recorded speech may be preferred over TTS engines”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [28] 28. João Guerreiro and Daniel Gonçalves. 2015. Faster text-to-speeches: Enhancing blind people's information scanning with faster concurrent speech. In Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility. 3-11. source
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationIncluding multiple concurrent voices can improve the speed and comprehension of scanning for information.
“including multiple concurrent voices can improve the speed and comprehension of scanning for information [28].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [28] 28. João Guerreiro and Daniel Gonçalves. 2015. Faster text-to-speeches: Enhancing blind people's information scanning with faster concurrent speech. In Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility. 3-11. source
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationSonification techniques have been used successfully in relaying graphical information.
“There is a wealth of information available on using sonification techniques successfully in relaying graphical information, and we refer users to References [23,48,49,59,[79][80][81] for more details.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [23,48,49,59,[79][80][81]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
InterpretationreasoningThe single touch limitation makes detection of angled or curving trajectories particularly challenging, relying largely on the kinesthetic system, which is rather noisy.
“This single touch limitation makes detection of angled or curving trajectories particularly challenging, relying largely on the kinesthetic system, which is rather noisy.”
Quote in the paperSubstantial claim- Rests on an assumption: Vibration feedback is not localized, resulting in the majority of exploration needing to be done via a single finger.
Classified as probably not a substantial claim.
InterpretationreasoningRelatively simple adaptations can be made in hardware and software that make exploration of multimodal graphics easier.
“Collectively, relatively simple adaptations can be made in hardware and software that make exploration of multimodal graphics easier.”
Quote in the paperSubstantial claimMay combine two claims.
PremisecitationSpatial information integrated across time and space in physical media is not always precise, which can harm the accuracy of mental images.
“This integration is also not always precise, which can negatively affect creation of a mental image with accurate spatial features [83].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [83] 83. Heng Xu, Michael A. Peshkin, and J. Edward Colgate. 2019. UltraShiver: Lateral force feedback on a bare fingertip via ultrasonic oscillation and electroadhesion. IEEE Trans. Haptics 12, 4 (2019), 497-507.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenOur group has not conducted formal studies comparing one exploration technique from the other.
“While our group has not conducted formal studies comparing one exploration technique from the other”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Study design and conductown dataWe have informally aggregated common exploration strategies that have resulted in high achieving outcomes from previous user studies.
“we have informally aggregated common exploration strategies that have resulted in high achieving outcomes from previous user studies.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S2 (checkable). May combine two claims.
InterpretationreasoningBar charts and geometry figures are fruitful for scaling up the design guidelines and are fundamental math concepts from which more complex graphics can be designed.
“Therefore, these two concepts provide fruitful ground for scaling up the design guidelines and strategies employed to date but also represent fundamental concepts in mathematics from which additional complex graphics can be designed.”
Quote in the paperNot a substantial claim- Rests on an assumption: Mathematics and statistics contain highly visual content that is often difficult for individuals with VI to fully participate in.
- Rests on an assumption: Bar charts are regularly used for categorical datasets and are a benchmark in fundamental statistical analysis.
- Rests on an assumption: Bar charts provide many fundamental aspects of all statistical graphics, including labels, legend, axes, and increments.
- Rests on an assumption: These skills are fundamental for using more advanced graphical representations of data.
- Rests on an assumption: Geometry figures are fundamental to larger STEM concepts.
- Rests on an assumption: These two concept areas are widely used in classrooms, the workplace, and scientific and popular press writing, so the findings have practical implications.
May combine two claims.
InterpretationreasoningWhile people may be able to trace these stimuli, it is often difficult for them to accurately perceive the magnitude of the deviation.
“while people may be able to trace these stimuli, it is often difficult for them to accurately perceive the magnitude of the deviation.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.
InterpretationreasoningGiven that the majority of VI users have adopted iOS, this movement is promising and necessary in supporting multimodal user experiences, learning, and inclusive design more broadly.
“Given that majority of VI users have adopted iOS, this movement is promising and necessary in supporting multimodal user experiences, learning, and inclusive design more broadly.”
Quote in the paperNot a substantial claim- Rests on an assumption: Majority of VI users have adopted iOS.
Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).
InterpretationreasoningWith the advent of Bluetooth vibration motors and wearable mechanisms, the lack of vibration capabilities in larger screens may not necessarily be a problem if individuals are open to augmenting their experience with additional hardware.
“We note, however, that with the advent of Bluetooth vibration motors, as well as wearable mechanisms, the lack of vibration capabilities in larger screens may not necessarily be a problem if individuals are open to augmenting their experience with additional hardware.”
Quote in the paperNot a substantial claim- Rests on an assumption: Most larger tablets often do not contain vibrotactile feedback and are more expensive and less portable than traditional tablets.
Probably not a substantial claim: may not pass S4 (based).
InterpretationreasoningHand movements used to accurately perceive and extract vibrotactile data will likely look similar to the ones described.
“the hand movements (and thus encoding strategies) used to accurately perceive and extract vibrotactile data will likely look similar to the ones we describe below.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThere is rich literature on discrimination thresholds and subjective interpretations of vibration profiles.
“There is, however, rich literature on discrimination thresholds and subjective interpretations of vibration profiles more broadly [14].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [14] 14. Seungmoon Choi and Katherine J. Kuchenbecker. 2013. Vibrotactile display: Perception, technology, and applications. Proc. IEEE 101, 9 (2013), 2093-2104. source
May combine two claims.
InterpretationreasoningThis can be a problem depending on how the user's movement intersects the stimulus, and is particularly challenging with small stimuli.
“This can be a problem, depending on how the user's movement intersects the stimulus, and is particularly challenging with small stimuli.”
Quote in the paperNot a substantial claim- Rests on an assumption: Only the center of the finger's contact pad with the touchscreen is used to generate on/off vibratory feedback.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
InterpretationreasoningThere is a limit to the amount of information that can be conveyed on smaller screens, though layering and panning techniques will likely help.
“There is certainly a limit to the amount of information that can be conveyed on smaller screens, though layering and panning techniques will likely help with this.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThis echoes recommendations by Reference [15] to assist users in staying within active area boundaries through simple hardware modifications such as stickers.
“This echoes recommendations put forward by Reference [15] to assist users in staying within the active area boundaries of a touchscreen through the use of simple hardware modifications, such as stickers.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [15] 15. Rafael Jeferson Pezzuto Damaceno, Juliana Cristina Braga, and Jesús Pascual Mena-Chalco. 2018. Mobile device ac- cessibility for the visually impaired: Problems mapping and recommendations. Univ. Access Inf. Soc. 17, 2 (2018), 421-435. source
Classified as probably not a substantial claim.
InterpretationreasoningProviding a legend or key for bar charts, similar to the tactile version, would support user search by allowing high-level information at the start of the task to direct search.
“This would support user search efforts by allowing them to obtain high-level information about the graphic's data at the start of the task so they might better direct their search of the graphic.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown dataConsumption of non-visual media can occur in digital space with graphical literacy performance at least on par with traditional tactile media.
“These guidelines demonstrate that consumption of non-visual media can occur in the digital space, with graphical literacy performance that is at least on par with traditional tactile media.”
Quote in the paperSubstantial claim- Rests on an assumption: The evaluation questions and scoring validly measure participant knowledge and performance on the graphics.
- Rests on an assumption: The study's findings can be generalized to students and adults with visual impairments in classroom and data-reading contexts.
- Rests on an assumption: The multimodal touchscreen graphics tested were implemented in accordance with the article's guidelines.
Classified as probably not a substantial claim.
Study design and conductreasoningEmbossed graphics were comparable in size to the tablet graphics to achieve mapping between stimuli and avoid confusion when moving between platforms.
“The embossed graphics were comparable in size to the graphics given on the tablet to achieve mapping between the two stimuli and to eliminate any confusion moving between platforms.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductown dataOf the 22 participants, all finished the geometry figure evaluations in both media, while 19 finished the bar-chart evaluations; one ran out of time before reaching the bar charts.
“Twenty-two participants completed the geometry figure evaluations in both mediums, but only 19 participants completed the bar-chart evaluations, as 1 participant did not reach the bar charts in the time that was allotted.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
InterpretationreasoningTo successfully represent a shape, all key parts (vertices, lines, special angles) must be found and stitched together in memory.
“To have a successful representation of the shape, all key parts (all vertices, lines, and special angles) must have been found and stitched together in memory.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningThe quicker evaluation of embossed graphics could be due to participants having more experience with physical media than with the brief training on touchscreen media.
“This could be due to several reasons with the most obvious being the experience disparity between the two mediums.Participants are likely to have had more experience exploring physical media as compared to the brief training period in which users had to acquaint themselves with the touchscreen-based media.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductown dataTraining sessions lasted 10 to 20 minutes and ended only after participants successfully completed criterion questions about the training graphic.
“Each training session lasted between 10 and 20 minutes and only concluded once participants successfully completed a set of criterion questions about the training graphic.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductnone givenParticipants also had to be able to read Braille and read tactile diagrams with minimal assistance.
“Potential participants were also required to have the ability to read Braille and read tactile diagrams with minimal assistance.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductown dataParticipants differed widely in age, gender, and prior skill with graphics.
“Second, our participant pool was highly varied across age, gender, and relevant graphic skills.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningAs a result, users could get audio information readily and proceed quickly, making efficient use of their time.
“This allowed users to easily obtain audio information and quickly move on, enabling them to efficiently use their time.”
Quote in the paperNot a substantial claim- Rests on an assumption: Finger-location heatmaps accurately indicate the most important features and exploration behavior.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductnone givenParticipants received all touchscreen or all embossed versions before the other, with the order of bar charts and geometry images alternating according to Latin square methodology.
“Participants received all touchscreen or embossed versions of the images before the other version, with the order of bar charts and geometry images alternating according to typical Latin square methodology.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductreasoningUsers had few choices for adjusting the speech rate, and this may have influenced how long they took and how they interpreted the graphics.
“Nonetheless, we note that our text-to-speech rate had limited options for users to choose, which could have affected their time and interpretation during exploration.”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductnone givenMost participants came with prior training and experience using embossed graphics, whereas their exposure to the multimodal graphics was limited to this study's training session.
“This is interesting, as many participants had training and experience with embossed graphics while having only the training epoch on the multimodal graphics in this study.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataEvaluation questions involved only information extraction and never required computation.
“During evaluation, participants were asked four-to-six questions (see Table 8 for a set of questions regarding a bar chart and geometry image from the study) about the graphic that only involved information extraction; no questions asked for computation in any form.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningAfter gaining familiarity with the bar charts, participants moved very quickly through touchscreen bar charts and may have eventually caught up to embossed media speeds.
“Yet, after gaining familiarity with the bar charts, participants moved very quickly through the touchscreen-based bar charts and users may have eventually caught up to the speeds at which they consumed the embossed media.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningThe heatmap findings highlight the importance and desire for users to use their time efficiently during these tasks.
“Again, this serves to highlight the importance and the desire for users to use their time efficiently during these tasks.”
Quote in the paperNot a substantial claim- Rests on an assumption: Finger-location heatmaps accurately indicate the most important features and exploration behavior.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductnone givenInclusion required self-reported fingertip sensation, functional finger movement, no severe cognitive impairment, and no or minimal hearing loss.
“To be considered for participation, individuals were required (by self-report) that they had sensation in their fingertips, functional movement of their fingers, no severe cognitive impairment (inability to understand directions or questions asked), and no/minimal hearing loss.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductreasoningA Latin square design was used to account for order effects.
“A Latin square design was employed as a means to account for order effects during the study.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductreasoningLimited time abbreviated the amount of training provided to participants.
“Additionally, this limited time also abbreviated the amount of training that could be provided to participants.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductown dataThe study was approved by Saint Louis University's Institutional Review Board, and participants gave informed consent and were compensated.
“The following study was approved by Saint Louis University's Institutional Review Board, and participants were provided informed consent and compensated for their time.”
Quote in the paperNot a substantial claim
The paper relies on this without support.
Few guidelines or processes exist to guide the design of multimodal, touchscreen-based graphics.
“yet few guidelines or processes exist to guide the design of multimodal, touchscreen-based graphics.”
The paper relies on this without support.
Recent estimates suggest that 70%-90% of VI cell phone users have smart phones in the United States.
“Recent estimates suggest that 70%-90% of VI cell phone users have smart phones in the United States.”
The paper relies on this without support.
Few basic parameters are available for rendering multimodal graphics, particularly complex ones, on touchscreens.
“few basic parameters are available for rendering multimodal graphics, particularly those that are more complex, on touchscreens.”
The paper relies on this without support.
Few guidelines exist to aid designers in applying vibration and sound feedback to an image for optimal consumption.
“Few guidelines exist to aid designers in applying vibration and sound feedback to an image for optimal consumption.”
The paper relies on this without support.
We lack guidelines that inform perception and usability of multimodal, vibrotactile-based graphics as displayed on screen.
“we lack guidelines that inform perception and usability of these graphics as displayed on screen.”
The paper relies on this without support.
There has not been as much investigation on which vibration profiles are most conducive for continuous exploration in the context of graphics.
“There has not been as much investigation on which vibration profiles are most conducive for continuous exploration in the context of graphics.”
The paper relies on this without support.
Commercially available touchscreens are featureless glass panes currently incapable of delivering localized vibration.
“Commercially available touchscreens are featureless glass panes currently incapable of delivering localized vibration.”
The paper relies on this without support.
Vibration feedback is not localized, resulting in the majority of exploration needing to be done via a single finger.
“vibration feedback is not localized, resulting in the majority of the exploration needing to be done via a single finger.”
The paper relies on this without support.
Only the center of the finger's contact pad with the touchscreen is used to generate on/off vibratory feedback.
“Only the center of the finger's contact pad with the touchscreen is used to generate the on/off vibratory feedback.”
The paper relies on this without support.
Touch, unlike vision, lacks specialized processors for parallel information and the user must undergo a complicated process of synthesizing touch information.
“Touch, unlike vision, also lacks specialized processors for parallel information and the user must undergo a complicated process of synthesizing touch information.”
The paper relies on this without support.
Creating and authoring multisensory content is a new area of research.
“Additionally, creating and authoring multisensory content is a new area of research.”
The paper relies on this without support.
Physical stimuli are often cutaneous cues perceived via pressure-based mechanoreceptors, whereas vibration cues innervate pacinian corpuscles, which are functionally different.
“physical stimuli are often cutaneous cues perceived via pressure-based mechanoreceptors, whereas vibration cues innervate pacinian corpuscles, which are functionally different.”
The paper relies on this without support.
Too much information conveyed on the screen results in confusion, and too little makes navigation and interpretation challenging.
“Too much information conveyed on the screen results in confusion, and too little makes navigation and interpretation challenging.”
The paper relies on this without support.
Companies that use Android OS, such as Samsung and LG, have and continue to consistently have vibration capabilities across mobile and tablet platforms.
“companies that use the Android OS, such as Samsung and LG, have and continue to consistently have vibration capabilities across mobile and tablet platforms.”
The paper relies on this without support.
Apple has had touch capabilities in their mobile platforms for some time, but it has yet to be available on tablets.
“While Apple has had touch capabilities in their mobile platforms for some time, it has yet to be available on tablets.”
The paper relies on this without support.
Android provides significantly more flexibility in developing vibration profiles and providing continuous vibration feedback.
“Android provides significantly more flexibility in developing vibration profiles and providing continuous vibration feedback.”
The paper relies on this without support.
To date, Apple has given limited control over tactile feedback capabilities and limits the run-time for them.
“To date, Apple has given limited control over the tactile feedback capabilities and limits the run-time for them.”
The paper relies on this without support.
Majority of VI users have adopted iOS.
“Given that majority of VI users have adopted iOS”
The paper relies on this without support.
When individuals learn tactile graphics, they are taught certain strategies to help maximize information encoding and interpretation of the information through touch.
“When individuals learn tactile graphics, they are taught certain strategies to help maximize information encoding and interpretation of the information through touch.”
The paper relies on this without support.
Touchscreens are now often outfitted with vibration capabilities.
“touchscreens are now often outfitted with vibration capabilities.”
The paper relies on this without support.
Most larger tablets often do not contain vibrotactile feedback and are more expensive and less portable than traditional tablets.
“most of the larger tablets often do not contain vibrotactile feedback and are more expensive and less portable than traditional tablets.”
The paper relies on this without support.
Physical media exploration is very cognitively demanding because spatial information must be integrated across time and space.
“Even with physical media, this way of accessing visual information is very cognitively demanding due to the integration of spatial information across time and space.”
The paper relies on this without support.
Given limited screen space on commercial touchscreen devices, accessing graphical materials such as maps would be impossible without panning and zooming.
“Given the limited screen real estate on commercial touchscreen devices, accessing graphical materials such as maps would not be possible without the incorporation of panning and zooming operations.”
The paper relies on this without support.
Mathematics and statistics contain highly visual content that is often difficult for individuals with VI to fully participate in.
“Using the guidelines and strategies above, our team has begun designing multimodal graphics, particularly in the area of mathematics and statistics, which are known to have highly visual content that is often difficult for individuals with VI to fully participate.”
The paper relies on this without support.
Bar charts are regularly used for categorical datasets and are a benchmark in fundamental statistical analysis.
“From a teaching and learning perspective, bar charts are regularly used to represent categorical datasets and are considered a benchmark in fundamental statistical analysis.”
The paper relies on this without support.
Bar charts provide many fundamental aspects of all statistical graphics, including labels, legend, axes, and increments.
“These types of graphs provide many of the fundamental aspects of all statistical graphics, including labels, legend, axes, and increments.”
The paper relies on this without support.
These skills are fundamental for using more advanced graphical representations of data.
“These skills are fundamental to utilize more advanced graphical representations of data (line plots, scatter plots, etc.).”
The paper relies on this without support.
Geometry figures are fundamental to larger STEM concepts.
“Geometry figures are also fundamental to larger STEM concepts.”
The paper relies on this without support.
These two concept areas are widely used in classrooms, the workplace, and scientific and popular press writing, so the findings have practical implications.
“Finally, these two concept areas are widely used in the classrooms, in the workplace, and in both scientific and popular press writing, enabling the findings of this work to have practical implications.”
The paper relies on this without support.
Context is necessary for understanding the purpose of onscreen content and better prepares the user to perform tasks with the data.
“Context is necessary for understanding the purpose of the content displayed onscreen and better prepares the user to perform any tasks with the data.”
The paper relies on this without support.
Information can be layered, which makes visual tools such as legends unnecessary.
“Information can be layered, rendering some visual tools such as legends, which take up space and require moving haptic exploration away from the core stimuli, unnecessary.”
The paper relies on this without support.
White space that is not meaningful to the graphic is extraneous and may over-saturate the user during exploration.
“If the white space is not meaningful to the graphic, it is extraneous information that may over-saturate the user during exploration.”
The paper relies on this without support.
Gestures are important interaction techniques that do not cost screen real estate or require audio or text input.
“Gestures are important interaction techniques that do not come at the cost of screen real estate or require audio or text input from the user.”
The paper relies on this without support.
Graphics and their interpretation are largely open-ended.
“It is important to interpret the guidelines posited in this article in this context, acknowledging that graphics and their interpretation are largely openended.”
The paper relies on this without support.
Guidelines that support perceptual detection and extraction are necessary, but pedagogical goals add complexity that must be considered in rendering multimodal graphics.
“While guidelines that support detection and extraction from a perceptual standpoint are necessary, there is an additional level of complexity driven by pedagogical goals that must be considered in rendering multimodal graphics.”
The paper relies on this without support.
The evaluation questions and scoring validly measure participant knowledge and performance on the graphics.
“All questions used to evaluate participant knowledge of the graphics were scored and averages computed to summarize performance in the evaluation task.”
The paper relies on this without support.
The study's findings can be generalized to students and adults with visual impairments in classroom and data-reading contexts.
“This is an advantageous finding for students in classrooms consuming subject-related material, but even has implication for adults who must read and interpret visualized data, such as bar-graph renderings.”
The paper relies on this without support.
The multimodal touchscreen graphics tested were implemented in accordance with the article's guidelines.
“These results show that performance when using the multimodal graphics as informed by the guidelines put forth in this article is within the statistical margin of error observed with traditional, embossed tactile graphics.”
The paper relies on this without support.
AndroidOS cannot register two finger touchdowns as a double-tap unless they occur within a couple of millimeters of each other.
“When this happens, it is difficult for AndroidOS to register finger touchdown events that do not occur within a couple of millimeters of each other as a double-tap.”
The paper relies on this without support.
The participant sample is typical of the population, though it may not represent all users in each age bracket.
“While this inserts heterogeneity within our study, this is a typical sample of the population, although it may not represent all users in each age bracket.”
The paper relies on this without support.
Finger-location heatmaps accurately indicate the most important features and exploration behavior.
“To demonstrate the most important features of each graphic, heatmaps of participant finger locations are provided by Figure 8.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Text-based and numerical descriptions of graphics are less precise, more error prone in their interpretation and require more cognitive load than a perceptual interface that directly renders the same information through touch, sound, or vision.
“Text-based and numerical descriptions of graphics are less precise, more error prone in their interpretation and require more cognitive load than a perceptual interface that directly renders the same information through touch, sound, or vision [53,111,119].”
From The Accessibility of Data Visualizations on the Web for Screen Reader Users: Practices and Experiences During COVID-19 (2023) · cites this paper as [53]
Section 4.1.2 describes a touchscreen graphic that conveys bars through vibration and labels and values through speech, supporting the claim that information can be rendered through touch and sound. But the paper does not establish that text-based or numerical descriptions are less precise, more error-prone, or more cognitively demanding than such an interface. Section 6 instead reports memory demands encountered while exploring the multimodal geometric figures; no page number was provided for these passages. (LLM, conf=0.78)
Experimental — accuracy not yet measuredIt will be challenging to design an IVIS with 4mm inter-element spacing based on Gorlewich's study.
“It will be challenging to design an IVIS with 4mm inter-element spacing based on Gorlewich's [48] study”
From A Brief Survey on Interactive Automotive UI (2021) · cites this paper as [48]
Statistics recomputed
Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.
- Consistentt(18) = 1.68reported p = .11 · recomputed p = .110
“t(18) = 1.68, p = .11”
- Consistentt(21) = -0.366reported p = .718 · recomputed p = .718
“t(21) = -.366,p = .718”
- Consistentt(37) = -2.99reported p = .005 · recomputed p = .005
“t(37) = -2.99,p = .005”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Geometry confidence interval conflicts with the nonsignificant result
MinorThe reported 95% confidence interval for the geometry comparison runs from −8.14 to −5.71, excluding zero. That conflicts with the reported p = .718 and the statement that the difference was not statistically significant.
“nor geometric images (t(21) = -.366,p = .718,95% CI = -8.14--5.71,Cohen's d = 0.073)”
“The analysis revealed no statistically significant differences between the percent means of embossed and touchscreen bar charts”
One missed bar-chart evaluation does not explain the reported sample size
MinorOf 22 participants, excluding one who did not reach the bar charts would leave 21, not 19. The text does not account for the other two participants.
Reported 22 · recomputed 20
“Twenty-two participants completed the geometry figure evaluations in both mediums, but only 19 participants completed the bar-chart evaluations, as 1 participant did not reach the bar charts in the time that was allotted.”
The participant vision descriptions conflict
MinorThe demographics say ten participants had some light perception, but also say that all but one reported no residual vision and were completely blind.
“Ten of the 22 participants stated that they had some form of light perception”
“all but 1 individual (who chose not to respond) stated that they had no residual vision and were completely blind.”
The citation for vibration-profile research points to a different source
MinorThe text cites reference 74 for work matching vibration effects to embossed lines, but entry 74 is a product page for swell-touch paper, not that research.
“In a recent work [74], we investigated which vibratory effects best mapped to embossed line profiles.”
“74. American Thermoform. 2019. Swell Touch Paper. Retrieved from http://www.americanthermoform.com/product/ swell-touch-paper/.”
The bar-chart completion count leaves three participants unaccounted for
MinorOf the 22 participants who completed the geometry evaluations, 19 completed the bar-chart evaluations. That leaves three participants, not the one cited as the reason for the shortfall.
Reported 1 · recomputed 3
“Twenty-two participants completed the geometry figure evaluations in both mediums, but only 19 participants completed the bar-chart evaluations, as 1 participant did not reach the bar charts in the time that was allotted.”
The geometry confidence interval conflicts with its reported test result
MinorThe reported 95% confidence interval has two negative endpoints, so it excludes zero. That conflicts with the reported p-value of .718 and the statement that the geometry comparison was not statistically significant.
“95% CI = -8.14--5.71,Cohen's d = 0.073”
“nor geometric images (t(21) = -.366,p = .718”
Cites
Hand movements: A window into haptic object recognition
Lederman, S. J., & Klatzky, R. L. (1987) · Cognitive Psychology · doi:10.1016/0010-0285(87)90008-9 · Cited by 2,016 · see citing works
Proceedings of the Human Factors and Ergonomics Society 2019 Annual Meeting
(2019) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1071181319631171 · Cited by 1,438 · see citing works
Lederman, S. J., & Klatzky, R. L. (2009) · Attention, Perception & Psychophysics · doi:10.3758/app.71.7.1439 · Cited by 1,108 · see citing works
Jones, L. A., & Lederman, S. J. (2006) · doi:10.1093/acprof:oso/9780195173154.001.0001 · Cited by 720 · see citing works
Vibrotactile Display: Perception, Technology, and Applications
Choi, S., & Kuchenbecker, K. J. (2013) · Proceedings of the IEEE · doi:10.1109/jproc.2012.2221071 · Cited by 496 · see citing works
Investigating the effectiveness of tactile feedback for mobile touchscreens
Hoggan, E. E., Brewster, S. A., & Johnston, J. (2008) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1357054.1357300 · Cited by 454 · see citing works
Tactile spatial resolution in blind Braille readers
Boven, R. W. V., Hamilton, R. H., Kauffman, T., Keenan, J. P., & Pascual–Leone, A. (2000) · Neurology · doi:10.1212/wnl.54.12.2230 · Cited by 380 · see citing works
Kane, S. K., Bigham, J. P., & Wobbrock, J. O. (2008) · Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/1414471.1414487 · Cited by 374 · see citing works
Tactile feedback for mobile interactions
Brewster, S. A., Chohan, F., & Brown, L. (2007) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1240624.1240649 · Cited by 313 · see citing works
Haptics in Education: Exploring an Untapped Sensory Modality
Minogue, J., & Jones, M. G. (2006) · Review of Educational Research · doi:10.3102/00346543076003317 · Cited by 255 · cited 1× · see citing works
“While touch is a fundamental part of our perception [42, 45], it is not an all-encompassing substitute for vision.”
BackgroundTouching for Knowing: Cognitive psychology of haptic manual perception
(2003) · Advances in Consciousness Research · doi:10.1075/aicr.53 · Cited by 179 · see citing works
SemFeel: a user interface with semantic tactile feedback for mobile touch-screen devices
Yatani, K., & Truong, K. N. (2009) · Proceedings of the 22nd annual ACM symposium on User interface software and technology · doi:10.1145/1622176.1622198 · Cited by 164 · see citing works
Information transmission with a multifinger tactual display
Tan, H. Z., Durlach, N. I., Reed, C. M., & Rabinowitz, W. M. (1999) · Perception & Psychophysics · doi:10.3758/bf03207608 · Cited by 159 · see citing works
Tactile acuity, aging, and braille reading in long-term blindness.
Stevens, J. C., Foulke, E., & Patterson, M. Q. (1996) · Journal of Experimental Psychology: Applied · doi:10.1037/1076-898x.2.2.91 · Cited by 147 · see citing works
Buehler, E., Kane, S. K., & Hurst, A. K. (2014) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/2661334.2661365 · Cited by 142 · see citing works
Learning non-visual graphical information using a touch-based vibro-audio interface
Giudice, N. A., Palani, H. P., Brenner, E., & Kramer, K. M. (2012) · Proceedings of the 14th international ACM SIGACCESS conference on Computers and accessibility · doi:10.1145/2384916.2384935 · Cited by 133 · see citing works
Self-citationEffect of Waveform on Tactile Perception by Electrovibration Displayed on Touch Screens
Vardar, Y., Guclu, B., & Basdogan, C. (2017) · IEEE Transactions on Haptics · doi:10.1109/toh.2017.2704603 · Cited by 130 · see citing works
Access overlays: improving non-visual access to large touch screens for blind users
Kane, S. K., Morris, M. R., Perkins, A. Z., Wigdor, D., Ladner, R. E., & Wobbrock, J. O. (2011) · Proceedings of the 24th annual ACM symposium on User interface software and technology · doi:10.1145/2047196.2047232 · Cited by 127 · cited 14× · see citing works
“There is a wealth of information available on using sonification techniques successfully in relaying graphical information, and we refer users to References [23, 48, 49, 59, 79–81] for more details.”
BackgroundInfluentialEvaluation of multimodal graphs for blind people
Yu, W., & Brewster, S. (2003) · Universal Access in the Information Society · doi:10.1007/s10209-002-0042-6 · Cited by 120 · cited 1× · see citing works
“For instance, a host of refreshable tactual technologies have been developed based on a variety of different schemes: force feedback [21, 47, 69, 77, 84, 86, 87], refreshable pin arrays [4, 70], micro fluidics [64], moldable alloys, and surface haptics [21, 47, 69, 77, 84], to name a few (see Reference [51] for a revi…”
BackgroundMagnitude estimation of conceptual data dimensions for use in sonification.
Walker, B. N. (2002) · Journal of Experimental Psychology Applied · doi:10.1037//1076-898x.8.4.211 · Cited by 116 · see citing works
Gravvitas: generic multi-touch presentation of accessible graphics
Goncu, C., & Marriott, K. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-23774-4_5 · Cited by 112 · see citing works
Accessible Interactive Maps for Visually Impaired Users
Ducasse, J., Brock, A. M., & Jouffrais, C. (2018) · Mobility of Visually Impaired People · doi:10.1007/978-3-319-54446-5_17 · Cited by 111 · see citing works
MudPad: tactile feedback and haptic texture overlay for touch surfaces
Jansen, Y., Karrer, T., & Borchers, J. (2010) · ACM International Conference on Interactive Tabletops and Surfaces · doi:10.1145/1936652.1936655 · Cited by 102 · see citing works
Poppinga (2011) · doi:10.1145/2037373.2037458 · Cited by 102 · see citing works
O'Modhrain, S., Giudice, N. A., Gardner, J. A., & Legge, G. E. (2015) · IEEE Transactions on Haptics · doi:10.1109/toh.2015.2466231 · Cited by 100 · see citing works
Self-citationSpearcons (Speech-Based Earcons) Improve Navigation Performance in Advanced Auditory Menus
Walker, B. N., Lindsay, J., Nance, A., Nakano, Y., Palladino, D. K., Dingler, T., & Jeon, M. (2012) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720812450587 · Cited by 94 · see citing works
Accessible Touchscreen Technology for People with Visual Impairments: A Survey
Grussenmeyer, W., & Folmer, E. (2017) · ACM Transactions on Accessible Computing · doi:10.1145/3022701 · Cited by 86 · see citing works
Universal Design of Auditory Graphs
Walker, B. N., & Mauney, L. M. (2010) · ACM Transactions on Accessible Computing · doi:10.1145/1714458.1714459 · Cited by 85 · see citing works
Klatzky, R. L., & Lederman, S. J. (2003) · Handbook of Psychology · doi:10.1002/0471264385.wei0406 · Cited by 85 · see citing works
Comparing two haptic interfaces for multimodal graph rendering
Yu, W., & Brewster, S. (2003) · Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002 · doi:10.1109/haptic.2002.998934 · Cited by 83 · see citing works
Mobility of Visually Impaired People
Pissaloux, E. E., & Velázquez, R. (2017) · Springer eBooks · doi:10.1007/978-3-319-54446-5 · Cited by 76 · see citing works
Klatzky, R. L., Giudice, N. A., Bennett, C. R., & Loomis, J. M. (2014) · Multisensory Research · doi:10.1163/22134808-00002447 · Cited by 74 · see citing works
Self-citationMobile device accessibility for the visually impaired: problems mapping and recommendations
Damaceno, R. J. P., Braga, J. C., & Mena-Chalco, J. P. (2018) · Universal Access in the Information Society · doi:10.1007/s10209-017-0540-1 · Cited by 73 · see citing works
Look what I have felt: Unidentified haptic line drawings are identified after sketching
Wijntjes, M. W. A., van Lienen, T., Verstijnen, I. M., & Kappers, A. M. L. (2008) · Acta Psychologica · doi:10.1016/j.actpsy.2008.01.006 · Cited by 60 · cited 1× · see citing works
“This integration is also not always precise, which can negatively affect creation of a mental image with accurate spatial features [83].”
BackgroundGiudice, N. A., Guenther, B. A., Jensen, N. A., & Haase, K. N. (2020) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2020.00087 · Cited by 60 · cited 1× · see citing works
“Particularly in education and spatial learning, recent investigations have demonstrated that vibrations are effective in representing maps [59] and building floor plans [22], accurately perceiving and following lines and graphs [23, 55, 73], representing graphical shapes [24, 72], and representing simple graphic entit…”
BackgroundSelf-citationTactile spatial resolution in blind Braille readers
Boven, R. W. V., Hamilton, R. H., Kauffman, T., Keenan, J. P., & Pascual‐Leone, Á. (2000) · American Journal of Ophthalmology · doi:10.1016/s0002-9394(00)00743-1 · Cited by 57 · see citing works
Perceptual space and adjective rating of sinusoidal vibrations perceived via mobile device
Hwang, I., & Choi, S. (2010) · 2010 IEEE Haptics Symposium · doi:10.1109/haptic.2010.5444692 · Cited by 54 · see citing works
Analyzing visually impaired people’s touch gestures on smartphones
Buzzi, M. C., Buzzi, M., Leporini, B., & Trujillo, A. (2017) · Multimedia Tools and Applications · doi:10.1007/s11042-016-3594-9 · Cited by 53 · cited 1× · see citing works
“We have observed (along with References [13, 15, 27]) that executing these types of gestures can be difficult for a VI user to perform due to the timing and spatial constraints of the gesture.”
Background- Sensory Substitution of Vision: Importance of Perceptual and Cognitive Processing
(2018) · Assistive Technology for Blindness and Low Vision · doi:10.1201/9781315216935-12 · Cited by 51 · see citing works
Mullenbach, J., Peshkin, M., & Colgate, J. E. (2017) · IEEE Transactions on Haptics · doi:10.1109/toh.2016.2630057 · Cited by 43 · see citing works
Guerreiro, T., Montague, K., Guerreiro, J., Nunes, R., Nicolau, H., & Gonçalves, D. J. V. (2015) · Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces - ITS '15 · doi:10.1145/2817721.2817743 · Cited by 43 · cited 1× · see citing works
“We have also aggregated shape and line exploration strategies observed across multiple experiments and found that users employed additional techniques including making crosses at vertex points to find connecting line segments (B) and scanning horizontally across the shape to uncover symmetry (C) [29, 72].”
MethodFaster Text-to-Speeches: Enhancing Blind People's Information Scanning with Faster Concurrent Speech
Guerreiro, J., & Gonçalves, D. (2015) · Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility - ASSETS '15 · doi:10.1145/2700648.2809840 · Cited by 41 · see citing works
Intuitive Tactile Zooming for Graphics Accessed by Individuals Who are Blind and Visually Impaired
Rastogi, R., Pawluk, T. V. D., & Ketchum, J. (2013) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2013.2250520 · Cited by 38 · see citing works
Auditory Interfaces and Sonification
Nees, M. A., & Walker, B. N. (2009) · Human factors and ergonomics · doi:10.1201/9781420064995-c32 · Cited by 37 · see citing works
DigiTaps: eyes-free number entry on touchscreens with minimal audio feedback
Azenkot, S., Bennett, C. L., & Ladner, R. E. (2013) · Proceedings of the 26th annual ACM symposium on User interface software and technology · doi:10.1145/2501988.2502056 · Cited by 35 · see citing works
Gorlewicz, J. L., Burgner-Kahrs, J., Withrow, T. J., & Webster, R. J., III (2014) · Journal of Special Education Technology · doi:10.1177/016264341402900202 · Cited by 31 · see citing works
Self-citationBaker, C. M., Milne, L. R., Drapeau, R., Scofield, J., Bennett, C. L., & Ladner, R. E. (2016) · ACM Transactions on Accessible Computing · doi:10.1145/2854005 · Cited by 31 · see citing works
Palani, H. P., & Giudice, N. A. (2017) · ACM Transactions on Accessible Computing · doi:10.1145/3035537 · Cited by 29 · see citing works
Self-citationThe design of pressure-controlled valves for a refreshable tactile display
Russomanno, A., Gillespie, R. B., O’Modhrain, S., & Burns, M. A. (2015) · IEEE World Haptics Conference (WHC) · doi:10.1109/whc.2015.7177710 · Cited by 29 · see citing works
Evaluation of a friction reduction based haptic surface at high frequency
Giraud, F., Hara, T., Giraud-Audine, C., Amberg, M., Lemaire‐Semail, B., & TAKASAKI, M. (2018) · IEEE Haptics Symposium · doi:10.1109/haptics.2018.8357178 · Cited by 26 · see citing works
Evaluation of non-visual panning operations using touch-screen devices
Palani, H., & Giudice, N. A. (2014) · Proceedings of the 16th international ACM SIGACCESS conference on Computers & accessibility - ASSETS '14 · doi:10.1145/2661334.2661336 · Cited by 26 · see citing works
Self-citationThe Graphical Access Challenge for People with Visual Impairments: Positions and Pathways Forward
L. Gorlewicz, J., L. Tennison, J., P. Palani, H., & A. Giudice, N. (2019) · Interactive Multimedia - Multimedia Production and Digital Storytelling · doi:10.5772/intechopen.82289 · Cited by 24 · see citing works
Evaluation of Non-visual Zooming Operations on Touchscreen Devices
Palani, H., Giudice, U., & Giudice, N. A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-40244-4_16 · Cited by 23 · see citing works
Self-citationNon-visual Perception of Lines on a Multimodal Touchscreen Tablet
Tennison, J. L., & Gorlewicz, J. L. (2019) · ACM Transactions on Applied Perception · doi:10.1145/3301415 · Cited by 20 · see citing works
Self-citationA User Study to Evaluate Tactile Charts with Blind and Visually Impaired People
Engel, C., & Weber, G. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-94274-2_24 · Cited by 20 · see citing works
Establishing Vibration-Based Tactile Line Profiles for Use in Multimodal Graphics
Tennison, J. L., Uesbeck, P. M., Giudice, N. A., Stefik, A., Smith, D. W., & Gorlewicz, J. L. (2020) · ACM Transactions on Applied Perception · doi:10.1145/3383457 · Cited by 19 · see citing works
Self-citationAudio-Based Feedback Techniques for Teaching Touchscreen Gestures
Oh, U., Branham, S., Findlater, L., & Kane, S. K. (2015) · ACM Transactions on Accessible Computing · doi:10.1145/2764917 · Cited by 18 · see citing works
Rastogi, R., & Pawluk, D. T. V. (2013) · Assistive Technology · doi:10.1080/10400435.2012.680659 · Cited by 12 · see citing works
Comparing Haptic Pattern Matching on Tablets and Phones: Large Screens Are Not Necessarily Better
Tennison, J. L., Carril, Z. S., Giudice, N. A., & Gorlewicz, J. L. (2018) · Optometry and Vision Science · doi:10.1097/opx.0000000000001274 · Cited by 11 · see citing works
Self-citationAutomatic, intuitive zooming for people who are blind or visually impaired.
Rastogi, R., & Pawluk, D. T. V. (2010) · Proceedings of the 12th international ACM SIGACCESS conference on Computers and accessibility · doi:10.1145/1878803.1878850 · Cited by 11 · see citing works
eShiver: Force feedback on fingertips through oscillatory motion of an electroadhesive surface
Mullenbach, J., Peshkin, M. A., & Colgate, J. E. (2016) · IEEE Haptics Symposium · doi:10.1109/haptics.2016.7463189 · Cited by 10 · see citing works
Exploring the Design of Audio-Kinetic Graphics for Education
Muehlbradt, A., Atreya, M., Guinness, D., & Kane, S. K. (2018) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3242969.3243004 · Cited by 10 · see citing works
Multiomodal Application for the Perception of Spaces (MAPS)
Adams, R., Pawluk, D., Fields, M., & Clingman, R. (2015) · Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility - ASSETS '15 · doi:10.1145/2700648.2811386 · Cited by 9 · cited 1× · see citing works
“As a result, traditional exploration strategies using multiple fingers or hands as a frame of reference are not yet technically possible, though interesting work affixing external vibrators to fingers has been investigated (e.g., Reference [2]).”
Background(2019) · doi:10.1002/9781119423942 · Cited by 3 · see citing works
Jansen, Y., Karrer, T., & Borchers, J. (2010) · ACM International Conference on Interactive Tabletops and Surfaces · doi:10.1145/1936652.1936734
Nees, M. A., & Walker, B. N. (2008) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120805202208
Flagged first, then by citations
Research works printed but not linked: 22
- Ada Lopez, Look, Listen, Learn
- Stephen, Proceedings of the 5th Conference on Australasian User Interface-Volume 28
- Gescheider George A., 2010, Verrillo
- Giudice Nicholas A., Proceedings of the 14th International ACM SIGACCESS Conference on Computers 8 Accessibility. ACM, 103--110
- Gorlewicz Jenna L., 2018, Hari Prasath Palani, and Nicholas A. Giudice
- Hwang Inwook, 2010, Proceedings of the IEEE Haptics Symposium. IEEE, 1--8.
- Jones Lynette A., 2006, Lederman
- Kane Shaun K., Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility. ACM, 73--80
- Kane Shaun K., 2047, Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST’11)
- Klatzky Roberta L., 2003, Lederman
- Loomis Jack M., 2018, Giudice
- Loomis Jack M., 1986, Tactual perception, Handbook Percept. Hum. Perform., 2, 2
- Muehlbradt Annika, Proceedings of the International Conference on Multimodal Interaction. ACM, 455--463
- Nees Michael A., 2009, Walker
- Palani Hari Prasath, Proceedings of the 16th International ACM SIGACCESS Conference on Computers 8 Accessibility. ACM, 293--294
- Palani Hari Prasath, 2016, Giudice
- Palani Hari Prasath, 2018, Giudice
- Polly Edman, Tactile Graphics
- Raja Monoj Kumar, The Development and Validation of a New Smartphone Based Non-visual Spatial Interface for Learning Indoor Layouts. Master’s Thesis
- Rastogi Ravi, Proceedings of the 12th International ACM SIGACCESS Conference on Computers and Accessibility. ACM, 239--240
- Summers Ed, 2012, Proceedings of the SAS Global Forum. Citeseer.
- Tennison Jennifer L., 2016, Gorlewicz
Cited by
Sorted by citations
Multimodal Interaction, Interfaces, and Communication: A Survey
Dritsas, E., Τρίγκα, Μ., Troussas, C., & Phivos Mylonas, B. (2025) · Multimodal Technologies and Interaction · doi:10.3390/mti9010006 · Cited by 108 · see citing works
Generating Automatic Feedback on UI Mockups with Large Language Models
Duan, P., Warner, J., Li, Y., & Hartmann, B. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642782 · Cited by 83 · see citing works
Fan, D., Fay Siu, A., Rao, H., Kim, G. S.-H., Vazquez, X., Greco, L., O'Modhrain, S., & Follmer, S. (2023) · ACM Transactions on Accessible Computing · doi:10.1145/3557899 · Cited by 46 · see citing works
“While online visualizations have flourished with the aid of several web tools and libraries [15, 26, 27, 128], these methods have largely relied on representations that leverage visual modalities for consumption, which leaves large parts of the news and information on the web inaccessible to people who are Blind and V…”
BackgroundExamining Visual Semantic Understanding in Blind and Low-Vision Technology Users
Potluri, V., Grindeland, T. E., Froehlich, J. E., & Mankoff, J. C. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445040 · Cited by 42 · see citing works
Siu, A. F., Fan, D., Kim, G. S.-H., Rao, H., Vazquez, X., O’Modhrain, S., & Follmer, S. (2021) · International Web for All Conference (W4A) · doi:10.1145/3430263.3452432 · Cited by 39 · see citing works
Fan, D., Siu, A. F., Law, W.-S. A., Zhen, R. R., O'Modhrain, S., & Follmer, S. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517790 · Cited by 37 · see citing works
Jiang, C., Kuang, E., & Fan, M. (2025) · ACM Transactions on Accessible Computing · doi:10.1145/3711931 · Cited by 35 · see citing works
Image Accessibility for Screen Reader Users: A Systematic Review and a Road Map
Oh, U., Joh, H., & Lee, Y. (2021) · Electronics · doi:10.3390/electronics10080953 · Cited by 29 · see citing works
Palani, H. P., Fink, P. D. S., & Giudice, N. A. (2021) · Multimodal Technologies and Interaction · doi:10.3390/mti6010001 · Cited by 24 · see citing works
Self-citationChartA11y: Designing Accessible Touch Experiences of Visualizations with Blind Smartphone Users
Zhang, Z., Thompson, J. R., Shah, A., Agrawal, M., Sarıkaya, A., Wobbrock, J. O., Cutrell, E. B., & Lee, B. (2024) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3663548.3675611 · Cited by 25 · see citing works
TADA: Making Node-link Diagrams Accessible to Blind and Low-Vision People
Zhao, Y., Nacenta, M. A., Sukhai, M. A., & Somanath, S. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642222 · Cited by 25 · see citing works
TactualPlot: Spatializing Data as Sound Using Sensory Substitution for Touchscreen Accessibility
Chundury, P., Reyazuddin, Y., Jordan, J. B., Lazar, J. K., & Elmqvist, N. (2023) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2023.3326937 · Cited by 22 · see citing works
Exploration strategies for tactile graphics displayed by electrovibration on a touchscreen
Sadia, B., Sadic, A., Ayyıldız, M., & Başdoğan, Ç. (2021) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2021.102760 · Cited by 21 · see citing works
Accessible Tutoring Platform Using Audio-Tactile Graphics Adapted for Visually Impaired People
Maćkowski, M., & Brzoza, P. (2022) · Sensors · doi:10.3390/s22228753 · Cited by 20 · see citing works
A Brief Survey on Interactive Automotive UI
Prabhakar, G., & Biswas, P. (2021) · Transportation Engineering · doi:10.1016/j.treng.2021.100089 · Cited by 18 · see citing works
Simphony: Enhancing Accessible Pattern Design Practices among Blind Weavers
Das, M., Gergle, D., & Piper, A. M. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581047 · Cited by 19 · see citing works
Evaluating design guidelines for hand proximate user interfaces
Perella-Holfeld, F., Faleel, S. A., & Irani, P. (2023) · ACM Designing Interactive Systems Conference (DIS) · doi:10.1145/3563657.3596117 · Cited by 12 · see citing works
de Paz, C., & Travieso, D. (2023) · Cognitive Research Principles and Implications · doi:10.1186/s41235-023-00495-w · Cited by 12 · see citing works
A wearable virtual touch system for IVIS in cars
Prabhakar, G., Rajkhowa, P., Harsha, D., & Biswas, P. (2021) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-021-00377-9 · Cited by 8 · see citing works
Brown, J. R., Doore, S. A., Dimmel, J. K., Giudice, N., & Giudice, N. A. (2023) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3597638.3608429 · Cited by 9 · see citing works
Self-citationTran, C. M., Bach, N. G., Tan, P. X., Kamioka, E., & Kanamaru, M. (2024) · Electronics · doi:10.3390/electronics13122395 · Cited by 7 · see citing works
Accessible Maps for the Future of Inclusive Ridesharing
Fink, P. D. S., Milne, H., Caccese, A., Alsamsam, M., Loranger, J., Colley, M., & Giudice, N. A. (2024) · Proceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications · doi:10.1145/3640792.3675736 · Cited by 8 · see citing works
“By contrast, our prototype solution utilizes existing psychophysical design guidelines for tactual perception on touchscreens [22, 32] to develop the first (to our knowledge) real-time vibro-audio ridesharing solution rendered on a smartphone.”
BackgroundMethodSelf-citationComposite Line Designs and Accuracy Measurements for Tactile Line Tracing on Touch Surfaces
Chau, E., Yu, J., Goncu, C., & Withana, A. I. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3488536 · Cited by 8 · see citing works
Guerino, G. C., Rodrigues, L., Capeleti, B. S., Mello, R. F., Freire, A. P., & Zaina, L. A. M. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-05005-2_20 · Cited by 11 · see citing works
Rong, A., Edward, N. H., & Li, D. (2025) · Visual Communication · doi:10.1177/14703572241300884 · Cited by 5 · see citing works
Tennison, J. L., Goswami, S., Hairston, J. R., Drews, P. M., Smith, D. W., Giudice, N. A., Stefik, A., & Gorlewicz, J. L. (2023) · Journal of Visual Impairment & Blindness · doi:10.1177/0145482x231217496 · Cited by 5 · see citing works
Self-citationPerspectives de l'OCDE sur l'éducation numérique 2021
OCDE (2022) · Digital education outlook · doi:10.1787/d5fe6bd0-fr · Cited by 19 · see citing works
Accessibility Research on Multimodal Interaction for the Elderly
Tu, Y., & Luo, J. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-61546-7_25 · Cited by 4 · see citing works
Moore, W. J. R., Kalal, M., Tennison, J. L., Giudice, N. A., & Gorlewicz, J. L. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3641959 · Cited by 5 · see citing works
Self-citationMedina, M. J., Thoo, Y.-J., Baudet, C., Froehlich, J. E., Ruffieux, N., & Lalanne, D. (2025) · ACM Transactions on Accessible Computing · doi:10.1145/3726531 · Cited by 3 · see citing works
Kruger, R., de Wet, F., & Niesler, T. (2023) · ACM Transactions on Accessible Computing · doi:10.1145/3584365 · Cited by 4 · see citing works
Augmenting Imagery with Multimodal Vibrotactile Representations: Touch, Feel, and Hear
Salous, M., Kramer, M., Heuten, W., Hudin, C., Boll, S., & Abdenebaoui, L. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791493 · Cited by 2 · see citing works
Audio-visual training and feedback to learn touch-based gestures
Rubab, S., Zaman, M. W. U., Rashid, U., Yu, L., & Wu, Y. (2024) · Journal of Visualization · doi:10.1007/s12650-024-01012-x · Cited by 3 · see citing works
HIFU Embossment of Acrylic Sheets
(2024) · doi:10.1145/3613904.3642890 · Cited by 3 · see citing works
HOW VISUALLY IMPAIRED LEARNERS CONSTRUCT OPPORTUNITIES TO LEARN MATHEMATICS?
Matobako, S., & Jita, L. C. (2022) · Armenian Journal of Special Education · doi:10.24234/se.v5i1.288 · Cited by 3 · see citing works
Fountouki, C., & Papadopoulos, K. S. (2025) · Disability and Rehabilitation Assistive Technology · doi:10.1080/17483107.2025.2508388 · Cited by 3 · see citing works
Non-Visual Interfaces for Visual Learners: Multisensory Learning of Graphic Primitives
Doore, S. A., Brown, J. R., Imai, S., Dimmel, J. K., & Giudice, N. A. (2024) · IEEE Access · doi:10.1109/access.2024.3513712 · Cited by 4 · see citing works
Self-citationEffects of Feedback Type on Touchscreen Navigation for Younger and Older Users
Chen, Y., Li, B., Yang, T., Liu, Y., & Du, F. (2024) · Interacting with Computers · doi:10.1093/iwc/iwae021 · Cited by 2 · see citing works
The effects of vibrotactile directions and touch methods on human tactile perceptions
Li, T.-Y., & Smith, S. S.-F. (2025) · Displays · doi:10.1016/j.displa.2025.103036 · Cited by 2 · see citing works
Holistic Multimodal Interaction and Design
(2022) · doi:10.1007/978-3-031-17615-9_2 · Cited by 1 · see citing works
Miura, T., Yabu, K.-I., Katagiri, A., Matsuo, M., Okochi, N., Yasu, K., Sakajiri, M., & Ifukube, T. (2026) · Journal of Sensor and Actuator Networks · doi:10.3390/jsan15040069
Toward Accessible Parsons Problems on Mobile Platforms
Kluthe, T., Contreras, G., Allee, W., Moore, W. J. R., Roy, N., Williams, H., Hoffman, A., Smith, D. W., Blaser, B., Gorlewicz, J. L., et al. (2026) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3770762.3772646 · Cited by 1 · see citing works
Self-citationA Wearable Virtual Touch System for CarsPreprint
Prabhakar, G., Rajkhowa, P., & Biswas, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.05700
Computational Modeling of Non-Visual Vibrotactile Touchscreen Exploration
Hwang, S., Moss, R. J., Fan, D., & Follmer, S. (2025) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3706599.3719851
Doore, S. A., Brown, J. R., & Giudice, N. A. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2660120
Self-citation
- Authors
- Gorlewicz, J. L., Tennison, J. L., Uesbeck, P. M., Richard, M. E., Palani, H. P., Stefik, A., Smith, D. W., & Giudice, N. A.
- Affiliations
- Saint Louis University (US)
- University of Nevada, Las Vegas (US)
- University of Maine (US)
- University of Alabama in Huntsville (US)
- ORCID
- Venue
- ACM Transactions on Accessible Computing
- Published
- 2020-08-03
- Volume
- 13
- Issue
- 3
- Pages
- 1-30
- ISSN
- 1936-7228 (ISSN-L)
- 1936-7236
- OpenAlex
- W3047199091
- Cited by
- 53
- References
- 49
- Citations by year
- 2026: 9 · 2025: 8 · 2024: 11 · 2023: 7 · 2022: 6 · 2021: 12
- FWCI
- 3.36
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- ACM Transactions on Accessible Computing (publishedVersion)
- Funders
- National Science Foundation (1644538,1644491,1644476,1644471,1822800,1650114)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Data Visualization and Analytics
- Keywords
- visual impairment, accessibility, design guidelines, haptic feedback, vibrotactile feedback, audio feedback, bar charts, geometry, mathematics education, learning performance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read under definition version 3 (extract-v3) on 2026-09-28.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-09-28.
Cited sources are checked by gpt-6-sol.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review