Cited by 53Tactile and Sensory InteractionsDigital Accessibility for DisabilitiesData Visualization and Analytics

Design Guidelines and Recommendations for Multimodal, Touchscreen-based Graphics

Open access
Gorlewicz, Jenna L., Tennison, Jennifer L., Uesbeck, P. Merlin, Richard, Margaret E., Palani, Hari P., Stefik, Andreas, Smith, Derrick W., Giudice, Nicholas A.·2020·ACM Transactions on Accessible Computing

Abstract

With content rapidly moving to the electronic space, access to graphics for individuals with visual impairments is a growing concern. Recent research has demonstrated the potential for representing basic graphical content on touchscreens using vibrations and sounds, yet few guidelines or processes exist to guide the design of multimodal, touchscreen-based graphics. In this work, we seek to address this gap by synergizing our collective research efforts over the past eight years and implementing our findings into a compilation of recommendations, which we validate through an iterative design process and user study. We start by reviewing previous work and then collate findings into a set of design guidelines for generating basic elements of touchscreen-based multimodal graphics. We then use these guidelines to generate exemplary graphics in mathematics, specifically bar charts and geometry concepts. We discuss the iterative design process of moving from guidelines to actual graphics and highlight challenges. We then present a formal user study with 22 participants with visual impairments, comparing learning performance on using touchscreen-rendered graphics to embossed graphics. We conclude with qualitative feedback from participants on the touchscreen-based approach and offer areas of future investigation as these recommendation are expanded to include more complex graphical concepts.

Integrity signals

Registry

Crossref · 10.1145/3403933

Cites

71 of 71 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

12 of 72 cited sources checked · 5 supported · 0 flagged · accuracy not yet measured

  • Findingcitation

    Switching vibratory signals at vertex points aids in shape identification accuracy for basic shapes up to five vertices.

    “we investigated the identification of basic shapes (up to five vertices) on a vibratory touchscreen and found that switching vibratory signals (e.g., increasing the intensity of the vibration) at the vertex points aids in shape identification accuracy [72].”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites [72] 72. Jennifer L. Tennison and Jenna L. Gorlewicz. 2019. Non-visual perception of lines on a multimodal touchscreen tablet. ACM Trans. Appl. Percept. 16, 1 (2019), 6. source

      Sections 3.2 and 4.3 (pages unavailable) describe line-tracing studies: one used different vibration patterns at line endpoints, while the other used auditory cues at bends. The Results in section 3.4 report line-recreation accuracy, not identification of basic shapes. Searches for shapes, five vertices, and vibratory cues at vertices found no passage testing the claimed effect on shape-identification accuracy. (LLM, conf=0.76)

      Experimental — accuracy not yet measured
  • Premisecitation

    Vibrations have been shown to aid in non-visual panning and zooming of information on the screen.

    “vibrations have been shown to aid in non-visual panning and zooming of information on the screen [52,54].”
    Quote in the paperSubstantial claim1 of 2 sources checked
    • cites [52] 52. Hari Prasath Palani and Nicholas A. Giudice. 2014. Evaluation of non-visual panning operations using touch-screen devices. In Proceedings of the 16th International ACM SIGACCESS Conference on Computers & Accessibility. ACM, 293-294. source
    • cites [54] 54. Hari Prasath Palani, Uro Giudice, and Nicholas A. Giudice. 2016. Evaluation of non-visual zooming operations on touchscreen devices. In Proceedings of the International Conference on Universal Access in Human-Computer Interaction. Springer, 162-174. source

      The Experimental Stimuli and Apparatus section describes vibrations representing map features, and the Results section reports that participants used non-visual zooming and panning to learn the maps. The study tested a multimodal interface, however, and does not establish that vibration itself aided the panning and zooming operations; zoom levels were indicated by speech, while panning used a two-finger drag. (LLM, conf=0.84)

      Experimental — accuracy not yet measured
  • Interpretationreasoning

    Saturation of sensation can lead to sensory fatigue and adaptation, making it difficult to continue to sense vibrating features on the touchscreen.

    “This saturation of sensation can then lead to sensory fatigue and adaptation, making it difficult to continue to sense vibrating features on the touchscreen.”
    Quote in the paperSubstantial claim1 of 3 sources checked
    • cites [26] 26. Jenna L. Gorlewicz, Jennifer L. Tennison, Hari Prasath Palani, and Nicholas A. Giudice. 2018. The graphical ac- cess challenge for people with visual impairments: Positions and pathways forward. In Interactive Multimedia. IntechOpen. source

      Section 2.1 (p. 2) discusses how touchscreen vibrations differ from raised tactile graphics, while section 2.4 (p. 7) discusses uses of vibrotactile feedback. Neither addresses whether sensation becomes saturated, causes sensory fatigue or adaptation, or makes vibrating features harder to sense. Searches for those terms found no supporting passage in our copy. (LLM, conf=0.72)

      Experimental — accuracy not yet measured
    • cites [39] 39. Roberta L. Klatzky, Nicholas A. Giudice, Christopher R. Bennett, and Jack M. Loomis. 2014. Touch-screen technology for the dynamic display of 2D spatial information without vision: Promise and progress.Multisens. Res. 27 (2014), 359-378. source
    • cites [55] 55. Hari Prasath Palani, Jennifer L. Tennison, G. Bernard Giudice, and Nicholas A. Giudice. 2018. Touchscreen-based hap- tic information access for assisting blind and visually-impaired users: Perceptual parameters and design guidelines. In Proceedings of the International Conference on Applied Human Factors and Ergonomics. Springer, 837-847.

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Premisecitation

    If the frequency of a vibration is below 3 Hz, it is perceived as slow kinesthetic motion.

    “If the frequency of a vibration is below 3 Hz, it is perceived as slow kinesthetic motion [68].”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [68] 68. Hong Z. Tan, Nathaniel I. Durlach, Charlotte M. Reed, and William M. Rabinowitz. 1999. Information transmission with a multifinger tactual display. Percept. Psychophys. 61, 6 (1999), 993-1008. source
  • Premisecitation

    Using a different feedback modality at vertices helps with shape identification.

    “This approach carries over into shape exploration, where marking vertices with a different modality of feedback aids in shape identification [24,72].”
    Quote in the paperSubstantial claim1 of 2 sources checked
    • cites [24] 24. Cagatay Goncu and Kim Marriott. 2011. GraVVITAS: Generic multi-touch presentation of accessible graphics. In Proceedings of the Conference on Human-Computer Interaction. Springer, 30-48. source
    • cites [72] 72. Jennifer L. Tennison and Jenna L. Gorlewicz. 2019. Non-visual perception of lines on a multimodal touchscreen tablet. ACM Trans. Appl. Percept. 16, 1 (2019), 6. source

      Section 1.1.1 reports prior work in which stronger vibrations or different sounds at vertices facilitated shape recognition. Section 4.3 uses auditory cues at key points on vibrating lines, but describes improved performance from separating the cues by modality as an expectation; this paper does not establish that switching modality at vertices improves shape identification. (LLM, conf=0.78)

      Experimental — accuracy not yet measured
  • May combine two claims. 48
  • Classified as probably not a substantial claim. 52
  • May combine two claims.

    Premisecitation

    Vibrations are effective in representing maps, building floor plans, lines, graphs, shapes, and simple graphic entities.

    “recent investigations have demonstrated that vibrations are effective in representing maps [59] and building floor plans [22], accurately perceiving and following lines and graphs [23,55,73], representing graphical shapes [24,72], and representing simple graphic entities [30].”
    Quote in the paperSubstantial claim1 of 5 sources checked
    • cites [59] 59. Benjamin Poppinga, Charlotte Magnusson, Martin Pielot, and Kirsten Rassmus-Gröhn. 2011. TouchOver map: Audio- tactile exploration of interactive maps. In Proceedings of the 13th International Conference on Human Computer Inter- action with Mobile Devices and Services. ACM, 545-550. source
    • cites [22] 22. Nicholas A. Giudice, Benjamin A. Guenther, Nicholas A. Jensen, and Kaitlyn N. Haase. 2020. Cognitive mapping without vision: Comparing wayfinding performance after learning from digital touchscreen-based multimodal maps vs. embossed tactile overlays. Front. Hum. Neurosci. 14 (2020), 87. source
    • cites [23] 23. Nicholas A. Giudice, Hari Prasath Palani, Eric Brenner, and Kevin M. Kramer. 2012. Learning non-visual graphi- cal information using a touch-based vibro-audio interface. In Proceedings of the 14th International ACM SIGACCESS Conference on Computers & Accessibility. ACM, 103-110. source
    • cites [55] 55. Hari Prasath Palani, Jennifer L. Tennison, G. Bernard Giudice, and Nicholas A. Giudice. 2018. Touchscreen-based hap- tic information access for assisting blind and visually-impaired users: Perceptual parameters and design guidelines. In Proceedings of the International Conference on Applied Human Factors and Ergonomics. Springer, 837-847. source
    • cites [73] 73. Jennifer L. Tennison, P. Merlin Uesbeck, Nicholas A. Giudice, Andreas Stefik, Derrick W. Smith, and Jenna L. Gorlewicz. 2020. Establishing vibration-based tactile line profiles for use in multimodal graphics. Trans. Appl. Per- cept. 17, 2 (2020), 1-14. source
  • May combine two claims.

    Premisecitation

    Touch is a fundamental part of perception but is not an all-encompassing substitute for vision.

    “While touch is a fundamental part of our perception [42,45], it is not an all-encompassing substitute for vision.”
    Quote in the paperSubstantial claim1 of 2 sources checked
    • cites [42] 42. Susan J. Lederman and Roberta L. Klatzky. 2009. Haptic perception: A tutorial. Atten. Percept. Psychophys. 71, 7 (2009), 1439-1459. source
    • cites [45] 45. James Minogue and M. Gail Jones. 2006. Haptics in education: Exploring an untapped sensory modality. Rev. Educ. Res. 76, 3 (2006), 317-348. source
  • May combine two claims.

    Interpretationcitation

    Lack of localized vibration provides users with no gradient of direction and can trigger sensory adaptation, fatiguing a user's finger.

    “This is problematic, because it provides users with no gradient of direction and can trigger sensory adaptation of feedback, fatiguing a user's finger of the vibration sensation [26,39,55].”
    Quote in the paperSubstantial claim1 of 3 sources checked
    • cites [26] 26. Jenna L. Gorlewicz, Jennifer L. Tennison, Hari Prasath Palani, and Nicholas A. Giudice. 2018. The graphical ac- cess challenge for people with visual impairments: Positions and pathways forward. In Interactive Multimedia. IntechOpen. source

      Section 2.1 (p. 2) says flat-touchscreen vibrations lack the direct cutaneous cues of raised graphics, but it does not say they lack a directional gradient. Searches for localized vibration, sensory adaptation, and finger fatigue found no passage in our copy addressing those claims. (LLM, conf=0.72)

      Experimental — accuracy not yet measured
    • cites [39] 39. Roberta L. Klatzky, Nicholas A. Giudice, Christopher R. Bennett, and Jack M. Loomis. 2014. Touch-screen technology for the dynamic display of 2D spatial information without vision: Promise and progress.Multisens. Res. 27 (2014), 359-378. source
    • cites [55] 55. Hari Prasath Palani, Jennifer L. Tennison, G. Bernard Giudice, and Nicholas A. Giudice. 2018. Touchscreen-based hap- tic information access for assisting blind and visually-impaired users: Perceptual parameters and design guidelines. In Proceedings of the International Conference on Applied Human Factors and Ergonomics. Springer, 837-847. source
    • Rests on an assumption: Commercially available touchscreens are featureless glass panes currently incapable of delivering localized vibration.
  • May combine two claims.

    Findingcitation

    Across multiple experiments, users also used techniques such as making crosses at vertices to locate connecting segments and scanning horizontally to find symmetry.

    “We have also aggregated shape and line exploration strategies observed across multiple experiments and found that users employed additional techniques including making crosses at vertex points to find connecting line segments (B) and scanning horizontally across the shape to uncover symmetry (C) [29,72].”
    Quote in the paperNot a substantial claim1 of 2 sources checked
    • cites [29] 29. Tiago Guerreiro, Kyle Montague, João Guerreiro, Rafael Nunes, Hugo Nicolau, and Daniel J. V. Gonçalves. 2015. Blind people interacting with large touch surfaces: Strategies for one-handed and two-handed exploration. In Proceedings of the International Conference on Interactive Tabletops & Surfaces. 25-34. source
    • cites [72] 72. Jennifer L. Tennison and Jenna L. Gorlewicz. 2019. Non-visual perception of lines on a multimodal touchscreen tablet. ACM Trans. Appl. Percept. 16, 1 (2019), 6. source

      Section 4.6 (page unavailable) reports that two participants used zigzag or circular movements to follow lines, but it does not describe making crosses at vertices or scanning horizontally to find symmetry. Searches for those techniques, including “vertex” and “symmetry,” found no passage in our copy addressing them. (LLM, conf=0.75)

      Experimental — accuracy not yet measured
  • May combine two claims.

    Findingcitation

    4mm ensures discrimination of vibrotactile lines rendered parallel to each other, but is not generalizable to oriented lines that subtend an angle.

    “While 4mm ensures discrimination of vibrotactile lines rendered parallel to each other, they are not generalizable to oriented lines that subtend an angle between each other.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingreasoning

    The above techniques are best suited for traditional tablet sizes (approximately 9-10 inches).

    “The above techniques are best suited for traditional tablet sizes (≈ 9-10 ).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Alternative poses such as holding the tablet in one hand and exploring with the other are viable options.

    “alternative poses such as holding the tablet in one hand and exploring with the other are also viable options.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Findingown data

    New users of multimodal graphics may need some training on how to best perceive and extract vibrotactile information.

    “we have found new users of multimodal graphics may need some training on how to best perceive and extract vibrotactile information.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Findingown data

    Users exploring onscreen content often look for some type of feedback semi-frequently, otherwise concerns arise of having drifted off the object of interest or out of the active screen areas.

    “We have anecdotally observed that users who are exploring onscreen content often look for some type of feedback semi-frequently, otherwise concerns arise of having drifted off of the object of interest or out of the active screen areas.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    This process is most useful in teaching individuals to use complementary fingers as anchoring and referencing points.

    “From a practical implementation, we have found this process to be most useful in teaching individuals to use complementary fingers as anchoring and referencing points.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Findingown data

    While authoring multimodal graphics, we have discovered the importance of being cognizant of the user's approach to interpreting them.

    “While authoring multimodal graphics, we have discovered the importance of being cognizant of the user's approach to interpreting them.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Adding small rubber dots along the vertical sides of the screen, or placing thin plastic tape across the perimeter of the active screen area, helps users remain in the active screen area and access easily identifiable reference points.

    “We have found that adding small, rubber dots along the vertical sides of the screen, or placing thin plastic tape across the perimeter of the active screen area, helps users in both ensuring that they remain in the active screen area and that they can also access easily identifiable reference points.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Findingnone given

    Simple tones tend to be preferred over highly stimulating auditory profiles.

    “From an auditory perspective, simple tones tend to be preferred over highly stimulating profiles.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Findingreasoning

    Using more than three to five vibration profiles total is ineffective from a perceptual and cognitive standpoint.

    “we have not found a need for more than this, and more importantly, acknowledge the ineffectiveness of using too many signals of the same modality from a perceptual and cognitive standpoint.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Findingreasoning

    Providing cues (a low-level clicking sound or a verbal cue stating no information) is preferred over leaving open white space without feedback.

    “we have found that providing cues (a low-level clicking sound or even a verbal cue stating “no information”) is preferred rather than leaving a lot of open, white space that does not provide any feedback.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingreasoning

    Reference fingers should not come too close together, as a new centroid point would then be calculated between the two fingers and could result in spurious triggering of feedback.

    “These reference fingers, however, should not come too close together, as a new centroid point would then be calculated between the two fingers and could result in spurious triggering of feedback.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Other fingers cannot trigger feedback but can act as guides and reference points to remember key places on the screen.

    “While other fingers cannot trigger feedback, they can act as guides and reference points to remember key places on the screen.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Findingnone given

    Affixing stands or mounts to the bottom of the tablet prevents vibration dampening from vibrations dissipating from the device to other surfaces.

    “To prevent vibration dampening from vibrations dissipating from the device to other surfaces, we recommend an additional hardware modification-affixing stands or mounts to the bottom of the tablet when possible”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Findingnone given

    It is best to have text read aloud when a user's finger is over the text in the diagram.

    “Currently, we have found it best to have text read aloud when a user's finger is over the text in the diagram.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Findingown data

    Twenty-two participants with visual impairment took part, recruited from the National Federation of the Blind national convention in 2019.

    “Twenty-two participants with visual impairment participated in this experiment, recruited from the National Federation of the Blind (NFB) national convention in 2019.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Some participants could not remember the difference between y- or x-axes or how to differentiate types of triangles.

    “For instance, some participants could not remember the difference between the y-or x-axes nor could some remember how to differentiate between different types of triangles (right, acute, obtuse).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Many users described the multimodal bar-chart representations as the strongest and easiest to understand, even though those graphics had slightly worse performance.

    “Despite having slightly worse performance of the two graphics, many users remarked that the multimodal bar-chart representations were the strongest and easiest to understand.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The evaluation questions and scoring validly measure participant knowledge and performance on the graphics.
  • May combine two claims.

    Findingreasoning

    Not much time was spent tracing middle sections of long lines; if participants remembered a key point nearby, they chose to find it from another spatial reference rather than trace the line all the way down.

    “Because of this, not much time was spent tracing the middle sections of long lines-if participants remembered there was a key point nearby, they chose to find the key point from another spatial reference rather than trace the line all the way down.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: Finger-location heatmaps accurately indicate the most important features and exploration behavior.
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    Ten of the 22 participants reported some light perception, and all but one reported no residual vision and complete blindness.

    “Ten of the 22 participants stated that they had some form of light perception and all but 1 individual (who chose not to respond) stated that they had no residual vision and were completely blind.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    In the study, the issue with double-tap was positioning rather than speed; users sometimes did not tap twice on the exact same location.

    “However, in this study, speed was not the issue encountered, but rather positioning.It was observed that users would sometimes not tap twice on the exact same location.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    Users pressed strongly on the screen when following vibrating lines or bars, causing the tablet to move slightly on the table.

    “We also note that it was observed that users pressed quite strongly on the screen when following vibrating lines or bars.This caused the tablet to move slightly on the table during exploration.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    Of the 22 participants, 16 had enough tactile diagram experience to need almost no additional assistance, while 6 requested assistance.

    “Of the 22 participants, 16 participants had sufficient experience with tactile diagrams to require almost no additional assistance, but 6 requested assistance reading the tactile diagrams.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    The menu bar implementation reduced screen real estate and caused accidental presses by users.

    “It quickly became apparent, however, that this implementation reduced screen real estate and introduced accidental presses from users.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    The double-tap gesture was not always activated correctly within the study, causing confusion for participants.

    “As such, the gesture was not always activated correctly within the study, which caused confusion for participants.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: AndroidOS cannot register two finger touchdowns as a double-tap unless they occur within a couple of millimeters of each other.
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    Most participants (N=22; average age 41) were female (N=13) and highly educated (N=16 had finished college or held graduate degrees).

    “A majority of these participants (N = 22; average age = 41 years) were female (N = 13) and highly educated (N = 16 finished college or had graduate degrees).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Average participant performance on multimodal touchscreen graphics was 80.09%, comparable to 81.83% on traditional embossed graphics.

    “On average, a participant's performance on multimodal, touchscreen-based graphics (M = 80.09%) was on par with their performance on the traditional embossed graphic (M = 81.83%).”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The evaluation questions and scoring validly measure participant knowledge and performance on the graphics.
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given

    The color-based feedback approach required each image's distinct components to be differentiated in a graphics program.

    “First, every image must have its distinct components differentiated using a graphics program.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    Participants had a wide range of diagnoses, most commonly Leber Congenital Amerosis (N=4), Glaucoma (N=3), and Retinitis Pigmentosa (N=3).

    “Participants represented a wide range of diagnoses, the most common being Leber Congenital Amerosis (N = 4), Glaucoma (N = 3), and Retinitis Pigmentosa (N = 3) (see Table 6 for complete demographics).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationcitation

    These findings illustrate the potential for vibrations to be a primary interaction modality for all individuals and a critical piece in closing the graphical access gap for individuals with visual impairments.

    “These findings have illustrated the potential for vibrations to not only be a primary interaction modality for all individuals, but to be a critical piece in closing the graphical access gap for individuals with VI.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationown data

    Signaling can be done within modality using different vibration patterns, but this comes with limitations.

    “This work illustrates that signaling can also be done within modality (as was done in this case by using different vibration patterns), but this comes with limitations.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    There is significant literature on tactile thresholds for physical stimuli, the effect of aging on tactile ability, and the tactile science supporting Braille reading and pattern recognition.

    “there is significant literature on tactile thresholds for physical stimuli [20,36], the effect of aging on tactile ability [66], and the tactile “science” supporting Braille reading and pattern recognition [76]”
    Quote in the paperSubstantial claim0 of 4 sources checked
    • cites [20] 20. George A. Gescheider, John H. Wright, and Ronald T. Verrillo. 2010. Information-processing Channels in the Tactile Sensory System: A Psychophysical and Physiological Analysis. Psychology Press.

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [36] 36. Lynette A. Jones and Susan J. Lederman. 2006. Human Hand Function. Oxford University Press. source
    • cites [66] 66. Joseph C. Stevens, Emerson Foulke, and Matthew Q. Patterson. 1996. Tactile acuity, aging, and Braille reading in long-term blindness.J. Exper. Psychol.: Appl. 2, 2 (1996), 91. source
    • cites [76] 76. Yasemin Vardar, Burak Güçlü, and Cagatay Basdogan. 2017. Effect of waveform on tactile perception by electrovibra- tion displayed on touch screens. IEEE Trans. Haptics 10, 4 (2017), 488-499. source
  • May combine two claims.

    Interpretationreasoning

    Vibratory touchscreens do not offer fine distinction and vibrate the entirety of the fingertip no matter what part is in contact with an object.

    “vibratory touchscreens do not offer such fine distinction and, instead, vibrate the entirety of the fingertip no matter what part is in contact with an object.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: Commercially available touchscreens are featureless glass panes currently incapable of delivering localized vibration.
  • May combine two claims.

    Interpretationreasoning

    This change in vibration patterns gives users key points to identify and salient landmarks to count and return to during exploration.

    “This change in vibration patterns gives users key points to identify and salient landmarks to count and to return to during their exploration.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    These limitations challenge designers of multimodal, tactile graphics.

    “These limitations undoubtedly challenge designers of multimodal, tactile graphics.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Guidelines and standards for tactile graphics such as those developed by the Braille Authority of North America and Braille Literacy Canada have formalized hard-copy tactile graphics and provided a framework for consistency in presentation of information that can be widely adopted.

    “guidelines and standards for tactile graphics such as those developed by the Braille Authority of North America [8] and Braille Literacy Canada [9] have formalized hard-copy tactile graphics and have provided a framework for consistency in presentation of information that can be widely adopted.”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [8] 8. BANA. 2019. Code Books and Guidelines. Retrieved from http://www.brailleauthority.org/publications-area.html.

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [9] 9. BLC. 2019. Braille Literacy Canada. Retrieved from http://www.brailleliteracycanada.ca/en/.

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Premisereasoning

    Principles for creating hard-copy tactile graphics exist, but only a subset apply to touchscreen-based graphics because of fundamental differences in how these graphics are conveyed.

    “While there are principles that exist for creating hard-copy tactile graphics [8], only a subset of them apply here, because of the fundamental differences in the way these graphics are conveyed.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [8] 8. BANA. 2019. Code Books and Guidelines. Retrieved from http://www.brailleauthority.org/publications-area.html.

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Interpretationreasoning

    Because vibration actuation is common in commercially available touch-based platforms, the necessary hardware capabilities are already present and adopted within the VI community, making the potential for adoption and widespread use high.

    “Namely, because vibration actuation is common in commercially available, touch-based platforms, the necessary hardware capabilities are already present and adopted within the VI community, making the potential for adoption and widespread use high.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Touchscreens are now often outfitted with vibration capabilities.
  • May combine two claims.

    Premisecitation

    Users must keep track of all important kinesthetic and spatial cues to perceive content correctly, highlighting the haptic system's spatial bandwidth and temporal processing limitations.

    “Users must keep track of all important kinesthetic and spatial cues to perceive content correctly, highlighting the haptic system's spatial bandwidth and temporal processing limitations [39].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [39] 39. Roberta L. Klatzky, Nicholas A. Giudice, Christopher R. Bennett, and Jack M. Loomis. 2014. Touch-screen technology for the dynamic display of 2D spatial information without vision: Promise and progress.Multisens. Res. 27 (2014), 359-378. source
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Apple has recently released Core Haptics for newer iOS devices (iPhone 8 and above), which promises to provide more flexibility to developers using tactile feedback in their applications.

    “Apple has recently released Core Haptics for newer iOS devices (iPhone 8 and above), which promises to provide more flexibility to developers using tactile feedback in their applications [16].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [16] 16. Core Haptics | Apple Developer. 2020. Retrieved from https://developer.apple.com/documentation/corehaptics.

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Premisecitation

    Human recorded speech may be preferred over TTS engines.

    “It is acknowledged that human recorded speech may be preferred over TTS engines”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [28] 28. João Guerreiro and Daniel Gonçalves. 2015. Faster text-to-speeches: Enhancing blind people's information scanning with faster concurrent speech. In Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility. 3-11. source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Including multiple concurrent voices can improve the speed and comprehension of scanning for information.

    “including multiple concurrent voices can improve the speed and comprehension of scanning for information [28].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [28] 28. João Guerreiro and Daniel Gonçalves. 2015. Faster text-to-speeches: Enhancing blind people's information scanning with faster concurrent speech. In Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility. 3-11. source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Sonification techniques have been used successfully in relaying graphical information.

    “There is a wealth of information available on using sonification techniques successfully in relaying graphical information, and we refer users to References [23,48,49,59,[79][80][81] for more details.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [23,48,49,59,[79][80][81]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Interpretationreasoning

    The single touch limitation makes detection of angled or curving trajectories particularly challenging, relying largely on the kinesthetic system, which is rather noisy.

    “This single touch limitation makes detection of angled or curving trajectories particularly challenging, relying largely on the kinesthetic system, which is rather noisy.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: Vibration feedback is not localized, resulting in the majority of exploration needing to be done via a single finger.
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    Relatively simple adaptations can be made in hardware and software that make exploration of multimodal graphics easier.

    “Collectively, relatively simple adaptations can be made in hardware and software that make exploration of multimodal graphics easier.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    Spatial information integrated across time and space in physical media is not always precise, which can harm the accuracy of mental images.

    “This integration is also not always precise, which can negatively affect creation of a mental image with accurate spatial features [83].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [83] 83. Heng Xu, Michael A. Peshkin, and J. Edward Colgate. 2019. UltraShiver: Lateral force feedback on a bare fingertip via ultrasonic oscillation and electroadhesion. IEEE Trans. Haptics 12, 4 (2019), 497-507.

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    Our group has not conducted formal studies comparing one exploration technique from the other.

    “While our group has not conducted formal studies comparing one exploration technique from the other”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Study design and conductown data

    We have informally aggregated common exploration strategies that have resulted in high achieving outcomes from previous user studies.

    “we have informally aggregated common exploration strategies that have resulted in high achieving outcomes from previous user studies.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

    Interpretationreasoning

    Bar charts and geometry figures are fruitful for scaling up the design guidelines and are fundamental math concepts from which more complex graphics can be designed.

    “Therefore, these two concepts provide fruitful ground for scaling up the design guidelines and strategies employed to date but also represent fundamental concepts in mathematics from which additional complex graphics can be designed.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Mathematics and statistics contain highly visual content that is often difficult for individuals with VI to fully participate in.
    • Rests on an assumption: Bar charts are regularly used for categorical datasets and are a benchmark in fundamental statistical analysis.
    • Rests on an assumption: Bar charts provide many fundamental aspects of all statistical graphics, including labels, legend, axes, and increments.
    • Rests on an assumption: These skills are fundamental for using more advanced graphical representations of data.
    • Rests on an assumption: Geometry figures are fundamental to larger STEM concepts.
    • Rests on an assumption: These two concept areas are widely used in classrooms, the workplace, and scientific and popular press writing, so the findings have practical implications.
  • May combine two claims.

    Interpretationreasoning

    While people may be able to trace these stimuli, it is often difficult for them to accurately perceive the magnitude of the deviation.

    “while people may be able to trace these stimuli, it is often difficult for them to accurately perceive the magnitude of the deviation.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationreasoning

    Given that the majority of VI users have adopted iOS, this movement is promising and necessary in supporting multimodal user experiences, learning, and inclusive design more broadly.

    “Given that majority of VI users have adopted iOS, this movement is promising and necessary in supporting multimodal user experiences, learning, and inclusive design more broadly.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Majority of VI users have adopted iOS.
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationreasoning

    With the advent of Bluetooth vibration motors and wearable mechanisms, the lack of vibration capabilities in larger screens may not necessarily be a problem if individuals are open to augmenting their experience with additional hardware.

    “We note, however, that with the advent of Bluetooth vibration motors, as well as wearable mechanisms, the lack of vibration capabilities in larger screens may not necessarily be a problem if individuals are open to augmenting their experience with additional hardware.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Most larger tablets often do not contain vibrotactile feedback and are more expensive and less portable than traditional tablets.
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationreasoning

    Hand movements used to accurately perceive and extract vibrotactile data will likely look similar to the ones described.

    “the hand movements (and thus encoding strategies) used to accurately perceive and extract vibrotactile data will likely look similar to the ones we describe below.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    There is rich literature on discrimination thresholds and subjective interpretations of vibration profiles.

    “There is, however, rich literature on discrimination thresholds and subjective interpretations of vibration profiles more broadly [14].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [14] 14. Seungmoon Choi and Katherine J. Kuchenbecker. 2013. Vibrotactile display: Perception, technology, and applications. Proc. IEEE 101, 9 (2013), 2093-2104. source
  • May combine two claims.

    Interpretationreasoning

    This can be a problem depending on how the user's movement intersects the stimulus, and is particularly challenging with small stimuli.

    “This can be a problem, depending on how the user's movement intersects the stimulus, and is particularly challenging with small stimuli.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Only the center of the finger's contact pad with the touchscreen is used to generate on/off vibratory feedback.
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Interpretationreasoning

    There is a limit to the amount of information that can be conveyed on smaller screens, though layering and panning techniques will likely help.

    “There is certainly a limit to the amount of information that can be conveyed on smaller screens, though layering and panning techniques will likely help with this.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    This echoes recommendations by Reference [15] to assist users in staying within active area boundaries through simple hardware modifications such as stickers.

    “This echoes recommendations put forward by Reference [15] to assist users in staying within the active area boundaries of a touchscreen through the use of simple hardware modifications, such as stickers.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [15] 15. Rafael Jeferson Pezzuto Damaceno, Juliana Cristina Braga, and Jesús Pascual Mena-Chalco. 2018. Mobile device ac- cessibility for the visually impaired: Problems mapping and recommendations. Univ. Access Inf. Soc. 17, 2 (2018), 421-435. source
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    Providing a legend or key for bar charts, similar to the tactile version, would support user search by allowing high-level information at the start of the task to direct search.

    “This would support user search efforts by allowing them to obtain high-level information about the graphic's data at the start of the task so they might better direct their search of the graphic.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationown data

    Consumption of non-visual media can occur in digital space with graphical literacy performance at least on par with traditional tactile media.

    “These guidelines demonstrate that consumption of non-visual media can occur in the digital space, with graphical literacy performance that is at least on par with traditional tactile media.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The evaluation questions and scoring validly measure participant knowledge and performance on the graphics.
    • Rests on an assumption: The study's findings can be generalized to students and adults with visual impairments in classroom and data-reading contexts.
    • Rests on an assumption: The multimodal touchscreen graphics tested were implemented in accordance with the article's guidelines.
  • Classified as probably not a substantial claim.

    Study design and conductreasoning

    Embossed graphics were comparable in size to the tablet graphics to achieve mapping between stimuli and avoid confusion when moving between platforms.

    “The embossed graphics were comparable in size to the graphics given on the tablet to achieve mapping between the two stimuli and to eliminate any confusion moving between platforms.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductown data

    Of the 22 participants, all finished the geometry figure evaluations in both media, while 19 finished the bar-chart evaluations; one ran out of time before reaching the bar charts.

    “Twenty-two participants completed the geometry figure evaluations in both mediums, but only 19 participants completed the bar-chart evaluations, as 1 participant did not reach the bar charts in the time that was allotted.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    To successfully represent a shape, all key parts (vertices, lines, special angles) must be found and stitched together in memory.

    “To have a successful representation of the shape, all key parts (all vertices, lines, and special angles) must have been found and stitched together in memory.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    The quicker evaluation of embossed graphics could be due to participants having more experience with physical media than with the brief training on touchscreen media.

    “This could be due to several reasons with the most obvious being the experience disparity between the two mediums.Participants are likely to have had more experience exploring physical media as compared to the brief training period in which users had to acquaint themselves with the touchscreen-based media.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductown data

    Training sessions lasted 10 to 20 minutes and ended only after participants successfully completed criterion questions about the training graphic.

    “Each training session lasted between 10 and 20 minutes and only concluded once participants successfully completed a set of criterion questions about the training graphic.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductnone given

    Participants also had to be able to read Braille and read tactile diagrams with minimal assistance.

    “Potential participants were also required to have the ability to read Braille and read tactile diagrams with minimal assistance.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductown data

    Participants differed widely in age, gender, and prior skill with graphics.

    “Second, our participant pool was highly varied across age, gender, and relevant graphic skills.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    As a result, users could get audio information readily and proceed quickly, making efficient use of their time.

    “This allowed users to easily obtain audio information and quickly move on, enabling them to efficiently use their time.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Finger-location heatmaps accurately indicate the most important features and exploration behavior.
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductnone given

    Participants received all touchscreen or all embossed versions before the other, with the order of bar charts and geometry images alternating according to Latin square methodology.

    “Participants received all touchscreen or embossed versions of the images before the other version, with the order of bar charts and geometry images alternating according to typical Latin square methodology.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductreasoning

    Users had few choices for adjusting the speech rate, and this may have influenced how long they took and how they interpreted the graphics.

    “Nonetheless, we note that our text-to-speech rate had limited options for users to choose, which could have affected their time and interpretation during exploration.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Study design and conductnone given

    Most participants came with prior training and experience using embossed graphics, whereas their exposure to the multimodal graphics was limited to this study's training session.

    “This is interesting, as many participants had training and experience with embossed graphics while having only the training epoch on the multimodal graphics in this study.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductown data

    Evaluation questions involved only information extraction and never required computation.

    “During evaluation, participants were asked four-to-six questions (see Table 8 for a set of questions regarding a bar chart and geometry image from the study) about the graphic that only involved information extraction; no questions asked for computation in any form.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    After gaining familiarity with the bar charts, participants moved very quickly through touchscreen bar charts and may have eventually caught up to embossed media speeds.

    “Yet, after gaining familiarity with the bar charts, participants moved very quickly through the touchscreen-based bar charts and users may have eventually caught up to the speeds at which they consumed the embossed media.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    The heatmap findings highlight the importance and desire for users to use their time efficiently during these tasks.

    “Again, this serves to highlight the importance and the desire for users to use their time efficiently during these tasks.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Finger-location heatmaps accurately indicate the most important features and exploration behavior.
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductnone given

    Inclusion required self-reported fingertip sensation, functional finger movement, no severe cognitive impairment, and no or minimal hearing loss.

    “To be considered for participation, individuals were required (by self-report) that they had sensation in their fingertips, functional movement of their fingers, no severe cognitive impairment (inability to understand directions or questions asked), and no/minimal hearing loss.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductreasoning

    A Latin square design was used to account for order effects.

    “A Latin square design was employed as a means to account for order effects during the study.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductreasoning

    Limited time abbreviated the amount of training provided to participants.

    “Additionally, this limited time also abbreviated the amount of training that could be provided to participants.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductown data

    The study was approved by Saint Louis University's Institutional Review Board, and participants gave informed consent and were compensated.

    “The following study was approved by Saint Louis University's Institutional Review Board, and participants were provided informed consent and compensated for their time.”
    Quote in the paperNot a substantial claim
81 of 81
  • The paper relies on this without support.

    Few guidelines or processes exist to guide the design of multimodal, touchscreen-based graphics.

    “yet few guidelines or processes exist to guide the design of multimodal, touchscreen-based graphics.”
  • The paper relies on this without support.

    Recent estimates suggest that 70%-90% of VI cell phone users have smart phones in the United States.

    “Recent estimates suggest that 70%-90% of VI cell phone users have smart phones in the United States.”
  • The paper relies on this without support.

    Few basic parameters are available for rendering multimodal graphics, particularly complex ones, on touchscreens.

    “few basic parameters are available for rendering multimodal graphics, particularly those that are more complex, on touchscreens.”
  • The paper relies on this without support.

    Few guidelines exist to aid designers in applying vibration and sound feedback to an image for optimal consumption.

    “Few guidelines exist to aid designers in applying vibration and sound feedback to an image for optimal consumption.”
  • The paper relies on this without support.

    We lack guidelines that inform perception and usability of multimodal, vibrotactile-based graphics as displayed on screen.

    “we lack guidelines that inform perception and usability of these graphics as displayed on screen.”
  • The paper relies on this without support.

    There has not been as much investigation on which vibration profiles are most conducive for continuous exploration in the context of graphics.

    “There has not been as much investigation on which vibration profiles are most conducive for continuous exploration in the context of graphics.”
  • The paper relies on this without support.

    Commercially available touchscreens are featureless glass panes currently incapable of delivering localized vibration.

    “Commercially available touchscreens are featureless glass panes currently incapable of delivering localized vibration.”
  • The paper relies on this without support.

    Vibration feedback is not localized, resulting in the majority of exploration needing to be done via a single finger.

    “vibration feedback is not localized, resulting in the majority of the exploration needing to be done via a single finger.”
  • The paper relies on this without support.

    Only the center of the finger's contact pad with the touchscreen is used to generate on/off vibratory feedback.

    “Only the center of the finger's contact pad with the touchscreen is used to generate the on/off vibratory feedback.”
  • The paper relies on this without support.

    Touch, unlike vision, lacks specialized processors for parallel information and the user must undergo a complicated process of synthesizing touch information.

    “Touch, unlike vision, also lacks specialized processors for parallel information and the user must undergo a complicated process of synthesizing touch information.”
  • The paper relies on this without support.

    Creating and authoring multisensory content is a new area of research.

    “Additionally, creating and authoring multisensory content is a new area of research.”
  • The paper relies on this without support.

    Physical stimuli are often cutaneous cues perceived via pressure-based mechanoreceptors, whereas vibration cues innervate pacinian corpuscles, which are functionally different.

    “physical stimuli are often cutaneous cues perceived via pressure-based mechanoreceptors, whereas vibration cues innervate pacinian corpuscles, which are functionally different.”
  • The paper relies on this without support.

    Too much information conveyed on the screen results in confusion, and too little makes navigation and interpretation challenging.

    “Too much information conveyed on the screen results in confusion, and too little makes navigation and interpretation challenging.”
  • The paper relies on this without support.

    Companies that use Android OS, such as Samsung and LG, have and continue to consistently have vibration capabilities across mobile and tablet platforms.

    “companies that use the Android OS, such as Samsung and LG, have and continue to consistently have vibration capabilities across mobile and tablet platforms.”
  • The paper relies on this without support.

    Apple has had touch capabilities in their mobile platforms for some time, but it has yet to be available on tablets.

    “While Apple has had touch capabilities in their mobile platforms for some time, it has yet to be available on tablets.”
  • The paper relies on this without support.

    Android provides significantly more flexibility in developing vibration profiles and providing continuous vibration feedback.

    “Android provides significantly more flexibility in developing vibration profiles and providing continuous vibration feedback.”
  • The paper relies on this without support.

    To date, Apple has given limited control over tactile feedback capabilities and limits the run-time for them.

    “To date, Apple has given limited control over the tactile feedback capabilities and limits the run-time for them.”
  • The paper relies on this without support.

    Majority of VI users have adopted iOS.

    “Given that majority of VI users have adopted iOS”
  • The paper relies on this without support.

    When individuals learn tactile graphics, they are taught certain strategies to help maximize information encoding and interpretation of the information through touch.

    “When individuals learn tactile graphics, they are taught certain strategies to help maximize information encoding and interpretation of the information through touch.”
  • The paper relies on this without support.

    Touchscreens are now often outfitted with vibration capabilities.

    “touchscreens are now often outfitted with vibration capabilities.”
  • The paper relies on this without support.

    Most larger tablets often do not contain vibrotactile feedback and are more expensive and less portable than traditional tablets.

    “most of the larger tablets often do not contain vibrotactile feedback and are more expensive and less portable than traditional tablets.”
  • The paper relies on this without support.

    Physical media exploration is very cognitively demanding because spatial information must be integrated across time and space.

    “Even with physical media, this way of accessing visual information is very cognitively demanding due to the integration of spatial information across time and space.”
  • The paper relies on this without support.

    Given limited screen space on commercial touchscreen devices, accessing graphical materials such as maps would be impossible without panning and zooming.

    “Given the limited screen real estate on commercial touchscreen devices, accessing graphical materials such as maps would not be possible without the incorporation of panning and zooming operations.”
  • The paper relies on this without support.

    Mathematics and statistics contain highly visual content that is often difficult for individuals with VI to fully participate in.

    “Using the guidelines and strategies above, our team has begun designing multimodal graphics, particularly in the area of mathematics and statistics, which are known to have highly visual content that is often difficult for individuals with VI to fully participate.”
  • The paper relies on this without support.

    Bar charts are regularly used for categorical datasets and are a benchmark in fundamental statistical analysis.

    “From a teaching and learning perspective, bar charts are regularly used to represent categorical datasets and are considered a benchmark in fundamental statistical analysis.”
  • The paper relies on this without support.

    Bar charts provide many fundamental aspects of all statistical graphics, including labels, legend, axes, and increments.

    “These types of graphs provide many of the fundamental aspects of all statistical graphics, including labels, legend, axes, and increments.”
  • The paper relies on this without support.

    These skills are fundamental for using more advanced graphical representations of data.

    “These skills are fundamental to utilize more advanced graphical representations of data (line plots, scatter plots, etc.).”
  • The paper relies on this without support.

    Geometry figures are fundamental to larger STEM concepts.

    “Geometry figures are also fundamental to larger STEM concepts.”
  • The paper relies on this without support.

    These two concept areas are widely used in classrooms, the workplace, and scientific and popular press writing, so the findings have practical implications.

    “Finally, these two concept areas are widely used in the classrooms, in the workplace, and in both scientific and popular press writing, enabling the findings of this work to have practical implications.”
  • The paper relies on this without support.

    Context is necessary for understanding the purpose of onscreen content and better prepares the user to perform tasks with the data.

    “Context is necessary for understanding the purpose of the content displayed onscreen and better prepares the user to perform any tasks with the data.”
  • The paper relies on this without support.

    Information can be layered, which makes visual tools such as legends unnecessary.

    “Information can be layered, rendering some visual tools such as legends, which take up space and require moving haptic exploration away from the core stimuli, unnecessary.”
  • The paper relies on this without support.

    White space that is not meaningful to the graphic is extraneous and may over-saturate the user during exploration.

    “If the white space is not meaningful to the graphic, it is extraneous information that may over-saturate the user during exploration.”
  • The paper relies on this without support.

    Gestures are important interaction techniques that do not cost screen real estate or require audio or text input.

    “Gestures are important interaction techniques that do not come at the cost of screen real estate or require audio or text input from the user.”
  • The paper relies on this without support.

    Graphics and their interpretation are largely open-ended.

    “It is important to interpret the guidelines posited in this article in this context, acknowledging that graphics and their interpretation are largely openended.”
  • The paper relies on this without support.

    Guidelines that support perceptual detection and extraction are necessary, but pedagogical goals add complexity that must be considered in rendering multimodal graphics.

    “While guidelines that support detection and extraction from a perceptual standpoint are necessary, there is an additional level of complexity driven by pedagogical goals that must be considered in rendering multimodal graphics.”
  • The paper relies on this without support.

    The evaluation questions and scoring validly measure participant knowledge and performance on the graphics.

    “All questions used to evaluate participant knowledge of the graphics were scored and averages computed to summarize performance in the evaluation task.”
  • The paper relies on this without support.

    The study's findings can be generalized to students and adults with visual impairments in classroom and data-reading contexts.

    “This is an advantageous finding for students in classrooms consuming subject-related material, but even has implication for adults who must read and interpret visualized data, such as bar-graph renderings.”
  • The paper relies on this without support.

    The multimodal touchscreen graphics tested were implemented in accordance with the article's guidelines.

    “These results show that performance when using the multimodal graphics as informed by the guidelines put forth in this article is within the statistical margin of error observed with traditional, embossed tactile graphics.”
  • The paper relies on this without support.

    AndroidOS cannot register two finger touchdowns as a double-tap unless they occur within a couple of millimeters of each other.

    “When this happens, it is difficult for AndroidOS to register finger touchdown events that do not occur within a couple of millimeters of each other as a double-tap.”
  • The paper relies on this without support.

    The participant sample is typical of the population, though it may not represent all users in each age bracket.

    “While this inserts heterogeneity within our study, this is a typical sample of the population, although it may not represent all users in each age bracket.”
  • The paper relies on this without support.

    Finger-location heatmaps accurately indicate the most important features and exploration behavior.

    “To demonstrate the most important features of each graphic, heatmaps of participant finger locations are provided by Figure 8.”
41 of 41

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Text-based and numerical descriptions of graphics are less precise, more error prone in their interpretation and require more cognitive load than a perceptual interface that directly renders the same information through touch, sound, or vision.

    “Text-based and numerical descriptions of graphics are less precise, more error prone in their interpretation and require more cognitive load than a perceptual interface that directly renders the same information through touch, sound, or vision [53,111,119].”

    From The Accessibility of Data Visualizations on the Web for Screen Reader Users: Practices and Experiences During COVID-19 (2023) · cites this paper as [53]

    Section 4.1.2 describes a touchscreen graphic that conveys bars through vibration and labels and values through speech, supporting the claim that information can be rendered through touch and sound. But the paper does not establish that text-based or numerical descriptions are less precise, more error-prone, or more cognitively demanding than such an interface. Section 6 instead reports memory demands encountered while exploring the multimodal geometric figures; no page number was provided for these passages. (LLM, conf=0.78)

    Experimental — accuracy not yet measured
  • It will be challenging to design an IVIS with 4mm inter-element spacing based on Gorlewich's study.

    “It will be challenging to design an IVIS with 4mm inter-element spacing based on Gorlewich's [48] study”

    From A Brief Survey on Interactive Automotive UI (2021) · cites this paper as [48]

Statistics recomputed

Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.

  • Consistentt(18) = 1.68reported p = .11 · recomputed p = .110

    “t(18) = 1.68, p = .11”

  • Consistentt(21) = -0.366reported p = .718 · recomputed p = .718

    “t(21) = -.366,p = .718”

  • Consistentt(37) = -2.99reported p = .005 · recomputed p = .005

    “t(37) = -2.99,p = .005”

3 of 3

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Geometry confidence interval conflicts with the nonsignificant result

    Minor

    The reported 95% confidence interval for the geometry comparison runs from −8.14 to −5.71, excluding zero. That conflicts with the reported p = .718 and the statement that the difference was not statistically significant.

  • One missed bar-chart evaluation does not explain the reported sample size

    Minor

    Of 22 participants, excluding one who did not reach the bar charts would leave 21, not 19. The text does not account for the other two participants.

    Reported 22 · recomputed 20

  • The participant vision descriptions conflict

    Minor

    The demographics say ten participants had some light perception, but also say that all but one reported no residual vision and were completely blind.

  • The citation for vibration-profile research points to a different source

    Minor

    The text cites reference 74 for work matching vibration effects to embossed lines, but entry 74 is a product page for swell-touch paper, not that research.

  • The bar-chart completion count leaves three participants unaccounted for

    Minor

    Of the 22 participants who completed the geometry evaluations, 19 completed the bar-chart evaluations. That leaves three participants, not the one cited as the reason for the shortfall.

    Reported 1 · recomputed 3

  • The geometry confidence interval conflicts with its reported test result

    Minor

    The reported 95% confidence interval has two negative endpoints, so it excludes zero. That conflicts with the reported p-value of .718 and the statement that the geometry comparison was not statistically significant.

6 of 6

Cites

Flagged first, then by citations

Research works printed but not linked: 22

  1. Ada Lopez, Look, Listen, Learn
  2. Stephen, Proceedings of the 5th Conference on Australasian User Interface-Volume 28
  3. Gescheider George A., 2010, Verrillo
  4. Giudice Nicholas A., Proceedings of the 14th International ACM SIGACCESS Conference on Computers 8 Accessibility. ACM, 103--110
  5. Gorlewicz Jenna L., 2018, Hari Prasath Palani, and Nicholas A. Giudice
  6. Hwang Inwook, 2010, Proceedings of the IEEE Haptics Symposium. IEEE, 1--8.
  7. Jones Lynette A., 2006, Lederman
  8. Kane Shaun K., Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility. ACM, 73--80
  9. Kane Shaun K., 2047, Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST’11)
  10. Klatzky Roberta L., 2003, Lederman
  11. Loomis Jack M., 2018, Giudice
  12. Loomis Jack M., 1986, Tactual perception, Handbook Percept. Hum. Perform., 2, 2
  13. Muehlbradt Annika, Proceedings of the International Conference on Multimodal Interaction. ACM, 455--463
  14. Nees Michael A., 2009, Walker
  15. Palani Hari Prasath, Proceedings of the 16th International ACM SIGACCESS Conference on Computers 8 Accessibility. ACM, 293--294
  16. Palani Hari Prasath, 2016, Giudice
  17. Palani Hari Prasath, 2018, Giudice
  18. Polly Edman, Tactile Graphics
  19. Raja Monoj Kumar, The Development and Validation of a New Smartphone Based Non-visual Spatial Interface for Learning Indoor Layouts. Master’s Thesis
  20. Rastogi Ravi, Proceedings of the 12th International ACM SIGACCESS Conference on Computers and Accessibility. ACM, 239--240
  21. Summers Ed, 2012, Proceedings of the SAS Global Forum. Citeseer.
  22. Tennison Jennifer L., 2016, Gorlewicz

Cited by

Sorted by citations

Authors
Gorlewicz, J. L., Tennison, J. L., Uesbeck, P. M., Richard, M. E., Palani, H. P., Stefik, A., Smith, D. W., & Giudice, N. A.
Affiliations
  • Saint Louis University (US)
  • University of Nevada, Las Vegas (US)
  • University of Maine (US)
  • University of Alabama in Huntsville (US)
Venue
ACM Transactions on Accessible Computing
Published
2020-08-03
Volume
13
Issue
3
Pages
1-30
ISSN
  • 1936-7228 (ISSN-L)
  • 1936-7236
OpenAlex
W3047199091
Cited by
53
References
49
Citations by year
2026: 9 · 2025: 8 · 2024: 11 · 2023: 7 · 2022: 6 · 2021: 12
FWCI
3.36
Type
journal article
Language
en
Open access
Locations
ACM Transactions on Accessible Computing (publishedVersion)
Funders
National Science Foundation (1644538,1644491,1644476,1644471,1822800,1650114)
Topics
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
  • Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Data Visualization and Analytics
Keywords
visual impairment, accessibility, design guidelines, haptic feedback, vibrotactile feedback, audio feedback, bar charts, geometry, mathematics education, learning performance

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read under definition version 3 (extract-v3) on 2026-09-28.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-09-28.

Cited sources are checked by gpt-6-sol.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review