Investigating touchscreen accessibility for people with visual impairments
Abstract
Touchscreen computing devices such as the iPhone are becoming more common. However this technology is largely inaccessible to people with visual impairments. We present the results of a requirements capture study that illustrates the problems with touchscreen accessibility, and the choices visually impaired people make when choosing assistive technology. We investigate ways of overcoming touchscreen accessibility problems by comparing a raised paper overlay touchscreen based MP3 player, with a touchscreen gesture based player. Twelve blindfolded participants, and one visually impaired person, were able to operate both players, though there were problems with short impact related operations in the gesture player. From our results we provide guidelines for future designers, to help them exploit the potential of touchscreen technology for visually impaired people.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Physical overlays add tactile information about the position of interface components.
“Physical overlays [14,20] add tactile information about the position of interface components.”
From Pressing a Button You Cannot See: Evaluating Visual Designs to Assist Persons with Low Vision through Augmented Reality (2021) · cites this paper as [20]
Physical overlays are suitable for static layouts of devices used repeatedly, such as microwave ovens, because they must be prepared ahead of an interaction.
“As they have to be prepared ahead of an interaction, they are suitable for static layouts of devices used repeatedly, such as microwave ovens.”
From Pressing a Button You Cannot See: Evaluating Visual Designs to Assist Persons with Low Vision through Augmented Reality (2021) · cites this paper as [20]
Similar to Kane et al. [10], participants suggested the idea of a system which was aware of the environment and context of use.
“Similar to Kane et al. [10], participants suggested the idea of a system which was aware of the environment and context of use.”
From Determining the Accessibility of Mobile Screen Readers for Blind Users (2012) · cites this paper as [10]
Prior tactile accessibility approaches had limited compatibility across multiple apps.
“had limited compatibility across multiple apps [15,22,29]”
From Interactiles: 3D Printed Tactile Interfaces to Enhance Mobile Touchscreen Accessibility (2018) · cites this paper as [22]
Qualitative studies consistently found problems with locating items within graphical interfaces that were designed to be seen rather than heard.
“These studies consistently found problems with locating items within graphical interfaces that were designed to be seen rather than heard.”
From Interactiles: 3D Printed Tactile Interfaces to Enhance Mobile Touchscreen Accessibility (2018) · cites this paper as [22]
Prior research has limited each static physical overlay to a specific screen in a single app.
“However, prior research has limited each such overlay to a specific screen in a single app (e.g., [15,22,29]).”
From Interactiles: 3D Printed Tactile Interfaces to Enhance Mobile Touchscreen Accessibility (2018) · cites this paper as [22]
Carrying multiple devices can be difficult to manage and costly.
“However, carrying multiple devices can be difficult to manage [17] and costly [22] (e.g., the Victor Reader Stream costs $369).”
From Interactiles: 3D Printed Tactile Interfaces to Enhance Mobile Touchscreen Accessibility (2018) · cites this paper as [22]
Users often carry multiple devices with overlapping functionality that each offer better accessibility for specific tasks.
“Because of these issues, users often carry multiple devices with overlapping functionality that each offer better accessibility for specific tasks [17,22].”
From Interactiles: 3D Printed Tactile Interfaces to Enhance Mobile Touchscreen Accessibility (2018) · cites this paper as [22]
Cites
Investigating the effectiveness of tactile feedback for mobile touchscreens
Hoggan, E. E., Brewster, S. A., & Johnston, J. (2008) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1357054.1357300 · Cited by 454 · see citing works
Self-citationLee, D. (1957) · The Lancet · doi:10.1016/s0140-6736(57)91352-1 · Cited by 392 · see citing works
Gestural and audio metaphors as a means of control for mobile devices
Pirhonen, A., Brewster, S. A., & Holguin, C. (2002) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/503376.503428 · Cited by 251 · see citing works
Self-citationDesperately seeking simplicity
Dawe, M. (2006) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1124772.1124943 · Cited by 239 · see citing works
Remote usability evaluations with disabled people.
Petrie, H., Hamilton, F., King, N., & Pavan, P. (2006) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1124772.1124942 · Cited by 157 · see citing works
Gesture in Human-Computer Interaction and Simulation
Gibet, S., Courty, N., & Kamp, J.-F. (2006) · Lecture notes in computer science · doi:10.1007/11678816 · Cited by 123 · see citing works
Trackball text entry for people with motor impairments
Wobbrock, J. O., & Myers, B. A. (2006) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1124772.1124845 · Cited by 76 · see citing works
Wall, S. A., & Brewster, S. A. (2006) · Nordic Conference on Human-Computer Interaction · doi:10.1145/1182475.1182477 · Cited by 61 · see citing works
Self-citationCrossan, A., & Brewster, S. A. (2008) · ACM Transactions on Accessible Computing · doi:10.1145/1408760.1408766 · Cited by 60 · see citing works
Self-citationDesign principles for tactile interaction
Challis, B. P., & Edwards, A. D. N. (2001) · Lecture notes in computer science · doi:10.1007/3-540-44589-7_2 · Cited by 54 · see citing works
Leonard, V. K., Jacko, J. A., & Pizzimenti, J. J. (2005) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/1090785.1090791 · Cited by 34 · see citing works
Morley, S. (1998) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/274497.274527 · Cited by 28 · see citing works
EMA-Tactons: Vibrotactile External Memory Aids in an Auditory Display
Kildal, J., & Brewster, S. A. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-74800-7_6 · Cited by 7 · see citing works
Self-citationSection, D. R., & Division, C. R. (2002) · Cited by 1 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Usable gestures for blind people: understanding preference and performance
Kane, S. K., Wobbrock, J. O., & Ladner, R. E. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979001 · Cited by 314 · see citing works
Elderly User Evaluation of Mobile Touchscreen Interactions
Kobayashi, M., Hiyama, A., Miura, T., Asakawa, C., Hirose, M., & Ifukube, T. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-23774-4_9 · Cited by 227 · see citing works
“There have been some accessibility-related evaluations of mobile touchscreens for visually-impaired or motor-impaired users [18][19].”
Anthony, L., Kim, Y., & Findlater, L. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2466158 · Cited by 201 · see citing works
“, [19,25]), a smaller number—discussed here—have examined accessibility for people with physical disabilities.”
BackgroundInteractivity improves usability of geographic maps for visually impaired people
Brock, A. M., Truillet, P., Oriola, B., Picard, D., & Jouffrais, C. (2015) · Human–Computer Interaction · doi:10.1080/07370024.2014.924412 · Cited by 195 · see citing works
“For instance, when comparing the use of a touch screen-based system with audio output and with or without raised-line overlay by visually impaired people, users made fewer errors and were quicker when using the interface with the overlay (McGookin et al., 2008).”
BackgroundKhan, A., & Khusro, S. (2021) · Universal Access in the Information Society · doi:10.1007/s10209-020-00733-8 · Cited by 177 · see citing works
“One of the significant disadvantages of touchbased interfaces is the missing tactical clues [55].”
BackgroundInfluentialSemFeel: a user interface with semantic tactile feedback for mobile touch-screen devices
Yatani, K., & Truong, K. N. (2009) · Proceedings of the 22nd annual ACM symposium on User interface software and technology · doi:10.1145/1622176.1622198 · Cited by 164 · see citing works
“studied accessibility issues on mobile touch-screen devices [14].”
BackgroundNo-Look Notes: Accessible Eyes-Free Multi-touch Text Entry
Bonner, M. N., Brudvik, J. T., Abowd, G. D., & Edwards, W. K. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-12654-3_24 · Cited by 154 · see citing works
“Unfortunately, as discussed by McGookin et al. [1], the creation of accessible modifications and enhancements for touch-based devices is lagging behind the breakneck pace of mainstream development.”
BackgroundCurrent and future mobile and wearable device use by people with visual impairments
Ye, H., Malu, M., Oh, U., & Findlater, L. (2014) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2557085 · Cited by 148 · see citing works
“Researchers have also tackled touchscreen mobile accessibility, both through software solutions that provide interaction with the screen and audio output [3,4,6,8,13,22], and through hardware solutions such as tactile overlays [18] and haptic output [12,17].”
BackgroundAccessible Visualization: Design Space, Opportunities, and Challenges
Kim, N. W., Joyner, S. C., Riegelhuth, A., & Kim, Y. (2021) · Computer Graphics Forum · doi:10.1111/cgf.14298 · Cited by 137 · see citing works
Interacting with mobile devices via VoiceOver: usability and accessibility issues
Leporini, B., Buzzi, M. C., & Buzzi, M. (2012) · Proceedings of the 24th Australian Computer-Human Interaction Conference · doi:10.1145/2414536.2414591 · Cited by 116 · see citing works
Touchplates: low-cost tactile overlays for visually impaired touch screen users
Kane, S. K., Morris, M. R., & Wobbrock, J. O. (2013) · Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/2513383.2513442 · Cited by 107 · see citing works
“[20] created a prototype mobile music player which used a fixed touch screen overlay to create the sensation of physical buttons.”
BackgroundYatani (2012) · doi:10.1145/2207676.2207734 · Cited by 123 · see citing works
“Our motivation for choosing a mobile touch-screen device is that it allows for taps and flick gestures—interactions that are easy for visually impaired users to perform [14, 19].”
BackgroundPoppinga (2011) · doi:10.1145/2037373.2037458 · Cited by 102 · see citing works
“McGookin et al. [3] investigated using raised paper as touch screen overlays to enable non-visual interaction.”
MethodUnderstanding palm-based imaginary interfaces
Gustafson, S. G., Rabe, B., & Baudisch, P. (2013) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2466114 · Cited by 94 · see citing works
“To address this, McGookin et al. [27] investigated tactile overlays and gesture-based interfaces to increase the usability of touchscreen phones.”
Jayant, C., Acuario, C., Johnson, W., Hollier, J., & Ladner, R. E. (2010) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/1878803.1878878 · Cited by 89 · see citing works
“Touch-screens on mobile devices are now accessible and usable by blind people [4, 6 ]. In 1971, the Optacon (OPtical to TActile CONverter) was invented, which enabled blind people to read text printed by raising the outlines of print letters [12].”
BackgroundA heuristic checklist for an accessible smartphone interface design
Mi, N., Cavuoto, L. A., Benson, K., Smith‐Jackson, T. L., & Nussbaum, M. A. (2013) · Universal Access in the Information Society · doi:10.1007/s10209-013-0321-4 · Cited by 87 · see citing works
Accessible Touchscreen Technology for People with Visual Impairments: A Survey
Grussenmeyer, W., & Folmer, E. (2017) · ACM Transactions on Accessible Computing · doi:10.1145/3022701 · Cited by 86 · see citing works
“There have been several research projects tackling general nonvisual gestural input [Kane et al. 2008; Vanderheiden 1996; Ahmed et al. 2010; McGookin et al. 2008].”
BackgroundLucentMaps: 3D Printed Audiovisual Tactile Maps for Blind and Visually Impaired People
Götzelmann, T. (2016) · Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/2982142.2982163 · Cited by 86 · see citing works
“McGookin et al. [21] presented a combination of opaque, raised paper overlays for non-visual interaction with dedicated applications using touch screens.”
BackgroundMobile device accessibility for the visually impaired: problems mapping and recommendations
Damaceno, R. J. P., Braga, J. C., & Mena-Chalco, J. P. (2018) · Universal Access in the Information Society · doi:10.1007/s10209-017-0540-1 · Cited by 73 · see citing works
“On the other hand, PVI are hindered in locating and using a greater quantity of physical buttons of smaller sizes that allow for less physical space between the keys [16, 22, 24, 34].”
BackgroundVisually Augmented Audio-Tactile Graphics for Visually Impaired People
Götzelmann, T. (2018) · ACM Transactions on Accessible Computing · doi:10.1145/3186894 · Cited by 65 · see citing works
“McGookin et al. [35] presented a study on the combination of opaque, raised paper overlays for non-visual interaction with dedicated applications using touch screens of mobile devices.”
BackgroundKhan, A., & Khusro, S. (2019) · Multimedia Tools and Applications · doi:10.1007/s11042-018-7094-y · Cited by 63 · see citing works
“However, one of the main issue in the touch-driven interface is the lack of tactical controls and physical buttons [39].”
BackgroundUser learning and performance with bezel menus
Jain, M., & Balakrishnan, R. (2012) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208376 · Cited by 58 · see citing works
“Due to small screen size, the fat-finger problem, high visual demand, and lack of tactile feedback from physical keys, accessing virtual keypads is difficult [24].”
BackgroundOpen Challenges of Blind People Using Smartphones
Rodrigues, A., Nicolau, H., Montague, K., Guerreiro, J., & Guerreiro, T. (2020) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2020.1768672 · Cited by 53 · see citing works
Analyzing visually impaired people’s touch gestures on smartphones
Buzzi, M. C., Buzzi, M., Leporini, B., & Trujillo, A. (2017) · Multimedia Tools and Applications · doi:10.1007/s11042-016-3594-9 · Cited by 53 · see citing works
“For instance, researchers are not always able to recruit visually impaired participants, particularly blind people, so they conduct their studies with blindfolded participants [28, 47] or by covering the device display [34].”
BackgroundImproving Gesture Recognition Accuracy on Touch Screens for Users with Low Vision
Vatavu, R.-D. (2017) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025941 · Cited by 51 · see citing works
“Because smart devices expose touch screens not adapted to non-visual input, touch and gesture interaction pose many challenges to people with visual impairments [11,12,20,30], which can only be addressed with a thorough understanding of their gesture articulation performance.”
BackgroundToward haptic/aural touchscreen display of graphical mathematics for the education of blind students
Toennies, J. L., Burgner-Kahrs, J., Withrow, T. J., & Webster, R. J., III (2011) · IEEE World Haptics Conference (WHC) · doi:10.1109/whc.2011.5945515 · Cited by 47 · see citing works
“Though current touchscreen technology is largely inaccesible for people with visual impairments [14], a touchscreen that provides tactile feedback has the potential to address this issue and enhance the accessibility of the information being conveyed to the user as well as the user’s ability to…”
BackgroundMaking touch-based kiosks accessible to blind users through simple gestures
Sandnes, F. E., Tan, T. B., Johansen, A., Sulic, E., Vesterhus, E., & Iversen, E. R. (2011) · Universal Access in the Information Society · doi:10.1007/s10209-011-0258-4 · Cited by 44 · see citing works
“Next, McGookin, Brewster and Jiang showed that MP3players can be controlled using gestures without visual cues [17], but that there can be problems with short impactrelated operations.”
BackgroundArslantaş, T. K., Yıldırım, S., & ALTUNAY, B. (2019) · Interactive Learning Environments · doi:10.1080/10494820.2019.1619587 · Cited by 42 · see citing works
“In another study, McGookin, Brewster, and Jiang (2008) found that auditory feedback was helpful in improving dragging performance of VI students with severe impairments.”
BackgroundEyes-free text entry on a touchscreen phone
Tinwala, H., & MacKenzie, I. S. (2009) · IEEE Toronto International Conference Science and Technology for Humanity · doi:10.1109/tic-sth.2009.5444381 · Cited by 42 · see citing works
“Furthermore, the inability to use these devices in an eyes-free manner affects people with visual impairments [10].”
BackgroundPielot, M., Kazakova, A., Hesselmann, T., Heuten, W., & Boll, S. (2012) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/2371574.2371624 · Cited by 40 · see citing works
“With respect to the executing of menu items our results support the guideline established by McGookin et al. [8] to avoid double clicks in non-visual touch screen interaction.”
BackgroundResultAli, A. X., Morris, M. R., & Wobbrock, J. O. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300485 · Cited by 40 · see citing works
“Other researchers capitalized on the method’s inclusivity of end-users’ abilities to design interactions for blind populations [5,11,16,25].”
MethodInteractive audio-tactile maps for visually impaired people
Brock, A., & Jouffrais, C. (2015) · ACM SIGACCESS Accessibility and Computing · doi:10.1145/2850440.2850441 · Cited by 49 · see citing works
“uding supplementary information—such as opening hours, entry prices, distances, etc.—in the map prototype. One possibility to make touch screens accessible without sight is using gestural interaction [17,21]. However, gestural interaction had never been combined with a raised-line map overlay. We implemented basic ges…”
MethodDesign of and subjective response to on-body input for people with visual impairments
Oh, U., & Findlater, L. (2014) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/2661334.2661376 · Cited by 38 · see citing works
“Solutions to improve touchscreen accessibility for people with visual impairments have included both hardware or physical overlays to provide enhanced tactile cues [16,20,31], and software solutions that incorporate touchscreen gestures [2,4,5,9].”
BackgroundVatavu, R.-D. (2017) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2017.1279827 · Cited by 38 · see citing works
“For instance, McGookin et al. (2008) implemented a touchscreen overlay for mobile devices in the form of a raised paper control panel with tactile buttons, which was demonstrated to control an MP3 player application.”
BackgroundMethodInfluentialMaking Visual Maps Accessible to the Blind
Buzzi, M. C., Buzzi, M., Leporini, B., & Martusciello, L. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-21663-3_29 · Cited by 33 · see citing works
“[22] carried out a study that illustrates accessibility problems on touchscreen use for visually impaired users, comparing two different methods for confronting this problem: to overlay a raised paper control panel that incorporated tactile buttons on the screen and to use a touchscreen gesture-based player.”
MethodEducational Content Creation and Sharing by Low-Income Visually Impaired People in India
Vashistha, A., Brady, E. L., Thies, W., & Cutrell, E. B. (2014) · ACM Symposium on Computing for Development (ACM DEV) · doi:10.1145/2674377.2674385 · Cited by 33 · see citing works
“In the developed world, visually impaired people access textual information through Braille books [39], audio recordings [29], or screenreaders on their phones or computers [26, 30].”
BackgroundTouch-screens are not tangible
Elglaly, Y. N., Quek, F. K. H., Smith‐Jackson, T. L., & Dhillon, G. S. (2013) · International Conference on Tangible, Embedded, and Embodied Interaction (TEI) · doi:10.1145/2460625.2460665 · Cited by 32 · see citing works
Zhang, X., Tran, T., Sun, Y., Culhane, I., Jain, S., Fogarty, J., & Mankoff, J. (2018) · ASSETS '18 · doi:10.1145/3234695.3236349 · Cited by 30 · see citing works
“However, carrying multiple devices can be difficult to manage [17] and costly [22] (e.”
BackgroundInfluentialImage Accessibility for Screen Reader Users: A Systematic Review and a Road Map
Oh, U., Joh, H., & Lee, Y. (2021) · Electronics · doi:10.3390/electronics10080953 · Cited by 29 · see citing works
Brock, A. (2013) · ACM SIGACCESS Accessibility and Computing · doi:10.1145/2444800.2444802 · Cited by 28 · see citing works
The impact of ICT services on perceptions of the quality of life of older people
Damant, J., Knapp, M. R. J., Watters, S., Freddolino, P. P., Ellis, M., & King, D. (2013) · Journal of Assistive Technologies · doi:10.1108/17549451311313183 · Cited by 28 · see citing works
Lang, F., & Machulla, T. (2021) · Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology · doi:10.1145/3489849.3489873 · Cited by 26 · see citing works
“troublesome, as the users cannot determine the distance between finger and touchscreen or the location of the target element within it [20].”
BackgroundToward accessibility with usability
Siebra, C., Gouveia, T. B., Macêdo, J., da Silva, F. Q. B., Santos, A. L. M., Correia, W. F. M., Penha, M., Anjos, M., & Florentin, F. (2017) · International Conference on Ubiquitous Information Management and Communication (IMCOM) · doi:10.1145/3022227.3022233 · Cited by 26 · see citing works
“In touch screen devices, this initial command is represented for some kind of action on an interface element, which is positioned at a specific place of the screen [14].”
BackgroundHe, L., Wan, Z., Findlater, L., & Froehlich, J. E. (2017) · Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3132525.3134818 · Cited by 26 · see citing works
“One solution is to employ physical overlays that are placed on top of the screen, providing tactile information and constraining input to only specific locations [1,4,6,7].”
BackgroundZhou, L., Saptono, A., Setiawan, I. M. A., & Parmanto, B. (2020) · JMIR mhealth and uhealth · doi:10.2196/15060 · Cited by 25 · see citing works
“…the accessibility of their apps, for instance, creating different user interfaces for people with different types of disabilities such as visual [32,33], hearing, physical, and cognitive impairment [34]; designing user interfaces and information and communication technology systems for older…”
TADA: Making Node-link Diagrams Accessible to Blind and Low-Vision People
Zhao, Y., Nacenta, M. A., Sukhai, M. A., & Somanath, S. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642222 · Cited by 25 · see citing works
“A continuous 150Hz pure tone (neither horn nor string) indicates the proximity to a diagram element.”
BackgroundDetermining the Accessibility of Mobile Screen Readers for Blind Users
Kuber, R., Hastings, A., Tretter, M., & Fitzpatrick, D. (2012) · Imaging and Signal Processing in Health Care and Technology / 772: Human-Computer Interaction / 773: Communication, Internet and Information Technology · doi:10.2316/p.2012.772-003 · Cited by 25 · see citing works
A Performance Comparison of On-Hand versus On-Phone Nonvisual Input by Blind and Sighted Users
Oh, U., & Findlater, L. (2015) · ACM Transactions on Accessible Computing · doi:10.1145/2820616 · Cited by 23 · see citing works
“…enhancing tactile feedback through external hardware devices [Vanderheiden 1996; Landau and Wells 2003], physical overlays [Kane et al. 2011, 2013], or the use of location-insensitive gestures [Bonner et al. 2010; Frey et al. 2011; Guerreiro et al. 2008; Kane et al. 2008; McGookin et al. 2008].”
BackgroundAccessible Gesture Typing for Non-Visual Text Entry on Smartphones
Billah, S. M., Ko, Y.-J., Ashok, V., Bi, X., & Ramakrishnan, IV (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300606 · Cited by 21 · see citing works
“Problems with touch-screen accessibility and recommendations for addressing them appear in McGookin et al. [15].”
BackgroundHuang, P.-H., & Chiu, M.-C. (2016) · Applied Ergonomics · doi:10.1016/j.apergo.2015.06.008 · Cited by 26 · see citing works
Oh, U., Stearns, L., Pradhan, A., Froehlich, J. E., & Findlater, L. (2017) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3132525.3132536 · Cited by 19 · see citing works
“Yet, touchscreen smartphones are not innately accessible due to a heavy reliance on visual cues and the minimal tactile feedback of the smooth touchscreen [18,23].”
BackgroundNon-visual navigation of spreadsheets
Doush, I. A., & Pontelli, E. (2012) · Universal Access in the Information Society · doi:10.1007/s10209-012-0272-1 · Cited by 19 · see citing works
“, [18, 33]) provide guidelines for designing accessible applications for the visually impaired on touch screen devices.”
BackgroundExploring Visually Impaired People's Gesture Preferences for Smartphones
Buzzi, M. C., Buzzi, M., Leporini, B., & Trujillo, A. (2015) · ACM SIGCHI Italian Chapter International Conference on Computer-Human Interaction · doi:10.1145/2808435.2808448 · Cited by 19 · see citing works
“Moreover, sometimes researchers do not have access to visually impaired participants, so they perform their studies with blindfolded participants [11; 21] or by blocking the device display [14].”
BackgroundHaptic reference cues to support the exploration of touchscreen mobile devices by blind users
Buzzi, M. C., Buzzi, M., Donini, F., Leporini, B., & Paratore, M. T. (2013) · Biannual Conference of the Italian SIGCHI Chapter (CHItaly) · doi:10.1145/2499149.2499156 · Cited by 17 · see citing works
“Through a user test with twelve blindfolded and one visually-impaired subject, authors compared a raised paper overlay touchscreen-based MP3 player with a touchscreen gesture-based one, detecting problems with both the use of buttons and gestures; thus authors have proposed general design guidelines for enhancing acce…”
MethodObservation based analysis on the use of mobile applications for visually impaired users
Siebra, C., Gouveia, T. B., Macêdo, J., Correia, W. F. M., Penha, M., Anjos, M., Florentin, F., da Silva, F. Q. B., & Santos, A. L. M. (2016) · International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI Adjunct) · doi:10.1145/2957265.2961848 · Cited by 17 · see citing works
“In touch screen devices, this initial command is represented for some kind of action on an interface element, which is positioned at a specific place of the screen [12].”
BackgroundMobile Device Accessibility for the Visually Impaired
Damaceno, R. J. P., Braga, J. C., & Mena‐Chalco, J. P. (2016) · Brazilian Symposium on Human Factors in Computing Systems (IHC) · doi:10.1145/3033701.3033703 · Cited by 17 · see citing works
“Com relação à segunda etapa do presente trabalho, uma série de estudos tem abordado a realização de gestos de toque por PDV. McGookin et al. [28] analisaram a interação de pessoas (com os olhos vendados) com tocadores de música.”
BackgroundAhmetovic, D. (2013) · IEEE International Conference on Mobile Data Management (MDM) · doi:10.1109/mdm.2013.58 · Cited by 17 · see citing works
“As suggested in the previous section, the evolution of the human-computer interaction on mobile devices from a tactile approach (keyboards) towards a purely graphical one has led to accessibility issues for visually impaired users (McGookin et al. [9]).”
BackgroundGrussenmeyer, W., & Folmer, E. (2016) · International Web for All Conference (W4A) · doi:10.1145/2899475.2899483 · Cited by 16 · see citing works
Development and Usability Evaluation of an Configurable Educational Game for the Visually Impaired
Corrêa, A. G. D., Biase, L. C. C. D., Lotto, E. P., & Lopes, R. D. D. (2018) · IEEE Games, Entertainment, Media Conference (GEM) · doi:10.1109/gem.2018.8516472 · Cited by 16 · see citing works
“Note that many devices with touchscreen interfaces also have vibration, which expands the senses through tactile feedback [15].”
BackgroundMethodInfluentialAutomated Person Detection in Dynamic Scenes to Assist People with Vision Impairments
Stearns, L., & Thieme, A. (2018) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3234695.3241017 · Cited by 15 · see citing works
“This method can be useful in early usabilityfocused (rather than empathy/ability-focused) system testing [17, 20], but we acknowledge that the head movements of a blindfolded user can be quite different from those of a blind person.”
MethodAccessible educational digital book on tablets for people with visual impairment
Costa, L. C. P., Corrêa, A. G. D., Dalmon, D. L., Zuffo, M. K., & Lopes, R. D. D. (2015) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2015.7298085 · Cited by 15 · see citing works
“The traditional accessibility features integrated in mobile platforms are [28]:”
BackgroundGesture based interaction for visually-impaired people
Vidal, S., & Lefebvre, G. (2010) · Nordic Conference on Human-Computer Interaction · doi:10.1145/1868914.1869035 · Cited by 15 · see citing works
“investigate more specificity touchscreen devices in [5] and propose ways of overcoming touchscreen accessibility issues by comparing a raised paper overlay touchscreen based MP3 player, with a touchscreen gesture based player.”
BackgroundUsability requirements for mobile accessibility
Siebra, C., Gouveia, T. B., Macêdo, J., Correia, W. F. M., Penha, M., da Silva, F. Q. B., Santos, A. L. M., Anjos, M., & Florentin, F. (2015) · International Conference on Mobile and Ubiquitous Multimedia (MUM) · doi:10.1145/2836041.2841213 · Cited by 14 · see citing works
“In touch screen devices, this initial command is represented for some kind of action on some interface element that is positioned in a specific place at the screen [14].”
BackgroundStories, journeys and smart maps: an approach to universal access
Wang, X., Crookes, D., Harding, S.-A. J., & Johnston, D. (2021) · Universal Access in the Information Society · doi:10.1007/s10209-021-00832-0 · Cited by 14 · see citing works
“Researchers have pointed out that avoiding short impact-related gestures (e.g. tap) is a significant factor in deciding the feasibility of the map [33].”
BackgroundAccessible way finding on mobile devices for different user groups
Krainz, E., Lind, V., Moser, W., & Dornhofer, M. (2016) · International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI Adjunct) · doi:10.1145/2957265.2961847 · Cited by 13 · see citing works
“Touchscreen and gestures for visual impairments [15][18], user centered interaction design for blinds [12] and aspects for elder people [10] are some of these facets.”
BackgroundTechnology use and non-use by low-income blind people in India
Vashistha, A., & Anderson, R. (2016) · ACM SIGACCESS Accessibility and Computing · doi:10.1145/3023851.3023853 · Cited by 11 · see citing works
“Prior works in the accessibility domain have examined technology use by blind people in developed countries, and designed new interfaces, devices and mediums for them [1,2,6,7,14,16,18,26,30,32].”
BackgroundLuthra, V., & Ghosh, S. K. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-20681-3_3 · Cited by 11 · see citing works
“McGookin et al. [3] investigated the accessibility of touch screens for visually impaired people in which they revealed problems on the use of buttons as well as gestures.”
BackgroundIncorporating information from trusted sources to enhance urban navigation for blind travelers
Min, B., Saxena, S., Steinfeld, A. M., & Dias, M. B. (2015) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2015.7139824 · Cited by 11 · see citing works
Design and evaluation of mobile applications for people with visual impairments
Silva, G. M. S., Andrade, R. M. C., & Darin, T. (2019) · Brazilian Symposium on Human Factors in Computing Systems (IHC) · doi:10.1145/3357155.3358450 · Cited by 11 · see citing works
“O apanhado na literatura trouxe à tona diretrizes e heurísticas baseadas em tecnologias de dispositivos móveis antigas que ainda se atrelam a modalidades de interação desatualizadas - predessoras ao touchscreen - como foi observado no trabalho de McGookin [33] “Disponha uma tecla home tátil e discernível”.”
BackgroundUsability evaluation of acoustic interfaces for the blind
Ferati, M., Mannheimer, S., & Bolchini, D. P. (2011) · ACM International Conference on Design of Communication (SIGDOC) · doi:10.1145/2038476.2038479 · Cited by 11 · see citing works
Patel, S., Liu, Y., Zhao, R., Liu, X., & Li, Y. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-04987-3_18 · Cited by 10 · see citing works
Using hand gestures to control mobile spoken dialogue systems
Tsourakis, N. (2013) · Universal Access in the Information Society · doi:10.1007/s10209-013-0317-0 · Cited by 10 · see citing works
“Although previous work provides some guidelines regarding gesturebased interfaces [14, 24], little attention has been paid to the question of how to control spoken dialogue systems (SDS) with gestures, while most efforts were directed to parallel combine these two distinct input modalities in order to control multimod…”
Investigating Feedback for Two-Handed Exploration of Digital Maps Without Vision
Bardot, S., Serrano, M., Perrault, S. T., Zhao, S., & Jouffrais, C. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-29381-9_19 · Cited by 9 · see citing works
Making Gestural Interaction Accessible to Visually Impaired People
Brock, A., Truillet, P., Oriola, B., & Jouffrais, C. (2014) · Lecture notes in computer science · doi:10.1007/978-3-662-44196-1_6 · Cited by 10 · see citing works
“Furthermore, short impact related gestures, such as single taps, should be avoided because they are likely to occur accidentally [12, 15].”
BackgroundConcept Mapping for Virtual Rehabilitation and Training of the Blind
Sánchez, J., & Flores, H. (2009) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2009.2032186 · Cited by 10 · see citing works
“Several haptic interfaces have been studied for use by blind users [12], [14], [15], concluding that complementing haptic interfaces with virtual environments can be very encouraging and motivating, as well as can become critical elements for improving cognitive rehabilitation and learning processes [2].”
BackgroundPerceptions of Mobile Device Authentication Mechanisms by Individuals who are Blind
Wolf, F., Kuber, R., & Aviv, A. J. (2017) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3132525.3134793 · Cited by 10 · see citing works
“Tactile aids have shown promise helping visually impaired users explore mobile and touchscreen interfaces [5].”
Can blindfolded users replace blind ones in product testing? an empirical study
Qiu, S., Hu, J., Han, T., & Matthias Rauterberg, A. (2023) · Behaviour and Information Technology · doi:10.1080/0144929x.2023.2226768 · Cited by 9 · see citing works
“Accessibility of Braille and touch screen (Mihara et al. 2005; McGookin, Brewster, and Weiwei 2008); .”
BackgroundUsability of User-Centric Mobile Application Design from Visually Impaired People’s Perspective
Qureshi, H. H., & Wong, D. H.-T. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-49282-3_22 · Cited by 9 · see citing works
Touching the Data: Exploring Data Sonification on Mobile Touchscreen Devices
Nikitenko, D., & Gillis, D. J. (2014) · Procedia Computer Science · doi:10.1016/j.procs.2014.07.038 · Cited by 9 · see citing works
ICTs and Music in Sensory and Motor Disabilities
Theodorou, P., & Drigas, A. S. (2017) · International Journal of Recent Contributions from Engineering Science & IT (iJES) · doi:10.3991/ijes.v5i2.6386 · Cited by 8 · see citing works
Evaluation of touchscreen assistive technology for visually disabled users
Smaradottir, B. F., Martínez, S., & Håland, J. (2017) · IEEE Symposium on Computers and Communications (ISCC) · doi:10.1109/iscc.2017.8024537 · Cited by 8 · see citing works
“The results presented are in line with other studies on assistive technologies and visually disabled users [21][22][23].”
BackgroundResultPromoting Self-Efficacy Through an Effective Human-Powered Nonvisual Smartphone Task Assistant
Rodrigues, A., Santos, A. J. D., Montague, K., & Guerreiro, T. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3449188 · Cited by 7 · see citing works
“Prior work in smartphone accessibility for blind people has targeted issues discreetly, often isolating the task from the context it is performed in, focusing on performance metrics, such as the works in text-entry[4, 19, 21, 29], and gesture input [13, 23, 28, 30].”
BackgroundCrossan, A., Williamson, J. H., & Brewster, S. A. (2010) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/1753846.1754106 · Cited by 7 · see citing works
“Notable exceptions include work by McGookin et al. [ 5 ].”
BackgroundSelf-citationWhy visually impaired people resist to adopt touchscreen smartphones in the Czech Republic?
Balata, J., & Míkovec, Z. (2016) · IEEE International Conference on Cognitive Infocommunications · doi:10.1109/coginfocom.2016.7804523 · Cited by 6 · see citing works
Avila, M., Kiss, F., Rodríguez, I., Schmidt, A., & Machulla, T. (2018) · International Conference on PErvasive Technologies Related to Assistive Environments (PETRA) · doi:10.1145/3197768.3201530 · Cited by 7 · see citing works
“…to guide readers’ fingertips from one line to the next on an e-book reader [2], paper overlays with cutouts to indicate the location of interactive elements of a digital MP3 player [11], or acrylic overlays with cutouts to position one’s fingers on a digital keyboard on an interactive tabletop [9].”
BackgroundSpeech and touch enhanced interface for visually impaired users
Oppenheim, M. (2013) · Journal of Assistive Technologies · doi:10.1108/jat-11-2012-0038 · Cited by 6 · see citing works
“However, for a visually impaired user, locating a control on a smooth screen is intrinsically more difficult than locating a tactile control (McGookin et al., 2008).”
BackgroundThe Online Apparel Shopping Experience of Blind Consumers
Williams, J., & Rothenberg, L. (2022) · Breaking Boundaries · doi:10.31274/itaa.13672 · Cited by 5 · see citing works
“…recommendations for alternative information for visual cues, navigation, and search functions (Buzzi et al., 2009; Francis et al., 2013; Kim, 2018; McGookin et al., 2008; Sohaib et al., 2011) but the findings in this study reveal that those same areas remain a challenge for today’s visually…”
BackgroundHo, Y. L., Lau, S. H., & Azman, A. (2022) · Universal Access in the Information Society · doi:10.1007/s10209-022-00928-1 · Cited by 6 · see citing works
“Face-to-face interview [2, 9, 52, 53] and experimental observation [2, 9, 42, 54] methods were used because the related literature on authentication systems for the blind and visually impaired on smartphones use these two methods.”
A Model to Develop Videogames for Orientation and Mobility
Sánchez, J., Guerrero, L. A., Sáenz, M., & Flores, H. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-14100-3_44 · Cited by 6 · see citing works
“These interfaces can be of different sorts: Audio [14], haptic [8] and multimodal [4].”
BackgroundBlindGuide: An audio based eyes-free caller guide for people with visual impairment
Chakraborty, T. S., & Samanta, D. (2012) · Intelligent Human Computer Interaction · doi:10.1109/ihci.2012.6481788 · Cited by 6 · see citing works
“As the difference in tactile sense is missing in mobile devices with touch screen, so, it is very hard to trace the virtual object controls within the same surface of display unit [5].”
BackgroundInfluentialAuditory menus are not just spoken visual menus
Jeon, M., Gupta, S., Davison, B. K., & Walker, B. N. (2010) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/1753846.1753978 · Cited by 7 · see citing works
Validation of Toolkits for developing third-generation Android accessible mobile applications
Gemou, M., Colomer, J. B. M., Cabrera-Umpiérrez, M. F., Ríos, S. D. L., Arredondo, M. T., & Bekiaris, E. D. (2014) · Universal Access in the Information Society · doi:10.1007/s10209-014-0377-9 · Cited by 6 · see citing works
Usability of Mobile Consumer Applications for Individuals Aging with Multiple Sclerosis
Ruzic, L., & Sanford, J. A. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-58706-6_21 · Cited by 6 · see citing works
Kan, C.-W. R., & Wang, C.-Y. (2020) · Disability and Rehabilitation Assistive Technology · doi:10.1080/17483107.2019.1683238 · Cited by 6 · see citing works
“There was a high level of agreement amongst surveyors that visually impaired people are less secure while using the internet than people without visual impairments [9] (median score 4.”
BackgroundArslantaş, T. K., Yıldırım, S., & ALTUNAY, B. (2022) · Assistive Technology · doi:10.1080/10400435.2022.2039325 · Cited by 7 · see citing works
“This also supports the arguments of McGookin et al. (2008) and Stein et al. (2011) who underlined the importance of auditory feedback in their respective studies.”
ResultExploring an effective interaction mode for blind mobile users in India
Chakraborty, T. S., & Samanta, D. (2013) · Asia-Pacific Computer and Human Interaction · doi:10.1145/2525194.2525306 · Cited by 6 · see citing works
“provided a solution to make the touch-screen accessible to the blind people by providing tactile sense through raised paper control fixed over the objects on the screen [29].”
BackgroundInfluentialMatraf, M. S. B., Hashim, N. L., Hussain, A., Habbal, A., Hamouda, H. N., & Ghazali, O. (2025) · Journal of King Saud University - Computer and Information Sciences · doi:10.1007/s44443-025-00180-6 · Cited by 5 · see citing works
“Specific questions were taken from McGookin et al. (2008) and Nathan (2017), with the addition of several other questions to address concerns associated with print and electronic books.”
SaSYS: A Swipe Gesture-Based System for Exploring Urban Environments for the Visually Impaired
Kim, J.-E., Bessho, M., Koshizuka, N., & Sakamura, K. (2013) · Mobile Computing, Applications, and Services · doi:10.1007/978-3-319-05452-0_5 · Cited by 6 · see citing works
“We initially assigned gestures to each TTS control in accordance with design guidelines for accessible touchscreens [10, 11].”
MethodMatraf, M. S. B., Hashim, N. L., & Hussain, A. (2023) · Journal of Information and Communication Technology · doi:10.32890/jict2023.22.3.5 · Cited by 5 · see citing works
Sakamoto, S. G., da Silva, L. F., & de Miranda, L. C. (2012) · doi:10.5555/2393536.2393540 · Cited by 6 · see citing works
- Authors
- McGookin, D., Brewster, S., & Jiang, W.
- Affiliations
- University of Glasgow (GB)
- Venue
- Proceedings of the 5th Nordic conference on Human-computer interaction: building bridges
- Publisher
- ACM
- Published
- 2008-10-20
- Pages
- 298-307
- OpenAlex
- W2133382749
- Cited by
- 151
- References
- 14
- Citations by year
- 2026: 2 · 2025: 1 · 2024: 1 · 2023: 5 · 2022: 4 · 2021: 5 · 2020: 6 · 2019: 13 · 2018: 9 · 2017: 16 · 2016: 12 · 2015: 12 · 2014: 15 · 2013: 21 · 2012: 9
- FWCI
- 10.94
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Nordic Conference on Human-Computer Interaction (publishedVersion)
- ENLIGHTEN (Jurnal Bimbingan dan Konseling Islam) (submittedVersion)
- Funders
- Engineering and Physical Sciences Research Council (GR/S86150/01)
- Sixth Framework Programme (IST-35183)
- Seventh Framework Programme (ICT-224675)
- Topics
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
- Keywords
- visual impairment, assistive technology, touchscreen gestures, blindfolded participants, MP3 players, requirements capture
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
