Smartphone Usage by Expert Blind Users
The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Abstract
People with vision impairments access smartphones with the help of screen reader apps such as TalkBack for Android and VoiceOver for iPhone. Prior research has mostly focused on understanding touchscreen phone adoption and typing performance of novice blind users by logging their real-world smartphone usage. Understanding smartphone usage pattern and practices of expert users can help in developing tools and tutorials for transitioning novice and intermediate users to expert users. In this work, we logged smartphone usage data of eight expert Android smartphone users with visual impairments for four weeks, and then interviewed them. This paper presents a detailed analysis that uncovered novel usage patterns, such as extensive usage of directional gestures, reliance on voice and external keyboard for text input, and repurposed explore by touch for single-tap. We conclude with design recommendations to inform the future of mobile accessibility, including hardware guidelines and rethinking accessible software design.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Falaki, H., Mahajan, R., Kandula, S., Lymberopoulos, D., Govindan, R., & Estrin, D. (2010) · Proceedings of the 8th international conference on Mobile systems, applications, and services · doi:10.1145/1814433.1814453 · Cited by 838
Kane, S. K., Jayant, C., Wobbrock, J. O., & Ladner, R. E. (2009) · Proceedings of the 11th international ACM SIGACCESS conference on Computers and accessibility · doi:10.1145/1639642.1639663 · Cited by 383
Kane, S. K., Bigham, J. P., & Wobbrock, J. O. (2008) · Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/1414471.1414487 · Cited by 374 · cited 1×
“The seminal work which arguably influenced the design of Apple’s iPhone screen reader, VoiceOver, was the Slide Rule work by Kane et al. [26].”
BackgroundUsable gestures for blind people: understanding preference and performance
Kane, S. K., Wobbrock, J. O., & Ladner, R. E. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979001 · Cited by 314 · cited 5×
“First, it is challenging for PVIs to learn how to perform touch-screen gestures [28, 45].”
BackgroundInfluentialMeasuring smartphone usage and task switching with log tracking and self-reports
Deng, T., Kanthawala, S., Meng, J., Peng, W., Kononova, A., Hao, Q., Zhang, Q., & David, P. (2019) · Mobile Media & Communication · doi:10.1177/2050157918761491 · Cited by 201 · cited 2×
“Logged data has been found to be more reliable than self-reporting as users tend to overestimate their phone (app) usage [16].”
BackgroundSmartphone usage in the wild: a large-scale analysis of applications and context
Do, T. M. T., Blom, J., & Gatica-Perez, D. (2011) · Proceedings of the 13th international conference on multimodal interfaces · doi:10.1145/2070481.2070550 · Cited by 198
Evaluating existing audio CAPTCHAs and an interface optimized for non-visual use
Bigham, J. P., & Cavender, A. C. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518983 · Cited by 187
"I am borrowing ya mixing ?" An Analysis of English-Hindi Code Mixing in Facebook
Bali, K., Sharma, J., Choudhury, M., & Vyas, Y. (2014) · Proceedings of the First Workshop on Computational Approaches to Code Switching · doi:10.3115/v1/w14-3914 · Cited by 180
Shinohara, K., & Wobbrock, J. O. (2016) · ACM Transactions on Accessible Computing · doi:10.1145/2827857 · Cited by 180
WebInSight: making web images accessible
Bigham, J. P., Kaminsky, R. S., Ladner, R. E., Danielsson, O. M., & Hempton, G. L. (2006) · Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility · doi:10.1145/1168987.1169018 · Cited by 161
Sato, D., Oh, U., Naito, K., Takagi, H., Kitani, K., & Asakawa, C. (2017) · Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3132525.3132535 · Cited by 158
Exploring the use of speech input by blind people on mobile devices
Azenkot, S., & Lee, N. B. (2013) · Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/2513383.2513440 · Cited by 151 · cited 6×
“Recent works in mobile accessibility have mostly focused on gestures [28, 40], text entry [3, 32, 39, 51], privacy and security [2, 4, 24], and app-specific accessibility for images [9, 63] and buttons [47].”
BackgroundMethodResultInfluentialDigiTouch: Reconfigurable Thumb-to-Finger Input and Text Entry on Head-mounted Displays
Whitmire, E., Jain, M., Jain, D., Nelson, G. L., Karkar, R., Patel, S., & Goel, M. (2017) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3130978 · Cited by 146
Self-citationA Survey on the Use of Mobile Applications for People who Are Visually Impaired
Griffin-Shirley, N., Banda, D. R., Ajuwon, P. M., Cheon, J., Lee, J., Park, H. R., & Lyngdoh, S. N. (2017) · Journal of Visual Impairment & Blindness · doi:10.1177/0145482x1711100402 · Cited by 134
Morris, M. R., Zolyomi, A., Yao, C., Bahram, S., Bigham, J. P., & Kane, S. K. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858116 · Cited by 131
Privacy Concerns and Behaviors of People with Visual Impairments
Ahmed, T., Hoyle, R., Connelly, K., Crandall, D., & Kapadia, A. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702334 · Cited by 127
An evaluation of BrailleTouch: mobile touchscreen text entry for the visually impaired
Southern, C., Clawson, J., Frey, B., Abowd, G., & Romero, M. (2012) · Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services · doi:10.1145/2371574.2371623 · Cited by 125
Blind people and mobile touch-based text-entry: acknowledging the need for different flavors
Oliveira, J., Guerreiro, T., Nicolau, H., Jorge, J., & Gonçalves, D. (2011) · The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility · doi:10.1145/2049536.2049569 · Cited by 123
Interacting with mobile devices via VoiceOver: usability and accessibility issues
Leporini, B., Buzzi, M. C., & Buzzi, M. (2012) · Proceedings of the 24th Australian Computer-Human Interaction Conference · doi:10.1145/2414536.2414591 · Cited by 116
PassChords: secure multi-touch authentication for blind people
Azenkot, S., Rector, K., Ladner, R., & Wobbrock, J. (2012) · Proceedings of the 14th international ACM SIGACCESS conference on Computers and accessibility · doi:10.1145/2384916.2384945 · Cited by 116 · cited 3×
“Third, prior work has highlighted privacy and security needs and struggles of PVIs [2, 33] in various contexts, including authentication [4, 29] and CAPTCHAs to differentiate humans from automated agents [8].”
BackgroundMethodCaption Crawler: Enabling Reusable Alternative Text Descriptions using Reverse Image Search
Guinness, D., Cutrell, E., & Morris, M. R. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174092 · Cited by 108
Accessible smartphones for blind users: A case study for a wayfinding system
Rodriguez‐Sanchez, M. C., Moreno-Alvarez, M. A., Martín, E., Borromeo, S., & Hernandez-Tamames, J. A. (2014) · Expert Systems with Applications · doi:10.1016/j.eswa.2014.05.031 · Cited by 104
Getting Smartphones to Talkback: Understanding the Smartphone Adoption Process of Blind Users
Rodrigues, A., Montague, K., Nicolau, H., & Guerreiro, T. (2015) · Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility - ASSETS '15 · doi:10.1145/2700648.2809842 · Cited by 102
A large scale study of text-messaging use
Battestini, A., Setlur, V., & Sohn, T. (2010) · Proceedings of the 12th international conference on Human computer interaction with mobile devices and services · doi:10.1145/1851600.1851638 · Cited by 90
Examining Image-Based Button Labeling for Accessibility in Android Apps through Large-Scale Analysis
Ross, A. S., Zhang, X., Fogarty, J., & Wobbrock, J. O. (2018) · Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3234695.3236364 · Cited by 90 · cited 4×
“Analysis of Android apps found various accessibility barriers, such as missing button labels in apps [47], and missing alternative text in images on (social media) apps [38].”
BackgroundInfluentialAccessible Touchscreen Technology for People with Visual Impairments: A Survey
Grussenmeyer, W., & Folmer, E. (2017) · ACM Transactions on Accessible Computing · doi:10.1145/3022701 · Cited by 86
Mobile device accessibility for the visually impaired: problems mapping and recommendations
Damaceno, R. J. P., Braga, J. C., & Mena-Chalco, J. P. (2018) · Universal Access in the Information Society · doi:10.1007/s10209-017-0540-1 · Cited by 73 · cited 1×
“Combining results from the above-mentioned prior work and more, several papers [15, 20, 58] provide a systematic literature review of smartphone accessibility problems faced by PVIs, propose recommendations to improve mobile accessibility, and identify new research directions.”
ResultJustSpeak: enabling universal voice control on Android
Zhong, Y., Raman, T. V., Burkhardt, C., Biadsy, F., & Bigham, J. P. (2014) · Proceedings of the 11th Web for All Conference · doi:10.1145/2596695.2596720 · Cited by 70
ProactiveTasks: the short of mobile device use sessions
Banovic, N., Brant, C., Mankoff, J., & Dey, A. (2014) · Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services · doi:10.1145/2628363.2628380 · Cited by 69
Oh, U., Kane, S. K., & Findlater, L. (2013) · ASSETS '13 · doi:10.1145/2513383.2513455 · Cited by 68 · cited 4×
“Approaches like corrective verbal feedback and gesture sonification has been proposed to teach touchscreen gestures [40].”
BackgroundInfluentialAgency in Assistive Technology Adoption: Visual Impairment and Smartphone Use in Bangalore
Pal, J., Viswanathan, A., Chandra, P., Nazareth, A., Kameswaran, V., Subramonyam, H., Johri, A., Ackerman, M. S., & O'Modhrain, S. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025895 · Cited by 68
RegionSpeak: Quick Comprehensive Spatial Descriptions of Complex Images for Blind Users
Zhong, Y., Lasecki, W. S., Brady, E., & Bigham, J. P. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702437 · Cited by 67
Understanding the Challenges of Mobile Phone Usage Data
Church, K., Ferreira, D., Banovic, N., & Lyons, K. (2015) · Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services · doi:10.1145/2785830.2785891 · Cited by 64
User learning and performance with bezel menus
Jain, M., & Balakrishnan, R. (2012) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208376 · Cited by 60
Self-citationUse of Audio-Haptic Interface Techniques to Allow Nonvisual Access to Touchscreen Appliances
Vanderheiden, G. C. (1996) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193129604002430 · Cited by 54
Analyzing visually impaired people’s touch gestures on smartphones
Buzzi, M. C., Buzzi, M., Leporini, B., & Trujillo, A. (2017) · Multimedia Tools and Applications · doi:10.1007/s11042-016-3594-9 · Cited by 53 · cited 2×
“Most works with PVIs [3, 11, 28, 34, 36] has been conducted in lab-settings and/or use survey or interview data.”
BackgroundTablet and Smartphone Accessibility Features in the Low Vision Rehabilitation
Irvine, D., Zemke, A., Pusateri, G., Gerlach, L., Chun, R., & Jay, W. M. (2014) · Neuro-Ophthalmology · doi:10.3109/01658107.2013.874448 · Cited by 51
Reyes-Cruz, G., Fischer, J. E., & Reeves, S. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376767 · Cited by 48
Ubiquitous Accessibility for People with Visual Impairments: Are We There Yet?
Billah, S. M., Ashok, V., Porter, D. E., & Ramakrishnan, I. V. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025731 · Cited by 43
Eyes-free text entry on a touchscreen phone
Tinwala, H., & MacKenzie, I. S. (2009) · 2009 IEEE Toronto International Conference Science and Technology for Humanity (TIC-STH) · doi:10.1109/tic-sth.2009.5444381 · Cited by 42
Typing Performance of Blind Users
Nicolau, H., Montague, K., Guerreiro, T., Rodrigues, A., & Hanson, V. L. (2015) · Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility - ASSETS '15 · doi:10.1145/2700648.2809861 · Cited by 37
BrailleSketch: A Gesture-based Text Input Method for People with Visual Impairments
Li, M.-Z., Fan, M., & Truong, K. (2017) · International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3132525.3132528 · Cited by 36
Toward tactile authentication for blind users
Kuber, R., & Sharma, S. (2010) · Proceedings of the 12th international ACM SIGACCESS conference on Computers and accessibility · doi:10.1145/1878803.1878875 · Cited by 34
Kacorri, H., Mascetti, S., Gerino, A., Ahmetovic, D., Alampi, V., Takagi, H., & Asakawa, C. (2018) · ACM Transactions on Accessible Computing · doi:10.1145/3178853 · Cited by 31
Antona, M., & Stephanidis, C. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-20681-3 · Cited by 29
India Connected: How the Smartphone Is Transforming the World’s Largest Democracy
Tenhunen, S. (2019) · South Asia Journal of South Asian Studies · doi:10.1080/00856401.2019.1683677 · Cited by 28
In-context Q&A to Support Blind People Using Smartphones
Rodrigues, A., Montague, K., Nicolau, H., Guerreiro, J., & Guerreiro, T. (2017) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3132525.3132555 · Cited by 22
Moving Beyond Market Research: Demystifying Smartphone User Behavior in India
Mathur, A., Kalanadhabhatta, L. M., Majethia, R., & Kawsar, F. (2017) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3130947 · Cited by 21
Xu, J. B., Billah, S. M., Shilkrot, R., & Balasubramanian, A. (2019) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3308561.3353806 · Cited by 20
Damaceno, R. J. P., Braga, J. C., & Mena‐Chalco, J. P. (2016) · Brazilian Symposium on Human Factors in Computing Systems (IHC) · doi:10.1145/3033701.3033703 · Cited by 19
Automatic Generation and Evaluation of Usable and Secure Audio reCAPTCHA
Jain, M., Tripathi, R., Bhansali, I., & Kumar, P. (2019) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3308561.3353777 · Cited by 15
Self-citationLuthra, V., & Ghosh, S. K. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-20681-3_3 · Cited by 11
TinyBlackBox: Supporting Mobile In-The-Wild Studies
Montague, K., Rodrigues, A., Nicolau, H., & Guerreiro, T. (2015) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/2700648.2811379 · Cited by 10
Coping with Accessibility Challenges for Security - A User Study with Blind Smartphone Users
Lobo, S., Hirom, U., Shyama, V. S., Basumatori, M., & Doke, P. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-68059-0_1 · Cited by 8
Vatavu, R.-D., & Vanderdonckt, J. M. (2020) · Designing Interactive Systems Conference · doi:10.1145/3393914.3395896 · Cited by 8
Research works printed but not linked: 5
- HT Correspondent. 2017. Number of blind to come down by 4M as India set to change blindness definition. Retrieved Dec 1, 2019 from https://bit.ly/3aXHKB7
- Steven Landua and Lesley Wells. 414-418. The Merging of Tactile Sensory Input and Audio Data by Means of The Talking Tactile Tablet. Proceedings of the EuroHaptics(414-418), 1–3. http://www.touchgraphics.com/publications/eurohaptics-paper.pdf
- 10.1080/10400435.2013.76871924620705[pmid] · doi:10.1080/10400435.2013.76871924620705[pmid]
- Andrew Sears, Min Lin, Julie Jacko, and Yan Xiao. 2003. When Computers Fade … Pervasive Computing and Situationally-Induced Impairments and Disabilities. (01 2003).
- Statista. 2017. Market share of mobile operating systems in India from 2012 to 2019. Retrieved Dec 1, 2019 from https://www.statista.com/statistics/262157/market-share-held-by-mobile-operating-systems-in-india/
Cited by
(2024) · doi:10.1145/3613904.3642939 · Cited by 31
“Theportability of mobile devices has led to an increasing number of visually impaired people using smartphones for daily life [57, 64, 111, 114].”
BackgroundSophistication with Limitation: Understanding Smartphone Usage by Emergent Users in India
Gupta, M., Mehta, D., Punj, A., & Thies, I. M. (2022) · ACM SIGCAS/SIGCHI Conference on Computing and Sustainable Societies (COMPASS) · doi:10.1145/3530190.3534824 · Cited by 36
“Researchers have also logged participant’s real time use of their smartphone to understand usage patterns [30, 42].”
BackgroundIndia, G., Jain, M., Karya, P., Diwakar, N., & Swaminathan, M. (2021) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3441852.3471206 · Cited by 28
Self-citationBarbareschi, G., & Inakage, M. (2022) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3517428.3544799 · Cited by 27
“enhance the unique competencies, interaction modalities and creative possibilities that emerge as a result of disability and assistive technology use [13, 14, 42, 67, 79].”
BackgroundModeling Touch-based Menu Selection Performance of Blind Users via Reinforcement Learning
Li, Z., Ko, Y.-J., Putkonen, A., Feiz, S., Ashok, V., Ramakrishnan, IV, Oulasvirta, A., & Bi, X. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580640 · Cited by 18
“, selecting items on a menu) is one of the most basic and common tasks that blind users perform on smartphones [30, 40].”
Background
Metadata
- Authors
- Jain, M., Diwakar, N., & Swaminathan, M.
- Affiliations
- Microsoft Research (India) (IN)
- Venue
- Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2021-05-06
- Pages
- 1-15
- OpenAlex
- W3161099169
- Cited by
- 41
- References
- 55
- Citations by year
- 2026: 4 · 2025: 8 · 2024: 14 · 2023: 7 · 2022: 6 · 2021: 2
- FWCI
- 9.52
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- Topics
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Keywords
- blind users, visual impairment, smartphone usage patterns, screen readers, TalkBack, expert users, speech input, mobile accessibility
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.