An Epidemiology-inspired Large-scale Analysis of Android App Accessibility
The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
Accessibility barriers in mobile applications (apps) can make it challenging for people who have impairments or use assistive technology to use those apps. Ross et al.’s epidemiology-inspired framework emphasizes that a wide variety of factors may influence an app's accessibility and presents large-scale analysis as a powerful tool for understanding the prevalence of accessibility barriers (i.e., inaccessibility diseases ). Drawing on this framework, we performed a large-scale analysis of free Android apps, exploring the frequency of accessibility barriers and factors that may have contributed to barrier prevalence. We tested a population of 9,999 apps for seven accessibility barriers: few TalkBack-focusable elements, missing labels, duplicate labels, uninformative labels, editable TextViews with contentDescription , fully overlapping clickable elements, and undersized elements. We began by measuring the prevalence of each accessibility barrier across all relevant element classes and apps. Missing labels and undersized elements were the most prevalent barriers. As a measure of the spread of barriers across apps, we assessed the five most reused classes of elements for missing labels and undersized elements. The Image Button class was among the most barrier-prone of the high reuse element classes; 53% of Image Button elements were missing labels and 40% were undersized. We also investigated factors that may have contributed to the high barrier prevalence in certain classes of elements, selecting examples based on prior knowledge, our analyses, and metrics of reuse and barrier-proneness. These case studies explore: (1) how the few TalkBack-focusable elements accessibility barrier relates to app category (e.g., Education, Entertainment) and the tools used to implement an app, (2) the prevalence of label-based barriers in image-based buttons, (3) design patterns that affect the labeling and size of Radio Buttons and Checkboxes, and (4) accessibility implications of the sizing of third-party plug-in elements. Our work characterizes the current state of Android accessibility, suggests improvements to the app ecosystem, and demonstrates analysis techniques that can be applied in further app accessibility assessments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Rico: A Mobile App Dataset for Building Data-Driven Design Applications
Deka, B., Huang, Z., Franzen, C., Hibschman, J., Afergan, D., Li, Y., Nichols, J., & Kumar, R. (2017) · Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3126594.3126651 · Cited by 482
The Current Status of Accessibility in Mobile Apps
Yan, S., & Ramachandran, P. G. (2019) · ACM Transactions on Accessible Computing · doi:10.1145/3300176 · Cited by 165 · cited 7×
“Sample sizes for these studies primarily ranged from 4 to 10 apps [14, 29, 35] with one study analyzing 479 apps [41].”
BackgroundResultInfluentialCaption Crawler: Enabling Reusable Alternative Text Descriptions using Reverse Image Search
Guinness, D., Cutrell, E., & Morris, M. R. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174092 · Cited by 108
A web accessibility report card for top international university web sites
Kane, S. K., Shulman, J. A., Shockley, T. J., & Ladner, R. E. (2007) · Proceedings of the 2007 international cross-disciplinary conference on Web accessibility (W4A) - W4A '07 · doi:10.1145/1243441.1243472 · Cited by 107 · cited 1×
“[28] performed manual and automated accessibility analyses of 100 university websites.”
MethodExamining Image-Based Button Labeling for Accessibility in Android Apps through Large-Scale Analysis
Ross, A. S., Zhang, X., Fogarty, J., & Wobbrock, J. O. (2018) · Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3234695.3236364 · Cited by 90 · cited 5×
“We present our prior work [34] that assessed three classes of image-based buttons for label-based accessibility barriers in 5,753 apps.”
BackgroundMethodInfluentialSelf-citationInteraction Proxies for Runtime Repair and Enhancement of Mobile Application Accessibility
Zhang, X., Ross, A. S., Caspi, A., Fogarty, J., & Wobbrock, J. O. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025846 · Cited by 59
Self-citation
Research works printed but not linked: 20
- Adobe. Adobe AIR. Retrieved on 17 April , 2019 from https://get.adobe.com/air. Adobe. Adobe AIR. Retrieved on 17 April, 2019 from https://get.adobe.com/air.
- 10.1145/2901739.2903508 · DOI · Paper page
- Apache Cordova . Retrieved on 3 April , 2019 from https://cordova.apache.org/. Apache Cordova. Retrieved on 3 April, 2019 from https://cordova.apache.org/.
- 10.1145/3033701.3033718 · DOI
- 10.1145/2596695.2596717 · DOI
- Cocos2d-x - World's #1 Open-Source Game Development Platform . Retrieved on 30 April , 2019 from https://cocos2d-x.org. Cocos2d-x - World's #1 Open-Source Game Development Platform. Retrieved on 30 April, 2019 from https://cocos2d-x.org.
- “ Data Driven Design Group .” Rico: A Mobile App Dataset of Building Data-Driven Design Applications. Retrieved on 17 April , 2019 from http://interactionmining.org/rico. “Data Driven Design Group.” Rico: A Mobile App Dataset of Building Data-Driven Design Applications. Retrieved on 17 April, 2019 from http://interactionmining.org/rico.
- 10.1145/2984511.2984581 · DOI · Paper page
- 10.1145/1899475.1899502 · DOI · Paper page
- 10.1145/2435215.2435217 · DOI · Paper page
- Shuai Hao , Bin Liu , Suman Nath , William G. J. Halfond , and Ramesh Govindan . 2014 . PUMA: Programmable UI-Automation for Large-Scale Dynamic Analysis of Mobile Apps *. DOI:http://doi.org/10.1145/2594368.2594390 10.1145/2594368.2594390 Shuai Hao, Bin Liu, Suman Nath, William G. J. Halfond, and Ramesh Govindan. 2014. PUMA: Programmable UI-Automation for Large-Scale Dynamic Analysis of Mobile Apps *. DOI:http://doi.org/10.1145/2594368.2594390 · DOI · Paper page
- Lauren R. Milne , Cynthia L. Bennett , and Richard E. Ladner . 2014. The accessibility of mobile health sensors for blind users . In Proceedings of the International Technology and Persons with Disabilities Conference (CSUN’14) . 166--175. DOI:http://doi.org/10211.3/133384 Lauren R. Milne, Cynthia L. Bennett, and Richard E. Ladner. 2014. The accessibility of mobile health sensors for blind users. In Proceedings of the International Technology and Persons with Disabilities Conference (CSUN’14). 166--175. DOI:http://doi.org/10211.3/133384
- 10.1109/MS.2013.142 · DOI · Paper page
- Kyudong Park , Taedong Goh , Hyo-Jeong So , Hyo-Jeong Association for Computing Machinery., HCI Society of Korea, and Hanbit Media (Firm). 2014 . Toward accessible mobile application design: Developing mobile application accessibility guidelines for people with visual impairment . In Proceedings of the International Conference on Human-Computer Interaction (HCI Korea’14) . 478. Retrieved from https://dl.acm.org/citation.cfm?id=2729491. Kyudong Park, Taedong Goh, Hyo-Jeong So, Hyo-Jeong Association for Computing Machinery., HCI Society of Korea, and Hanbit Media (Firm). 2014. Toward accessible mobile application design: Developing mobile application accessibility guidelines for people with visual impairment. In Proceedings of the International Conference on Human-Computer Interaction (HCI Korea’14). 478. Retrieved from https://dl.acm.org/citation.cfm?id=2729491.
- John T. Richards , Kyle Montague , and Vicki L. Hanson . 2012. Web accessibility as a side effect . In Proceedings of the International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS’12) . 79. DOI:http://doi.org/10.1145/2384916.2384931 10.1145/2384916.2384931 John T. Richards, Kyle Montague, and Vicki L. Hanson. 2012. Web accessibility as a side effect. In Proceedings of the International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS’12). 79. DOI:http://doi.org/10.1145/2384916.2384931 · DOI · Paper page
- Anne Spencer Ross , Xiaoyi Zhang , James Fogarty , and Jacob O. Wobbrock . 2017. Epidemiology as a framework for large-scale mobile application accessibility assessment . In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS’17) . 2--11. DOI:http://doi.org/10.1145/3132525.3132547 10.1145/3132525.3132547 Anne Spencer Ross, Xiaoyi Zhang, James Fogarty, and Jacob O. Wobbrock. 2017. Epidemiology as a framework for large-scale mobile application accessibility assessment. In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS’17). 2--11. DOI:http://doi.org/10.1145/3132525.3132547 · DOI · Paper page
- 10.1016/j.procs.2015.09.279 · DOI · Paper page
- 10.1145/2836041.2841213 · DOI
- The Crosswalk Project . Retrieved on 30 April , 2019 from crosswalk-project.org/. The Crosswalk Project. Retrieved on 30 April, 2019 from crosswalk-project.org/.
- Unity. Retrieved on 30 April , 2019 from https://unity.com/. Unity. Retrieved on 30 April, 2019 from https://unity.com/.
Cited by
Working at the Intersection of Race, Disability and Accessibility
Harrington, C. N., Desai, A., Lewis, A., Moharana, S., Ross, A. S., & Mankoff, J. (2023) · The 25th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3597638.3608389 · Cited by 53
“, [132, 149]); but many apps, data sets, and algorithms may all encode ableist biases [104].”
BackgroundSelf-citationBeyond HCI: The Need for Accessibility Across the CS Curriculum
Elglaly, Y. N., Baker, C. M., Ross, A. S., & Shinohara, K. (2024) · Proceedings of the 55th ACM Technical Symposium on Computer Science Education V. 1 · doi:10.1145/3626252.3630788 · Cited by 39
“We emphasize that, to support accessible user interface design, underlying systems should be engineered to be accessible through low-level infrastructure to propagate accessibility via native controls and operations [48].”
BackgroundSelf-citationThe making of accessible Android applications: an empirical study on the state of the practice
Di Gregorio, M., Di Nucci, D., Palomba, F., & Vitiello, G. (2022) · Empirical Software Engineering · doi:10.1007/s10664-022-10182-x · Cited by 25
“Subsequently, again Ross et al. (2020) performed a large-scale analysis of free A NDROID apps, exploring the frequency of accessibility barriers and the factors that may have contributed to barrier prevalence.”
BackgroundIntegrating Accessibility in a Mobile App Development Course
Bhatia, J. S., P D, P., Tiwari, S., Nagpal, D., & Joshi, S. (2023) · Proceedings of the 54th ACM Technical Symposium on Computer Science Education V. 1 · doi:10.1145/3545945.3569825 · Cited by 21
Metadata
- Authors
- Ross, A. S., Zhang, X., Fogarty, J., & Wobbrock, J. O.
- Venue
- ACM Transactions on Accessible Computing
- Published
- 2020-03-31
- Volume
- 13
- Issue
- 1
- Pages
- 1-36
- ISSN
- 1936-7228 (ISSN-L)
- 1936-7236
- OpenAlex
- W3021907903
- Cited by
- 54
- References
- 6
- FWCI
- 13.53
- Type
- journal article
- Language
- en
- Open access
- closed
- Funders
- National Science Foundation (IIS-1702751)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.