CoChat

An Epidemiology-inspired Large-scale Analysis of Android App Accessibility

Ross, Anne Spencer, Zhang, Xiaoyi, Fogarty, James, Wobbrock, Jacob O. · 2020 · ACM Transactions on Accessible Computing
Cited by 54

The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.

Abstract

Accessibility barriers in mobile applications (apps) can make it challenging for people who have impairments or use assistive technology to use those apps. Ross et al.’s epidemiology-inspired framework emphasizes that a wide variety of factors may influence an app's accessibility and presents large-scale analysis as a powerful tool for understanding the prevalence of accessibility barriers (i.e., inaccessibility diseases ). Drawing on this framework, we performed a large-scale analysis of free Android apps, exploring the frequency of accessibility barriers and factors that may have contributed to barrier prevalence. We tested a population of 9,999 apps for seven accessibility barriers: few TalkBack-focusable elements, missing labels, duplicate labels, uninformative labels, editable TextViews with contentDescription , fully overlapping clickable elements, and undersized elements. We began by measuring the prevalence of each accessibility barrier across all relevant element classes and apps. Missing labels and undersized elements were the most prevalent barriers. As a measure of the spread of barriers across apps, we assessed the five most reused classes of elements for missing labels and undersized elements. The Image Button class was among the most barrier-prone of the high reuse element classes; 53% of Image Button elements were missing labels and 40% were undersized. We also investigated factors that may have contributed to the high barrier prevalence in certain classes of elements, selecting examples based on prior knowledge, our analyses, and metrics of reuse and barrier-proneness. These case studies explore: (1) how the few TalkBack-focusable elements accessibility barrier relates to app category (e.g., Education, Entertainment) and the tools used to implement an app, (2) the prevalence of label-based barriers in image-based buttons, (3) design patterns that affect the labeling and size of Radio Buttons and Checkboxes, and (4) accessibility implications of the sizing of third-party plug-in elements. Our work characterizes the current state of Android accessibility, suggests improvements to the app ecosystem, and demonstrates analysis techniques that can be applied in further app accessibility assessments.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3348797

Cites

6 of 6 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 6 references

Research works printed but not linked: 20

  1. Adobe. Adobe AIR. Retrieved on 17 April , 2019 from https://get.adobe.com/air. Adobe. Adobe AIR. Retrieved on 17 April, 2019 from https://get.adobe.com/air.
  2. 10.1145/2901739.2903508 · DOI · Paper page
  3. Apache Cordova . Retrieved on 3 April , 2019 from https://cordova.apache.org/. Apache Cordova. Retrieved on 3 April, 2019 from https://cordova.apache.org/.
  4. 10.1145/3033701.3033718 · DOI
  5. 10.1145/2596695.2596717 · DOI
  6. Cocos2d-x - World's #1 Open-Source Game Development Platform . Retrieved on 30 April , 2019 from https://cocos2d-x.org. Cocos2d-x - World's #1 Open-Source Game Development Platform. Retrieved on 30 April, 2019 from https://cocos2d-x.org.
  7. “ Data Driven Design Group .” Rico: A Mobile App Dataset of Building Data-Driven Design Applications. Retrieved on 17 April , 2019 from http://interactionmining.org/rico. “Data Driven Design Group.” Rico: A Mobile App Dataset of Building Data-Driven Design Applications. Retrieved on 17 April, 2019 from http://interactionmining.org/rico.
  8. 10.1145/2984511.2984581 · DOI · Paper page
  9. 10.1145/1899475.1899502 · DOI
  10. 10.1145/2435215.2435217 · DOI
  11. Shuai Hao , Bin Liu , Suman Nath , William G. J. Halfond , and Ramesh Govindan . 2014 . PUMA: Programmable UI-Automation for Large-Scale Dynamic Analysis of Mobile Apps *. DOI:http://doi.org/10.1145/2594368.2594390 10.1145/2594368.2594390 Shuai Hao, Bin Liu, Suman Nath, William G. J. Halfond, and Ramesh Govindan. 2014. PUMA: Programmable UI-Automation for Large-Scale Dynamic Analysis of Mobile Apps *. DOI:http://doi.org/10.1145/2594368.2594390 · DOI · Paper page
  12. Lauren R. Milne , Cynthia L. Bennett , and Richard E. Ladner . 2014. The accessibility of mobile health sensors for blind users . In Proceedings of the International Technology and Persons with Disabilities Conference (CSUN’14) . 166--175. DOI:http://doi.org/10211.3/133384 Lauren R. Milne, Cynthia L. Bennett, and Richard E. Ladner. 2014. The accessibility of mobile health sensors for blind users. In Proceedings of the International Technology and Persons with Disabilities Conference (CSUN’14). 166--175. DOI:http://doi.org/10211.3/133384
  13. 10.1109/MS.2013.142 · DOI · Paper page
  14. Kyudong Park , Taedong Goh , Hyo-Jeong So , Hyo-Jeong Association for Computing Machinery., HCI Society of Korea, and Hanbit Media (Firm). 2014 . Toward accessible mobile application design: Developing mobile application accessibility guidelines for people with visual impairment . In Proceedings of the International Conference on Human-Computer Interaction (HCI Korea’14) . 478. Retrieved from https://dl.acm.org/citation.cfm?id=2729491. Kyudong Park, Taedong Goh, Hyo-Jeong So, Hyo-Jeong Association for Computing Machinery., HCI Society of Korea, and Hanbit Media (Firm). 2014. Toward accessible mobile application design: Developing mobile application accessibility guidelines for people with visual impairment. In Proceedings of the International Conference on Human-Computer Interaction (HCI Korea’14). 478. Retrieved from https://dl.acm.org/citation.cfm?id=2729491.
  15. John T. Richards , Kyle Montague , and Vicki L. Hanson . 2012. Web accessibility as a side effect . In Proceedings of the International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS’12) . 79. DOI:http://doi.org/10.1145/2384916.2384931 10.1145/2384916.2384931 John T. Richards, Kyle Montague, and Vicki L. Hanson. 2012. Web accessibility as a side effect. In Proceedings of the International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS’12). 79. DOI:http://doi.org/10.1145/2384916.2384931 · DOI · Paper page
  16. Anne Spencer Ross , Xiaoyi Zhang , James Fogarty , and Jacob O. Wobbrock . 2017. Epidemiology as a framework for large-scale mobile application accessibility assessment . In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS’17) . 2--11. DOI:http://doi.org/10.1145/3132525.3132547 10.1145/3132525.3132547 Anne Spencer Ross, Xiaoyi Zhang, James Fogarty, and Jacob O. Wobbrock. 2017. Epidemiology as a framework for large-scale mobile application accessibility assessment. In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS’17). 2--11. DOI:http://doi.org/10.1145/3132525.3132547 · DOI
  17. 10.1016/j.procs.2015.09.279 · DOI
  18. 10.1145/2836041.2841213 · DOI
  19. The Crosswalk Project . Retrieved on 30 April , 2019 from crosswalk-project.org/. The Crosswalk Project. Retrieved on 30 April, 2019 from crosswalk-project.org/.
  20. Unity. Retrieved on 30 April , 2019 from https://unity.com/. Unity. Retrieved on 30 April, 2019 from https://unity.com/.

Cited by

See all 54

Metadata

Authors
Ross, A. S., Zhang, X., Fogarty, J., & Wobbrock, J. O.
Venue
ACM Transactions on Accessible Computing
Published
2020-03-31
Volume
13
Issue
1
Pages
1-36
ISSN
  • 1936-7228 (ISSN-L)
  • 1936-7236
OpenAlex
W3021907903
Cited by
54
References
6
FWCI
13.53
Type
journal article
Language
en
Open access
closed
Funders
National Science Foundation (IIS-1702751)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: An Epidemiology-inspired Large-scale Analysis of Android App Accessibility. https://app.cochat.ai/papers/10.1145/3348797
The paper
Ross, A. S., Zhang, X., Fogarty, J., & Wobbrock, J. O. (2020). An Epidemiology-inspired Large-scale Analysis of Android App Accessibility. ACM Transactions on Accessible Computing. https://doi.org/10.1145/3348797

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.