A Large-Scale Longitudinal Analysis of Missing Label Accessibility Failures in Android Apps
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
We present the first large-scale longitudinal analysis of missing label accessibility failures in Android apps. We developed a crawler and collected monthly snapshots of 312 apps over 16 months. We use this unique dataset in empirical examinations of accessibility not possible in prior datasets. Key large-scale findings include missing label failures in 55.6% of unique image-based elements, longitudinal improvement in ImageButton elements but not in more prevalent ImageView elements, that 8.8% of unique screens are unreachable without navigating at least one missing label failure, that app failure rate does not improve with number of downloads, and that effective labeling is neither limited to nor guaranteed by large software organizations. We then examine longitudinal data in individual apps, presenting illustrative examples of accessibility impacts of systematic improvements, incomplete improvements, interface redesigns, and accessibility regressions. We discuss these findings and potential opportunities for tools and practices to improve label-based accessibility.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Rico: A Mobile App Dataset for Building Data-Driven Design Applications
Deka, B., Huang, Z., Franzen, C., Hibschman, J., Afergan, D., Li, Y., Nichols, J., & Kumar, R. (2017) · Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3126594.3126651 · Cited by 482
Chen, C., Su, T., Meng, G., Xing, Z., & Liu, Y. (2018) · Proceedings of the 40th International Conference on Software Engineering · doi:10.1145/3180155.3180240 · Cited by 188
The Current Status of Accessibility in Mobile Apps
Yan, S., & Ramachandran, P. G. (2019) · ACM Transactions on Accessible Computing · doi:10.1145/3300176 · Cited by 165 · cited 10×
“For example, prior large-scale analyses of app accessibility have measured the prevalence of specifc accessibility failures and identifed patterns that suggest contributors to those failures (e.g., inconsistent documentation and tooling across difer-ent classes of image-based elements) [39, 40, 50].”
BackgroundInfluentialExamining Image-Based Button Labeling for Accessibility in Android Apps through Large-Scale Analysis
Ross, A. S., Zhang, X., Fogarty, J., & Wobbrock, J. O. (2018) · Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3234695.3236364 · Cited by 90 · cited 10×
“We therefore also analyzed per-app missing label failure rates (i.e., as defned in Section 4.4.2) in image-based elements, fnding a strong bimodal distribution consistent with prior large-scale analyses [39, 40].”
BackgroundMethodResultInfluentialSelf-citationInteraction Proxies for Runtime Repair and Enhancement of Mobile Application Accessibility
Zhang, X., Ross, A. S., Caspi, A., Fogarty, J., & Wobbrock, J. O. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025846 · Cited by 59 · cited 1×
“Closer to our focus on missing label accessibility failures, research has demonstrated runtime repair of missing labels using interaction proxies [53] together with third-party annotation [54].”
BackgroundSelf-citationZhong, Y., Weber, A., Burkhardt, C., Weaver, P., & Bigham, J. P. (2015) · Proceedings of the 12th International Web for All Conference · doi:10.1145/2745555.2747277 · Cited by 42 · cited 1×
“…includes techniques for assistive macros [35], for accessibility services based on system-level content and events [36], for pointing enhancement [55], for per-sonalizable accessibility overlays [37], and for creating accessible screenshots by embedding accessibility data directly in images [32].”
Background(2019) · doi:10.1145/3308561.3353808 · Cited by 14
Cited by
AXNav: Replaying Accessibility Tests from Natural Language
Taeb, M., Swearngin, A., Schoop, E., Cheng, R., Jiang, Y., & Nichols, J. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642777 · Cited by 52
“Many mobile apps still have incomplete support for accessibility features [4, 23, 43, 56, 57].”
BackgroundAkter, T., Cha, Y., Figueira, I., Branham, S. M., & Piper, A. M. (2023) · The 25th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3597638.3608420 · Cited by 24
Integrating Accessibility in a Mobile App Development Course
Bhatia, J. S., P D, P., Tiwari, S., Nagpal, D., & Joshi, S. (2023) · Proceedings of the 54th ACM Technical Symposium on Computer Science Education V. 1 · doi:10.1145/3545945.3569825 · Cited by 21
“Despite an increasing awareness in the software industry about accessibility over the past few years, many mainstream software products fall short of meeting accessibility criteria [2, 4, 9, 15, 26].”
BackgroundXie, I., Choi, W., Wang, S., Lee, H. S., Hong, B. H., Wang, N.-C., & Cudjoe, E. K. (2024) · Journal of Imaging · doi:10.3390/jimaging10080205 · Cited by 8
“Fok et al. [32] pointed out that there are frequent instances of missing labels for non-text interface design elements and a lack of improvement over time in their longitudinal analysis of applications.”
Background
Metadata
- Authors
- Fok, R., Zhong, M., Ross, A. S., Fogarty, J., & Wobbrock, J. O.
- Venue
- CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2022-04-29
- Pages
- 1-16
- OpenAlex
- W4224986572
- Cited by
- 25
- References
- 7
- FWCI
- 7.72
- Type
- conference paper
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Large-Scale Longitudinal Analysis of Missing Label Accessibility Failures in Android Apps. https://app.cochat.ai/papers/10.1145/3491102.3502143
- The paper
- Fok, R., Zhong, M., Ross, A. S., Fogarty, J., & Wobbrock, J. O. (2022). A Large-Scale Longitudinal Analysis of Missing Label Accessibility Failures in Android Apps. CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3491102.3502143
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.