CodeTalk: Improving Programming Environment Accessibility for Visually Impaired Developers
The DOI matches its Crossref record.
Abstract
In recent times, programming environments like Visual Studio are widely used to enhance programmer productivity. However, inadequate accessibility prevents Visually Impaired (VI) developers from taking full advantage of these environments. In this paper, we focus on the accessibility challenges faced by the VI developers in using Graphical User Interface (GUI) based programming environments. Based on a survey of VI developers and based on two of the authors' personal experiences, we categorize the accessibility difficulties into Discoverability, Glanceability, Navigability, and Alertability. We propose solutions to some of these challenges and implement these in CodeTalk, a plugin for Visual Studio. We show how CodeTalk improves developer experience and share promising early feedback from VI developers who used our plugin.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Yuksel, B. F., Fazli, P., Mathur, U., Bisht, V., Kim, S. J., Lee, J. J., Jin, S. J., Siu, Y.-T., Miele, J. A., & Yoon, I. (2020) · Proceedings of the 2020 ACM Designing Interactive Systems Conference · doi:10.1145/3357236.3395433 · Cited by 60
Understanding Accessibility and Collaboration in Programming for People with Visual Impairments
Pandey, M., Kameswaran, V., Rao, H. V., O'Modhrain, S., & Oney, S. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3449203 · Cited by 54
“Similarly, tools like SodBeans [75] and CodeTalk [64] suggest that audio-based tools can signifcantly reduce debugging time.”
BackgroundMethodInfluentialEducational Experiences of Blind Programmers
Baker, C. M., Bennett, C. L., & Ladner, R. E. (2019) · Proceedings of the 50th ACM Technical Symposium on Computer Science Education · doi:10.1145/3287324.3287410 · Cited by 41
CodeWalk: Facilitating Shared Awareness in Mixed-Ability Collaborative Software Development
Potluri, V., Pandey, M., Begel, A., Barnett, M., & Reitherman, S. (2022) · Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3517428.3544812 · Cited by 39
“BVI and sighted developers navigate code and interfaces differently [2, 55, 56]; they may want to read a part of the code that their sighted collaborator is talking about by character or by word, a kind of fine-grained navigation a non-screen reader user has no idea about.”
BackgroundMethodSelf-citationDas, M., Piper, A. M., & Gergle, D. (2022) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3480169 · Cited by 32
Huff, E. W., Boateng, K., Moster, M., Rodeghero, P., & Brinkley, J. (2021) · Proceedings of the 52nd ACM Technical Symposium on Computer Science Education · doi:10.1145/3408877.3432418 · Cited by 32
“Although tools such as StructJumper [6], AudioHighlight [4], and CodeTalk [23] help in improving code navigation in IDEs, such tools are limited to a few platforms (Eclipse, Visual Studio).”
MethodExamining The Work Experience of Programmers with Visual Impairments
Huff, E. W., Boateng, K., Moster, M., Rodeghero, P., & Brinkley, J. (2020) · 2020 IEEE International Conference on Software Maintenance and Evolution (ICSME) · doi:10.1109/icsme46990.2020.00077 · Cited by 21
Cha, Y., Figueira, I., Ayala, J., Edwards, E. J., Garcia, J., van der Hoek, A., & Branham, S. M. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642130 · Cited by 16
The Dilemma of Building Do-It-Yourself (DIY) Solutions For Workplace Accessibility
Cha, Y., Jackson, V., Kohl, K., Prikladnicki, R., van der Hoek, A., & Branham, S. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713302 · Cited by 14
“Researchers have proposed a variety of tools for accessible software development, including replacements for standard tools [31, 69], command line interface scripts [31], browser plugins [48], and integrated development environment plugins [11, 83].”
Enabling BLV Developers with LLM-driven Code Debugging
Saben, C., & Chandrasekar, P. (2024) · arXiv · doi:10.48550/arxiv.2401.16654 · Cited by 2
Metadata
- Authors
- Potluri, V., Vaithilingam, P., Iyengar, S., Vidya, Y., Swaminathan, M., & Srinivasa, G.
- Venue
- Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2018-04-21
- Pages
- 1-11
- OpenAlex
- W2795889338
- Cited by
- 91
- References
- 0
- FWCI
- 11.25
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.