Interaction Proxies for Runtime Repair and Enhancement of Mobile Application Accessibility
The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
Abstract
We introduce interaction proxies as a strategy for runtime repair and enhancement of the accessibility of mobile applications. Conceptually, interaction proxies are inserted between an application's original interface and the manifest interface that a person uses to perceive and manipulate the application. This strategy allows third-party developers and researchers to modify an interaction without an application's source code, without rooting the phone, without otherwise modifying an application, while retaining all capabilities of the system (e.g., Android's full implementation of the TalkBack screen reader). This paper introduces interaction proxies, defines a design space of interaction re-mappings, identifies necessary implementation abstractions, presents details of implementing those abstractions in Android, and demonstrates a set of Android implementations of interaction proxies from throughout our design space. We then present a set of interviews with blind and low-vision people interacting with our prototype interaction proxies, using these interviews to explore the seamlessness of interaction, the perceived usefulness and potential of interaction proxies, and visions of how such enhancements could gain broad usage. By allowing third-party developers and researchers to improve an interaction, interaction proxies offer a new approach to personalizing mobile application accessibility and a new approach to catalyzing development, deployment, and evaluation of mobile accessibility enhancements.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In this paper, we describe our implementation which, although it leveraged concepts from Interaction Proxies, was entirely novel.”
From Interactiles: 3D Printed Tactile Interfaces to Enhance Mobile Touchscreen Accessibility (2018) · cites this paper as [32]
Citations
Cites
del Carmen Malbrán, M. (2011) · Journal of Policy and Practice in Intellectual Disabilities · doi:10.1111/j.1741-1130.2011.00320.x · Cited by 1,674
Direct Manipulation Interfaces
Hutchins, E. L., Hollan, J. D., & Norman, D. A. (1985) · Human–Computer Interaction · doi:10.1207/s15327051hci0104_2 · Cited by 1,307
Past, present, and future of user interface software tools
Myers, B., Hudson, S. E., & Pausch, R. (2000) · ACM Transactions on Computer-Human Interaction · doi:10.1145/344949.344959 · Cited by 808 · cited 1×
“Although such personalization is promising for many accessibility needs, adoption of such methods is limited by a need for interfaces to be re-written as abstract specifications [45].”
BackgroundVizWiz: nearly real-time answers to visual questions
Bigham, J. P., Jayant, C., Ji, H., Little, G., Miller, A., Miller, R. C., Miller, R., Tatarowicz, A., White, B., White, S., et al. (2010) · Proceedings of the 23nd annual ACM symposium on User interface software and technology · doi:10.1145/1866029.1866080 · Cited by 601 · cited 1×
“VizWiz examines supporting blind people in using a mobile device to take a picture and ask a crowd a question about that picture [5,11].”
BackgroundAbility-Based Design: Concept, Principles and Examples
Wobbrock, J. O., Kane, S. K., Gajos, K. Z., Harada, S., & Froehlich, J. (2011) · ACM Transactions on Accessible Computing · doi:10.1145/1952383.1952384 · Cited by 567 · cited 5×
“Figure 10 shows an example of a personalized interface layout, motivated by SUPPLE’s approach to arranging entire interfaces to match an individual’s motor abilities [23,58].”
BackgroundMethodInfluentialSelf-citationVizWiz: nearly real-time answers to visual questions
Bigham, J. P., Jayant, C., Ji, H., Little, G., Miller, A., Miller, R. C., Tatarowicz, A., White, B., White, S., & Yeh, T. (2010) · Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A) · doi:10.1145/1805986.1806020 · Cited by 536
Kane, S. K., Jayant, C., Wobbrock, J. O., & Ladner, R. E. (2009) · Proceedings of the 11th international ACM SIGACCESS conference on Computers and accessibility · doi:10.1145/1639642.1639663 · Cited by 383 · cited 1×
“Prior research examines how people adapt to accessibility barriers in mobile devices and how devices can enhance access in the physical world [35].”
BackgroundSelf-citationMaking computers easier for older adults to use: area cursors and sticky icons
Worden, A., Walker, N., Bharat, K., & Hudson, S. (1997) · Proceedings of the ACM SIGCHI Conference on Human factors in computing systems · doi:10.1145/258549.258724 · Cited by 376 · cited 1×
“Examples include making targets “sticky” [29,59], dynamically modifying cursor behavior according to a person’s movement profile [57], and breaking a pointing interaction into multiple interactions that disambiguate the intended target [22,33,63].”
BackgroundKane, S. K., Bigham, J. P., & Wobbrock, J. O. (2008) · Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/1414471.1414487 · Cited by 374 · cited 3×
“, Slide Rule [34], Android’s TalkBack, iOS’s VoiceOver), which re-maps touch to support navigation separate from activation and may completely disable visual display of an app.”
BackgroundInfluentialSelf-citationEnsuring Digital Accessibility Through Process and Policy
Lazar, J., Goldstein, D., & Taylor, A. (2015) · Elsevier eBooks · doi:10.1016/c2013-0-13367-3 · Cited by 359 · cited 1×
“, Android’s TalkBack, iOS’s VoiceOver), and now improve accessibility of apps on those platforms [42].”
BackgroundSikuli: using GUI screenshots for search and automation
Yeh, T., Chang, T.-H., & Miller, R. C. (2009) · Proceedings of the 22nd annual ACM symposium on User interface software and technology · doi:10.1145/1622176.1622213 · Cited by 346 · cited 1×
“Runtime modification can be implemented using only pixel-level analysis [15,16,17,18,19,61] or in combination with information from an accessibility API [13].”
MethodAutomatically generating personalized user interfaces with Supple
Gajos, K. Z., Weld, D. S., & Wobbrock, J. O. (2010) · Artificial Intelligence · doi:10.1016/j.artint.2010.05.005 · Cited by 317 · cited 3×
“Figure 10 shows an example of a personalized interface layout, motivated by SUPPLE’s approach to arranging entire interfaces to match an individual’s motor abilities [23,58].”
BackgroundMethodSelf-citationAbout Face: The Essentials of User Interface Design
Cooper, A. (1995) · John Wiley & Sons, Inc. eBooks · Cited by 247
Visual challenges in the everyday lives of blind people
Brady, E., Morris, M. R., Zhong, Y., White, S., & Bigham, J. P. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2481291 · Cited by 230 · cited 1×
“VizWiz examines supporting blind people in using a mobile device to take a picture and ask a crowd a question about that picture [5,11].”
BackgroundReal-time captioning by groups of non-experts
Lasecki, W., Miller, C., Sadilek, A., Abumoussa, A., Borrello, D., Kushalnagar, R., & Bigham, J. (2012) · Proceedings of the 25th annual ACM symposium on User interface software and technology · doi:10.1145/2380116.2380122 · Cited by 197 · cited 1×
“Related insights have been applied to supporting deaf students through real-time captioning for classroom activities [40].”
BackgroundStencils-based tutorials: design and evaluation
Kelleher, C., & Pausch, R. (2005) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1054972.1055047 · Cited by 187
WinCuts: manipulating arbitrary window regions for more effective use of screen space
Tan, D. S., Meyers, B., & Czerwinski, M. (2004) · CHI '04 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/985921.986106 · Cited by 168
WebInSight: making web images accessible
Bigham, J. P., Kaminsky, R. S., Ladner, R. E., Danielsson, O. M., & Hempton, G. L. (2006) · Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility · doi:10.1145/1168987.1169018 · Cited by 161 · cited 6×
“We adopt the term “proxy” to be analogous to the web, where proxies can modify webpages between a server and their rendering in a browser (including web proxies with a purpose of improving web accessibility [6,8,53]).”
BackgroundMethodInfluentialLadner, R. E. (2015) · Interactions · doi:10.1145/2723869 · Cited by 160 · cited 1×
“Ensuring full access to the wealth of information and services provided by such apps is a matter of social justice [39], but for the estimated 15% of the world population with a disability [60], many capabilities and services offered by apps remain inaccessible.”
BackgroundInvestigating the appropriateness of social network question asking as a resource for blind users
Brady, E. L., Zhong, Y., Morris, M. R., & Bigham, J. P. (2013) · Proceedings of the 2013 conference on Computer supported cooperative work · doi:10.1145/2441776.2441915 · Cited by 147 · cited 1×
“Extensions examine conversational interaction with the crowd [41] and soliciting volunteer assistance in social networks [9,10].”
BackgroundUser interface façades: towards fully adaptable user interfaces
Stuerzlinger, W., Chapuis, O., Phillips, D., & Roussel, N. (2006) · Proceedings of the 19th annual ACM symposium on User interface software and technology · doi:10.1145/1166253.1166301 · Cited by 144 · cited 2×
“Complementary work explores input-output re-direction in the window manager [56], using information from the desktop accessibility API to make changes in an interface façade [52].”
MethodPrefab: implementing advanced behaviors using pixel-based reverse engineering of interface structure
Dixon, M., & Fogarty, J. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753554 · Cited by 137 · cited 2×
“Runtime modification can be implemented using only pixel-level analysis [15,16,17,18,19,61] or in combination with information from an accessibility API [13].”
BackgroundMethodSelf-citationAccess overlays: improving non-visual access to large touch screens for blind users
Kane, S. K., Morris, M. R., Perkins, A. Z., Wigdor, D., Ladner, R. E., & Wobbrock, J. O. (2011) · Proceedings of the 24th annual ACM symposium on User interface software and technology · doi:10.1145/2047196.2047232 · Cited by 127 · cited 1×
“Other research has explored alternative pointing for physically large devices [36].”
BackgroundSelf-citationThe angle mouse: target-agnostic dynamic gain adjustment based on angular deviation
Wobbrock, J. O., Fogarty, J., Liu, S.-Y. (., Kimuro, S., & Harada, S. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518912 · Cited by 123 · cited 1×
“Examples include making targets “sticky” [29,59], dynamically modifying cursor behavior according to a person’s movement profile [57], and breaking a pointing interaction into multiple interactions that disambiguate the intended target [22,33,63].”
BackgroundSelf-citationProgress on Website Accessibility?
Hanson, V. L., & Richards, J. T. (2013) · ACM Transactions on the Web · doi:10.1145/2435215.2435217 · Cited by 115
WebAnywhere: a screen reader on-the-go
Bigham, J. P., Prince, C. M., & Ladner, R. E. (2008) · Proceedings of the 2008 international cross-disciplinary conference on Web accessibility (W4A) · doi:10.1145/1368044.1368060 · Cited by 109
Social accessibility: achieving accessibility through collaborative metadata authoring
Takagi, H., Kawanaka, S., Kobayashi, M., Itoh, T., & Asakawa, C. (2008) · Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibility · doi:10.1145/1414471.1414507 · Cited by 106 · cited 3×
“Such research has examined collaborative authoring of missing image alternative text and other metadata [51,54,55], sharing of scripts to implement site-specific repairs [7], and more recent work focusing on crowdsourcing contributions [27].”
BackgroundEnhanced area cursors: reducing fine pointing demands for people with motor impairments
Findlater, L., Jansen, A., Shinohara, K., Dixon, M., Kamb, P., Rakita, J., & Wobbrock, J. O. (2010) · Proceedings of the 23nd annual ACM symposium on User interface software and technology · doi:10.1145/1866029.1866055 · Cited by 98 · cited 2×
“For example, prior work explores two-stage selection of small targets [22,33,63].”
BackgroundSelf-citationAccessmonkey: a collaborative scripting framework for web users and developers
Bigham, J. P., & Ladner, R. E. (2007) · Proceedings of the 2007 international cross-disciplinary conference on Web accessibility (W4A) - W4A '07 · doi:10.1145/1243441.1243452 · Cited by 90 · cited 1×
“Such research has examined collaborative authoring of missing image alternative text and other metadata [51,54,55], sharing of scripts to implement site-specific repairs [7], and more recent work focusing on crowdsourcing contributions [27].”
BackgroundA11y Attacks: Exploiting Accessibility in Operating Systems
Jang, Y., Song, C., Chung, S. P. H., Wang, T., & Lee, W. (2014) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/2660267.2660295 · Cited by 79 · cited 1×
“Nevertheless, protecting against malicious accessibility services is an important topic for additional security research [32].”
BackgroundAnswering visual questions with conversational crowd assistants
Lasecki, W. S., Thiha, P., Zhong, Y., Brady, E., & Bigham, J. P. (2013) · Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/2513383.2517033 · Cited by 69 · cited 1×
“Extensions examine conversational interaction with the crowd [41] and soliciting volunteer assistance in social networks [9,10].”
BackgroundGauging Receptiveness to Social Microvolunteering
Brady, E., Morris, M. R., & Bigham, J. P. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702329 · Cited by 68 · cited 1×
“Extensions examine conversational interaction with the crowd [41] and soliciting volunteer assistance in social networks [9,10].”
BackgroundTranscoding proxy for nonvisual web access
Takagi, H., & Asakawa, C. (2000) · Proceedings of the fourth international ACM conference on Assistive technologies · doi:10.1145/354324.354371 · Cited by 52 · cited 3×
“The strategy is analogous to web proxies that modify a page between a server and a browser (including web proxies that modify pages to improve their accessibility [6,8,53]), but extended to address the design and implementation challenges of mobile app accessibility.”
MethodContent and hierarchy in pixel-based methods for reverse engineering interface structure
Dixon, M., Leventhal, D., & Fogarty, J. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979086 · Cited by 52 · cited 2×
“Runtime modification can be implemented using only pixel-level analysis [15,16,17,18,19,61] or in combination with information from an accessibility API [13].”
BackgroundMethodSelf-citationAutomatically identifying targets users interact with during real world tasks
Hurst, A., Hudson, S. E., & Mankoff, J. (2010) · Proceedings of the 15th international conference on Intelligent user interfaces · doi:10.1145/1719970.1719973 · Cited by 50 · cited 3×
“The problem is analogous to developer failure to provide alternative text for images on the web [6] or to implement accessibility guidelines in desktop applications [28].”
BackgroundMethodCracking the cocoa nut: user interface programming at runtime
Eagan, J. R., Beaudouin-Lafon, M., & Mackay, W. E. (2011) · Proceedings of the 24th annual ACM symposium on User interface software and technology · doi:10.1145/2047196.2047226 · Cited by 50 · cited 2×
“More recently, Scotty examined runtime toolkit overloading, developing abstractions for implementing modifications in code injected directly into the interface runtime [20].”
BackgroundMethodBlind and Deaf Consumer Preferences for Android and iOS Smartphones
Morris, J., & Mueller, J. (2014) · Springer eBooks · doi:10.1007/978-3-319-05095-9_7 · Cited by 49
Collaborative web accessibility improvement: challenges and possibilities
Takagi, H., Kawanaka, S., Kobayashi, M., Sato, D., & Asakawa, C. (2009) · Proceedings of the 11th international ACM SIGACCESS conference on Computers and accessibility · doi:10.1145/1639642.1639677 · Cited by 48 · cited 3×
“Such research has examined collaborative authoring of missing image alternative text and other metadata [51,54,55], sharing of scripts to implement site-specific repairs [7], and more recent work focusing on crowdsourcing contributions [27].”
BackgroundAssociating the visual representation of user interfaces with their internal structures and metadata
Chang, T.-H., Yeh, T., & Miller, R. (2011) · Proceedings of the 24th annual ACM symposium on User interface software and technology · doi:10.1145/2047196.2047228 · Cited by 47 · cited 5×
“Runtime modification can be implemented using only pixel-level analysis [15,16,17,18,19,61] or in combination with information from an accessibility API [13].”
BackgroundMethodInfluentialZhong, Y., Weber, A., Burkhardt, C., Weaver, P., & Bigham, J. P. (2015) · Proceedings of the 12th International Web for All Conference · doi:10.1145/2745555.2747277 · Cited by 42
Making the web easier to see with opportunistic accessibility improvement
Bigham, J. P. (2014) · Proceedings of the 27th annual ACM symposium on User interface software and technology · doi:10.1145/2642918.2647357 · Cited by 36 · cited 1×
“Some accessibility repairs can be automated, such as attempting to automatically identify sources of alternative text for web images [6] or automatically increasing font size to improve readability [4].”
BackgroundAccessibility commons: a metadata infrastructure for web accessibility
Kawanaka, S., Borodin, Y., Bigham, J. P., Lunn, D., Takagi, H., & Asakawa, C. (2008) · Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibility · doi:10.1145/1414471.1414500 · Cited by 36 · cited 1×
“Other approaches emphasize social annotation, wherein people contribute accessibility repairs that benefit additional people who encounter the same accessibility failure [37].”
BackgroundImplementing interface attachments based on surface representations
Olsen, D. R., Hudson, S. E., Verratti, T., Heiner, J. M., & Phelps, M. (1999) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/302979.303038 · Cited by 35
Dixon, M., Fogarty, J. A., & Wobbrock, J. O. (2012) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208734 · Cited by 34 · cited 2×
“Runtime modification can be implemented using only pixel-level analysis [15,16,17,18,19,61] or in combination with information from an accessibility API [13].”
BackgroundMethodSelf-citationHurst, A., Mankoff, J., Dey, A. K., & Hudson, S. E. (2007) · Proceedings of the 20th annual ACM symposium on User interface software and technology · doi:10.1145/1294211.1294242 · Cited by 32 · cited 1×
“Examples include making targets “sticky” [29,59], dynamically modifying cursor behavior according to a person’s movement profile [57], and breaking a pointing interaction into multiple interactions that disambiguate the intended target [22,33,63].”
BackgroundSystematic output modification in a 2D user interface toolkit
Edwards, W. K., Hudson, S. E., Marinacci, J., Rodenstein, R., Rodriguez, T. K., & Smith, I. (1997) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/263407.263537 · Cited by 32 · cited 1×
“Early work replaced a toolkit drawing object and intercepted commands (e.g., draw_string ) [21,46].”
BackgroundTechniques to assist in developing accessibility engineers
Carter, J. A., & Fourney, D. W. (2007) · Proceedings of the 9th international ACM SIGACCESS conference on Computers and accessibility · doi:10.1145/1296843.1296865 · Cited by 28 · cited 1×
“, [12,31,47]), such accessibility failures remain common on the web [25].”
BackgroundJansen, A., Findlater, L., & Wobbrock, J. O. (2011) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/1979742.1979888 · Cited by 25 · cited 2×
“For example, prior work explores two-stage selection of small targets [22,33,63].”
BackgroundSelf-citationPrefab layers and prefab annotations: extensible pixel-based interpretation of graphical interfaces
Dixon, M., Nied, A. C., & Fogarty, J. A. (2014) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/2642918.2647412 · Cited by 24 · cited 3×
“Runtime modification can be implemented using only pixel-level analysis [15,16,17,18,19,61] or in combination with information from an accessibility API [13].”
BackgroundMethodSelf-citationExploratory Analysis of Collaborative Web Accessibility Improvement
Sato, D., Takagi, H., Kobayashi, M., Kawanaka, S., & Asakawa, C. (2010) · ACM Transactions on Accessible Computing · doi:10.1145/1857920.1857922 · Cited by 20 · cited 3×
“Such research has examined collaborative authoring of missing image alternative text and other metadata [51,54,55], sharing of scripts to implement site-specific repairs [7], and more recent work focusing on crowdsourcing contributions [27].”
BackgroundThe Accessibility of Mobile Health Sensors for Blind Users
Milne, L. R., Bennett, C. L., & Ladner, R. E. (2014) · CSUN ScholarWorks (California State University, Northridge) · Cited by 19
Breaking Barriers with Assistive Macros
Rodrigues, A. (2015) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/2700648.2811322 · Cited by 17 · cited 2×
“Notable examples include supporting macros motivated by accessibility needs [48] and implementations of pointing enhancements [63].”
BackgroundA tool to support the web accessibility evaluation process for novices
Pearson, E., Bailey, C., & Green, S. (2011) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/1999747.1999758 · Cited by 15 · cited 1×
“, [12,31,47]), such accessibility failures remain common on the web [25].”
BackgroundUser interface toolkit mechanisms for securing interface elements
Roesner, F., Fogarty, J. A., & Kohno, T. (2012) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/2380116.2380147 · Cited by 14 · cited 1×
“Prior research has explored composing interfaces from mutually distrustful elements [50], and the development of effective abstractions is important to improving the security of accessibility enhancements.”
BackgroundSelf-citationPixel-based methods for widget state and style in a runtime implementation of sliding widgets
Dixon, M., Laput, G., & Fogarty, J. A. (2014) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2556979 · Cited by 14 · cited 2×
“Runtime modification can be implemented using only pixel-level analysis [15,16,17,18,19,61] or in combination with information from an accessibility API [13].”
BackgroundMethodSelf-citationCoFaçade: A Customizable Assistive Approach for Elders and Their Helpers
Zhao, J. C., Davis, R., Foong, P. S., & Zhao, S. (2015) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702588 · Cited by 10
CAN: composable accessibility infrastructure via data-driven crowdsourcing
Huang, Y., Dobreski, B., Deo, B. B., Xin, J., Barbosa, N. M., Wang, Y., & Bigham, J. P. (2015) · Proceedings of the 12th International Web for All Conference · doi:10.1145/2745555.2746651 · Cited by 7 · cited 3×
“, social annotation approaches that have been proposed and examined in web-based systems [27,51,54,55]).”
BackgroundImproving learning transfer from stencils-based tutorials
Harms, K. J., Kerr, J. H., & Kelleher, C. L. (2011) · ACM International Conference on Interaction Design and Children (IDC) · doi:10.1145/1999030.1999050 · Cited by 7 · cited 2×
“user’s attention to the correct interface component and prevent the user from interacting with other components” [26,38].”
BackgroundSWAT: Mobile System-Wide Assistive Technologies
Rodrigues, A., & Guerreiro, T. (2014) · doi:10.5555/2742941.2742991 · Cited by 6
Cited by
SeeingVR: A Set of Tools to Make Virtual Reality More Accessible to People with Low Vision
Zhao, Y., Cutrell, E., Holz, C., Morris, M. R., Ofek, E., & Wilson, A. D. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300341 · Cited by 207
“introduced interaction proxies [81], which improved the accessibility of mobile apps by adding an overlay that modified the input and output of the underlying app.”
BackgroundScreen Recognition: Creating Accessibility Metadata for Mobile Applications from Pixels
Zhang, X., de Greef, L., Swearngin, A., White, S., Murray, K., Yu, L., Shan, Q., Nichols, J., Wu, J., Fleizach, C., et al. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445186 · Cited by 144
“tory of such information for runtime repair [80, 81].”
BackgroundSelf-citationLi, T. J.-J., Radensky, M., Jia, J., Singarajah, K., Mitchell, T. M., & Myers, B. A. (2019) · Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3332165.3347899 · Cited by 111
“P UMICE uses an interaction proxy overlay [53] for recording, so that it can record all values visible on the screen, not limited to the selectable or clickable ones.”
Unblind your apps: predicting natural-language labels for mobile GUI components by deep learning
Chen, J., Chen, C., Xing, Z., Xu, X., Zhu, L., Li, G., & Wang, J. (2020) · Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering · doi:10.1145/3377811.3380327 · Cited by 109
“For other accessibility issues, they further develop an approach to deploy the interaction proxies for runtime repair and enhancement of mobile application accessibility [77]”
BackgroundCaption Crawler: Enabling Reusable Alternative Text Descriptions using Reverse Image Search
Guinness, D., Cutrell, E., & Morris, M. R. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174092 · Cited by 108
“Zhang et al. presented a proxy-based method for runtime repair of Android applications [39].”
Method
Metadata
- Authors
- Zhang, X., Ross, A. S., Caspi, A., Fogarty, J., & Wobbrock, J. O.
- Affiliations
- University of Washington (US)
- Venue
- Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2017-05-02
- Pages
- 6024-6037
- OpenAlex
- W2610917376
- Semantic Scholar
- 8577f8716ef27982a47963c498bd12f891c70702
- Cited by
- 59
- References
- 59
- Citations by year
- 2026: 2 · 2025: 6 · 2024: 3 · 2023: 5 · 2022: 5 · 2021: 11 · 2020: 10 · 2019: 8 · 2018: 6 · 2017: 3
- FWCI
- 14.34
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- Funders
- National Science Foundation (IIS-1053868)
- Topics
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- mobile application accessibility, Android, blind and visually impaired users
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.