“Unfold and Go Touch”: A Portable Method for Making Existing Touchscreens Accessible to Blind and Low Vision People in Self-Service Terminals
Open accessAbstract
Self-service terminals (SSTs) are almost everywhere in our daily life and increasingly use capacitive and infrared touchscreens as the interface. Most of the current solutions to help blind and low vision (BLV) people access existing touchscreens mostly are only suitable for capacitive touchscreens and not for infrared touchscreens. In this paper, we proposed a voice-based interactive method using a conductive folding stand with the phone camera to allow BLV people to access both touchscreens of SSTs. Voice feedback was provided to guide users to move the phone close to the button and touch it with the end of the unfolded stand. Using a portable accessory, this method directly guided users to touch the target and effectively avoids false triggering. A preliminary evaluation indicated that our approach enabled users to access the target buttons on the touchscreen with high accuracy and a short completion time.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Unfold and Go Touch by Lin et al. provides verbal guidance via a smartphone camera to assist users in selecting touchscreen options.
“Another proposed solution called Unfold and Go Touch by Lin et al. [51], provides verbal guidance via a smartphone camera to assist users in selecting touchscreen options.”
From Experiences and Perceptions of Blind and Low-Vision (BLV) People with Retail Self-Checkout Systems (2026) · cites this paper as [51]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
An improved Canny edge detection algorithm
Rong, W., Li, Z., Zhāng, W., & Sun, L. (2014) · IEEE International Conference on Mechatronics and Automation (ICMA) · doi:10.1109/icma.2014.6885761 · Cited by 462 · see citing works
Jayant, C., Ji, H., White, S., & Bigham, J. P. (2011) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/2049536.2049573 · Cited by 168 · see citing works
Investigating touchscreen accessibility for people with visual impairments
McGookin, D., Brewster, S., & Jiang, W. (2008) · Proceedings of the 5th Nordic conference on Human-computer interaction: building bridges · doi:10.1145/1463160.1463193 · Cited by 151 · cited 5× · see citing works
“The voice feedback will be provided as spoken direction (up, down, left, right, forward, and back) every second, which is used in many existing approaches[7, 21] and usable without training [19].”
BackgroundMethodInfluentialAccess overlays: improving non-visual access to large touch screens for blind users
Kane, S. K., Morris, M. R., Perkins, A. Z., Wigdor, D., Ladner, R. E., & Wobbrock, J. O. (2011) · Proceedings of the 24th annual ACM symposium on User interface software and technology · doi:10.1145/2047196.2047232 · Cited by 127 · cited 2× · see citing works
“Different ways to browse and explore UI elements on large touchscreens, such as screen edge positioning, nearest item browsing, and speech feedback at path, also were proposed[13].”
BackgroundTouchplates: low-cost tactile overlays for visually impaired touch screen users
Kane, S. K., Morris, M. R., & Wobbrock, J. O. (2013) · Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/2513383.2513442 · Cited by 107 · see citing works
Getting Smartphones to Talkback
Rodrigues, A., Montague, K., Nicolau, H., & Guerreiro, T. (2015) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/2700648.2809842 · Cited by 101 · see citing works
VizLens: A Robust and Interactive Screen Reader for Interfaces in the Real World
Guo, A., Chen, X. '., Qi, H., White, S., Ghosh, S., Asakawa, C., & Bigham, J. P. (2016) · Proceedings of the 29th Annual Symposium on User Interface Software and Technology · doi:10.1145/2984511.2984518 · Cited by 99 · see citing works
Multimodal collaborative handwriting training for visually-impaired people
Plimmer, B., Crossan, A., Brewster, S. A., & Blagojevic, R. (2008) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1357054.1357119 · Cited by 84 · see citing works
A simple and efficient template matching algorithm
Jurie, F., & Dhome, M. (2002) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2001.937673 · Cited by 77 · see citing works
Self-service Technology Adoption: An Analysis of Customer to Technology Interactions
Considine, E., & Cormican, K. T. (2016) · Procedia Computer Science · doi:10.1016/j.procs.2016.09.129 · Cited by 75 · see citing works
Adaptive blind interaction technique for touchscreens
Yfantidis, G., & Evreinov, G. (2006) · Universal Access in the Information Society · doi:10.1007/s10209-004-0109-7 · Cited by 73 · cited 2× · see citing works
“Furthermore, several works [15, 19, 25, 26] investigated the accessibility of touchscreens and proposed some guidelines for future designers.”
BackgroundKhan, A., & Khusro, S. (2019) · Multimedia Tools and Applications · doi:10.1007/s11042-018-7094-y · Cited by 63 · see citing works
Content and hierarchy in pixel-based methods for reverse engineering interface structure
Dixon, M., Leventhal, D., & Fogarty, J. A. (2011) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979086 · Cited by 52 · see citing works
Toward haptic/aural touchscreen display of graphical mathematics for the education of blind students
Toennies, J. L., Burgner-Kahrs, J., Withrow, T. J., & Webster, R. J., III (2011) · IEEE World Haptics Conference (WHC) · doi:10.1109/whc.2011.5945515 · Cited by 47 · see citing works
Making touch-based kiosks accessible to blind users through simple gestures
Sandnes, F. E., Tan, T. B., Johansen, A., Sulic, E., Vesterhus, E., & Iversen, E. R. (2011) · Universal Access in the Information Society · doi:10.1007/s10209-011-0258-4 · Cited by 44 · see citing works
Smartphone Usage by Expert Blind Users
Jain, M., Diwakar, N., & Swaminathan, M. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445074 · Cited by 41 · cited 1× · see citing works
“It enables users to navigate and activate items by non-visual interaction such as swipe and tap gestures[8].”
BackgroundStateLens: A Reverse Engineering Solution for Making Existing Dynamic Touchscreens Accessible
Guo, A., Kong, J., Rivera, M., Xu, F. F., & Bigham, J. P. (2019) · Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3332165.3347873 · Cited by 35 · see citing works
Universal Access in Human-Computer Interaction. Access to Interaction
Antona, M., & Stephanidis, C. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-20681-3 · Cited by 26 · see citing works
Jagdish, D., Sawhney, R., Gupta, M., & Nangia, S. (2008) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/1378773.1378824 · Cited by 17 · see citing works
StoryBox: Independent Multi-modal Interactive Storytelling for Children with Visual Impairment
Chopra, B., & Gupta, R. (2022) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3491101.3519651 · Cited by 14 · see citing works
“I Shake The Package To Check If It’s Mine”
Lei, W., Fan, M., & Thang, J. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3502063 · Cited by 13 · see citing works
Touchscreen Accessibility in Self-Service Terminals
Jokisuu, E., McKenna, M., Smith, A. W. D., & Day, P. N. (2016) · Cited by 5 · see citing works
Flagged first, then by citations
Research works printed but not linked: 4
- Timothy Hoye and Joseph Kozak. 2010. Touch screens: A pressing technology. In Tenth Annual Freshman Engineering Sustainability in the New Millennium Conference April, Vol. 10.
- Ian Maxwell. 2007. An overview of optical-touch technologies. Information Display 23, 12 (2007), 26.
- Helen Petrie, Jenny S. Darzentas, and Christopher Power. 2014. Self-Service Ter- minals for Older and Disabled Users: Attitudes of Key Stakeholders. In Computers Helping People with Special Needs, Klaus Miesenberger, Deborah Fels, Dominique Archambault, Petr Peňáz, and Wolfgang Zagler (Eds.). Springer International Publishing, Cham, 340-347.
- André Rodrigues, Kyle Montague, Hugo Nicolau, and Tiago Guerreiro. 2015. Get- ting smartphones to talkback: Understanding the smartphone adoption process of blind users. In Proceedings of the 17th international acm sigaccess conference on computers & accessibility. 23-32.
Cited by
Sorted by citations
BrushLens: Hardware Interaction Proxies for Accessible Touchscreen Interface Actuation
Liang, C., Iravantchi, Y., Krolikowski, T., Geng, R., Sample, A. P., & Guo, A. (2023) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3586183.3606730 · Cited by 9 · see citing works
Mäkipää, J.-P., & Iijima, J. (2025) · Information and Software Technology · doi:10.1016/j.infsof.2025.107970 · Cited by 1 · see citing works
Experiences and Perceptions of Blind and Low-Vision (BLV) People with Retail Self-Checkout Systems
Heisey, A., Shinohara, K., & Tigwell, G. W. (2026) · ACM Transactions on Accessible Computing · doi:10.1145/3816243
- Authors
- Lin, W., Li, T., Liu, L., & Zhu, Q.
- Affiliations
- Peking University (CN)
- Huawei Technologies (China) (CN)
- Hong Kong University of Science and Technology (HK)
- Corresponding author
- Lin, Weiyue
- Venue
- Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2023-04-19
- Pages
- 1-7
- OpenAlex
- W4366597145
- Cited by
- 3
- References
- 22
- Citations by year
- 2026: 1 · 2025: 1 · 2023: 1
- FWCI
- 1.26
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) (publishedVersion)
- Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
- Topics
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
- Keywords
- self-service terminals, capacitive touch screen, voice feedback, portable assistive device, false triggering
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
