A Performance Comparison of On-Hand versus On-Phone Nonvisual Input by Blind and Sighted Users
The DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.
Abstract
On-body interaction, in which the user employs one's own body as an input surface, has the potential to provide efficient mobile computing access for blind users. It offers increased tactile and proprioceptive feedback compared to a phone and, because it is always available, it should allow for quick audio output control without having to retrieve the phone from a pocket or bag. Despite this potential, there has been little investigation of on-body input for users with visual impairments. To assess blind users’ performance with on-body input versus touchscreen input, we conducted a controlled lab study with 12 sighted and 11 blind participants. Study tasks included basic pointing and drawing more complex shape gestures. Our findings confirm past work with sighted users showing that the hand results in faster pointing than the phone. Most important, we also show that: (1) the performance gain of the hand applies to blind users as well, (2) the accuracy of where the pointing finger first lands is higher with the hand than the phone, (3) on-hand pointing performance is affected by the location of targets, and (4) shape gestures drawn on the hand result in higher gesture recognition rates than those on the phone. Our findings highlight the potential of on-body input to support accessible nonvisual mobile computing.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
A Simple Sequentially Rejective Multiple Test Procedure
(1979) · Scandinavian Journal of Statistics · doi:10.2307/4615733 · Cited by 21,526 · cited 1×
“For posthoc pairwise comparisons ( t -tests or Wilcoxon signed-rank tests), Holm’s sequential Bonferroni adjustments were used to protect against Type I error [Holm 1979].”
MethodThe aligned rank transform for nonparametric factorial analyses using only anova procedures
Wobbrock, J. O., Findlater, L., Gergle, D., & Higgins, J. J. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1978963 · Cited by 2,854
Self-citationSkinput: appropriating the body as an input surface
Harrison, C., Tan, D., & Morris, D. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753394 · Cited by 694
OmniTouch: wearable multitouch interaction everywhere
Harrison, C., Benko, H., & Wilson, A. D. (2011) · Proceedings of the 24th annual ACM symposium on User interface software and technology · doi:10.1145/2047196.2047255 · Cited by 562
Representation of space in blind persons: vision as a spatial sense?
Thinus-Blanc, C., & Gaunet, F. (1997) · Psychological Bulletin · doi:10.1037/0033-2909.121.1.20 · Cited by 477
Digits: freehand 3D interactions anywhere using a wrist-worn gloveless sensor
Kim, D., Hilliges, O., Izadi, S., Butler, A. D., Chen, J., Oikonomidis, I., & Olivier, P. (2012) · Proceedings of the 25th annual ACM symposium on User interface software and technology · doi:10.1145/2380116.2380139 · Cited by 428
Tactile Acuity is Enhanced in Blindness
Goldreich, D., & Kanics, I. M. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-08-03439.2003 · Cited by 427
Proceedings of Graphics Interface 2007 on - GI '07
(2007) · Proceedings · doi:10.1145/1268517 · Cited by 399
Kane, S. K., Jayant, C., Wobbrock, J. O., & Ladner, R. E. (2009) · Proceedings of the 11th international ACM SIGACCESS conference on Computers and accessibility · doi:10.1145/1639642.1639663 · Cited by 383 · cited 1×
“Through a diary study and interviews, Kane et al. [2009] showed that mobile technology allows visually impaired users to gain independence.”
MethodTactile spatial resolution in blind Braille readers
Boven, R. W. V., Hamilton, R. H., Kauffman, T., Keenan, J. P., & Pascual–Leone, A. (2000) · Neurology · doi:10.1212/wnl.54.12.2230 · Cited by 380
Research works printed but not linked: 3
- 10.5555/2022539.2022543 · doi:10.5555/2022539.2022543
- Allyn Jackson . 2002 . Communications—The world of blind mathematicians . Notices of the AMS 49 , 10, 1246 -- 1251 . Allyn Jackson. 2002. Communications—The world of blind mathematicians. Notices of the AMS 49, 10, 1246--1251.
- Steven Landau and Lesley Wells . 2003 . Merging tactile sensory input and audio data by means of the Talking Tactile Tablet . Proceedings of EuroHaptics 2003 , 414 -- 418 . Steven Landau and Lesley Wells. 2003. Merging tactile sensory input and audio data by means of the Talking Tactile Tablet. Proceedings of EuroHaptics 2003, 414--418.
Cited by
Design and Construction of Electronic Aid for Visually Impaired People
Patil, K. R., Jawadwala, Q., & Shu, F. C. (2018) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2018.2799588 · Cited by 156
Human--Computer Interaction on the Skin
(2019) · doi:10.1145/3332166 · Cited by 46
Placing and Recalling Virtual Items on the Skin
Bergström, J., Boring, S., & Hornbæk, K. (2017) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3026030 · Cited by 43
Like A Second Skin: Understanding How Epidermal Devices Affect Human Tactile Perception
Nittala, A. S., Kruttwig, K., Lee, J., Bennewitz, R., Arzt, E., & Steimle, J. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300610 · Cited by 50
Vatavu, R.-D. (2017) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2017.1279827 · Cited by 38
I Really did That: Sense of Agency with Touchpad, Keyboard, and On-skin Interaction
Bergstrom-Lehtovirta, J., Coyle, D., Knibbe, J., & Hornbæk, K. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173952 · Cited by 38
Next Steps in Epidermal Computing: Opportunities and Challenges for Soft On-Skin Devices
Nittala, A. S., & Steimle, J. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517668 · Cited by 37
Stearns, L., Oh, U., Findlater, L., & Froehlich, J. E. (2018) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3161416 · Cited by 30
Self-citationOh, U., Stearns, L., Pradhan, A., Froehlich, J. E., & Findlater, L. (2017) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3132525.3132536 · Cited by 21
Self-citationAugmenting On-Body Touch Input with Tactile Feedback Through Fingernail Haptics
Tran, P. K. D., Gadepalli, P. V. A., Lee, J., & Nittala, A. S. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581473 · Cited by 24
(2018) · doi:10.1145/3173574.3174138 · Cited by 16
Liu, G., Gu, Y., Yin, Y., Yu, C., Wang, Y., Mi, H., & Shi, Y. (2020) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3397308 · Cited by 22
Technology use and non-use by low-income blind people in India
Vashistha, A., & Anderson, R. (2016) · ACM SIGACCESS Accessibility and Computing · doi:10.1145/3023851.3023853 · Cited by 14
Emotionally Oriented Analysis of the Experiences of Visually Impaired People on Facebook
Nobre, C. N., Meireles, M. R. G., Silva, D. B. F. D., Faria, A. H., & Vieira, N. (2018) · ACM Transactions on Accessible Computing · doi:10.1145/3230739 · Cited by 11
ThroughHand: 2D Tactile Interaction to Simultaneously Recognize and Touch Multiple Objects
Jung, J., Son, S., Lee, S., Kim, Y., & Lee, G. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445530 · Cited by 11
Understanding Gesture and Microgesture Inputs for Augmented Reality Maps
Danyluk, K., Klueber, S., Nittala, A. S., & Willett, W. (2024) · Designing Interactive Systems Conference · doi:10.1145/3643834.3661630 · Cited by 8
Evaluation of Haptic Textures for Tangible Interfaces for the Tactile Internet
Tzimos, N., Voutsakelis, G., Kontogiannis, S. I., & Kokkonis, G. (2024) · Electronics · doi:10.3390/electronics13183775 · Cited by 4
Localization of skin features on the hand and wrist from small image patches
Stearns, L., Oh, U., Cheng, B. J., Findlater, L., Ross, D. A., Chellappa, R., & Froehlich, J. E. (2016) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2016.7899767 · Cited by 3
Self-citationBoyd, L. E. (2024) · Synthesis lectures on technology and health · doi:10.1007/978-3-031-48843-6_3 · Cited by 3
Joh, H., Lee, Y. J., & Oh, U. (2022) · Proceedings of the 19th International Web for All Conference · doi:10.1145/3493612.3520454 · Cited by 1
Self-citationDeveloping Brain-Based Bare-Handed Human-Machine Interaction via On-Skin Input
Kim, M.-K., Shin, H.-B., Cho, J.-H., & Lee, S. (2025) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2025.3533088
Wu, T.-Y., & Wu, K.-C. (2023) · International Conference on Applied System Innovation · doi:10.1109/icasi57738.2023.10179544
PalmPen: A Palmprint Positioning Pen
Yu, J., Wang, Z., Pan, Z., Feng, J., & Zhou, J. (2025) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3749549
Metadata
- Authors
- Oh, U., & Findlater, L.
- Affiliations
- University of Maryland, College Park (US)
- Venue
- ACM Transactions on Accessible Computing
- Published
- 2015-11-19
- Volume
- 7
- Issue
- 4
- Pages
- 1-20
- ISSN
- 1936-7228 (ISSN-L)
- 1936-7236
- OpenAlex
- W2295709925
- Semantic Scholar
- 3f1211c195d43e7c87a1de47c93416c455d081cd
- Cited by
- 23
- References
- 63
- Citations by year
- 2025: 2 · 2024: 3 · 2023: 2 · 2022: 2 · 2021: 1 · 2020: 1 · 2019: 2 · 2018: 5 · 2017: 3 · 2016: 2
- FWCI
- 2.00
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Transactions on Accessible Computing (publishedVersion)
- Funders
- Nokia (University Coorperation Grant)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Physical Sciences › Computer Science › Human-Computer Interaction › Interactive and Immersive Displays
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Keywords
- blind users, visual impairment, gesture recognition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.