A Performance Comparison of On-Hand versus On-Phone Nonvisual Input by Blind and Sighted Users
The DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.
Abstract
On-body interaction, in which the user employs one's own body as an input surface, has the potential to provide efficient mobile computing access for blind users. It offers increased tactile and proprioceptive feedback compared to a phone and, because it is always available, it should allow for quick audio output control without having to retrieve the phone from a pocket or bag. Despite this potential, there has been little investigation of on-body input for users with visual impairments. To assess blind users’ performance with on-body input versus touchscreen input, we conducted a controlled lab study with 12 sighted and 11 blind participants. Study tasks included basic pointing and drawing more complex shape gestures. Our findings confirm past work with sighted users showing that the hand results in faster pointing than the phone. Most important, we also show that: (1) the performance gain of the hand applies to blind users as well, (2) the accuracy of where the pointing finger first lands is higher with the hand than the phone, (3) on-hand pointing performance is affected by the location of targets, and (4) shape gestures drawn on the hand result in higher gesture recognition rates than those on the phone. Our findings highlight the potential of on-body input to support accessible nonvisual mobile computing.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
A Simple Sequentially Rejective Multiple Test Procedure
(1979) · Scandinavian Journal of Statistics · doi:10.2307/4615733 · Cited by 21,526 · cited 1×
“For posthoc pairwise comparisons ( t -tests or Wilcoxon signed-rank tests), Holm’s sequential Bonferroni adjustments were used to protect against Type I error [Holm 1979].”
MethodThe aligned rank transform for nonparametric factorial analyses using only anova procedures
Wobbrock, J. O., Findlater, L., Gergle, D., & Higgins, J. J. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1978963 · Cited by 2,854
Self-citationSkinput: appropriating the body as an input surface
Harrison, C., Tan, D., & Morris, D. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753394 · Cited by 694
OmniTouch: wearable multitouch interaction everywhere
Harrison, C., Benko, H., & Wilson, A. D. (2011) · Proceedings of the 24th annual ACM symposium on User interface software and technology · doi:10.1145/2047196.2047255 · Cited by 562
Representation of space in blind persons: vision as a spatial sense?
Thinus-Blanc, C., & Gaunet, F. (1997) · Psychological Bulletin · doi:10.1037/0033-2909.121.1.20 · Cited by 477
Digits: freehand 3D interactions anywhere using a wrist-worn gloveless sensor
Kim, D., Hilliges, O., Izadi, S., Butler, A. D., Chen, J., Oikonomidis, I., & Olivier, P. (2012) · Proceedings of the 25th annual ACM symposium on User interface software and technology · doi:10.1145/2380116.2380139 · Cited by 428
Tactile Acuity is Enhanced in Blindness
Goldreich, D., & Kanics, I. M. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-08-03439.2003 · Cited by 427
Proceedings of Graphics Interface 2007 on - GI '07
(2007) · Proceedings · doi:10.1145/1268517 · Cited by 399
Kane, S. K., Jayant, C., Wobbrock, J. O., & Ladner, R. E. (2009) · Proceedings of the 11th international ACM SIGACCESS conference on Computers and accessibility · doi:10.1145/1639642.1639663 · Cited by 383 · cited 1×
“Through a diary study and interviews, Kane et al. [2009] showed that mobile technology allows visually impaired users to gain independence.”
MethodTactile spatial resolution in blind Braille readers
Boven, R. W. V., Hamilton, R. H., Kauffman, T., Keenan, J. P., & Pascual–Leone, A. (2000) · Neurology · doi:10.1212/wnl.54.12.2230 · Cited by 380
Kane, S. K., Bigham, J. P., & Wobbrock, J. O. (2008) · Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/1414471.1414487 · Cited by 374 · cited 2×
“…enhancing tactile feedback through external hardware devices [Vanderheiden 1996; Landau and Wells 2003], physical overlays [Kane et al. 2011, 2013], or the use of location-insensitive gestures [Bonner et al. 2010; Frey et al. 2011; Guerreiro et al. 2008; Kane et al. 2008; McGookin et al. 2008].”
BackgroundWUW - wear Ur world: a wearable gestural interface
Mistry, P., Maes, P., & Chang, L. (2009) · CHI '09 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/1520340.1520626 · Cited by 372
iSkin: Flexible, Stretchable and Visually Customizable On-Body Touch Sensors for Mobile Computing
Weigel, M., Lu, T., Bailly, G., Oulasvirta, A., Majidi, C., & Steimle, J. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702391 · Cited by 367
Enabling always-available input with muscle-computer interfaces
Saponas, T. S., Tan, D. S., Morris, D., Balakrishnan, R., Turner, J., & Landay, J. A. (2009) · Proceedings of the 22nd annual ACM symposium on User interface software and technology · doi:10.1145/1622176.1622208 · Cited by 328
Usable gestures for blind people: understanding preference and performance
Kane, S. K., Wobbrock, J. O., & Ladner, R. E. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979001 · Cited by 314 · cited 3×
“For the circle, equilateral triangle, and square, we calculated this difference for aspect ratio , the ratio of width to height (ideally 1), and closure [Kane et al. 2011], the Euclidian distance between the start and end points of the gesture (ideally 0).”
BackgroundMethodResultSpatial Acuity of the Body Surface over the Life Span
Stevens, J. C., & Choo, K. K. (1996) · Somatosensory & Motor Research · doi:10.3109/08990229609051403 · Cited by 279
A lightweight multistroke recognizer for user interface prototypes
Anthony, L., & Wobbrock, J. O. (2010) · Graphics Interface · Cited by 215
Imaginary phone: learning imaginary interfaces by transferring spatial memory from a familiar device
Gustafson, S., Holz, C., & Baudisch, P. (2011) · Proceedings of the 24th annual ACM symposium on User interface software and technology · doi:10.1145/2047196.2047233 · Cited by 193
The role of visual experience for the neural basis of spatial cognition
Pasqualotto, A., & Proulx, M. J. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2012.01.008 · Cited by 192
No-Look Notes: Accessible Eyes-Free Multi-touch Text Entry
Bonner, M. N., Brudvik, J. T., Abowd, G. D., & Edwards, W. K. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-12654-3_24 · Cited by 154 · cited 1×
“…enhancing tactile feedback through external hardware devices [Vanderheiden 1996; Landau and Wells 2003], physical overlays [Kane et al. 2011, 2013], or the use of location-insensitive gestures [Bonner et al. 2010; Frey et al. 2011; Guerreiro et al. 2008; Kane et al. 2008; McGookin et al. 2008].”
BackgroundInvestigating touchscreen accessibility for people with visual impairments
McGookin, D., Brewster, S., & Jiang, W. (2008) · Proceedings of the 5th Nordic conference on Human-computer interaction: building bridges · doi:10.1145/1463160.1463193 · Cited by 151 · cited 1×
“…enhancing tactile feedback through external hardware devices [Vanderheiden 1996; Landau and Wells 2003], physical overlays [Kane et al. 2011, 2013], or the use of location-insensitive gestures [Bonner et al. 2010; Frey et al. 2011; Guerreiro et al. 2008; Kane et al. 2008; McGookin et al. 2008].”
BackgroundCurrent and future mobile and wearable device use by people with visual impairments
Ye, H., Malu, M., Oh, U., & Findlater, L. (2014) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2557085 · Cited by 148
Self-citationTactile acuity, aging, and braille reading in long-term blindness.
Stevens, J. C., Foulke, E., & Patterson, M. Q. (1996) · Journal of Experimental Psychology: Applied · doi:10.1037/1076-898x.2.2.91 · Cited by 147
Skin buttons: cheap, small, low-powered and clickable fixed-icon laser projectors
Laput, G., Xiao, R., Chen, X. '., Hudson, S. E., & Harrison, C. (2014) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/2642918.2647356 · Cited by 146
The Influence of Age and Physical Activity on Upper Limb Proprioceptive Ability
Adamo, D. E., Alexander, N. B., & Brown, S. H. (2009) · Journal of Aging and Physical Activity · doi:10.1123/japa.17.3.272 · Cited by 136
Retention of high tactile acuity throughout the life span in blindness
LEGGE, G. E., MADISON, C., VAUGHN, B. N., CHEONG, A. M. Y., & MILLER, J. C. (2008) · Perception & Psychophysics · doi:10.3758/pp.70.8.1471 · Cited by 133
On-body interaction: armed and dangerous
Harrison, C., Ramamurthy, S., & Hudson, S. E. (2012) · International Conference on Tangible, Embedded, and Embodied Interaction (TEI) · doi:10.1145/2148131.2148148 · Cited by 129
BrailleTouch: Mobile Texting for the Visually Impaired
Frey, B., Southern, C., & Romero, M. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-21666-4_3 · Cited by 129
Performance of blind and sighted humans on a tactile grating detection task
Goldreich, D., & Kanics, I. M. (2006) · Perception & Psychophysics · doi:10.3758/bf03193735 · Cited by 128
Access overlays: improving non-visual access to large touch screens for blind users
Kane, S. K., Morris, M. R., Perkins, A. Z., Wigdor, D., Ladner, R. E., & Wobbrock, J. O. (2011) · Proceedings of the 24th annual ACM symposium on User interface software and technology · doi:10.1145/2047196.2047232 · Cited by 127 · cited 3×
“For the circle, equilateral triangle, and square, we calculated this difference for aspect ratio , the ratio of width to height (ideally 1), and closure [Kane et al. 2011], the Euclidian distance between the start and end points of the gesture (ideally 0).”
BackgroundMethodWeigel, M., Mehta, V., & Steimle, J. (2014) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2557239 · Cited by 125
Minimum jerk trajectory control for rehabilitation and haptic applications
Amirabdollahian, F., Loureiro, R. C. V., & Harwin, W. (2003) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2002.1014233 · Cited by 111
Touchplates: low-cost tactile overlays for visually impaired touch screen users
Kane, S. K., Morris, M. R., & Wobbrock, J. O. (2013) · Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/2513383.2513442 · Cited by 107
From Tapping to Touching: Making Touch Screens Accessible to Blind Users
Guerreiro, T., Lagoá, P., Nicolau, H., Gonalves, D., & Jorge, J. A. (2008) · IEEE Multimedia · doi:10.1109/mmul.2008.88 · Cited by 100
Dezfuli, N., Khalilbeigi, M., Huber, J., Müller, F., & Mühlhäuser, M. (2012) · European Conference on Interactive TV and Video (EuroITV) · doi:10.1145/2325616.2325623 · Cited by 95
Mobile Lorm Glove: introducing a communication device for deaf-blind people
Gollner, U., Bieling, T., & Joost, G. (2012) · Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction · doi:10.1145/2148131.2148159 · Cited by 95
Differences in spatial acuity between digits
Vega–Bermudez, F., & Johnson, K. O. (2001) · Neurology · doi:10.1212/wnl.56.10.1389 · Cited by 95
Understanding palm-based imaginary interfaces: the role of visual and tactile cues when browsing
Gustafson, S. G., Rabe, B., & Baudisch, P. M. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2466114 · Cited by 93
(2013) · doi:10.1145/2501988.2502039 · Cited by 88
(2011) · doi:10.1145/2047196.2047259 · Cited by 79
A comparison of tactile spatial sensitivity on the palm and fingerpad
Craig, J. C., & Lyle, K. B. (2001) · Perception & Psychophysics · doi:10.3758/bf03194474 · Cited by 76
Gesture search: a tool for fast mobile data access
Li, Y. (2010) · Proceedings of the 23nd annual ACM symposium on User interface software and technology · doi:10.1145/1866029.1866044 · Cited by 74
Brainy hand: an ear-worn hand gesture interaction device
Tamaki, E., Miyaki, T., & Rekimoto, J. (2009) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/1520340.1520649 · Cited by 69
Oh, U., Kane, S. K., & Findlater, L. (2013) · ASSETS '13 · doi:10.1145/2513383.2513455 · Cited by 68
Self-citationRubber Hands Feel Touch, but Not in Blind Individuals
Petkova, V. I., Zetterberg, H., & Ehrsson, H. H. (2012) · PLoS ONE · doi:10.1371/journal.pone.0035912 · Cited by 67
Alary, F., Goldstein, R., Duquette, M., Chapman, C. E., Voss, P., & Lepore, F. (2008) · Experimental Brain Research · doi:10.1007/s00221-008-1327-7 · Cited by 66 · cited 1×
“…shown that blind people, both congenitally blind and those who became blind later in life, have superior tactile acuity to sighted people [Van Boven et al. 2000; Gaunet et al. 2006; Goldreich and Kanics 2003; Legge et al. 2008; Stevens et al. 1996; Goldreich and Kanics 2006; Alary et al. 2008].”
BackgroundPinchWatch: A Wearable Device for One-Handed Microinteractions
Loclair, C., & Gustafson, S. G. (2010) · Cited by 65
Ozdemir, R. A., Pourmoghaddam, A., & Paloski, W. H. (2013) · Gait & Posture · doi:10.1016/j.gaitpost.2013.02.003 · Cited by 61
A wearable Malossi alphabet interface for deafblind people
(2008) · doi:10.1145/1385569.1385655 · Cited by 56
Gosselin-Kessiby, N., Kalaska, J. F., & Messier, J. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.2374-08.2009 · Cited by 56
Use of Audio-Haptic Interface Techniques to Allow Nonvisual Access to Touchscreen Appliances
Vanderheiden, G. C. (1996) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193129604002430 · Cited by 54
Gaunet, F., & Rossetti, Y. (2006) · Perception · doi:10.1068/p5333 · Cited by 49
Early non-visual experience influences proprioceptive-spatial discrimination acuity in adulthood
Fiehler, K., Reuschel, J., & Rösler, F. (2008) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2008.12.023 · Cited by 42
Leveraging proprioception to make mobile phones more accessible to users with visual impairments
Li, F. C. Y., Dearman, D., & Truong, K. N. (2010) · Proceedings of the 12th international ACM SIGACCESS conference on Computers and accessibility · doi:10.1145/1878803.1878837 · Cited by 42
Design of and subjective response to on-body input for people with visual impairments
Oh, U., & Findlater, L. (2014) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/2661334.2661376 · Cited by 41
Self-citationTouch interface on back of the hand
(2011) · doi:10.1145/2037715.2037760 · Cited by 31
(2011) · doi:10.1145/2073370.2073374 · Cited by 19
Spatial gestures using a tactile-proprioceptive display
Folmer, E., & Morelli, T. (2012) · International Conference on Tangible, Embedded, and Embodied Interaction (TEI) · doi:10.1145/2148131.2148161 · Cited by 17
TWuiST: A discrete tactile-proprioceptive display for eye and ear free output on mobile devices
Morelli, T., & Folmer, E. (2012) · IEEE Haptics Symposium · doi:10.1109/haptic.2012.6183829 · Cited by 7
Research works printed but not linked: 3
- 10.5555/2022539.2022543 · doi:10.5555/2022539.2022543
- Allyn Jackson . 2002 . Communications—The world of blind mathematicians . Notices of the AMS 49 , 10, 1246 -- 1251 . Allyn Jackson. 2002. Communications—The world of blind mathematicians. Notices of the AMS 49, 10, 1246--1251.
- Steven Landau and Lesley Wells . 2003 . Merging tactile sensory input and audio data by means of the Talking Tactile Tablet . Proceedings of EuroHaptics 2003 , 414 -- 418 . Steven Landau and Lesley Wells. 2003. Merging tactile sensory input and audio data by means of the Talking Tactile Tablet. Proceedings of EuroHaptics 2003, 414--418.
Cited by
Design and Construction of Electronic Aid for Visually Impaired People
Patil, K. R., Jawadwala, Q., & Shu, F. C. (2018) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2018.2799588 · Cited by 156
Human--Computer Interaction on the Skin
(2019) · doi:10.1145/3332166 · Cited by 46
Placing and Recalling Virtual Items on the Skin
Bergström, J., Boring, S., & Hornbæk, K. (2017) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3026030 · Cited by 43
Like A Second Skin: Understanding How Epidermal Devices Affect Human Tactile Perception
Nittala, A. S., Kruttwig, K., Lee, J., Bennewitz, R., Arzt, E., & Steimle, J. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300610 · Cited by 50
Vatavu, R.-D. (2017) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2017.1279827 · Cited by 38
Metadata
- Authors
- Oh, U., & Findlater, L.
- Affiliations
- University of Maryland, College Park (US)
- Venue
- ACM Transactions on Accessible Computing
- Published
- 2015-11-19
- Volume
- 7
- Issue
- 4
- Pages
- 1-20
- ISSN
- 1936-7228 (ISSN-L)
- 1936-7236
- OpenAlex
- W2295709925
- Semantic Scholar
- 3f1211c195d43e7c87a1de47c93416c455d081cd
- Cited by
- 23
- References
- 63
- Citations by year
- 2025: 2 · 2024: 3 · 2023: 2 · 2022: 2 · 2021: 1 · 2020: 1 · 2019: 2 · 2018: 5 · 2017: 3 · 2016: 2
- FWCI
- 2.00
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Transactions on Accessible Computing (publishedVersion)
- Funders
- Nokia (University Coorperation Grant)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Physical Sciences › Computer Science › Human-Computer Interaction › Interactive and Immersive Displays
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Keywords
- blind users, visual impairment, gesture recognition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.