Hybrid-Brailler: Combining Physical and Gestural Interaction for Mobile Braille Input and Editing
The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Abstract
Braille input enables fast nonvisual entry speeds on mobile touchscreen devices. Yet, the lack of tactile cues commonly results in typing errors, which are hard to correct. We propose Hybrid-Brailler, an input solution that combines physical and gestural interaction to provide fast and accurate Braille input. We use the back of the device for physical chorded input while freeing the touchscreen for gestural interaction. Gestures are used in editing operations, such as caret movement, text selection, and clipboard control, enhancing the overall text entry experience. We conducted two user studies to assess both input and editing performance. Results show that Hybrid-Brailler supports fast entry rates as its virtual counterpart, while significantly increasing input accuracy. Regarding editing performance, when compared with the mainstream technique, Hybrid-Brailler shows performance benefits of 21% in speed and increased editing accuracy. We finish with lessons learned for designing future nonvisual input and editing techniques.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
The aligned rank transform for nonparametric factorial analyses using only anova procedures
Wobbrock, J. O., Findlater, L., Gergle, D., & Higgins, J. J. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1978963 · Cited by 2,854
Statistical analysis of repeated measures data using SAS procedures.
Littell, R. C., Henry, P. R., & Ammerman, C. B. (1998) · Journal of Animal Science · doi:10.2527/1998.7641216x · Cited by 2,825
Phrase sets for evaluating text entry techniques
MacKenzie, I. S., & Soukoreff, R. W. (2003) · CHI '03 extended abstracts on Human factors in computing systems - CHI '03 · doi:10.1145/765891.765971 · Cited by 825
Text Entry for Mobile Computing: Models and Methods, Theory and Practice
MacKenzie, I. S., & Soukoreff, R. W. (2002) · Human-Computer Interaction · doi:10.1207/s15327051hci172&3_2 · Cited by 571
Metrics for text entry research: an evaluation of MSD and KSPC, and a new unified error metric
Soukoreff, R. W., & MacKenzie, I. S. (2003) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/642611.642632 · Cited by 398
Usable gestures for blind people: understanding preference and performance
Kane, S. K., Wobbrock, J. O., & Ladner, R. E. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979001 · Cited by 314 · cited 4×
“However, these do not directly apply to blind users, since proposed interfaces are visually demanding and gesture input ability differs significantly from that of sighted people [10].”
BackgroundInfluentialAnalyzing the input stream for character- level errors in unconstrained text entry evaluations
Wobbrock, J. O., & Myers, B. A. (2006) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1188816.1188819 · Cited by 200 · cited 4×
“We used an unconstrained text entry protocol [28], where participants were free to correct any errors they encountered.”
BackgroundMethodInfluentialTwiddler typing: one-handed chording text entry for mobile phones
Lyons, K., Starner, T., Plaisted, D., Fusia, J., Lyons, A., Drew, A., & Looney, E. W. (2004) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/985692.985777 · Cited by 196
Shinohara, K., & Wobbrock, J. O. (2016) · ACM Transactions on Accessible Computing · doi:10.1145/2827857 · Cited by 180
No-Look Notes: Accessible Eyes-Free Multi-touch Text Entry
Bonner, M. N., Brudvik, J. T., Abowd, G. D., & Edwards, W. K. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-12654-3_24 · Cited by 154 · cited 1×
“No-Look Notes [3] is a text entry method with large virtual keys that uses an alphabetical character grouping identical to multi-tap approaches.”
MethodExploring the use of speech input by blind people on mobile devices
Azenkot, S., & Lee, N. B. (2013) · Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/2513383.2513440 · Cited by 151 · cited 3×
“Azenkot and Lee [1] conducted an observational study on how blind people used speech input and an on-screen keyboard.”
BackgroundAn evaluation of BrailleTouch: mobile touchscreen text entry for the visually impaired
Southern, C., Clawson, J., Frey, B., Abowd, G., & Romero, M. (2012) · Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services · doi:10.1145/2371574.2371623 · Cited by 125
Blind people and mobile touch-based text-entry: acknowledging the need for different flavors
Oliveira, J., Guerreiro, T., Nicolau, H., Jorge, J., & Gonçalves, D. (2011) · The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility · doi:10.1145/2049536.2049569 · Cited by 123 · cited 1×
“These keyboards are consistently faster and more accurate than their touch-based counterparts [20,25].”
BackgroundSelf-citationPredictive text entry methods for mobile phones
Dunlop, M. D., & Crossan, A. (2000) · Personal and Ubiquitous Computing · doi:10.1007/bf01324120 · Cited by 121
BrailleType: Unleashing Braille over Touch Screen Mobile Phones
Oliveira, J., Guerreiro, T., Nicolau, H., Jorge, J., & Gonçalves, D. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-23774-4_10 · Cited by 111
Self-citation(2012) · Graphics Interface · Cited by 103
From Tapping to Touching: Making Touch Screens Accessible to Blind Users
Guerreiro, T., Lagoa, P., Nicolau, H., Gonalves, D., & Jorge, J. A. (2008) · IEEE MultiMedia · doi:10.1109/mmul.2008.88 · Cited by 89
Self-citationAccessible Touchscreen Technology for People with Visual Impairments: A Survey
Grussenmeyer, W., & Folmer, E. (2017) · ACM Transactions on Accessible Computing · doi:10.1145/3022701 · Cited by 86
Adaptive blind interaction technique for touchscreens
Yfantidis, G., & Evreinov, G. (2006) · Universal Access in the Information Society · doi:10.1007/s10209-004-0109-7 · Cited by 73 · cited 1×
“Yfantidis and Evreinov [29] proposed one of the first touchscreen input methods for blind people, which consists of a pie menu with eight options and three levels.”
BackgroundTypeInBraille: a braille-based typing application for touchscreen devices
Mascetti, S., Bernareggi, C., & Belotti, M. (2011) · The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility · doi:10.1145/2049536.2049614 · Cited by 68
Motor-impaired touchscreen interactions in the wild
Montague, K., Nicolau, H., & Hanson, V. L. (2014) · Proceedings of the 16th international ACM SIGACCESS conference on Computers & accessibility - ASSETS '14 · doi:10.1145/2661334.2661362 · Cited by 59
Self-citationFuccella, V., Isokoski, P., & Martin, B. (2013) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2481385 · Cited by 57
Typing Performance of Blind Users
Nicolau, H., Montague, K., Guerreiro, T., Rodrigues, A., & Hanson, V. L. (2015) · Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility - ASSETS '15 · doi:10.1145/2700648.2809861 · Cited by 37 · cited 1×
“participants tend to correct most errors when given the chance [18], which result in high quality transcribed sentences.”
BackgroundSelf-citationChen, C., Perrault, S. T., Zhao, S., & Ooi, W. T. (2014) · International Conference on Advanced Visual Interfaces (AVI) · doi:10.1145/2598153.2598162 · Cited by 30
Designing a text entry multimodal keypad for blind users of touchscreen mobile phones
Buzzi, M. C., Buzzi, M., Leporini, B., & Trujillo, A. (2014) · Proceedings of the 16th international ACM SIGACCESS conference on Computers & accessibility - ASSETS '14 · doi:10.1145/2661334.2661354 · Cited by 28 · cited 1×
“The severity of these issues is demonstrated by some users that prefer to clear the entire text field and rewrite the original text rather than edit it [1,4].”
BackgroundB#: chord-based correction for multitouch braille input
Nicolau, H., Montague, K., Guerreiro, T., Guerreiro, J., & Hanson, V. L. (2014) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2557269 · Cited by 27
Self-citationVirtual Stick in Caret Positioning on Touch Screens
Scheibel, J.-B., Pierson, C., Martin, B., Godard, N., Fuccella, V., & Isokoski, P. (2013) · Conference on l'Interaction Homme-Machine (IHM) · doi:10.1145/2534903.2534918 · Cited by 21
Investigating Laboratory and Everyday Typing Performance of Blind Users
Nicolau, H., Montague, K., Guerreiro, T., Rodrigues, A., & Hanson, V. L. (2017) · ACM Transactions on Accessible Computing · doi:10.1145/3046785 · Cited by 17
Self-citationSuzuki, K., Okabe, K., Sakamoto, R., & Sakamoto, D. (2015) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/2815585.2815728 · Cited by 5
Research works printed but not linked: 1
- 10.5555/2305276.2305297 · doi:10.5555/2305276.2305297
Cited by
Open Challenges of Blind People Using Smartphones
Rodrigues, A., Nicolau, H., Montague, K., Guerreiro, J., & Guerreiro, T. (2020) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2020.1768672 · Cited by 53
Self-citationA Systematic Survey on Android API Usage for Data-driven Analytics with Smartphones
Lee, H., Park, J., & Lee, U. (2022) · ACM Computing Surveys · doi:10.1145/3530814 · Cited by 33
Zhang, X., Tran, T., Sun, Y., Culhane, I., Jain, S., Fogarty, J., & Mankoff, J. (2018) · ASSETS '18 · doi:10.1145/3234695.3236349 · Cited by 30
“Hybrid-Brailler [31] combined physical and gestural interaction to provide fast and accurate Braille input.”
BackgroundThe Design Space of Nonvisual Word Completion
Nicolau, H., Rodrigues, A., Santos, A., Guerreiro, T., Montague, K., & Guerreiro, J. (2019) · Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3308561.3353786 · Cited by 21
Self-citationMathis, F., & Schöning, J. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713486 · Cited by 22
Metadata
- Authors
- Trindade, D., Rodrigues, A., Guerreiro, T., & Nicolau, H.
- Affiliations
- Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento (PT)
- University of Lisbon (PT)
- Venue
- Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2018-04-19
- Pages
- 1-12
- OpenAlex
- W2796004174
- Semantic Scholar
- c88e15d64a455eac71eb3d4a2d74a78f47632d07
- Cited by
- 19
- References
- 29
- Citations by year
- 2026: 1 · 2025: 3 · 2024: 2 · 2022: 3 · 2021: 1 · 2020: 4 · 2019: 3 · 2018: 2
- FWCI
- 4.29
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- Funders
- Fundação para a Ciência e Tecnologia (UID/CEC/50021/2013, UID/CEC/00408/2013)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- Braille input, gesture-based interaction, touchscreen devices, text entry, text editing, tactile feedback, input accuracy, entry speed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.