Multimodal collaborative handwriting training for visually-impaired people
Abstract
"McSig" is a multimodal teaching and learning environ-ment for visually-impaired students to learn character shapes, handwriting and signatures collaboratively with their teachers. It combines haptic and audio output to realize the teacher's pen input in parallel non-visual modalities. McSig is intended for teaching visually-impaired children how to handwrite characters (and from that signatures), something that is very difficult without visual feedback. We conducted an evaluation with eight visually-impaired children with a pretest to assess their current skills with a set of character shapes, a training phase using McSig and then a post-test of the same character shapes to see if there were any improvements. The children could all use McSig and we saw significant improvements in the character shapes drawn, particularly by the completely blind children (many of whom could draw almost none of the characters before the test). In particular, the blind participants all expressed enjoyment and excitement about the system and using a computer to learn to handwrite.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
It is very difficult for blind users to learn and use handwriting.
“it is very difficult for them to learn and use handwriting [13].”
From Designing a text entry multimodal keypad for blind users of touchscreen mobile phones (2014) · cites this paper as [13]
Cites
Haptic guidance: experimental evaluation of a haptic training method for a perceptual motor skill
Feygin, D., Keehner, M., & Tendick, R. (2003) · Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002 · doi:10.1109/haptic.2002.998939 · Cited by 394 · see citing works
Evaluation of multimodal graphs for blind people
Yu, W., & Brewster, S. (2003) · Universal Access in the Information Society · doi:10.1007/s10209-002-0042-6 · Cited by 120 · cited 5× · see citing works
“Work from Crossan and Brewster [4] indicated that multimodal playback of a shape could help visually-impaired people to recreate the shape.”
BackgroundInfluentialSelf-citation
Flagged first, then by citations
Cited by
Sorted by citations
Supporting Novice to Expert Transitions in User Interfaces
Cockburn, A., Gutwin, C., Scarr, J., & Malacria, S. (2015) · ACM Computing Surveys · doi:10.1145/2659796 · Cited by 193 · see citing works
Branham, S. M., & Kane, S. K. (2015) · Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility - ASSETS '15 · doi:10.1145/2700648.2809864 · Cited by 169 · see citing works
Collaborative Accessibility: How Blind and Sighted Companions Co-Create Accessible Home Spaces
Branham, S. M., & Kane, S. K. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702511 · Cited by 159 · see citing works
No-Look Notes: Accessible Eyes-Free Multi-touch Text Entry
Bonner, M. N., Brudvik, J. T., Abowd, G. D., & Edwards, W. K. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-12654-3_24 · Cited by 154 · see citing works
Access overlays: improving non-visual access to large touch screens for blind users
Kane, S. K., Morris, M. R., Perkins, A. Z., Wigdor, D., Ladner, R. E., & Wobbrock, J. O. (2011) · Proceedings of the 24th annual ACM symposium on User interface software and technology · doi:10.1145/2047196.2047232 · Cited by 127 · see citing works
Analyzing visually impaired people’s touch gestures on smartphones
Buzzi, M. C., Buzzi, M., Leporini, B., & Trujillo, A. (2017) · Multimedia Tools and Applications · doi:10.1007/s11042-016-3594-9 · Cited by 53 · see citing works
Vincenzi, B., Taylor, A. S., & Stumpf, S. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3449143 · Cited by 48 · see citing works
Designing a text entry multimodal keypad for blind users of touchscreen mobile phones
Buzzi, M. C., Buzzi, M., Leporini, B., & Trujillo, A. (2014) · Proceedings of the 16th international ACM SIGACCESS conference on Computers & accessibility - ASSETS '14 · doi:10.1145/2661334.2661354 · Cited by 28 · see citing works
A Systematic Review of Ability-diverse Collaboration through Ability-based Lens in HCI
Xiao, L., Bandukda, M., Angerbauer, K., Lin, W., Bhatnagar, T., Sedlmair, M., & Holloway, C. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3641930 · Cited by 26 · see citing works
Lin, W., Li, T., Liu, L., & Zhu, Q. (2023) · Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544549.3585819 · Cited by 3 · see citing works
- Authors
- Plimmer, B., Crossan, A., Brewster, S. A., & Blagojevic, R.
- Affiliations
- University of Auckland (NZ)
- University of Glasgow (GB)
- Venue
- Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2008-04-06
- Pages
- 393-402
- OpenAlex
- W2062709156
- Cited by
- 84
- References
- 2
- Citations by year
- 2026: 1 · 2025: 4 · 2024: 7 · 2023: 7 · 2022: 1 · 2021: 4 · 2020: 4 · 2019: 1 · 2018: 7 · 2017: 5 · 2016: 4 · 2015: 4 · 2014: 4 · 2013: 6 · 2012: 3
- FWCI
- 14.21
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- ResearchOnline (Glasgow Caledonian University) (acceptedVersion)
- ResearchSpace (University of Auckland) (submittedVersion)
- Funders
- University of Auckland
- Engineering and Physical Sciences Research Council
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Keywords
- visually impaired students, handwriting practice, multimodal learning environments, haptic feedback, audio feedback, blind users, cooperative learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
