Signing on the tactile line: A multimodal system for teaching handwriting to blind children
Open accessThe DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
We present McSig, a multimodal system for teaching blind children cursive handwriting so that they can create a personal signature. For blind people handwriting is very difficult to learn as it is a near-zero feedback activity that is needed only occasionally, yet in important situations; for example, to make an attractive and repeatable signature for legal contracts. McSig aids the teaching of signatures by translating digital ink from the teacher's stylus gestures into three non-visual forms: (1) audio pan and pitch represents the x and y movement of the stylus; (2) kinaesthetic information is provided to the student through a force-feedback haptic pen that mimics the teacher's stylus movement; and (3) a physical tactile line on the writing sheet is created by the haptic pen. McSig has been developed over two major iterations of design, usability testing and evaluation. The final step of the first iteration was a short evaluation with eight visually impaired children. The results suggested that McSig had the highest potential benefit for congenitally and totally blind children and also indicated some areas where McSig could be enhanced. The second prototype incorporated significant modifications to the system, improving the audio, tactile and force-feedback. We then ran a detailed, longitudinal evaluation over 14 weeks with three of the congenitally blind children to assess McSig's effectiveness in teaching the creation of signatures. Results demonstrated the effectiveness of McSig—they all made considerable progress in learning to create a recognizable signature. By the end of ten lessons, two of the children could form a complete, repeatable signature unaided, the third could do so with a little verbal prompting. Furthermore, during this project, we have learnt valuable lessons about providing consistent feedback between different communications channels (by manual interactions, haptic device, pen correction) that will be of interest to others developing multimodal systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Evaluation of multimodal graphs for blind people
Yu, W., & Brewster, S. (2003) · Universal Access in the Information Society · doi:10.1007/s10209-002-0042-6 · Cited by 120
Self-citationMultimodal collaborative handwriting training for visually-impaired people
Plimmer, B., Crossan, A., Brewster, S. A., & Blagojevic, R. (2008) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1357054.1357119 · Cited by 84
Self-citation
Cited by
Oh, U., Kane, S. K., & Findlater, L. (2013) · ASSETS '13 · doi:10.1145/2513383.2513455 · Cited by 68
Stearns, L., Du, R., Oh, U., Wang, Y., Findlater, L., Chellappa, R., & Froehlich, J. E. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-16199-0_43 · Cited by 27
Audio-Based Feedback Techniques for Teaching Touchscreen Gestures
Oh, U., Branham, S., Findlater, L., & Kane, S. K. (2015) · ACM Transactions on Accessible Computing · doi:10.1145/2764917 · Cited by 18
“McSig [Plimmer et al. 2011] used this same combination of sonification and force feedback to teach handwriting to blind children, while SemFeel [Yatani and Truong 2009], SpaceSense [Yatani et al. 2012], and work from Noble and Martin [Noble and Martin 2006] used primarily tactile feedback to…”
Background
Metadata
- Authors
- Plimmer, B., Reid, P., Blagojevic, R., Crossan, A., & Brewster, S.
- Venue
- ACM Transactions on Computer-Human Interaction
- Published
- 2011-07
- Volume
- 18
- Issue
- 3
- Pages
- 1-29
- ISSN
- 1073-0516 (ISSN-L)
- 1557-7325
- OpenAlex
- W2113598159
- Cited by
- 45
- References
- 2
- FWCI
- 1.21
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Signing on the tactile line: A multimodal system for teaching handwriting to blind children. https://app.cochat.ai/papers/10.1145/1993060.1993067
- The paper
- Plimmer, B., Reid, P., Blagojevic, R., Crossan, A., & Brewster, S. (2011). Signing on the tactile line: A multimodal system for teaching handwriting to blind children. ACM Transactions on Computer-Human Interaction. https://doi.org/10.1145/1993060.1993067
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.