Improving literacy in developing countries using speech recognition-supported games on mobile devices
The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
Learning to read in a second language is challenging, but highly rewarding. For low-income children in developing countries, this task can be significantly more challenging because of lack of access to high-quality schooling, but can potentially improve economic prospects at the same time. A synthesis of research findings suggests that practicing recalling and vocalizing words for expressing an intended meaning could improve word reading skills - including reading in a second language - more than silent recognition of what the given words mean. Unfortunately, many language learning software do not support this instructional approach, owing to the technical challenges of incorporating speech recognition support to check that the learner is vocalizing the correct word. In this paper, we present results from a usability test and two subsequent experiments that explore the use of two speech recognition-enabled mobile games to help rural children in India read words with understanding. Through a working speech recognition prototype, we discuss two major contributions of this work: first, we give empirical evidence that shows the extent to which productive training (i.e. vocalizing words) is superior to receptive vocabulary training, and discuss the use of scaffolding hints to ""unpack"" factors in the learner's linguistic knowledge that may impact reading. Second, we discuss what our results suggest for future research in HCI.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
What Video Games Have to Teach Us about Learning and Literacy
(2004) · Education + Training · doi:10.1108/et.2004.00446dae.002 · Cited by 6,674
Reading Ability: Lexical Quality to Comprehension
Perfetti, C. (2007) · Scientific Studies of Reading · doi:10.1080/10888430701530730 · Cited by 2,095
SWAIN, M., & LAPKIN, S. (1995) · Applied Linguistics · doi:10.1093/applin/16.3.371 · Cited by 1,407 · cited 1×
“Similarly, vocalization helps her realize that she either lacks this knowledge, thus prompting her to acquire it, or that she has this knowledge, thus enabling her to further consolidate it [9, 36].”
BackgroundThe Psycholinguistics of the Output Hypothesis
de Bot, K. (1996) · Language Learning · doi:10.1111/j.1467-1770.1996.tb01246.x · Cited by 236 · cited 3×
“More than half of the world speaks at least two languages [9], to the extent that “bilingualism and multilingualism are a normal and unremarkable necessity to everyday life for the majority of the world‟s population” [12].”
Background
Cited by
Nye, B. D. (2015) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-014-0028-6 · Cited by 259
Equity Beyond Bias in Language Technologies for Education
Mayfield, E., Madaio, M., Prabhumoye, S., Gerritsen, D., McLaughlin, B., Dixon-Román, E., & Black, A. W. (2019) · Proceedings of the Fourteenth Workshop on Innovative Use of NLP for Building Educational Applications · doi:10.18653/v1/w19-4446 · Cited by 62
“For early readers, speech recognition systems have been developed for children’s voice and language (Gerosa et al., 2009) and are used to improve students’ early reading skills (Mostow et al., 2003), or for speech-based vocabulary practice (Kumar et al., 2012).”
BackgroundRevisiting “Hole in the Wall” Computing: Private Smart Speakers and Public Slum Settings
Robinson, S., Pearson, J., Ahire, S., Ahirwar, R., Bhikne, B., Maravi, N., & Jones, M. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174072 · Cited by 37
Leaving the Butler Behind: The Future of Role Reproduction in CUI
McMillan, D., & Jaber, R. (2021) · CUI 2021 - 3rd Conference on Conversational User Interfaces · doi:10.1145/3469595.3469606 · Cited by 8
“…with interaction paradigms which revolve around verbalising commands without the expectation of (much of) a vocal response, or those which monitor how, when, and what people say for language training [11, 29, 35], speech therapy [3, 12, 13, 18, 36, 39], or medial assessment [38, 62] purposes.”
Background
Metadata
- Authors
- Kumar, A., Reddy, P., Tewari, A., Agrawal, R., & Kam, M.
- Venue
- Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2012-05-05
- Pages
- 1149-1158
- OpenAlex
- W1988986693
- Cited by
- 66
- References
- 4
- FWCI
- 7.58
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.