Chatbot Experiences of Informal Language Learners: A Sentiment Analysis
Open accessAbstract
In 2016, a number of language applications released chatbots to complement their programmes. Used primarily in informal learning settings, chatbots enable language learners to engage in conversational speaking practice, which can be perceived as less threatening than face-to-face interactions with native speakers. This study takes a closer look at four second language (L2) chatbots—Duolingo, Eggbun, Memrise, and Mondly—and analyses the experiences which informal language learners expressed on various online platforms (e.g., Duolingo forum, Memrise community, Reddit). Results indicate a degree of curiosity and a willingness to engage in conversation with chatbots. However, learners expressed frustration if the dialogues did not correspond to their learning goals or if they were excluded from using the bots because of technical or payment issues, or discontinuation of services.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Some users reported feeling disconnected and frustrated with the lack of genuine human interaction, and felt the chatbot's responses were robotic and impersonal, leading to a sense of isolation.
“It was also reported feeling disconnected and frustrated with the lack of genuine human interaction.Some users expressed that the chatbot's responses, although based on evidence-based techniques, felt robotic and impersonal, leading to a sense of isolation [134].”
From Ethical Framework for Harnessing the Power of AI in Healthcare and Beyond (2024) · cites this paper as [134]
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414 · see citing works
Comparison of convenience sampling and purposive sampling
Etikan, I. (2016) · American Journal of Theoretical and Applied Statistics · doi:10.11648/j.ajtas.20160501.11 · Cited by 11,412 · see citing works
ELIZA—a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1966) · Communications of the ACM · doi:10.1145/365153.365168 · Cited by 4,452 · see citing works
It's only a computer: virtual humans increase willingness to disclose
Lucas, G. M., Gratch, J., King, A., & Morency, L.-P. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.04.043 · Cited by 977 · see citing works
Sentiment Analysis of Short Informal Texts
Kiritchenko, S., Zhu, X., & Mohammad, S. M. (2014) · Journal of Artificial Intelligence Research · doi:10.1613/jair.4272 · Cited by 884 · see citing works
Sentiment analysis: A combined approach
Prabowo, R., & Thelwall, M. A. (2009) · Journal of Informetrics · doi:10.1016/j.joi.2009.01.003 · Cited by 806 · see citing works
A survey on sentiment analysis challenges
Hussein, D. M. E.-D. M. (2016) · Journal of King Saud University - Engineering Sciences · doi:10.1016/j.jksues.2016.04.002 · Cited by 694 · see citing works
Technology and the future of language teaching
Kessler, G. (2018) · Foreign Language Annals · doi:10.1111/flan.12318 · Cited by 529 · see citing works
Dale, R. (2016) · Natural Language Engineering · doi:10.1017/s1351324916000243 · Cited by 488 · see citing works
Chatbot learning partners: connecting learning experiences, interest and competence
Fryer, L. K., Nakao, K., & Thompson, A. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2018.12.023 · Cited by 470 · see citing works
Fryer, L. K., Ainley, M., Thompson, A., Gibson, A., & Sherlock, Z. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2017.05.045 · Cited by 448 · see citing works
Friend or foe? Google Translate in language for academic purposes
Groves, M. J., & Mundt, K. (2014) · English for Specific Purposes · doi:10.1016/j.esp.2014.09.001 · Cited by 258 · see citing works
Bots as language learning tools
Fryer, L. K., & Carpenter, R. (2006) · Language learning & technology · doi:10.64152/10125/44068 · Cited by 243 · see citing works
Using google translate in EFL drafts: a preliminary investigation
Tsai, S.-C. (2019) · Computer Assisted Language Learning · doi:10.1080/09588221.2018.1527361 · Cited by 197 · see citing works
Landers, R. N., Brusso, R. C., Cavanaugh, K. J., & Collmus, A. B. (2016) · Psychological Methods · doi:10.1037/met0000081 · Cited by 195 · see citing works
Smartphones and language learning
Godwin‐Jones, R. (2017) · Language learning & technology · doi:10.64152/10125/44607 · Cited by 154 · see citing works
The Handbook of Informal Language Learning
(2019) · Wiley eBooks · doi:10.1002/9781119472384 · Cited by 153 · see citing works
The linguistic accuracy of chatbots: usability from an ESL perspective
Coniam, D. (2014) · Text and Talk · doi:10.1515/text-2014-0018 · Cited by 129 · see citing works
Chiu, T.-L., Liou, H., & Yeh, Y. (2007) · Computer Assisted Language Learning · doi:10.1080/09588220701489374 · Cited by 127 · see citing works
Using Learning Analytics to Understand the Design of an Intelligent Language Tutor – Chatbot Lucy
Fei, Y., & Petrina, S. (2013) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2013.041117 · Cited by 93 · see citing works
Predictive Analytics with Microsoft Azure Machine Learning
Barga, R., Fontama, V., & Tok, W. H. (2015) · Apress eBooks · doi:10.1007/978-1-4842-1200-4 · Cited by 83 · see citing works
Evaluating the language resources of chatbots for their potential in English as a second language
Coniam, D. (2008) · ReCALL · doi:10.1017/s0958344008000815 · Cited by 75 · see citing works
Lange, P. G. (2018) · The International Encyclopedia of Media Literacy · doi:10.1002/9781118978238.ieml0090 · Cited by 66 · see citing works
Lai, C. (2019) · Annual Review of Applied Linguistics · doi:10.1017/s0267190519000035 · Cited by 54 · see citing works
Exploring the potential of a 360° video application for foreign language learning
Berns, A., Mota, J. M., Ruiz‐Rube, I., & Dodero, J. M. (2018) · Ninth International Conference on Technological Ecosystems for Enhancing Multiculturality (TEEM'21) · doi:10.1145/3284179.3284309 · Cited by 51 · see citing works
Transforming Teaching: New Skills for Online Language Learning Spaces
Stickler, U., & Hampel, R. (2015) · Palgrave Macmillan UK eBooks · doi:10.1057/9781137412263_5 · Cited by 49 · see citing works
AI-based chatterbots and spoken English teaching: a critical analysis
Sha, G. (2009) · Computer Assisted Language Learning · doi:10.1080/09588220902920284 · Cited by 43 · see citing works
Veletsianos, G., Kimmons, R. M., Larsen, R., Dousay, T. A., & Lowenthal, P. R. (2018) · PLoS ONE · doi:10.1371/journal.pone.0197331 · Cited by 43 · see citing works
Let's Chat: A conversational dialogue system for second language practice
Stewart, I. A. D., & File, P. E. (2007) · Computer Assisted Language Learning · doi:10.1080/09588220701331386 · Cited by 32 · see citing works
CCDST: A free Canadian climate data scraping tool
Bonifacio, C. M. T., Barchyn, T. E., Hugenholtz, C. H., & Kienzle, S. W. (2014) · Computers & Geosciences · doi:10.1016/j.cageo.2014.10.010 · Cited by 26 · see citing works
Influence of Language Learning Anxiety on L2 Speaking and Writing of Filipino Engineering Students
Macayan, J. V., Quinto, E. J. M., Otsuka, J. C., et al. (2018) · 3L The Southeast Asian Journal of English Language Studies · doi:10.17576/3l-2018-2401-04 · Cited by 26 · see citing works
An Evaluation of Chatbots as Software Aids to Learning English as a Second Language
Coniam, D. (2008) · The EuroCALL Review · doi:10.4995/eurocall.2008.16353 · Cited by 16 · see citing works
Investor classification and sentiment analysis
Chatterjee, A., & Perrizo, W. (2016) · IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM) · doi:10.1109/asonam.2016.7752388 · Cited by 14 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Ethical Framework for Harnessing the Power of AI in Healthcare and Beyond
Nasir, S., Khan, R. A., & Bai, S. (2024) · IEEE Access · doi:10.1109/access.2024.3369912 · Cited by 152 · see citing works
- Authors
- Alm, A., & Nkomo, L. M.
- Affiliations
- University of Otago (NZ)
- Venue
- Research Anthology on Implementing Sentiment Analysis Across Multiple Disciplines
- Publisher
- IGI Global
- Published
- 2022-06-10
- Pages
- 933-948
- OpenAlex
- W4286593277
- Cited by
- 11
- References
- 33
- Citations by year
- 2025: 3 · 2024: 4 · 2023: 2 · 2022: 2
- FWCI
- 7.14
- Type
- book chapter
- Language
- ng
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- IGI Global eBooks (publishedVersion, cc-by)
- Topics
- Physical Sciences › Computer Science › Information Systems › Mobile Learning in Education
- Social Sciences › Arts and Humanities › Language and Linguistics › EFL/ESL Teaching and Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- chatbots, second language acquisition, informal language learning, student experience, Duolingo, Memrise, language learning apps, learner frustration
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review