Conversation with a Chatbot before an Online EFL Group Discussion and the Effects on Critical Thinking
Open accessThe DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
This study investigated learners of English as a foreign language (EFL) who engaged in a group discussion and saw how their discussion was affected by a preceding conversation with a chatbot. The chatbot was designed to reflect the Socratic inquiry method based on Eliza, a computer program developed for psychotherapy. Two case studies were conducted, and 130 university students (Case 1: n=63; Case 2: n=67) were divided into experimental and control groups and observed. Case 1 served as the pilot study and focused on the effects of a chatbot conversation on the discussion; the critical thinking, satisfaction, and number of conversations in experimental and control groups were analyzed. Case 2 examined the difference in critical thinking pre- and post-discussion in both groups. Case 1 showed that a preceding conversation with a chatbot might lead to an increase in the number of contributions that students made to conversations and could increase the number of conversations in which the students participated. Case 2 results showed that pre-discussion with a chatbot could increase the students’ awareness of critical thinking and enable them to form inquiring mindsets.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
E-Learning in the 21st Century
Garrison, D. R. (2011) · doi:10.4324/9780203838761 · Cited by 549
Yang, Y.-T. C., Newby, T. J., & Bill, R. L. (2005) · American Journal of Distance Education · doi:10.1207/s15389286ajde1903_4 · Cited by 296
Cited by
Huang, W., Hew, K. F., & Fryer, L. K. (2022) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12610 · Cited by 830
Chen, Y., Jensen, S., Albert, L. J., Gupta, S., & Lee, T. (2023) · Information Systems Frontiers · doi:10.1007/s10796-022-10291-4 · Cited by 685
“For example, Goda et al. (2014) designed a chatbot to supplement instruction for English foreign language learners and found that conversations with a chatbot before learning sessions increased users’ engagement and performance.”
BackgroundAre We There Yet? - A Systematic Literature Review on Chatbots in Education
Wollny, S., Schneider, J., Di Mitri, D., Weidlich, J., Rittberger, M., & Drachsler, H. (2021) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2021.654924 · Cited by 557
Chatbot learning partners: connecting learning experiences, interest and competence
Fryer, L. K., Nakao, K., & Thompson, A. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2018.12.023 · Cited by 470
Fryer, L. K., Ainley, M., Thompson, A., Gibson, A., & Sherlock, Z. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2017.05.045 · Cited by 448
Chocarro, R., Cortiñas, M., & Marcos-Matás, G. (2023) · Educational Studies · doi:10.1080/03055698.2020.1850426 · Cited by 343
“Goda et al. (2014) found higher quality debates when students have had a previous conversation about the topic with an online agent.”
BackgroundEssel, H. B., Vlachopoulos, D., Essuman, A. B., & Amankwa, J. O. (2024) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2023.100198 · Cited by 296
“This finding is invariant with prior studies that have illustrated a positive nexus between prior critical thinking skills and the effectiveness of interventions to improve critical thinking (Hapsari & Wu, 2022 & Goda et al., 2014).”
ResultDeng, X., & Yu, Z. (2023) · Sustainability · doi:10.3390/su15042940 · Cited by 298
“(2014) [61] 63 (31/32) 30 min Partner Language Critical thinking and learning achievement”
BackgroundMethodArtificial Intelligence (AI) Chatbot as Language Learning Medium: An inquiry
Haristiani, N. (2019) · Journal of Physics: Conference Series · doi:10.1088/1742-6596/1387/1/012020 · Cited by 268
Effects of chatbot-assisted in-class debates on students’ argumentation skills and task motivation
Guo, K., Zhong, Y., Li, D., & Chu, S. K. W. (2023) · Computers & Education · doi:10.1016/j.compedu.2023.104862 · Cited by 188
Effect of chatbot-assisted language learning: A meta-analysis
Zhang, S., Shan, C., Lee, J. S. Y., Che, S., & Kim, J. H. (2023) · Education and Information Technologies · doi:10.1007/s10639-023-11805-6 · Cited by 80
Al-Abdullatif, A. M., Al-Dokhny, A. A., & Drwish, A. M. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1129070 · Cited by 80
Wang, F., Cheung, A. C. K., Neitzel, A. J., & Chai, C. S. (2025) · Review of Educational Research · doi:10.3102/00346543241255621 · Cited by 64
Influence of artificial intelligence tools on higher order thinking skills: a meta-analysis
Ilgun Dibek, M., Sahin Kursad, M., & Erdogan, T. (2025) · Interactive Learning Environments · doi:10.1080/10494820.2024.2402028 · Cited by 45
“In a similar vein, Goda et al. (2014) conducted an experimental research to investigate EFL students ’ critical thinking skills after their preceding conversation with Chatbot.”
Huang, H.-W., Teng, D. C.-E., & Tiangco, J. A. N. Z. (2025) · Journal of Science Education and Technology · doi:10.1007/s10956-024-10179-9 · Cited by 23
Zhang, Y., Lai, X., Yi, S., & Lu, Y. (2025) · Education and Information Technologies · doi:10.1007/s10639-024-13190-0 · Cited by 18
“For instance, some previous research showed that Chatbot positively impact students critical thinking (Chang et al., 2022; Goda et al., 2014; Liu et al., 2022).”
Unpacking the Rejection of L2 Students Toward ChatGPT-Generated Feedback: An Explanatory Research
Chen (陈子淇), Z., Wei (韦卫), W., Zhu (祝新华), X., & Yao (姚远), Y. (2026) · ECNU Review of Education · doi:10.1177/20965311241305140 · Cited by 16
“According to Goda et al. ’ s (2014) study, students have reported feeling that computer-generated voices are unnatural compared to human voices, ultimately limiting their engagement with the immersive learning environment.”
Metadata
- Authors
- Goda, Y., Yamada, M., Matsukawa, H., Hata, K., & Yasunami, S.
- Venue
- The Journal of Information and Systems in Education
- Published
- 2014
- Volume
- 13
- Issue
- 1
- Pages
- 1-7
- ISSN
- 1348-236X (ISSN-L)
- 2186-3679
- OpenAlex
- W2077201361
- Cited by
- 102
- References
- 2
- FWCI
- 7.20
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.