CoChat
Sign Up
Cited by 69English Language Learning and TeachingEFL/ESL Teaching and LearningArtificial Intelligence in Education

The use of artificially intelligent chatbots in English language learning: A systematic meta-synthesis study of articles published between 2010 and 2024

Open access
Koç, Fatma Şeyma, Savaş, Perihan·2025·ReCALL
DOI 10.1017/s0958344024000168
Open this paper in CoChat — free account

Abstract

In this qualitative systematic meta-synthesis study, 57 studies from the international literature published between 2010 and 2024 on the use of voice-based artificially intelligent chatbots in English language learning were analyzed. The present study aimed to explore the most recent studies on this topic by investigating the theoretical frameworks, methodological and technological properties, user reports of chatbot usage experience, and pedagogical implementations. It sought to identify research and implementation trends for voice-based chatbots via qualitative data analysis methods. Based on the reviewed studies, this paper presents data-based pedagogical implications that align with the latest voice-based AI chatbot research trends.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1017/s0958344024000168

Cites

12 of 12 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 73

  1. Annamalai, N., Eltahir, M. E., Zyoud, S. H., Soundrarajan, D., Zakarneh, B. & Al Salhi, N. R. (2023) Exploring English language learning via Chabot: A case study from a self determination theory perspective. Computers and Education: Artificial Intelligence, 5: Article 100148. https://doi.org/10.1016/j.caeai.2023.100148 CrossRefGoogle Scholar · DOI
  2. Ayedoun, E., Hayashi, Y. & Seta, K. (2019b) L2 learners’ preferences of dialogue agents: A key to achieve adaptive motivational support? In Isotani, S., Millán, E., Ogan, A., Hastings, P., McLaren, B. & Luckin, R. (eds.), Artificial intelligence in education: 20th International Conference, AIED 2019, Chicago, IL, USA, June 25-20, 2019: Proceedings, Part II. Cham: Springer International Publishing, 19–23.CrossRefGoogle Scholar
  3. Belda-Medina, J. & Calvo-Ferrer, J. R. (2022) Using chatbots as AI conversational partners in language learning. Applied Sciences, 12(17): Article 8427. https://doi.org/10.3390/app12178427 CrossRefGoogle Scholar · DOI · Paper page
  4. Belda-Medina, J. & Kokošková, V. (2023) Integrating chatbots in education: Insights from the chatbot-human interaction satisfaction model (CHISM). International Journal of Educational Technology in Higher Education, 20: Article 62. https://doi.org/10.1186/s41239-023-00432-3 CrossRefGoogle Scholar · DOI
  5. Çakmak, F. (2022) Chatbot-human interaction and its effects on EFL students’ L2 speaking performance and anxiety. Novitas-ROYAL, 16(2): 113–131.Google Scholar
  6. Caldarini, G., Jaf, S. & McGarry, K. (2022) A literature survey of recent advances in chatbots. Information, 13(1): Article 41. https://doi.org/10.3390/INFO13010041 CrossRefGoogle Scholar · DOI · Paper page
  7. Chen, H. H.-J., Yang, C. T.-Y. & Lai, K. K.-W. (2023) Investigating college EFL learners’ perceptions toward the use of Google Assistant for foreign language learning. Interactive Learning Environments, 31(3): 1335–1350. https://doi.org/10.1080/10494820.2020.1833043 CrossRefGoogle Scholar · DOI
  8. Dizon, G. (2020) Evaluating intelligent personal assistants for L2 listening and speaking development. Language Learning & Technology, 24(1): 16–26. https://doi.org/10125/44705 Google Scholar
  9. Dizon, G. & Tang, D. (2020) Intelligent personal assistants for autonomous second language learning: An investigation of Alexa. The JALT CALL Journal, 16(2): 107–120. https://doi.org/10.29140/jaltcall.v16n2.273 CrossRefGoogle Scholar · DOI
  10. Ebadi, S. & Amini, A. (2024) Examining the roles of social presence and human-likeness on Iranian EFL learners’ motivation using artificial intelligence technology: A case of CSIEC chatbot. Interactive Learning Environments, 32(2): 655–673. https://doi.org/10.1080/10494820.2022.2096638 CrossRefGoogle Scholar · DOI
  11. Ellis, R. (2003) Task-based language learning and teaching. Oxford: Oxford University Press.Google Scholar
  12. El Shazly, R. (2021) Effects of artificial intelligence on English speaking anxiety and speaking performance: A case study. Expert Systems, 38(3): Article e12667. https://doi.org/10.1111/exsy.12667 CrossRefGoogle Scholar · DOI
  13. Ericsson, E., Lundin, J. & Sofkova Hashemi, S. (2023) From deadpan machine to relating socially: Middle school students’ experiences speaking English with embodied conversational agents. Journal of Research on Technology in Education. Advance online publication. https://doi.org/10.1080/15391523.2023.2213902 CrossRefGoogle Scholar · DOI
  14. Ericsson, E., Sofkova Hashemi, S. & Lundin, J. (2023) Fun and frustrating: Students’ perspectives on practicing speaking English with virtual humans. Cogent Education, 10(1): Article 2170088. https://doi.org/10.1080/2331186X.2023.2170088 CrossRefGoogle Scholar · DOI
  15. Finfgeld, D. L. (2003) Metasynthesis: The state of the art—So far. Qualitative Health Research, 13(7): 893–904. https://doi.org/10.1177/1049732303253462 CrossRefGoogle ScholarPubMed · DOI
  16. Fishbein, M. & Ajzen, I. (1975) Belief, attitude, intention, and behavior: An introduction to theory and research. Reading: Addison-Wesley.Google Scholar
  17. Forsyth, C. M., Luce, C., Zapata-Rivera, D., Jackson, G. T., Evanini, K. & So, Y. (2019) Evaluating English language learners’ conversations: Man vs. machine. Computer Assisted Language Learning, 32(4): 398–417. https://doi.org/10.1080/09588221.2018.1517126 CrossRefGoogle Scholar · DOI
  18. Fryer, L. K., Ainley, M., Thompson, A., Gibson, A. & Sherlock, Z. (2017) Stimulating and sustaining interest in a language course: An experimental comparison of chatbot and human task partners. Computers in Human Behavior, 75: 461–468. https://doi.org/10.1016/j.chb.2017.05.045 CrossRefGoogle Scholar · DOI · Paper page
  19. Fryer, L. K., Nakao, K. & Thompson, A. (2019) Chatbot learning partners: Connecting learning experiences, interest and competence. Computers in Human Behavior, 93: 279–289. https://doi.org/10.1016/j.chb.2018.12.023 CrossRefGoogle Scholar · DOI · Paper page
  20. Fryer, L. K., Thompson, A., Nakao, K., Howarth, M. & Gallacher, A. (2020) Supporting self-efficacy beliefs and interest as educational inputs and outcomes: Framing AI and human partnered task experiences. Learning and Individual Differences, 80: Article 101850. https://doi.org/10.1016/j.lindif.2020.101850 CrossRefGoogle Scholar · DOI · Paper page
  21. Gardner, D. & Miller, L. (1999) Establishing self-access: From theory to practice. Cambridge: Cambridge University Press.Google Scholar
  22. Garrison, D. R. & Arbaugh, J. B. (2007) Researching the community of inquiry framework: Review, issues, and future directions. The Internet and Higher Education, 10(3): 157–172. https://doi.org/10.1016/j.iheduc.2007.04.001 CrossRefGoogle Scholar · DOI · Paper page
  23. Godwin-Jones, R. (2022) Chatbots in language learning: AI systems on the rise. In Arnbjörnsdóttir, B., Bédi, B., Bradley, L., Friðriksdóttir, K., Garðarsdóttir, H., Thouësny, S. & Whelpton, M. J. (eds.), Intelligent CALL, granular systems and learner data: Short papers from EUROCALL 2022. Voillans: Research-publishing.net, 124–128. https://doi.org/10.14705/rpnet.2022.61.1446 CrossRefGoogle Scholar · DOI
  24. Godwin-Jones, R. (2023) Smart devices and informal language learning. In Toffoli, D., Sockett, G. & Kusyk, M. (eds.), Language learning and leisure: Informal language learning in the digital age. Berlin: Walter de Gruyter GmbH, 89–113. https://doi.org/10.1515/9783110752441-004 Google Scholar · DOI
  25. Han, D.-E. (2020) The effects of voice-based AI chatbots on Korean EFL middle school students’ speaking competence and affective domains. Asia-Pacific Journal of Convergent Research Interchange, 6(7): 71–80. https://doi.org/10.47116/apjcri.2020.07.07 CrossRefGoogle Scholar · DOI · Paper page
  26. Han, J. & Lee, D. (2024) Research on the development of principles for designing elementary English speaking lessons using artificial intelligence chatbots. Humanities and Social Sciences Communications, 11: Article 212. https://doi.org/10.1057/s41599-024-02646-w CrossRefGoogle Scholar · DOI
  27. Hassani, K., Nahvi, A. & Ahmadi, A. (2016) Design and implementation of an intelligent virtual environment for improving speaking and listening skills. Interactive Learning Environments, 24(1): 252–271. https://doi.org/10.1080/10494820.2013.846265 CrossRefGoogle Scholar · DOI
  28. Hsu, L. (2022) To CALL or not to CALL: Empirical evidence from neuroscience. Computer Assisted Language Learning, 35(4): 792–815. https://doi.org/10.1080/09588221.2020.1750429 CrossRefGoogle Scholar · DOI
  29. Huang, W., Hew, K. F. & Fryer, L. K. (2022) Chatbots for language learning—Are they really useful? A systematic review of chatbot-supported language learning. Journal of Computer Assisted Learning, 38(1): 237–257. https://doi.org/10.1111/jcal.12610 CrossRefGoogle Scholar · DOI · Paper page
  30. Hwang, W.-Y., Guo, B.-C., Hoang, A., Chang, C.-C. & Wu, N.-T. (2022) Facilitating authentic contextual EFL speaking and conversation with smart mechanisms and investigating its influence on learning achievements. Computer Assisted Language Learning. Advance online publication. https://doi.org/10.1080/09588221.2022.2095406 CrossRefGoogle Scholar · DOI
  31. Jeon, J. (2022) Exploring a self-directed interactive app for informal EFL learning: A self-determination theory perspective. Education and Information Technologies, 27(4): 5767–5787. https://doi.org/10.1007/s10639-021-10839-y CrossRefGoogle Scholar · DOI
  32. Jeon, J., Lee, S. & Choe, H. (2023) Beyond ChatGPT: A conceptual framework and systematic review of speech-recognition chatbots for language learning. Computers & Education, 206: Article 104898. https://doi.org/10.1016/j.compedu.2023.104898 CrossRefGoogle Scholar · DOI
  33. Jeon, J., Lee, S. & Choi, S. (2023) A systematic review of research on speech-recognition chatbots for language learning: Implications for future directions in the era of large language models. Interactive Learning Environments. Advance online publication. https://doi.org/10.1080/10494820.2023.2204343 CrossRefGoogle Scholar · DOI · Paper page
  34. Ji, H., Han, I. & Ko, Y. (2023) A systematic review of conversational AI in language education: Focusing on the collaboration with human teachers. Journal of Research on Technology in Education, 55(1): 48–63. https://doi.org/10.1080/15391523.2022.2142873 CrossRefGoogle Scholar · DOI · Paper page
  35. Jia, J. (2009) CSIEC: A computer assisted English learning chatbot based on textual knowledge and reasoning. Knowledge-Based Systems, 22(4): 249–255. https://doi.org/10.1016/j.knosys.2008.09.001 CrossRefGoogle Scholar · DOI
  36. Johnson, W. L. (2019) Data-driven development and evaluation of Enskill English. International Journal of Artificial Intelligence in Education, 29(3): 425–457. https://doi.org/10.1007/s40593-019-00182-2 CrossRefGoogle Scholar · DOI
  37. Jonassen, D., Davidson, M., Collins, M., Campbell, J. & Haag, B. B. (1995) Constructivism and computer-mediated communication in distance education. American Journal of Distance Education, 9(2): 7–26. https://doi.org/10.1080/08923649509526885 CrossRefGoogle Scholar · DOI · Paper page
  38. Kim, H., Yang, H., Shin, D. & Lee, J. H. (2022) Design principles and architecture of a second language learning chatbot. Language Learning & Technology, 26(1): 1–18. http://hdl.handle.net/10125/73463 Google Scholar
  39. Kim, N.-Y. (2018) A study on chatbots for developing Korean college students’ English listening and reading skills. Journal of Digital Convergence, 16(8): 19–26. https://doi.org/10.14400/JDC.2018.16.8.019 Google Scholar · DOI
  40. Kim, N.-Y., Cha, Y. & Kim, H.-S. (2019) Future English learning: Chatbots and artificial intelligence. Multimedia-Assisted Language Learning, 22(3): 32–53. https://doi.org/10.15702/mall.2019.22.3.32 Google Scholar · DOI
  41. Kukulska-Hulme, A. & Lee, H. (2020) Intelligent assistants in language learning: An analysis of features and limitations. In Frederiksen, K.-M., Larsen, S., Bradley, L. & Thouësny, S. (eds.), CALL for widening participation: Short papers from EUROCALL 2020. Voillans: Research-publishing.net, 172–176. https://doi.org/10.14705/rpnet.2020.48.1184 CrossRefGoogle Scholar · DOI
  42. Lantolf, J. P., Thorne, S. L. & Poehner, M. E. (2014) Sociocultural theory and second language development. In VanPatten, B. & Williams, J. (eds.), Theories in second language acquisition: An introduction (2nd ed.). New York: Routledge, 207–226.Google Scholar
  43. Lee, K.-A. & Lim, S.-B. (2023) Designing a leveled conversational teachable agent for English language learners. Applied Sciences, 13(11): Article 6541. https://doi.org/10.3390/app13116541 Google Scholar · DOI
  44. Lee, S. & Jeon, J. (2022) Visualizing a disembodied agent: Young EFL learners’ perceptions of voice-controlled conversational agents as language partners. Computer Assisted Language Learning. Advance online publication. https://doi.org/10.1080/09588221.2022.2067182 CrossRefGoogle Scholar · DOI
  45. Li, K.-C., Chang, M. & Wu, K.-H. (2020) Developing a task-based dialogue system for English language learning. Education Sciences, 10(11): Article 306. https://doi.org/10.3390/educsci10110306 CrossRefGoogle Scholar · DOI
  46. Long, M. H. (1996) The role of the linguistic environment in second language acquisition. In Ritchie, W. C. & Bhatia, T. K. (eds.), Handbook of second language acquisition. New York: Academic Press, 413–468. https://doi.org/10.1016/B978-012589042-7/50015-3 Google Scholar · DOI · Paper page
  47. Lyster, R. & Sato, M. (2013) Skill acquisition theory and the role of practice in L2 development. In García Mayo, M. P., Gutierrez Mangado, M. J. & Martínez Adrián, M. (eds.), Contemporary approaches to second language acquisition. Amsterdam: John Benjamins, 71–92. https://doi.org/10.1075/aals.9.07ch4 CrossRefGoogle Scholar · DOI
  48. MacIntyre, P. D., Clément, R., Dörnyei, Z. & Noels, K. A. (1998) Conceptualizing willingness to communicate in a L2: A situational model of L2 confidence and affiliation. The Modern Language Journal, 82(4): 545–562. https://doi.org/10.1111/j.1540-4781.1998.tb05543.x CrossRefGoogle Scholar · DOI · Paper page
  49. Morton, H., Gunson, N. & Jack, M. (2012) Interactive language learning through speech-enabled virtual scenarios. Advances in Human-Computer Interaction, 2012: Article 389523. https://doi.org/10.1155/2012/389523 CrossRefGoogle Scholar · DOI
  50. Morton, H. & Jack, M. (2010) Speech interactive computer-assisted language learning: A cross-cultural evaluation. Computer Assisted Language Learning, 23(4): 295–319. https://doi.org/10.1080/09588221.2010.493524 CrossRefGoogle Scholar · DOI
  51. Moussalli, S. & Cardoso, W. (2020) Intelligent personal assistants: Can they understand and be understood by accented L2 learners? Computer Assisted Language Learning, 33(8): 865–890. https://doi.org/10.1080/09588221.2019.1595664 CrossRefGoogle Scholar · DOI
  52. Moussalli, S. & Cardoso, W. (2021) Intelligent personal assistants and L2 pronunciation development: Focus on English past -ed. In Zoghlami, N., Brudermann, C., Sarré, C., Grosbois, M., Bradley, L. & Thouësny, S. (eds.), CALL and professionalisation: Short papers from EUROCALL 2021. Voillans: Research-publishing.net, 226–231. https://doi.org/10.14705/rpnet.2021.54.1337 CrossRefGoogle Scholar · DOI
  53. Nass, C., Moon, Y., Fogg, B. J., Reeves, B. & Dryer, D. C. (1995) Can computer personalities be human personalities? International Journal of Human-Computer Studies, 43(2): 223–239. https://doi.org/10.1006/ijhc.1995.1042 CrossRefGoogle Scholar · DOI
  54. Park, H. (2022) Effects of virtual reality-based English learning on Korean university students’ speaking ability. Multimedia-Assisted Language Learning, 25(4): 93–119. https://doi.org/10.15702/mall.2022.25.4.93 Google Scholar · DOI
  55. Pérez, J. Q., Daradoumis, T. & Puig, J. M. M. (2020) Rediscovering the use of chatbots in education: A systematic literature review. Computer Applications in Engineering Education, 28(6): 1549–1565. https://doi.org/10.1002/cae.22326 CrossRefGoogle Scholar · DOI · Paper page
  56. Rassaei, E. (2023) The effects of text-based and audio-based dynamic glosses on L2 vocabulary learning: A dynamic assessment approach. The Language Learning Journal, 51(4): 509–522. https://doi.org/10.1080/09571736.2023.2213247 CrossRefGoogle Scholar · DOI
  57. Reinders, H. & White, C. (2016) 20 years of autonomy and technology: How far have we come and where to next? Language Learning & Technology, 20(2): 143–154. https://doi.org/10125/44466 Google Scholar
  58. Ryan, R. M. & Deci, E. L. (2017) Self-determination theory: Basic psychological needs in motivation, development, and wellness. New York: Guilford Press. https://doi.org/10.1521/978.14625/28806 CrossRefGoogle Scholar · DOI · Paper page
  59. Saini, M. & Shlonsky, A. (2012) Systematic synthesis of qualitative research. New York: Oxford University Press. https://doi.org/10.1093/acprof:oso/9780195387216.001.0001 CrossRefGoogle Scholar · DOI
  60. Schmidt, R. (1995) Consciousness and foreign language learning: A tutorial on the role of attention and awareness in learning. In Schmidt, R. (ed.), Attention and awareness in foreign language learning. Honolulu: University of Hawai‘i Mānoa, Second Language Teaching & Curriculum Center, 1–63.Google Scholar
  61. Sydorenko, T., Daurio, P. & Thorne, S. L. (2018) Refining pragmatically-appropriate oral communication via computer-simulated conversations. Computer Assisted Language Learning, 31(1–2): 157–180. https://doi.org/10.1080/09588221.2017.1394326 CrossRefGoogle Scholar · DOI
  62. Sydorenko, T., Smits, T. F. H., Evanini, K. & Ramanarayanan, V. (2019) Simulated speaking environments for language learning: Insights from three cases. Computer Assisted Language Learning, 32(1–2): 17–48. https://doi.org/10.1080/09588221.2018.1466811 CrossRefGoogle Scholar · DOI
  63. Tai, T.-Y. & Chen, H. H.-J. (2022) The impact of intelligent personal assistants on adolescent EFL learners’ listening comprehension. Computer Assisted Language Learning. Advance online article. https://doi.org/10.1080/09588221.2022.2040536 CrossRefGoogle Scholar · DOI · Paper page
  64. Thornberg, R. & Charmaz, K. (2014) Grounded theory and theoretical coding. In Flick, U. (ed.), The SAGE handbook of qualitative data analysis. London: SAGE Publications, 153–169. https://doi.org/10.4135/9781446282243.n11 CrossRefGoogle Scholar · DOI · Paper page
  65. Timpe-Laughlin, V. & Dombi, J. (2020) Exploring L2 learners’ request behavior in a multi-turn conversation with a fully automated agent. Intercultural Pragmatics, 17(2): 221–257. https://doi.org/10.1515/ip-2020-0010 CrossRefGoogle Scholar · DOI
  66. Timpe-Laughlin, V., Sydorenko, T. & Daurio, P. (2022) Using spoken dialogue technology for L2 speaking practice: What do teachers think? Computer Assisted Language Learning, 35(5–6), 1194–1217. https://doi.org/10.1080/09588221.2020.1774904 CrossRefGoogle Scholar · DOI
  67. Wang, X., Liu, Q., Pang, H., Tan, S. C., Lei, J., Wallace, M. P. & Li, L. (2023) What matters in AI-supported learning: A study of human-AI interactions in language learning using cluster analysis and epistemic network analysis. Computers & Education, 194: Article 104703. https://doi.org/10.1016/j.compedu.2022.104703 CrossRefGoogle Scholar · DOI
  68. Wang, X., Pang, H., Wallace, M. P., Wang, Q. & Chen, W. (2022) Learners’ perceived AI presences in AI-supported language learning: A study of AI as a humanized agent from community of inquiry. Computer Assisted Language Learning. Advance online article. https://doi.org/10.1080/09588221.2022.2056203 CrossRefGoogle Scholar · DOI
  69. Wu, C. H., Lam, H. Y., Kong, A. & Wong, W. L. H. (2023) The design and evaluation of a digital learning-based English chatbot as an online self-learning method. International Journal of Engineering Business Management, 15: 1–22. https://doi.org/10.1177/18479790231176372 CrossRefGoogle Scholar · DOI
  70. Xiao, F., Zhao, P., Sha, H., Yang, D. & Warschauer, M. (2023) Conversational agents in language learning. Journal of China Computer-Assisted Language Learning. Advance online publication. https://doi.org/10.1515/jccall-2022-0032 CrossRefGoogle Scholar · DOI
  71. Yang, C. T.-Y., Lai, S.-L. & Chen, H. H.-J. (2022) The impact of intelligent personal assistants on learners’ autonomous learning of second language listening and speaking. Interactive Learning Environments. Advance online publication. https://doi.org/10.1080/10494820.2022.2141266 CrossRefGoogle Scholar · DOI
  72. Yang, H., Kim, H., Lee, J. H. & Shin, D. (2022) Implementation of an AI chatbot as an English conversation partner in EFL speaking classes. ReCALL, 34(3): 327–343. https://doi.org/10.1017/S0958344022000039 CrossRefGoogle Scholar · DOI
  73. Zhai, C. & Wibowo, S. (2022) A systematic review on cross-culture, humor and empathy dimensions in conversational chatbots: The case of second language acquisition. Heliyon, 8(12): Article e12056. https://doi.org/10.1016/j.heliyon.2022.e12056 CrossRefGoogle ScholarPubMed · DOI

Cited by

Sorted by citations

Authors
Koç, F. Ş., & Savaş, P.
Affiliations
  • Akdeniz University (TR)
  • Middle East Technical University (TR)
ORCID
Venue
ReCALL
Publisher
Cambridge University Press (CUP)
Published
2024-05-27
Volume
37
Issue
1
Pages
4-21
ISSN
  • 0958-3440 (ISSN-L)
  • 1474-0109
DOI
10.1017/s0958344024000168
OpenAlex
W4399054209
Cited by
69
References
12
Citations by year
2026: 39 · 2025: 27 · 2024: 3
FWCI
26.02
Type
journal article
Language
en
Open access
Licence
Locations
  • ReCALL (publishedVersion, cc-by)
  • OpenMETU (Middle East Technical University) (submittedVersion, cc-by-nc-nd)
Topics
  • Physical Sciences › Computer Science › Information Systems › English Language Learning and Teaching
  • Social Sciences › Arts and Humanities › Language and Linguistics › EFL/ESL Teaching and Learning
  • Physical Sciences › Computer Science › Information Systems › Artificial Intelligence in Education
Keywords
chatbots, artificial intelligence in education, English language learning, speech-based interaction, research trends, theoretical framework

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review