MOCA: a motivational online conversational agent for improving student engagement in collaborative learning
Abstract
The use of conversational agents in computer-supported collaborative learning (CSCL) has been identified as a useful tactic for motivational intervention. The purpose of the current study was to design and implement a conversational agent called a motivational online conversational agent (MOCA) that incorporated motivational interviewing (MI) and was based on an intelligent dialog engine to enhance learner engagement in CSCL. Additionally, the study empirically examined the effects of MOCA on promoting positive changes in collaborative learning engagement through multiturn conversation interventions. A prototype system was developed by combining MOCA and an immersive virtual world, and an effectiveness study was conducted with 40 volunteers. A series of multilevel growth models based on the framework of the hierarchical linear model was established through multiwave longitudinal data. The results indicated that the use of MOCA significantly improved student engagement scores (p< 0.001) and that female students performed better on collaborative tasks than male students (p< 0.05,t= 2.97). Additionally, time was an important predictor and significantly interacted with the MOCA-use condition. The study has implications for the design and assessment of conversational agents embodied in virtual reality.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Chatbots that operated as teaching assistants provided academic knowledge, offered formative feedback, and enabled scaffolded learning.
“The chatbots that operated as teaching assistants provided academic knowledge ([41,[48], [49], [50]]), offered formative feedback to EFL learners [45], and enabled scaffolded learning ([22,27,31,42,51]).”
Conversational agents such as MOCA needed a moderate level of motivation.
“Furthermore, conversational agents such as MOCA ([26,45]) enhanced learner engagement in EFL collaborative tasks and significantly improved their learning performance [26] but needed a moderate level of motivation [45].”
Conversational agents such as MOCA enhanced learner engagement in EFL collaborative tasks.
“Furthermore, conversational agents such as MOCA ([26,45]) enhanced learner engagement in EFL collaborative tasks and significantly improved their learning performance [26] but needed a moderate level of motivation [45].”
Interactive tools such as chatbots kept learners motivated and engaged, while allowing them to learn EFL in an exciting and relaxing atmosphere.
“Interactive tools such as chatbots kept learners motivated and engaged, while allowing them to learn EFL in an exciting and relaxing atmosphere ([26,41,42,45]).”
AI-based conversational chatbots significantly improved EFL learners' engagement.
“These studies revealed that AI-based conversational chatbots significantly improved EFL learners’ engagement.”
Most experiments were conducted over a brief period, ranging from two 50-min experiments to a three-month quasi-experimental study.
“Most experiments were conducted over a brief period, ranging from two 50-min experiments [50] to a three-month quasi-experimental study ([41,45,47,51]).”
Cites
Development and use of the ARCS model of instructional design
Keller, J. M. (1987) · Journal of Instructional Development · doi:10.1007/bf02905780 · Cited by 2,332 · see citing works
Motivational interviewing: a systematic review and meta-analysis.
Rubak, S., Sandbæk, A., Lauritzen, T., & Christensen, B. (2005) · Europe PMC (PubMed Central) · Cited by 1,855 · see citing works
Building End-To-End Dialogue Systems Using Generative Hierarchical Neural Network Models
Serban, I. V., Sordoni, A., Bengio, Y., Courville, A. C., & Pineau, J. (2016) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.1609/aaai.v30i1.9883 · Cited by 1,639 · see citing works
Cooperative Learning: Review of Research and Practice
Gillies, R. M. (2016) · The Australian journal of teacher education · doi:10.14221/ajte.2016v41n3.3 · Cited by 646 · see citing works
Jeong, H., & Hmelo‐Silver, C. E. (2016) · Educational Psychologist · doi:10.1080/00461520.2016.1158654 · Cited by 476 · see citing works
Motivation and Cognitive Engagement in Learning Environments
Blumenfeld, P. C., Kempler, T. M., & Krajcik, J. S. (2005) · Cambridge University Press eBooks · doi:10.1017/cbo9780511816833.029 · Cited by 466 · see citing works
Cerebral Blood Flow in Subjects With Social Phobia During Stressful Speaking Tasks: A PET Study
Tillfors, M., Furmark, T., Marteinsdóttir, Í., Fischer, H., Pissiota, A., Långström, B., & Fredrikson, M. G. (2001) · American Journal of Psychiatry · doi:10.1176/appi.ajp.158.8.1220 · Cited by 353 · see citing works
Learning technologies: Affective and social issues in computer-supported collaborative learning
Jones, A. C., & Issroff, K. (2004) · Computers & Education · doi:10.1016/j.compedu.2004.04.004 · Cited by 309 · see citing works
Eight Stages in Learning Motivational Interviewing
Miller, W. R., & Moyers, T. B. (2006) · Journal of Teaching in the Addictions · doi:10.1300/j188v05n01_02 · Cited by 283 · see citing works
Riper, H., Andersson, G., Hunter, S. B., Wit, J., Berking, M., & Cuijpers, P. (2014) · Addiction · doi:10.1111/add.12441 · Cited by 276 · see citing works
Collaborative group engagement in a computer-supported inquiry learning environment
Sinha, S., Rogat, T. K., Adams-Wiggins, K. R., & Hmelo‐Silver, C. E. (2015) · International Journal of Computer-Supported Collaborative Learning · doi:10.1007/s11412-015-9218-y · Cited by 236 · see citing works
A Review of Self-Report and Alternative Approaches in the Measurement of Student Motivation
Fulmer, S. M., & Frijters, J. C. (2009) · Educational Psychology Review · doi:10.1007/s10648-009-9107-x · Cited by 227 · see citing works
Automated interventions for multiple health behaviors using conversational agents
Bickmore, T. W., Schulman, D., & Sidner, C. (2013) · Patient Education and Counseling · doi:10.1016/j.pec.2013.05.011 · Cited by 206 · see citing works
Measurement and assessment in computer-supported collaborative learning
Gress, C. L. Z., Fior, M., Hadwin, A. F., & Winne, P. H. (2007) · Computers in Human Behavior · doi:10.1016/j.chb.2007.05.012 · Cited by 163 · see citing works
Architecture for Building Conversational Agents That Support Collaborative Learning
Kumar, R., & Rosé, C. P. (2011) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2010.41 · Cited by 160 · see citing works
Multilevel modeling of longitudinal data for psychotherapy researchers: I. The basics
Tasca, G. A., & Gallop, R. (2009) · Psychotherapy Research · doi:10.1080/10503300802641444 · Cited by 148 · see citing works
Neal, D. J., & Carey, K. B. (2003) · Addictive Behaviors · doi:10.1016/j.addbeh.2003.08.004 · Cited by 130 · see citing works
Affective states in computer-supported collaborative learning: Studying the past to drive the future
Reis, R. C. D., Isotani, S., Rodriguez, C. L., Lyra, K. T., Jaques, P. A., & Bittencourt, I. I. (2018) · Computers & Education · doi:10.1016/j.compedu.2018.01.015 · Cited by 113 · see citing works
Veletsianos, G., & Russell, G. S. (2013) · Springer eBooks · doi:10.1007/978-1-4614-3185-5_61 · Cited by 110 · see citing works
Hsieh, M.-Y., Ponsford, J., Wong, D., Schönberger, M., Taffe, J., & Mckay, A. (2012) · Neuropsychological Rehabilitation · doi:10.1080/09602011.2012.678860 · Cited by 102 · see citing works
Tegos, S., Demetriadis, S., & Karakostas, A. (2015) · Computers & Education · doi:10.1016/j.compedu.2015.07.014 · Cited by 90 · see citing works
Walker, E., Rummel, N., & Koedinger, K. R. (2011) · International Journal of Computer-Supported Collaborative Learning · doi:10.1007/s11412-011-9111-2 · Cited by 90 · see citing works
An update on the efficacy of psychological treatments for obsessive-compulsive disorder in adults
Ponniah, K., Magiati, I., & Hollon, S. D. (2013) · Journal of Obsessive-Compulsive and Related Disorders · doi:10.1016/j.jocrd.2013.02.005 · Cited by 79 · see citing works
Ayedoun, E., Hayashi, Y., & Seta, K. (2015) · Procedia Computer Science · doi:10.1016/j.procs.2015.08.219 · Cited by 76 · see citing works
Enhancing Scientific Reasoning and Discussion with Conversational Agents
Dyke, G., Adamson, D., Howley, I. K., & Rosé, C. P. (2013) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2013.25 · Cited by 72 · see citing works
Tegos, S. D., Demetriadis, S., Papadopoulos, P. M., & Weinberger, A. (2016) · International Journal of Computer-Supported Collaborative Learning · doi:10.1007/s11412-016-9246-2 · Cited by 71 · see citing works
Conversational Agents Improve Peer Learning through Building on Prior Knowledge.
Tegos, S. D., & Demetriadis, S. (2017) · Educational Technology & Society · Cited by 71 · see citing works
A Sequential Matching Framework for Multi-Turn Response Selection in Retrieval-Based Chatbots
Wu, Y., Wu, W., Chen, X., Xu, C., Li, Z., & Zhou, M. (2018) · Computational Linguistics · doi:10.1162/coli_a_00345 · Cited by 71 · see citing works
Studying the effectiveness of multi-user immersive environments for collaborative evaluation tasks
Lorenzo, C.-M., Sicilia, M., & Sánchez‐Alonso, S. (2012) · Computers & Education · doi:10.1016/j.compedu.2012.06.002 · Cited by 69 · see citing works
Use of Motivational Interviewing to Improve Return-to-work and Work-related Outcomes: A Review
Page, K. M., & Tchernitskaia, I. (2014) · Australian Journal of Rehabilitation Counselling · doi:10.1017/jrc.2014.5 · Cited by 69 · see citing works
Brains or Beauty: How to Engender Trust in User-Agent Interactions
Yuksel, B. F., Collisson, P., & Czerwinski, M. (2017) · ACM Transactions on Internet Technology · doi:10.1145/2998572 · Cited by 63 · see citing works
A User Perception--Based Approach to Create Smiling Embodied Conversational Agents
Ochs, M., Pélachaud, C., & McKeown, G. J. (2017) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/2925993 · Cited by 52 · see citing works
Dieterich, R., & Demirci, J. R. (2020) · Patient Education and Counseling · doi:10.1016/j.pec.2020.05.011 · Cited by 52 · see citing works
Using collaborative filtering to support college students’ use of online forum for English learning
Wang, P., & Yang, H.-C. (2012) · Computers & Education · doi:10.1016/j.compedu.2012.02.007 · Cited by 51 · see citing works
Hayashi, Y. (2020) · International Journal of Computer-Supported Collaborative Learning · doi:10.1007/s11412-020-09333-3 · Cited by 50 · see citing works
Lämsä, J., Hämäläinen, R., Koskinen, P., & Viiri, J. (2018) · International Journal of Science Education · doi:10.1080/09500693.2018.1506594 · Cited by 46 · see citing works
Engagement Modeling in Dyadic Interaction
Dermouche, S., & Pélachaud, C. (2019) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3340555.3353765 · Cited by 46 · see citing works
Collaborative Learning Through Chat Discussions and Argument Diagrams in Secondary School
Marttunen, M. J., & Laurinen, L. I. (2007) · Journal of Research on Technology in Education · doi:10.1080/15391523.2007.10782500 · Cited by 42 · see citing works
Gueldner, B. A., & Merrell, K. W. (2011) · Journal of Educational and Psychological Consultation · doi:10.1080/10474412.2010.522876 · Cited by 41 · see citing works
Motivational Interviewing in the Schools: Conversations to Improve Behavior and Learning
Roden, D. (2018) · School social work journal · Cited by 31 · see citing works
Parallel Processes: Using Motivational Interviewing as an Implementation Coaching Strategy
Hettema, J. E., Ernst, D., Williams, J. R., & Miller, K. J. (2013) · The Journal of Behavioral Health Services & Research · doi:10.1007/s11414-013-9381-8 · Cited by 29 · see citing works
Hayashi, Y. (2018) · Cognitive Systems Research · doi:10.1016/j.cogsys.2018.04.005 · Cited by 29 · see citing works
Automating the Production of Communicative Gestures in Embodied Characters
Ravenet, B., Pélachaud, C., Clavel, C., & Marsella, S. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.01144 · Cited by 29 · see citing works
Motivational Interviewing: An Evidence-Based Practice for Improving Student Practice Skills
Hohman, M. M., Pierce, P., & Barnett, E. Y. (2015) · Journal of Social Work Education · doi:10.1080/10437797.2015.1012925 · Cited by 24 · see citing works
Team-Based Learning for Nursing and Medical Students
Feather, R. A., Carr, D. E., Reising, D. L., & Garletts, D. M. (2016) · Nurse Educator · doi:10.1097/nne.0000000000000240 · Cited by 23 · see citing works
Providing engineers with OARS and EARS
Klonek, F. E., & Kauffeld, S. (2015) · Higher Education Skills and Work-based Learning · doi:10.1108/heswbl-06-2014-0025 · Cited by 21 · see citing works
Balinese Historian Chatbot using Full-Text Search and Artificial Intelligence Markup Language Method
Wirawan, K. T., Sukarsa, I. M., & Bayupati, I. P. A. (2019) · International Journal of Intelligent Systems and Applications · doi:10.5815/ijisa.2019.08.03 · Cited by 17 · see citing works
Virtual Agents for Professional Social Skills Training: An Overview of the State-of-the-Art
Bosman, K., Bosse, T., & Formolo, D. (2019) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-030-16447-8_8 · Cited by 16 · see citing works
Venner, K. L., & Verney, S. P. (2015) · Professional Psychology Research and Practice · doi:10.1037/a0038856 · Cited by 15 · see citing works
Enhancing Parent–Child Interaction Therapy With Motivational Interviewing Techniques
N’zi, A. M., Lucash, R. E., Clionsky, L. N., & Eyber, S. M. (2016) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2016.03.002 · Cited by 15 · see citing works
Mantler, T., Irwin, J. D., Morrow, D., Hall, C. R., & Mandich, A. D. (2014) · Addiction Research & Theory · doi:10.3109/16066359.2014.946410 · Cited by 13 · see citing works
An Encoding Mechanism for Seq2Seq based Multi-Turn Sentimental Dialogue Generation Model
Ma, Z., Du, B., Shen, J., Yang, R., & Wan, J. (2020) · Procedia Computer Science · doi:10.1016/j.procs.2020.06.108 · Cited by 12 · see citing works
Learning to change: the rationale for the use of motivational interviewing in higher education
Wells, H., & Jones, A. (2016) · Innovations in Education and Teaching International · doi:10.1080/14703297.2016.1198714 · Cited by 9 · see citing works
Leveraging the Dynamics of Non-Verbal Behaviors For Social Attitude Modeling
Dermouche, S., & Pélachaud, C. (2020) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2020.2989262 · Cited by 6 · see citing works
A Multimodal Chatbot System for Enhancing Social Skills Training for Security Guards
de Bever, S., Formolo, D., Wang, S., & Bosse, T. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-22646-6_37 · Cited by 5 · see citing works
Knowledge discovery in task-oriented dialogue
Wanderley, G. M. P., Tacla, C. A., BARTHES, J.-P. A., & Paraíso, E. C. (2015) · Expert Systems with Applications · doi:10.1016/j.eswa.2015.05.005 · Cited by 4 · see citing works
A computational model for the emergence of turn-taking behaviors in user-agent interactions
Jégou, M., & Chevaillier, P. (2018) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-018-0265-3 · Cited by 3 · see citing works
Osborn, C. J., Giegerich, V., Tolbert, Y. R., Marder, S., & Emanuelson, G. (2020) · Journal of Counselor Preparation and Supervision · doi:10.7729/42.1379 · Cited by 2 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Zhai, C., & Wibowo, S. (2023) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2023.100134 · Cited by 363 · see citing works
Ouyang, F., & Zhang, L. (2024) · Educational Research Review · doi:10.1016/j.edurev.2024.100616 · Cited by 138 · see citing works
Yusuf, H., Money, A., & Daylamani-Zad, D. (2025) · Educational technology research and development · doi:10.1007/s11423-025-10447-4 · Cited by 112 · see citing works
AlTwijri, L., & Alghizzi, T. M. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e31053 · Cited by 93 · see citing works
Debets, T., Banihashem, S. K., Brinke, D. J.-T., Vos, T. E. J., Wenniger, G. M. D. B., & Camp, G. (2025) · Computers & Education · doi:10.1016/j.compedu.2025.105323 · Cited by 113 · see citing works
Hu, W., Tian, J., & Li, Y. (2024) · The Internet and Higher Education · doi:10.1016/j.iheduc.2024.100979 · Cited by 66 · see citing works
Ba, S., Yang, L., Yan, Z., Looi, C. K., & Gašević, D. (2025) · Computers and Education Open · doi:10.1016/j.caeo.2025.100284 · Cited by 84 · see citing works
Chatbots and student motivation: a scoping review
Huang, W., Jiang, J., King, R. B., & Fryer, L. K. (2025) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-025-00524-2 · Cited by 69 · see citing works
Ouyang, F., Guo, M., Zhang, N., Bai, X., & Jiao, P. (2024) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2024.3486749 · Cited by 39 · see citing works
A review of using multilevel modeling in e-learning research
Lin, H., Wu, J., Liang, J., Lee, Y., Huang, P.-C., Kwok, O., & Tsai, C. (2023) · Computers & Education · doi:10.1016/j.compedu.2023.104762 · Cited by 34 · see citing works
Lu, G., & Ba, S. (2026) · Educational Psychology · doi:10.1080/01443410.2025.2489784 · Cited by 24 · see citing works
Zheng, L., Kinshuk, K., Fan, Y., & Long, M. (2023) · Education and Information Technologies · doi:10.1007/s10639-023-11886-3 · Cited by 20 · see citing works
Jia, Y., Wang, X. E., Sin, Z. P. T., Li, C., Ng, P. H. F., Huang, X. X., Baciu, G., Cao, J., & Li, Q. (2024) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2024.3406638 · Cited by 19 · see citing works
Exploring the Potential of Generative AI in English Language Teaching
Ironsi, C. S. (2023) · Advances in higher education and professional development book series · doi:10.4018/979-8-3693-0487-7.ch007 · Cited by 21 · see citing works
A Conversational AI Bot for Efficient Learning: A Prototypical Design
Elragal, A. A., Awad, A. I., Andersson, I., & Nilsson, J. (2024) · IEEE Access · doi:10.1109/access.2024.3476953 · Cited by 15 · see citing works
Zheng, L., Fan, Y., Huang, Z., & Gao, L. (2023) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12860 · Cited by 15 · see citing works
Zheng, L., Shi, Z., & Gao, L. (2025) · Computers & Education · doi:10.1016/j.compedu.2025.105489 · Cited by 10 · see citing works
Hu, W., Gong, R., Wu, S., & Li, Y. (2025) · Educational Technology Research and Development · doi:10.1007/s11423-025-10526-6 · Cited by 11 · see citing works
Liao, M., Zhu, K., & Wang, G. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1288503 · Cited by 12 · see citing works
Privacy Vs. Personalization: GENAI’s Role in Technology Adoption
Chakraborty, D., Gunasekaran, A., & Subramanian, G. (2025) · Journal of Computer Information Systems · doi:10.1080/08874417.2025.2534545 · Cited by 11 · see citing works
Lu, G., Ba, S., & Yang, L. (2025) · Education and Information Technologies · doi:10.1007/s10639-025-13778-0 · Cited by 11 · see citing works
The Impact and Future of AI-Enhanced Teaching Methods in the Use of Business Simulations
Martins, H. F. (2024) · Advances in educational technologies and instructional design book series · doi:10.4018/979-8-3693-2728-9.ch014 · Cited by 6 · see citing works
A Systematic Review on Using Chatbots in Computer-Supported Collaborative Learning
Liu, Y., & Tang, Y. (2025) · International Conference on Educational and Information Technology · doi:10.1109/iceit64364.2025.10975978 · Cited by 5 · see citing works
Liu, W., & Cui, X. (2024) · 2024 4th International Conference on Educational Technology (ICET) · doi:10.1109/icet62460.2024.10868171 · Cited by 4 · see citing works
Chen, F. (2023) · International Journal of Emerging Technologies in Learning (iJET) · doi:10.3991/ijet.v18i03.38051 · Cited by 3 · see citing works
Alarifi, S., AlSahli, M. M., & Alghizzi, T. M. (2025) · Arab World English Journal · doi:10.24093/awej/ai.7 · Cited by 2 · see citing works
Lu, Y., Jia, Y., Chen, G., Wang, Y., Ng, P. H. F., Zhou, L., Li, Q., & Li, C. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-4407-0_4 · Cited by 1 · see citing works
How Virtual Agents Can Shape Human-Human Collaboration: A Systematic Review
Earle-Randell, T. V., Zhang, S., Schroeder, N. L., Boyer, K. E., & Dorley, E. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-98420-4_33 · Cited by 1 · see citing works
AI and student motivation: A scoping review
Li, J., King, R. B., Chai, C. S., Lee, V. W. Y., & Li, R. (2026) · Journal of Research on Technology in Education · doi:10.1080/15391523.2026.2672515 · Cited by 1 · see citing works
Masha, A. K., & Agyeman, N. Y. B. (2025) · Studies in Learning and Teaching · doi:10.46627/silet.v6i2.588
Zhan, Q., & Fu, X. (2026) · Croatian Journal of Education - Hrvatski časopis za odgoj i obrazovanje · doi:10.15516/cje.v28i3.42889
Enhancing Student Engagement in Peer Discussions: The Role of a Collaborative Conversational Agent
Papageorgiou, E., Çini, A., Stoidis, A., de Araujo, A., & Papadopoulos, P. M. (2026) · IEEE International Conference on Advanced Learning Technologies (ICALT) · doi:10.1109/icalt68022.2026.00038
- Authors
- Xie, T., Liu, R., Chen, Y., & Liu, G.
- Affiliations
- Southwest University (CN)
- Venue
- IEEE Transactions on Learning Technologies
- Published
- 2021-10-01
- Volume
- 14
- Issue
- 5
- Pages
- 653-664
- ISSN
- 1939-1382 (ISSN-L)
- 2372-0050
- OpenAlex
- W3216247330
- Semantic Scholar
- a00285403d9d3651d5c7086dab78435abc8384f6
- Cited by
- 32
- References
- 58
- Citations by year
- 2026: 3 · 2025: 14 · 2024: 9 · 2023: 6
- FWCI
- 1.33
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Learning Technologies (publishedVersion)
- Funders
- National Natural Science Foundation of China (61807027)
- Social Science Planning Foundation of Chongqing (2018BS100)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Keywords
- chatbots, computer-supported collaborative learning, student engagement, motivational interviewing, virtual reality, immersive virtual worlds, gender differences in learning, student motivation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
