The Promise and Peril of ChatGPT in Higher Education: Opportunities, Challenges, and Design Implications
Open accessThe DOI matches its Crossref record; 100 of the 101 references it cites were found in a registry or an index, and 1 are not checked yet; 10 of the 47 sources its claims cite were checked for support.
Abstract
A growing number of students in higher education are using ChatGPT for various educational purposes, ranging from seeking information to writing essays. Although many universities have officially banned the use of ChatGPT because of its potential harm and unintended consequences, it is still important to uncover how students leverage ChatGPT for learning, what challenges emerge, and how we can make better use of ChatGPT in higher education. Thus, we conducted focus group workshops and a series of participatory design sessions with thirty students who have actively interacted with ChatGPT for one semester in university and with other five stakeholders (e.g., professors, AI experts). Based on these, this paper identifies real opportunities and challenges of utilizing and designing ChatGPT for higher education.
Verified 2026-11-19 · 1 reference not checked yet
Overview
CoChat Summary
TL;DR
This CHI 2024 study used focus groups and participatory design with 30 undergraduates in a semester-long AI class plus 5 experts to examine ChatGPT in higher education. Students valued efficiency, personalization, and scalability, but reported hallucination, bias, transparency, recency, academic-integrity, social-interaction, and prompt-engineering challenges, leading to design proposals such as fine-tuning/embedding/fact-checking, prompt suggestions, learning maps, multi-agents, and social/metaverse features.
Key findings
- Students found ChatGPT usable and beneficial: all teams praised its speed/efficiency, 24/7 availability, interactivity, and concise explanations; they also valued personalized feedback, perceived objectivity/fairness, a sense of privacy, and scalability for diversity, equity, inclusion, and extensibility with other educational tools.
- Students identified algorithmic problems including hallucination, algorithmic bias (e.g., ChatGPT defaulting characters to specific races), lack of transparency/interpretability, and lack of recency; human/social problems including limited capability, decreased learning and academic integrity, reduced social interaction, lack of human ingenuity, and privacy concerns; and usability problems including difficult prompt engineering and lack of hands-on learning.
- In participatory design, students and experts proposed functions to address hallucination via fine-tuning, embedding, and external fact-checking algorithms; improve usability via prompt suggestions, tutorials, learning maps/navigation, and AI-helper agents; provide less biased but more diverse perspectives via multi-agents; and foster social interactions via one-to-many communication and metaverse/VR-style spaces.
- The paper argues that ChatGPT could complement intelligent tutoring systems: ITSs offer systematic dialogue, feedback, pumps, prompts, and scaffolding, while ChatGPT offers free-form, open-ended, student-directed interaction, but currently places high cognitive burdens on students.
Methods
- Design: semester-long, three-phase curriculum in an accredited undergraduate AI class at an American university on the East Coast, spring 2023, about one month after ChatGPT-3.5’s release; students were permitted to use AI tools including ChatGPT-3.5 and DALL·E2 for legitimate educational purposes.
- Sample: thirty undergraduate students (P01–P30) who actively participated in all curriculum phases, plus five external stakeholders/expert participants (P31–P35), including AI engineers and scholars; the study used focus group workshops, brainstorming, idea sketching, expert sessions, and participatory design sessions.
- Analysis: qualitative thematic analysis with an inductive and iterative process of student-generated content (reports, individual/team reports, sketches, final presentations, focus group design activities, contest submissions) and expert interviews; intercoder reliability was not measured, following similar qualitative and participatory design papers.
Limitations
- Stated: findings are based on English-speaking university students in a Western culture and may not reflect English-as-a-second-language students, students in other regions, or those unable to enter university; the study focused on undergraduates, so graduate students or those with different AI literacy may differ; classroom-based study may have made students uncomfortable sharing frank opinions in front of professors and peers; the study did not systematically observe or measure whether AI tools improved students’ learning; and it used ChatGPT-3.5, so newer versions such as ChatGPT-4 or Pro may yield different results.
- Evident from the text: the sample is small (30 students plus 5 experts) and drawn from a single class/university; no personal demographic information was collected due to de-anonymization concerns; and no intercoder reliability was measured, which the authors justify by citing similar qualitative and participatory design work.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
6 Valid · 5 Not valid · 23 Not checked · 126 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“While researchers in HCI and AIEd have long accumulated relevant knowledge of educational AI and even established a basis for human-AI partnership in the classroom [98] beyond the development of successful AI tutors, little is known about how people should approach and prepare for LLM-based chatbots that are being used in all areas of education.”
What the sources say
- Supportedcites [98] [98] Kexin Bella Yang, Vanessa Echeverria, Zijing Lu, Hongyu Mao, Kenneth Holstein, Nikol Rummel, and Vincent Aleven. 2023. Pair-Up: Prototyping Human-AI Coorchestration of Dynamic Transitions between Individual and Collaborative Learning in the Classroom. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems , 1-17. https://doi.org/10.1145/3544548.3581398 - source
The citation is attached to the claim about a basis for human–AI partnership in classrooms, not the following claim about LLM-based chatbots. The Introduction describes the paper’s classroom system as sharing orchestration control between teachers and AI; Section 2.1 also discusses human–AI co-orchestration in classrooms. Neither passage needs to establish the separate LLM claim. (LLM, conf=0.92)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“The most critical problem of ChatGPT that our participants frequently mentioned was its hallucination”
What the sources say
- Supportedcites [64] [64] OpenAI. 2023. GPT-4 Technical Report. https://doi.org/10.48550/arXiv.2303. 08774 - source
The report identifies hallucination as a significant limitation of GPT models (5 Limitations, p. 10) and describes real-world ChatGPT responses flagged by users as not factual (3.1 Model Mitigations, p. 64). The statement about what the citing authors’ own participants mentioned is their finding, not a finding attributed to this source. (LLM, conf=0.84)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Among recent CHI studies [36, 68, 95, 96] that demonstrate the strong effects of social presence of working or learning in the metaverse”
What the sources say
- Not checked — no full text of the sourcecites [36] [36] Qiao Jin, Yu Liu, Svetlana Yarosh, Bo Han, and Feng Qian. 2022. How Will VR Enter University Classrooms? Multi-stakeholders Investigation of VR in Higher Education. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI '22), 1-17. https://doi.org/10.1145/3491102.3517542 - source
- Supportedcites [68] [68] Hyanghee Park, Daehwan Ahn, and Joonhwan Lee. 2023. Towards a Metaverse Workspace: Opportunities, Challenges, and Design Implications. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI '23), 1-20. https://doi.org/10.1145/3544548.3581306 - source
In “Increased Interactions and Collaborations” (page not provided), the paper reports that participants attributed increased productivity to the social presence of the metaverse workspace. It also describes stronger feelings of togetherness, improved relationships, and a greater sense of belonging. These findings support the claim’s working-in-the-metaverse branch; the citation need not establish a separate learning setting. (LLM, conf=0.88)
- Partly supportedcites [95] [95] Julie Williamson, Jie Li, Vinoba Vinayagamoorthy, David A. Shamma, and Pablo Cesar. 2021. Proxemics and Social Interactions in an Instrumented Virtual Reality Workshop. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems , 1-13. https://doi.org/10.1145/3411764.3445729 - sourceExperimental — accuracy not yet measured
The paper’s opening summary (p. 1) reports that virtual workshop spaces influenced group formation, shared attention, and personal space; Results §5.1 (p. 10) describes differences in group cohesion across workshop activities. This supports the claim that social interaction matters in a virtual workshop, but the study does not establish strong effects of social presence on working or learning outcomes. (LLM, conf=0.82)
- Partly supportedcites [96] [96] Julie R. Williamson, Joseph O'Hagan, John Alexis Guerra-Gomez, John H Williamson, Pablo Cesar, and David A. Shamma. 2022. Digital Proxemics: Designing Social and Collaborative Interaction in Virtual Environments. In CHI Conference on Human Factors in Computing Systems , 1-12. https://doi.org/10. 1145/3491102.3517594 - sourceExperimental — accuracy not yet measured
The Procedure (section 4.3) describes a collaborative task in a virtual environment, and Social Signals and Attention (section 4.5.2) reports differences in participants’ social behavior between headset and desktop conditions. The paper does not establish strong effects of social presence on working or learning outcomes; its Conclusion (section 6) says further research is needed to understand the resulting experiences. Page numbers were not available in our copy. (LLM, conf=0.82)
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“Holstein et al. [28, 30], which discovered the least preferred feature of AI tutors among both teachers and students was providing automated emotional support to frustrated students.”
What the sources say
- Could not verifycites [28] [28] Kenneth Holstein and Vincent Aleven. 2022. Designing for human-AI complementarity in K-12 education. AI Magazine 43, 2: 239-248. https://doi.org/10. 1002/aaai.12058 - sourceExperimental — accuracy not yet measured
The Case Study Background describes exploring teachers’ information needs, and the Iterative Piloting section describes teachers offering encouragement that the AI tutor could not provide. Neither reports a preference ranking from both teachers and students or identifies automated emotional support for frustrated students as the least preferred feature (searched: least preferred, frustration, emotional support, and teacher and student preferences). (LLM, conf=0.72)
- Not checked — no full text of the sourcecites [30] [30] Kenneth Holstein, Bruce M. McLaren, and Vincent Aleven. 2018. Student learning benefits of a mixed-reality teacher awareness tool in AI-enhanced classrooms. In Artificial Intelligence in Education: 19th International Conference, AIED 2018, London, UK, June 27-30, 2018, Proceedings, Part I 19 , 154-168. - source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“in another fi eld study of an AI-enhanced classroom, the authors observed a human teacher approach a student who struggled learning with the AI tutor and found out that the student's struggle did not result from interaction with AI but a break up with his significant other [28].”
What the sources say
- Partly supportedcites [28] [28] Kenneth Holstein and Vincent Aleven. 2022. Designing for human-AI complementarity in K-12 education. AI Magazine 43, 2: 239-248. https://doi.org/10. 1002/aaai.12058 - sourceExperimental — accuracy not yet measured
Split into 2 atoms — 1 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
plainSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
64 more claims
Create a free account to see all 160 claims and to verify the 2 references still open.
- Probably not a substantial claim. 62
- It may state two separate claims as one. 50
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Several authors lament the current state of popular AI detection tools, such as iThenticate, MOSS, and Turnitin, stating they are inadequate for the needs of educators [4,9,10].”
From Generative AI and Academic Integrity in Higher Education: A Systematic Review and Research Agenda (2025) · cites this paper as [9]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Reviewing support is typically provided through quantitative feedback, with a focus on evaluation rather than direct revision [95,132].”
From Co-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Process (2025) · cites this paper as [95]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Park and Ahn [9], for instance, reveal that while ChatGPT can enhance information accessibility and efficiency, it threatens academic integrity by potentially lowering learning engagement and standards.”
From Generative AI and Academic Integrity in Higher Education: A Systematic Review and Research Agenda (2025) · cites this paper as [9]
The cited source says what the claim attributes to it.
In the citing paper
“Park and Ahn [9], for instance, reveal that while ChatGPT can enhance information accessibility and efficiency, it threatens academic integrity by potentially lowering learning engagement and standards.”
From Generative AI and Academic Integrity in Higher Education: A Systematic Review and Research Agenda (2025) · cites this paper as [9]
The cited source says what the claim attributes to it.
In the citing paper
“As we all become more familiar with using generative AI, we are finding that some specific knowledge is necessary (e.g., basic prompting skills, [40]) but that even more important are general principles that guide usage, such as the need to prompt iteratively and encourage students to use their own agency to refine the AI output.”
From Incorporating generative AI into a writing-intensive undergraduate course without off-loading learning (2025) · cites this paper as [40]
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
Kytle, J., & Bandura, A. (1978) · Contemporary Sociology · doi:10.2307/2065952 · Cited by 25,422
ChatGPT for Good? On Opportunities and Challenges of Large Language Models for Education
Kasneci, E., Seßler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · doi:10.35542/osf.io/5er8f · Cited by 7,552
ChatGPT for good? On opportunities and challenges of large language models for education
Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · Learning and Individual Differences · doi:10.1016/j.lindif.2023.102274 · Cited by 7,326 · cited 2×
“Kasneci et al. [41] has written a position paper that highlights how LLMs could potentially be utilized to produce educational content, personalize students’ learning, and induce deeper engagement or interaction from students.”
BackgroundTraining language models to follow instructions with human feedback
Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C. L., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., et al. (2022) · arXiv · doi:10.48550/arxiv.2203.02155 · Cited by 4,208 · cited 1×
“By leveraging massive text datasets and a human-involved feedback system known as ’Reinforcement Learning from Human Feedback’ (RLHF) [65], Chat-GPT has elevated the capabilities of NLP to unprecedented levels.”
Kung, T. H., Cheatham, M., Medenilla, A., Sillos, C., De Leon, L., Elepaño, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., Maningo, J., et al. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000198 · Cited by 4,115
Kung, T. H., Cheatham, M., ChatGPT, Medenilla, A., Sillos, C., De Leon, L., Elepaño, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., et al. (2022) · doi:10.1101/2022.12.19.22283643 · Cited by 4,115
What is AI Literacy? Competencies and Design Considerations
Long, D., & Magerko, B. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376727 · Cited by 3,241 · cited 2×
“Pinpointing the exact skill sets required in the AI era is challenging, but there is broad consensus among experts and scholars that critical thinking and AI literacy are key competencies [54].”
BackgroundArtificial intelligence and the future of work: Human-AI symbiosis in organizational decision making
Jarrahi, M. H. (2018) · Business Horizons · doi:10.1016/j.bushor.2018.03.007 · Cited by 2,772 · cited 1×
“AI is profoundly transforming our work environments [33, 34, 66, 67, 102], reshaping both the nature of work and the skills required.”
BackgroundVanLEHN, K. (2011) · Educational Psychologist · doi:10.1080/00461520.2011.611369 · Cited by 2,323 · cited 7×
“Some have regarded ITSs as superior to earlier forms of learning technology, such as computer-assisted instruction or computer-based training [22, 80, 87].”
BackgroundResultInfluentialProceedings of the 2017 CHI Conference on Human Factors in Computing Systems
(2017) · doi:10.1145/3025453 · Cited by 2,207
Gilson, A., Safranek, C. W., Huang, T., Socrates, V., Chi, L., Taylor, R. A., & Chartash, D. (2023) · JMIR Medical Education · doi:10.2196/45312 · Cited by 2,078 · cited 2×
“People are shocked by the continuous stream of news articles and reports with headlines like “ChatGPT Passes Wharton School’s MBA exam [107, 108] and US Medical Licensing Exam” [20, 46].”
BackgroundWhat if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education
Tlili, A., Shehata, B., Adarkwah, M. A., Bozkurt, A., Hickey, D. T., Huang, R., & Agyemang, B. (2023) · Smart Learning Environments · doi:10.1186/s40561-023-00237-x · Cited by 2,003 · cited 2×
“For such reasons, recent studies [41, 72, 85] set out to list potential benefits and drawbacks of using ChatGPT, the most popular LLM-based chatbot at present.”
BackgroundQualitative Interviewing and Grounded Theory Analysis
Charmaz, K., & Belgrave, L. L. (2012) · The SAGE Handbook of Interview Research: The Complexity of the Craft · doi:10.4135/9781452218403.n25 · Cited by 1,997 · cited 1×
“We used a qualitative approach [13, 16] and thematic analysis [8] to examine all of the student-generated data and identify similar topics and categories.”
MethodProceedings of the 2020 CHI Conference on Human Factors in Computing Systems
(2020) · doi:10.1145/3313831 · Cited by 1,951
Participatory Design: Principles and Practices
(2017) · CRC Press eBooks · doi:10.1201/9780203744338 · Cited by 1,500 · cited 1×
“Thus, the initial goal of the class was to give students ample chances to become acquainted with both AI technologies and essential design principles relevant to the participatory design processes [42, 76, 100].”
BackgroundEvaluating Large Language Models Trained on Code
Chen, M., Tworek, J., Jun, H., Yuan, Q., Pinto, H. P. D. O., Kaplan, J., Edwards, H., Burda, Y., Joseph, N., Brockman, G., et al. (2021) · arXiv · doi:10.48550/arxiv.2107.03374 · Cited by 1,436
Why Johnny Can’t Prompt: How Non-AI Experts Try (and Fail) to Design LLM Prompts
Zamfirescu-Pereira, J. D., Wong, R. Y., Hartmann, B., & Yang, Q. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581388 · Cited by 1,274 · cited 1×
“Research has further explored what challenges (e.g., prompt-engineering) users face when interacting with LLMs [94, 101], but the permeation of LLMs in academia and how it will change all aspects of education [44, 82] has not been investigated to answer 1) how exactly college students are using…”
BackgroundEvolution and Revolution in Artificial Intelligence in Education
Roll, I., & Wylie, R. (2016) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-016-0110-3 · Cited by 1,229 · cited 1×
“Among these diverse applications in AIEd, ITSs are the most prominent tool and well-established area of research [62, 74, 75] due to their scalability, accessibility, and personalization.”
BackgroundParticipatory Design: Issues and Concerns
Kensing, F., & Blomberg, J. (1998) · Computer Supported Cooperative Work (CSCW) · doi:10.1023/a:1008689307411 · Cited by 1,084 · cited 1×
“Thus, the initial goal of the class was to give students ample chances to become acquainted with both AI technologies and essential design principles relevant to the participatory design processes [42, 76, 100].”
BackgroundEnvisioning AI for K-12: What Should Every Child Know about AI?
Touretzky, D., Gardner-McCune, C., Martin, F., & Seehorn, D. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33019795 · Cited by 918 · cited 1×
“Critical thinking is indispensable for human ingenuity [2, 17, 54, 59, 86, 105]; it equips individuals to question, analyze, and interpret the rapidly evolving sociotechnical landscape, where complex information, emerging technologies, social systems, and diverse stakeholders are intricately…”
BackgroundThe Intellectual Challenge of CSCW: The Gap Between Social Requirements and Technical Feasibility
Ackerman, M. S. (2000) · Human–Computer Interaction · doi:10.1207/s15327051hci1523_5 · Cited by 892 · cited 1×
“To develop more holistic and effective solutions, it is crucial to adopt a sociotechnical perspective that considers human psychology, organizational culture, and social norms [1].”
BackgroundProceedings of the 2023 CHI Conference on Human Factors in Computing Systems
(2023) · doi:10.1145/3544548 · Cited by 735
Engineering Education in the Era of ChatGPT: Promise and Pitfalls of Generative AI for Education
Qadir, J. (2023) · 2023 IEEE Global Engineering Education Conference (EDUCON) · doi:10.1109/educon54358.2023.10125121 · Cited by 707 · cited 1×
“For such reasons, recent studies [41, 72, 85] set out to list potential benefits and drawbacks of using ChatGPT, the most popular LLM-based chatbot at present.”
BackgroundDetect Rumors Using Time Series of Social Context Information on Microblogging Websites
Ma, J., Gao, W., Wei, Z., Lu, Y., & Wong, K.-F. (2015) · Proceedings of the 24th ACM International on Conference on Information and Knowledge Management · doi:10.1145/2806416.2806607 · Cited by 640
Heffernan, N. T., & Heffernan, C. L. (2014) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-014-0024-x · Cited by 616 · cited 1×
“The communities of HCI and AI in education (AIEd) have long endeavored to improve education by applying AI (e.g., educational robots [84, 91], adaptive assessment [27]) and leveraging a variety of interfaces (e.g., voice, text) [55, 92].”
BackgroundViewpoint: when will AI exceed human performance? evidence from AI experts
Grace, K., Salvatier, J., Dafoe, A., Zhang, B., & Evans, O. (2018) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.11222 · Cited by 579
Algorithmic management in a work context
Jarrahi, M. H., Newlands, G., Lee, M. K., Wolf, C. T., Kinder, E., & Sutherland, W. (2021) · Big Data & Society · doi:10.1177/20539517211020332 · Cited by 532 · cited 1×
“AI is profoundly transforming our work environments [33, 34, 66, 67, 102], reshaping both the nature of work and the skills required.”
Background"Alexa is my new BFF": Social Roles, User Satisfaction, and Personification of the Amazon Echo
Purington, A., Taft, J. G., Sannon, S., Bazarova, N. N., & Taylor, S. H. (2017) · Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/3027063.3053246 · Cited by 476 · cited 1×
“In line with previous CHI studies [7, 48, 71, 99] that do not specifically focus on ChatGPT but value exploration of students’ unique experience with commercial AI (e.g., Alexa) and user-centered design, we explore students’ real experiences and perceptions of ChatGPT in higher education and…”
Letting Artificial Intelligence in Education Out of the Box: Educational Cobots and Smart Classrooms
Timms, M. J. (2016) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-016-0095-y · Cited by 428 · cited 1×
“The communities of HCI and AI in education (AIEd) have long endeavored to improve education by applying AI (e.g., educational robots [84, 91], adaptive assessment [27]) and leveraging a variety of interfaces (e.g., voice, text) [55, 92].”
BackgroundEmbodied conversational interface agents
Cassell, J. (2000) · Communications of the ACM · doi:10.1145/332051.332075 · Cited by 393 · cited 1×
“It is difficult to grasp and solve such complex problems caused by the use of ChatGPT despite existing, extensive research into conversational agents (CA) and their practical applications [11, 12, 19, 23, 38, 52].”
BackgroundThe power of a nod and a glance: envelope vs. emotional feedback in animated conversational agents
Cassell, J., & Thorisson, K. R. (1999) · Applied Artificial Intelligence · doi:10.1080/088395199117360 · Cited by 383 · cited 1×
“It is difficult to grasp and solve such complex problems caused by the use of ChatGPT despite existing, extensive research into conversational agents (CA) and their practical applications [11, 12, 19, 23, 38, 52].”
Background(2001) · doi:10.1609/aimag.v22i4.1591 · Cited by 381 · cited 5×
“Thus, many of them have been recognized both in academia or practice [19, 23] for proving that AI tutors in CA form can outperform human tutors through meta-analysis [28].”
BackgroundInfluentialSteenbergen-Hu, S., & Cooper, H. (2014) · Journal of Educational Psychology · doi:10.1037/a0034752 · Cited by 355 · cited 5×
“Some have regarded ITSs as superior to earlier forms of learning technology, such as computer-assisted instruction or computer-based training [22, 80, 87].”
BackgroundInfluentialRumor Detection over Varying Time Windows
Kwon, S., Cha, M., & Jung, K. (2017) · PLOS ONE · doi:10.1371/journal.pone.0168344 · Cited by 352 · cited 1×
“Moreover, the HCI community has long designed and studied fact-checking algorithms [4, 26, 35, 39, 89, 103] to identify fake news, false information, and rumors [47, 56–58].”
BackgroundLee, M., Liang, P., & Yang, Q. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3502030 · Cited by 345 · cited 3×
“Accordingly, recent HCI research has expanded LLMs’ application to tasks such as co-writing with LLMs [15, 32, 49] and providing health interventions for socially isolated or marginalized individuals [37, 90].”
BackgroundOut of the laboratory and into the classroom: the future of artificial intelligence in education
Schiff, D. (2021) · AI & SOCIETY · doi:10.1007/s00146-020-01033-8 · Cited by 334 · cited 1×
“Among these diverse applications in AIEd, ITSs are the most prominent tool and well-established area of research [62, 74, 75] due to their scalability, accessibility, and personalization.”
BackgroundInternational Handbook of the Learning Sciences
(2018) · Routledge eBooks · doi:10.4324/9781315617572 · Cited by 331
Communication Breakdowns Between Families and Alexa
Beneteau, E., Richards, O. K., Zhang, M., Kientz, J. A., Yip, J., & Hiniker, A. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300473 · Cited by 313 · cited 1×
“In line with previous CHI studies [7, 48, 71, 99] that do not specifically focus on ChatGPT but value exploration of students’ unique experience with commercial AI (e.g., Alexa) and user-centered design, we explore students’ real experiences and perceptions of ChatGPT in higher education and…”
CHI Conference on Human Factors in Computing Systems
(2022) · doi:10.1145/3491102 · Cited by 308
Toward Automated Fact-Checking: Detecting Check-worthy Factual Claims by ClaimBuster
Hassan, N., Arslan, F., Li, C., & Tremayne, M. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098131 · Cited by 302 · cited 1×
“Moreover, the HCI community has long designed and studied fact-checking algorithms [4, 26, 35, 39, 89, 103] to identify fake news, false information, and rumors [47, 56–58].”
BackgroundZhou, J., Zhang, Y., Luo, Q., Parker, A. G., & De Choudhury, M. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581318 · Cited by 288 · cited 1×
“Moreover, the HCI community has long designed and studied fact-checking algorithms [4, 26, 35, 39, 89, 103] to identify fake news, false information, and rumors [47, 56–58].”
BackgroundSusarla, A., Gopal, R., Thatcher, J. B., & Sarker, S. (2023) · Information Systems Research · doi:10.1287/isre.2023.ed.v34.n2 · Cited by 285 · cited 2×
“For instance, the introduction of calculators once sparked significant debate and concern among a wide range of educational stakeholders [82].”
BackgroundWhen Will AI Exceed Human Performance? Evidence from AI Experts
Grace, K., Salvatier, J., Dafoe, A., Zhang, B., & Evans, O. (2017) · arXiv · doi:10.48550/arxiv.1705.08807 · Cited by 285 · cited 1×
“These large-scale models consume enormous volumes of data and increasingly surpass human performance across a range of activities [21].”
BackgroundCo-Writing with Opinionated Language Models Affects Users’ Views
Jakesch, M., Bhat, A., Buschek, D., Zalmanson, L., & Naaman, M. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581196 · Cited by 265 · cited 3×
“Accordingly, recent HCI research has expanded LLMs’ application to tasks such as co-writing with LLMs [15, 32, 49] and providing health interventions for socially isolated or marginalized individuals [37, 90].”
BackgroundStudent Learning Benefits of a Mixed-Reality Teacher Awareness Tool in AI-Enhanced Classrooms
Holstein, K., McLaren, B. M., & Aleven, V. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-93843-1_12 · Cited by 235 · cited 3×
“For example, AI has been used to adaptively manage students’ learning [61], provide teachers with real-time analysis of students [30], or even predict students’ dropout rates in higher education [18, 83].”
BackgroundResultDetect Rumor and Stance Jointly by Neural Multi-task Learning
Ma, J., Gao, W., & Wong, K.-F. (2018) · Companion of the The Web Conference 2018 on The Web Conference 2018 - WWW '18 · doi:10.1145/3184558.3188729 · Cited by 219 · cited 1×
“Moreover, the HCI community has long designed and studied fact-checking algorithms [4, 26, 35, 39, 89, 103] to identify fake news, false information, and rumors [47, 56–58].”
BackgroundArtificial Intelligence as an Effective Classroom Assistant
du Boulay, B. (2016) · IEEE Intelligent Systems · doi:10.1109/mis.2016.93 · Cited by 213 · cited 5×
“Multiple meta-analyses have already suggested that students learn better with AI tutors than with human tutors [19] and that students are enthusiastic about ChatGPT’s great availability and capability.”
BackgroundInfluential32 Qualitative Interviewing and Grounded Theory Analysis
Charmaz, K. (2012) · Handbook of Interview Research · doi:10.4135/9781412973588.d39 · Cited by 208
TaleBrush: Sketching Stories with Generative Pretrained Language Models
Chung, J. J. Y., Kim, W., Yoo, K. M., Lee, H., Adar, E., & Chang, M. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501819 · Cited by 206
CodeHelp: Using Large Language Models with Guardrails for Scalable Support in Programming Classes
Liffiton, M., Sheese, B. E., Savelka, J., & Denny, P. (2023) · Proceedings of the 23rd Koli Calling International Conference on Computing Education Research · doi:10.1145/3631802.3631830 · Cited by 192 · cited 1×
“” [Design Implication] Starting from medical education [20, 46], scholars have begun developing LLMs through fine-tuning that are specialized to unique subjects (e.g., math [78]) or specific domains (e.g., programming [53]).”
Background“Intelligent tutoring systems,”
Graesser, A. C., Hu, X., & Sottilare, R. (2018) · International Handbook of the Learning Sciences · doi:10.4324/9781315617572-24 · Cited by 182
Steenbergen-Hu, S., & Cooper, H. (2013) · Journal of Educational Psychology · doi:10.1037/a0032447 · Cited by 175
Jo, E., Epstein, D. A., Jung, H., & Kim, Y.-H. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581503 · Cited by 174
Examining Adult-Child Interactions in Intergenerational Participatory Design
Yip, J. C., Sobel, K., Pitt, C., Lee, K. J., Chen, S., Nasu, K., & Pina, L. R. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025787 · Cited by 168 · cited 1×
“Thus, the initial goal of the class was to give students ample chances to become acquainted with both AI technologies and essential design principles relevant to the participatory design processes [42, 76, 100].”
BackgroundZhang, A., Boltz, A., Wang, C. W., & Lee, M. K. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501866 · Cited by 166 · cited 1×
“AI is profoundly transforming our work environments [33, 34, 66, 67, 102], reshaping both the nature of work and the skills required.”
BackgroundDeictic believability: Coordinated gesture, locomotion, and speech in lifelike pedagogical agents
Lester, J. C., Voerman, J. L., Towns, S. G., & Callaway, C. B. (1999) · Applied Artificial Intelligence · doi:10.1080/088395199117324 · Cited by 161 · cited 1×
“It is difficult to grasp and solve such complex problems caused by the use of ChatGPT despite existing, extensive research into conversational agents (CA) and their practical applications [11, 12, 19, 23, 38, 52].”
BackgroundHeuristic Evaluation of Conversational Agents
Langevin, R., Lordon, R. J., Avrahami, T., Cowan, B. R., Hirsch, T., & Hsieh, G. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445312 · Cited by 159 · cited 1×
“In line with previous CHI studies [7, 48, 71, 99] that do not specifically focus on ChatGPT but value exploration of students’ unique experience with commercial AI (e.g., Alexa) and user-centered design, we explore students’ real experiences and perceptions of ChatGPT in higher education and…”
Designing for human–AI complementarity in K‐12 education
Holstein, K., & Aleven, V. (2022) · AI Magazine · doi:10.1002/aaai.12058 · Cited by 156
Designing Trans Technology: Defining Challenges and Envisioning Community-Centered Solutions
Haimson, O. L., Gorrell, D., Starks, D. L., & Weinger, Z. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376669 · Cited by 136 · cited 1×
“We did not measure intercoder reliability in line with similar qualitative and participatory design papers [25, 69, 99], following the justification presented in [9].”
ResultKim, S., Eun, J., Oh, C., Suh, B., & Lee, J. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376785 · Cited by 133 · cited 2×
“Regarding this, prior CHI studies [43, 50, 77, 79, 93] have investigated potential scenarios of interacting with multi-party based chatbots [ 77] as well as diverse roles of chatbots and their positive impact on familiarization among teammates [79], generating more ideas and diverse views [43, 50,…”
BackgroundThe classroom as a dashboard: co-designing wearable cognitive augmentation for K-12 teachers
Holstein, K., Hong, G., Tegene, M., McLaren, B. M., & Aleven, V. (2018) · Proceedings of the 8th International Conference on Learning Analytics and Knowledge · doi:10.1145/3170358.3170377 · Cited by 129 · cited 1×
“To solve such problems, Holstein et al. [29] created Lumilo, smart glasses that support teachers to assist students struggling learning with AI tutor by displaying real-time information about the students (i.e., their learning, meta cognition, and behavior).”
BackgroundProxemics and Social Interactions in an Instrumented Virtual Reality Workshop
Williamson, J., Li, J., Vinayagamoorthy, V., Shamma, D. A., & Cesar, P. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445729 · Cited by 127 · cited 1×
“Among recent CHI studies [36, 68, 95, 96] that demonstrate the strong effects of social presence of working or learning in the metaverse, Jin et al. [36] argued that although university students wanted VR adoption when learning to increase social presence, utilizing VR in higher education is still…”
BackgroundJiang, S., & Wilson, C. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274351 · Cited by 125 · cited 1×
“Moreover, the HCI community has long designed and studied fact-checking algorithms [4, 26, 35, 39, 89, 103] to identify fake news, false information, and rumors [47, 56–58].”
BackgroundWang, Q., Saha, K., Gregori, E., Joyner, D., & Goel, A. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445645 · Cited by 120 · cited 1×
“Regarding this, prior CHI studies [43, 50, 77, 79, 93] have investigated potential scenarios of interacting with multi-party based chatbots [ 77] as well as diverse roles of chatbots and their positive impact on familiarization among teammates [79], generating more ideas and diverse views [43, 50,…”
BackgroundRePrompt: Automatic Prompt Editing to Refine AI-Generative Art Towards Precise Expressions
Wang, Y., Shen, S., & Lim, B. Y. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581402 · Cited by 120 · cited 1×
“Research has further explored what challenges (e.g., prompt-engineering) users face when interacting with LLMs [94, 101], but the permeation of LLMs in academia and how it will change all aspects of education [44, 82] has not been investigated to answer 1) how exactly college students are using…”
BackgroundPark, H., Ahn, D., Hosanagar, K., & Lee, J. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445304 · Cited by 116 · cited 1×
“AI is profoundly transforming our work environments [33, 34, 66, 67, 102], reshaping both the nature of work and the skills required.”
BackgroundSelf-citationBuschek, D., Zürn, M., & Eiband, M. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445372 · Cited by 108 · cited 1×
“Because they produce language and dialogue similar to humans in terms of fluency and naturalness, people use and receive help from LLMs when doing various tasks, ranging from mundane (e.g., composing emails [10]) to creative (e.g., writing a novel [32, 49]).”
BackgroundHuman and Technological Infrastructures of Fact-checking
Juneja, P., & Mitra, T. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555143 · Cited by 99 · cited 1×
“Moreover, the HCI community has long designed and studied fact-checking algorithms [4, 26, 35, 39, 89, 103] to identify fake news, false information, and rumors [47, 56–58].”
BackgroundBeyond Dyadic Interactions: Considering Chatbots as Community Members
Seering, J., Luria, M., Kaufman, G., & Hammer, J. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300680 · Cited by 97 · cited 1×
“Regarding this, prior CHI studies [43, 50, 77, 79, 93] have investigated potential scenarios of interacting with multi-party based chatbots [ 77] as well as diverse roles of chatbots and their positive impact on familiarization among teammates [79], generating more ideas and diverse views [43, 50,…”
BackgroundYip, J. C., Sobel, K., Gao, X., Hishikawa, A. M., Lim, A., Meng, L., Ofiana, R. F., Park, J., & Hiniker, A. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300303 · Cited by 88 · cited 3×
“We did not measure intercoder reliability in line with similar qualitative and participatory design papers [25, 69, 99], following the justification presented in [9].”
BackgroundResultHow Will VR Enter University Classrooms? Multi-stakeholders Investigation of VR in Higher Education
Jin, Q., Liu, Y., Yarosh, S., Han, B., & Qian, F. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517542 · Cited by 77 · cited 3×
“For online interactions, we suggest human instructors utilize existing virtual platforms to arrange a space (e.g., PC-based Metaverse or VR [36]) where students can interact with peers while feeling stronger social presence.”
BackgroundRise of concerns about AI: reflections and directions
Dietterich, T. G., & Horvitz, E. J. (2015) · Communications of the ACM · doi:10.1145/2770869 · Cited by 76
(2018) · Cited by 73
Towards a Metaverse Workspace: Opportunities, Challenges, and Design Implications
Park, H., Ahn, D., & Lee, J. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581306 · Cited by 72
Self-citationOne AI Does Not Fit All: A Cluster Analysis of the Laypeople’s Perception of AI Roles
Kim, T., Molina, M. D., Rheu, M. (., Zhan, E. S., & Peng, W. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581340 · Cited by 68 · cited 2×
“What are the genuine roles of human tutors in circumstances where ChatGPT can assist students, such as editing their essays [15, 32, 44, 49], fixing their computer codes [14], and searching and retrieving information [63]?”
BackgroundPark, H., Ahn, D., Hosanagar, K., & Lee, J. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517672 · Cited by 67 · cited 1×
“AI is profoundly transforming our work environments [33, 34, 66, 67, 102], reshaping both the nature of work and the skills required.”
BackgroundSelf-citationDigital Proxemics: Designing Social and Collaborative Interaction in Virtual Environments
Williamson, J. R., O'Hagan, J., Guerra-Gomez, J. A., Williamson, J. H., Cesar, P., & Shamma, D. A. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517594 · Cited by 63 · cited 1×
“Among recent CHI studies [36, 68, 95, 96] that demonstrate the strong effects of social presence of working or learning in the metaverse, Jin et al. [36] argued that although university students wanted VR adoption when learning to increase social presence, utilizing VR in higher education is still…”
BackgroundMutual Theory of Mind for Human-AI CommunicationPreprint
Wang, Q., & Goel, A. K. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2210.03842 · Cited by 57
Learning from Fact-checkers: Analysis and Generation of Fact-checking Language
Vo, N., & Lee, K. (2019) · Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3331184.3331248 · Cited by 53 · cited 1×
“Moreover, the HCI community has long designed and studied fact-checking algorithms [4, 26, 35, 39, 89, 103] to identify fake news, false information, and rumors [47, 56–58].”
BackgroundLee, Y., Chung, J. J. Y., Song, J. Y., Chang, M., & Kim, J. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445222 · Cited by 52 · cited 3×
“Some students also self-study with others by using video-conferencing tools (e.g., Zoom) to share their appearance or study materials, which creates social presence and ambience [51].”
BackgroundSolutionChat: Real-time Moderator Support for Chat-based Structured Discussion
Lee, S.-C., Song, J., Ko, E.-Y., Park, S., Kim, J., & Kim, J. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376609 · Cited by 49 · cited 2×
“Regarding this, prior CHI studies [43, 50, 77, 79, 93] have investigated potential scenarios of interacting with multi-party based chatbots [ 77] as well as diverse roles of chatbots and their positive impact on familiarization among teammates [79], generating more ideas and diverse views [43, 50,…”
BackgroundWang, Q., Camacho, I., Jing, S., & Goel, A. K. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3512977 · Cited by 47
Yang, K. B., Echeverria, V., Lu, Z., Mao, H., Holstein, K., Rummel, N., & Aleven, V. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581398 · Cited by 47 · cited 1×
“…in HCI and AIEd have long accumulated relevant knowledge of educational AI and even established a basis for human-AI partnership in the classroom [98] beyond the development of successful AI tutors, little is known about how people should approach and prepare for LLM-based chatbots that are…”
BackgroundMathBERT: A Pre-trained Language Model for General NLP Tasks in Mathematics Education
Shen, J. T., Yamashita, M., Prihar, E., Heffernan, N., Wu, X., Graff, B., & Lee, D. (2021) · arXiv · doi:10.48550/arxiv.2106.07340 · Cited by 47 · cited 1×
“” [Design Implication] Starting from medical education [20, 46], scholars have begun developing LLMs through fine-tuning that are specialized to unique subjects (e.g., math [78]) or specific domains (e.g., programming [53]).”
BackgroundArtificial intelligence technologies for personnel learning management systems
Nenkov, N., Dimitrov, G., Dyachenko, Y., & Koeva, K. (2016) · 2016 IEEE 8th International Conference on Intelligent Systems (IS) · doi:10.1109/is.2016.7737420 · Cited by 46 · cited 1×
“For example, AI has been used to adaptively manage students’ learning [61], provide teachers with real-time analysis of students [30], or even predict students’ dropout rates in higher education [18, 83].”
BackgroundPark, H., & Lee, J. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445133 · Cited by 44 · cited 1×
“We did not measure intercoder reliability in line with similar qualitative and participatory design papers [25, 69, 99], following the justification presented in [9].”
ResultSelf-citationLu, X., Fan, S., Houghton, J., Wang, L., & Wang, X. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580957 · Cited by 42 · cited 1×
“The communities of HCI and AI in education (AIEd) have long endeavored to improve education by applying AI (e.g., educational robots [84, 91], adaptive assessment [27]) and leveraging a variety of interfaces (e.g., voice, text) [55, 92].”
BackgroundSocial copresence in anonymous social interactions using a mobile video telephone
Kang, S.-H., Watt, J. H., & Ala, S. K. (2008) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1357054.1357295 · Cited by 37 · cited 1×
“Studies have shown that the presence of others can affect not only the productivity of students in learning [51] but also the effectiveness of social interaction [40].”
BackgroundIntroBot: Exploring the Use of Chatbot-assisted Familiarization in Online Collaborative Groups
Shin, D., Kim, S., Shang, R., Lee, J., & Hsieh, G. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580930 · Cited by 37 · cited 2×
“Regarding this, prior CHI studies [43, 50, 77, 79, 93] have investigated potential scenarios of interacting with multi-party based chatbots [ 77] as well as diverse roles of chatbots and their positive impact on familiarization among teammates [79], generating more ideas and diverse views [43, 50,…”
BackgroundZhu, G., Fan, X., Hou, C., Zhong, T., SEOW, P. S. K., Chen, S. A., Rajalingam, P., Low, K. Y., & Poh, T. L. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.18616 · Cited by 30 · cited 1×
“As a result, ChatGPT has seen the most rapidly expanding consumer application ever recorded, a noteworthy milestone for any AI-based solution [31, 104].”
BackgroundGPT3-to-plan: Extracting plans from text using GPT-3
Olmo, A., Sreedharan, S., & Kambhampati, S. (2021) · arXiv · doi:10.48550/arxiv.2106.07131 · Cited by 27 · cited 1×
“What are the genuine roles of human tutors in circumstances where ChatGPT can assist students, such as editing their essays [15, 32, 44, 49], fixing their computer codes [14], and searching and retrieving information [63]?”
BackgroundAn Evaluation of Generative Pre-Training Model-based Therapy Chatbot for Caregivers
Wang, L., Mujib, M. I., Williams, J., Demiris, G., & Huh-Yoo, J. (2021) · arXiv · doi:10.48550/arxiv.2107.13115 · Cited by 21 · cited 2×
“Accordingly, recent HCI research has expanded LLMs’ application to tasks such as co-writing with LLMs [15, 32, 49] and providing health interventions for socially isolated or marginalized individuals [37, 90].”
BackgroundAppling, S., Bruckman, A. S., & Choudhury, M. D. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555128 · Cited by 17
Taştimur, C., Karaköse, M., & Akın, E. (2016) · International Conference on Information Technology Based Higher Education and Training (ITHET) · doi:10.1109/ithet.2016.7760736 · Cited by 15 · cited 1×
“For example, AI has been used to adaptively manage students’ learning [61], provide teachers with real-time analysis of students [30], or even predict students’ dropout rates in higher education [18, 83].”
BackgroundCodeHelp: Using Large Language Models with Guardrails for Scalable Support in Programming ClassesPreprint
Liffiton, M., Sheese, B. E., Šavelka, J., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2308.06921 · Cited by 9 · cited 1×
“” [Design Implication] Starting from medical education [20, 46], scholars have begun developing LLMs through fine-tuning that are specialized to unique subjects (e.g., math [78]) or specific domains (e.g., programming [53]).”
BackgroundINTELLIGENT TUTORING SYSTEMS - TRENDS ON DESIGN, DEVELOPMENT AND DEPLOYMENT
Niculescu, C. (2016) · eLearning and Software for Education · doi:10.12753/2066-026x-16-218 · Cited by 6 · cited 1×
“Among these diverse applications in AIEd, ITSs are the most prominent tool and well-established area of research [62, 74, 75] due to their scalability, accessibility, and personalization.”
BackgroundLeveraging the Singularity: Introducing AI to Liberal Arts Students
Marshall, J. B. (2008) · Cited by 2
Designing for human-AI complementarity in K-12 educationPreprint
Holstein, K., & Aleven, V. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.01266
OpenAI, Achiam, J., Adler, S., Agarwal, S., Ahmad, L., Akkaya, I., Aleman, F. L., Almeida, D., Altenschmidt, J., Altman, S., et al. (2023) · arXiv · doi:10.48550/arxiv.2303.08774
Research works printed but not linked: 8
- Safinah Ali, Blakeley H. Payne, Randi Williams, Hae Won Park, and Cynthia Breazeal. 2019. Constructionism, ethics, and creativity: Developing primary and middle school artificial intelligence education. In International workshop on education in artificial intelligence k-12 (eduai’19), 1–4.
- Jill Barshay. 2023. PROOF POINTS: It's easy to fool ChatGPT detectors. The Hechinger Report. Retrieved September 9, 2023 from https://hechingerreport.org/proof-points-its-easy-to-fool-chatgpt-detectors/
- John W. Creswell and Cheryl N. Poth. 2016. Qualitative inquiry and research design: Choosing among five approaches. Sage publications.
- W. Lewis Johnson, Jeff W. Rickel, and James C. Lester. 2000. Animated pedagogical agents: Face-to-face interaction in interactive learning environments. International Journal of Artificial intelligence in education 11, 1: 47–78.
- Will Summerlin. Productivity Gains Could Propel The AI Software Market To $14 Trillion By 2030 - ARK Invest. Retrieved September 7, 2023 from https://ark-invest.com/articles/analyst-research/productivity-gains-could-propel-the-ai-software-market-to-14-trillion-by-2030/
- J. World Economic Forum. 2020. The future of jobs report 2020. Retrieved from Geneva.
- 2014. Be More Human in the AI Age with Kevin Roose (Transcript). Steelcase. Retrieved September 7, 2023 from https://www.steelcase.com/research/articles/be-more-human-in-the-ai-age-with-kevin-roose-transcript/
- AI art: Artificial Intelligence won an art contest, and artists are furious. Retrieved September 7, 2023 from https://www.9news.com.au/world/ai-art-artificial-intelligence-won-an-art-contest-and-artists-are-furious/31d67f45-c0e7-4572-806f-f3ead1cde73d#
Cited by
Wang, J., & Fan, W. (2025) · Humanities and Social Sciences Communications · doi:10.1057/s41599-025-04787-y · Cited by 322
“…and generate content to enhance students ’ academic performance, it lacks emotional intelligence (Birenbaum, 2023), limiting its ability to provide the kind of “ humanized ” interaction needed to establish emotional resonance with students or spark deeper learning interest (Park and Ahn, 2024).”
RetractedGenerative AI and Academic Integrity in Higher Education: A Systematic Review and Research Agenda
Bittle, K., & El-Gayar, O. (2025) · Information · doi:10.3390/info16040296 · Cited by 305
“Park and Ahn [9], for instance, reveal that while ChatGPT can enhance information accessibility and efficiency, it threatens academic integrity by potentially lowering learning engagement and standards.”
InfluentialChatGPT Promises and Challenges in Education: Computational and Ethical Perspectives
Adel, A., Ahsan, A., & Davison, C. (2024) · Education Sciences · doi:10.3390/educsci14080814 · Cited by 108
Pang, R. Y., Schroeder, H., Smith, K. S., Barocas, S., Xiao, Z., Tseng, E., & Bragg, D. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713726 · Cited by 146
“For example, Park and Ahn [126] mentioned that their research is based only on English-speaking university students, so the result “ may not reflect students who speak English as a second language .”
Rapp, A., Lodovico, C. D., & Di, L. (2025) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2025.103471 · Cited by 76
Metadata
- Authors
- Park, H., & Ahn, D.
- Affiliations
- Seoul National University (KR)
- University of Georgia (US)
- Venue
- Proceedings of the CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2024-05-11
- Pages
- 1-21
- OpenAlex
- W4396831857
- Semantic Scholar
- aeb3963e323aceeedfb61dd1ef194ff8ee7cda5c
- Cited by
- 84
- References
- 83
- Citations by year
- 2026: 31 · 2025: 52 · 2024: 1
- FWCI
- 31.79
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion, cc-by)
- Topics
- Social Sciences › Education › Artificial Intelligence in Education
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Keywords
- ChatGPT, large language models, higher education, student use of AI, artificial intelligence in education, generative AI in writing, participatory design, student perceptions
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-25, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-25 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.