Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 100 of the 101 references it cites were found in a registry or an index, and 1 are not checked yet; 10 of the 47 sources its claims cite were checked for support.

The Promise and Peril of ChatGPT in Higher Education: Opportunities, Challenges, and Design Implications

Open access
Park, Hyanghee, Ahn, Daehwan · 2024 · Proceedings of the CHI Conference on Human Factors in Computing Systems

Abstract

A growing number of students in higher education are using ChatGPT for various educational purposes, ranging from seeking information to writing essays. Although many universities have officially banned the use of ChatGPT because of its potential harm and unintended consequences, it is still important to uncover how students leverage ChatGPT for learning, what challenges emerge, and how we can make better use of ChatGPT in higher education. Thus, we conducted focus group workshops and a series of participatory design sessions with thirty students who have actively interacted with ChatGPT for one semester in university and with other five stakeholders (e.g., professors, AI experts). Based on these, this paper identifies real opportunities and challenges of utilizing and designing ChatGPT for higher education.

Verified 2026-10-25 · 1 reference not checked yet

Overview

CoChat Summary

TL;DR

This CHI 2024 study used focus groups and participatory design with 30 undergraduates in a semester-long AI class plus 5 experts to examine ChatGPT in higher education. Students valued efficiency, personalization, and scalability, but reported hallucination, bias, transparency, recency, academic-integrity, social-interaction, and prompt-engineering challenges, leading to design proposals such as fine-tuning/embedding/fact-checking, prompt suggestions, learning maps, multi-agents, and social/metaverse features.

Key findings

  • Students found ChatGPT usable and beneficial: all teams praised its speed/efficiency, 24/7 availability, interactivity, and concise explanations; they also valued personalized feedback, perceived objectivity/fairness, a sense of privacy, and scalability for diversity, equity, inclusion, and extensibility with other educational tools.
  • Students identified algorithmic problems including hallucination, algorithmic bias (e.g., ChatGPT defaulting characters to specific races), lack of transparency/interpretability, and lack of recency; human/social problems including limited capability, decreased learning and academic integrity, reduced social interaction, lack of human ingenuity, and privacy concerns; and usability problems including difficult prompt engineering and lack of hands-on learning.
  • In participatory design, students and experts proposed functions to address hallucination via fine-tuning, embedding, and external fact-checking algorithms; improve usability via prompt suggestions, tutorials, learning maps/navigation, and AI-helper agents; provide less biased but more diverse perspectives via multi-agents; and foster social interactions via one-to-many communication and metaverse/VR-style spaces.
  • The paper argues that ChatGPT could complement intelligent tutoring systems: ITSs offer systematic dialogue, feedback, pumps, prompts, and scaffolding, while ChatGPT offers free-form, open-ended, student-directed interaction, but currently places high cognitive burdens on students.

Methods

  • Design: semester-long, three-phase curriculum in an accredited undergraduate AI class at an American university on the East Coast, spring 2023, about one month after ChatGPT-3.5’s release; students were permitted to use AI tools including ChatGPT-3.5 and DALL·E2 for legitimate educational purposes.
  • Sample: thirty undergraduate students (P01–P30) who actively participated in all curriculum phases, plus five external stakeholders/expert participants (P31–P35), including AI engineers and scholars; the study used focus group workshops, brainstorming, idea sketching, expert sessions, and participatory design sessions.
  • Analysis: qualitative thematic analysis with an inductive and iterative process of student-generated content (reports, individual/team reports, sketches, final presentations, focus group design activities, contest submissions) and expert interviews; intercoder reliability was not measured, following similar qualitative and participatory design papers.

Limitations

  • Stated: findings are based on English-speaking university students in a Western culture and may not reflect English-as-a-second-language students, students in other regions, or those unable to enter university; the study focused on undergraduates, so graduate students or those with different AI literacy may differ; classroom-based study may have made students uncomfortable sharing frank opinions in front of professors and peers; the study did not systematically observe or measure whether AI tools improved students’ learning; and it used ChatGPT-3.5, so newer versions such as ChatGPT-4 or Pro may yield different results.
  • Evident from the text: the sample is small (30 students plus 5 experts) and drawn from a single class/university; no personal demographic information was collected due to de-anonymization concerns; and no intercoder reliability was measured, which the authors justify by citing similar qualitative and participatory design work.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1145/3613904.3642785

Cites

100 of 101 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

6 Valid · 5 Not valid · 23 Not checked · 126 Own results and interpretations

64 more claims

Create a free account to see all 160 claims and to verify the 2 references still open.

See all claims — free account
  • Probably not a substantial claim. 62
  • It may state two separate claims as one. 50
  • The quote only partly states this claim. 1

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 83 references

Research works printed but not linked: 8

  1. Safinah Ali, Blakeley H. Payne, Randi Williams, Hae Won Park, and Cynthia Breazeal. 2019. Constructionism, ethics, and creativity: Developing primary and middle school artificial intelligence education. In International workshop on education in artificial intelligence k-12 (eduai’19), 1–4.
  2. Jill Barshay. 2023. PROOF POINTS: It's easy to fool ChatGPT detectors. The Hechinger Report. Retrieved September 9, 2023 from https://hechingerreport.org/proof-points-its-easy-to-fool-chatgpt-detectors/
  3. John W. Creswell and Cheryl N. Poth. 2016. Qualitative inquiry and research design: Choosing among five approaches. Sage publications.
  4. W. Lewis Johnson, Jeff W. Rickel, and James C. Lester. 2000. Animated pedagogical agents: Face-to-face interaction in interactive learning environments. International Journal of Artificial intelligence in education 11, 1: 47–78.
  5. Will Summerlin. Productivity Gains Could Propel The AI Software Market To $14 Trillion By 2030 - ARK Invest. Retrieved September 7, 2023 from https://ark-invest.com/articles/analyst-research/productivity-gains-could-propel-the-ai-software-market-to-14-trillion-by-2030/
  6. J. World Economic Forum. 2020. The future of jobs report 2020. Retrieved from Geneva.
  7. 2014. Be More Human in the AI Age with Kevin Roose (Transcript). Steelcase. Retrieved September 7, 2023 from https://www.steelcase.com/research/articles/be-more-human-in-the-ai-age-with-kevin-roose-transcript/
  8. AI art: Artificial Intelligence won an art contest, and artists are furious. Retrieved September 7, 2023 from https://www.9news.com.au/world/ai-art-artificial-intelligence-won-an-art-contest-and-artists-are-furious/31d67f45-c0e7-4572-806f-f3ead1cde73d#

Cited by

See all 95

Metadata

Authors
Park, H., & Ahn, D.
Affiliations
  • Seoul National University (KR)
  • University of Georgia (US)
Venue
Proceedings of the CHI Conference on Human Factors in Computing Systems
Publisher
ACM
Published
2024-05-11
Pages
1-21
OpenAlex
W4396831857
Cited by
84
References
83
Citations by year
2026: 31 · 2025: 52 · 2024: 1
FWCI
31.79
Type
conference paper
Language
en
Open access
Locations
CHI Conference on Human Factors in Computing Systems (publishedVersion, cc-by)
Topics
  • Social Sciences › Education › Artificial Intelligence in Education
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
Keywords
ChatGPT, large language models, higher education, student use of AI, artificial intelligence in education, generative AI in writing, participatory design, student perceptions

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-25, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-25 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: The Promise and Peril of ChatGPT in Higher Education: Opportunities, Challenges, and Design Implications. https://app.cochat.ai/papers/10.1145/3613904.3642785
The paper
Park, H., & Ahn, D. (2024). The Promise and Peril of ChatGPT in Higher Education: Opportunities, Challenges, and Design Implications. Proceedings of the CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3613904.3642785

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.