Cited by 54Artificial Intelligence in EducationTeaching and Learning ProgrammingArtificial Intelligence in Healthcare and Education

“It's not like Jarvis, but it's pretty close!” - Examining ChatGPT's Usage among Undergraduate Students in Computer Science

Open access
Budhiraja, Ritvik, Joshi, Ishika, Challa, Jagat Sesh, Akolekar, Harshal D., Kumar, Dhruv·2024·Proceedings of the 26th Australasian Computing Education Conference

Abstract

Large language models (LLMs) such as ChatGPT and Google Bard have garnered significant attention in the academic community. Previous research has evaluated these LLMs for various applications such as generating programming exercises and solutions. However, these evaluations have predominantly been conducted by instructors and researchers, not considering the actual usage of LLMs by students. This study adopts a student-first approach to comprehensively understand how undergraduate computer science students utilize ChatGPT, a popular LLM, released by OpenAI. We employ a combination of student surveys and interviews to obtain valuable insights into the benefits, challenges, and suggested improvements related to ChatGPT. Our findings suggest that a majority of students (over 57%) have a convincingly positive outlook towards adopting ChatGPT as an aid in coursework-related tasks. However, our research also highlights various challenges that must be resolved for long-term acceptance of ChatGPT amongst students. The findings from this investigation have broader implications and may be applicable to other LLMs and their role in computing education.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3636243.3636257

Cites

31 of 31 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • The pre-workshop survey results that students used ChatGPT for various purposes are consistent with findings of numerous studies that investigated student use and perceptions of ChatGPT.

    “This is consistent with the findings of numerous studies that investigated student use and perceptions of ChatGPT, which found that students appreciated the technology's ability to provide personalized guidance, facilitate understanding of difficult concepts, and assist with writing tasks (Budhiraja et al. 2024;Ding et al. 2023;Li 2023;Mahapatra 2024;Malik et al. 2023;Yan 2023).”

    From Fostering AI Literacy in Undergraduates: A ChatGPT Workshop Case Study (2025) · cites this paper as Budhiraja et al. 2024

  • Students appreciated ChatGPT's ability to provide personalized guidance, facilitate understanding of difficult concepts, or assist with writing tasks.

    “Students appreciated Chat-GPT's ability to provide personalized guidance, facilitate understanding of difficult concepts, or assist with writing tasks (Budhiraja et al. 2024;Ding et al. 2023;Li 2023;Mahapatra 2024;Malik et al. 2023;Yan 2023).”

    From Fostering AI Literacy in Undergraduates: A ChatGPT Workshop Case Study (2025) · cites this paper as Budhiraja et al. 2024

  • Students surveyed and interviewed by Budhiraja et al. expressed a desire for more training on effective uses of GenAI tools.

    “For example, students that were surveyed and interviewed by Budhiraja et al. [23] expressed a desire for more training on effective uses of GenAI tools”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Budhiraja, R., Joshi, I., Challa, J. S., Akolekar, H. D., & Kumar, D.
Affiliations
  • Indraprastha Institute of Information Technology Delhi (IN)
  • Birla Institute of Technology and Science, Pilani (IN)
  • Dept of Mech. Eng. & School of AIDE, IIT Jodhpur, India
Venue
Proceedings of the 26th Australasian Computing Education Conference
Publisher
ACM
Published
2024-01-29
Pages
124-133
OpenAlex
W4390490886
Cited by
52
References
31
Citations by year
2026: 14 · 2025: 26 · 2024: 12
FWCI
19.80
Type
conference paper
Language
en
Open access
Locations
  • Australasian Computing Education Conference (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Information Systems › Artificial Intelligence in Education
  • Physical Sciences › Computer Science › Computer Science Applications › Teaching and Learning Programming
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
Keywords
ChatGPT, large language models, computer science undergraduates, student use of AI, student attitudes toward AI, student perceptions of AI tools

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review