Benefits and Challenges of Collaboration between Students and Conversational Generative Artificial Intelligence in Programming Learning: An Empirical Case Study
Open accessThe DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
The utilization of conversational generative artificial intelligence (Gen AI) in learning is often seen as a double-edged sword that may lead to superficial learning. We designed and implemented a programming course focusing on collaboration between students and Gen AI. This study explores the dynamics of such collaboration, focusing on students’ communication strategies with Gen AI, perceived benefits, and challenges encountered. Data were collected from class observations, surveys, final reports, dialogues between students and Gen AI, and semi-structured in-depth interviews. The results showed that effective collaboration between students and Gen AI could enhance students’ meta-cognitive and self-regulated learning skills and positively impact human-to-human communication. This study further revealed the difficulties and individual differences in collaborating with Gen AI on complex learning tasks. Overall, collaborating with Gen AI as a learning partner, rather than just a tool, enables sustainable and independent learning, beyond specific learning tasks at a given time.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Metacognition and cognitive monitoring: A new area of cognitive–developmental inquiry
Flavell, J. H. (1979) · American Psychologist · doi:10.1037/0003-066x.34.10.906 · Cited by 11,282 · cited 1×
“Therefore, this study indicates greater effort should be placed on helping students maintain a higher degree of independence and leadership in their interactions with Gen AI.”
BackgroundChatGPT for Good? On Opportunities and Challenges of Large Language Models for Education
Kasneci, E., Seßler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · doi:10.35542/osf.io/5er8f · Cited by 7,552
ChatGPT for good? On opportunities and challenges of large language models for education
Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · Learning and Individual Differences · doi:10.1016/j.lindif.2023.102274 · Cited by 7,326
An Educational Psychology Success Story: Social Interdependence Theory and Cooperative Learning
Johnson, D. W., & Johnson, R. T. (2009) · Educational Researcher · doi:10.3102/0013189x09339057 · Cited by 2,721
Johnson, D. W., Maruyama, G., Johnson, R., Nelson, D., & Skon, L. (1981) · Psychological Bulletin · doi:10.1037/0033-2909.89.1.47 · Cited by 1,588
A comprehensive AI policy education framework for university teaching and learning
Chan, C. K. Y. (2023) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-023-00408-3 · Cited by 1,577 · cited 2×
“Despite the challenges and risks to education, it is essential to integrate Gen AI into higher education by equipping graduates with Gen AI proficiency for various sectors, enhancing personalized education, and preparing for future societal roles [10].”
BackgroundVision, challenges, roles and research issues of Artificial Intelligence in Education
Hwang, G.-J., Xie, H., Wah, B. W., & Gašević, D. (2020) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2020.100001 · Cited by 1,435
Gao, C. A., Howard, F. M., Markov, N. S., Dyer, E. C., Ramesh, S., Luo, Y., & Pearson, A. T. (2022) · doi:10.1101/2022.12.23.521610 · Cited by 1,099 · cited 1×
“Using Gen AI output in its current state as a learning artifact may inhibit deeper learning and pose a risk of plagiarism [4,5].”
BackgroundGao, C. A., Howard, F. M., Markov, N. S., Dyer, E. C., Ramesh, S., Luo, Y., & Pearson, A. T. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00819-6 · Cited by 1,099
Collaborative learning and the “conversation of mankind”
Bruffee, K. A. (1984) · College English · doi:10.2307/376924 · Cited by 1,016
Cited by
Zhang, X., Zhang, P., Shen, Y., Liu, M., Wang, Q., Gašević, D., & Fan, Y. (2024) · Frontiers of Digital Education · doi:10.1007/s44366-024-0028-5 · Cited by 83
Matobobo, C., Ncube, P. D. N., Ngesimani, N. L., Dzvapatsva, G. P., & Chinhamo, E. (2025) · 2025 IEEE Global Engineering Education Conference (EDUCON) · doi:10.1109/educon62633.2025.11016317 · Cited by 17
“A study in [18] describes GenAI as a “supportive companion” in programming education, providing a non-judgmental space where students can experiment and develop creativity alongside essential CT skills.”
Sun, J., & Rui, J. (2026) · Journal of Educational Computing Research · doi:10.1177/07356331251399452 · Cited by 6
Generative AI for health communication training among health care students
Lo Ping, C. F. (2026) · Current Opinion in Epidemiology and Public Health · doi:10.1097/pxh.0000000000000070
Metadata
- Authors
- Yan, W., Nakajima, T., & Sawada, R.
- Venue
- Education Sciences
- Publisher
- MDPI AG
- Published
- 2024-04-20
- Volume
- 14
- Issue
- 4
- Pages
- 433
- ISSN
- 2227-7102 (ISSN-L)
- OpenAlex
- W4395011010
- Cited by
- 60
- References
- 19
- FWCI
- 22.96
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Benefits and Challenges of Collaboration between Students and Conversational Generative Artificial Intelligence in Programming Learning: An Empirical Case Study. https://app.cochat.ai/papers/10.3390/educsci14040433
- The paper
- Yan, W., Nakajima, T., & Sawada, R. (2024). Benefits and Challenges of Collaboration between Students and Conversational Generative Artificial Intelligence in Programming Learning: An Empirical Case Study. Education Sciences. https://doi.org/10.3390/educsci14040433
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.