Investigation of student experiences with ChatGPT-supported online learning applications in higher education
Open accessThe DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Abstract
The purpose of this study was to determine university students' experiences with the use of ChatGPT in online courses. The sample consisted of 84 associate degree students from a state university in Turkey. A multi-method approach was used in the study. Although quantitative data were collected using the Chatbot Usability Scale, qualitative data were collected using a semi-structured interview form that we developed. The data were analysed using descriptive and content analysis methods. According to the findings, ChatGPT exhibits advantages such as a user-friendly interface and fast, concise, relevant responses. Moreover, emphasizing its contribution to the learning process, the information provided was sufficient and topic-oriented. The understandability of the chatbot’s functions and the clarity of their communication were emphasized. However, there are disadvantages such as performance issues, frequency of errors and the risk of providing misleading information. Concerns have also been raised about the potential difficulties chatbots may face in ambiguous conversations and providing insufficient information on privacy issues. In conclusion, ChatGPT is recognised as a potentially valuable tool in education based on positive usability impressions; however, more research is needed for its safe use. Implications for practice or policy Based on positive usability impressions, students and instructors can use ChatGPT to support educational activities. ChatGPT can promote and enhance students' personalised learning experiences. ChatGPT can be used in all higher education courses. Users should be cautious about the accuracy and reliability of the answers provided by ChatGPT. Decision-makers should take precautions against risks such as privacy, ethics, confidentiality and security that may arise from using artificial intelligence in education.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-019-0171-0 · Cited by 7,242 · cited 1×
“There is a need for more studies on how AI applications should be adapted to higher education (Zawacki-Richter et al., 2019).”
BackgroundChatting and cheating: Ensuring academic integrity in the era of ChatGPT
Cotton, D. R. E., Cotton, P. A., & Shipway, J. R. (2024) · Innovations in Education and Teaching International · doi:10.1080/14703297.2023.2190148 · Cited by 3,087
Chatting and Cheating. Ensuring academic integrity in the era of ChatGPT
Cotton, D., Cotton, P., & Shipway, J. R. (2023) · doi:10.35542/osf.io/mrz8h · Cited by 3,079
Gilson, A., Safranek, C. W., Huang, T., Socrates, V., Chi, L., Taylor, R. A., & Chartash, D. (2023) · JMIR Medical Education · doi:10.2196/45312 · Cited by 2,078
What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education
Tlili, A., Shehata, B., Adarkwah, M. A., Bozkurt, A., Hickey, D. T., Huang, R., & Agyemang, B. (2023) · Smart Learning Environments · doi:10.1186/s40561-023-00237-x · Cited by 2,003 · cited 2×
“Similar results were also obtained in the study conducted by Tlili et al. (2023).”
BackgroundResultChatGPT: Bullshit spewer or the end of traditional assessments in higher education?
(2023) · Journal of Applied Learning & Teaching · doi:10.37074/jalt.2023.6.1.9 · Cited by 1,806 · cited 1×
“This situation is emphasised to promote self-regulation (Chiu et al., 2023) and facilitate learning by increasing participation (Karsenti, 2019; Rudolph et al., 2023; Šlapeta, 2023).”
BackgroundEthics of AI in Education: Towards a Community-Wide Framework
Holmes, W., Porayska-Pomsta, K., Holstein, K., Sutherland, E., Baker, T., Shum, S. B., Santos, O. C., Rodrigo, M. T., Cukurova, M., Bittencourt, I. I., et al. (2022) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-021-00239-1 · Cited by 1,437
ChatGPT for Education and Research: Opportunities, Threats, and Strategies
Rahman, M. M., & Watanobe, Y. (2023) · Applied Sciences · doi:10.3390/app13095783 · Cited by 1,080 · cited 2×
“It can also make extra contributions in terms of providing instant feedback for students and creating scenario-based learning environments (Rahman & Watanobe, 2023).”
BackgroundHistorical threads, missing links, and future directions in AI in education
Williamson, B., & Eynon, R. (2020) · Learning, Media and Technology · doi:10.1080/17439884.2020.1798995 · Cited by 981
Revolutionizing education with AI: Exploring the transformative potential of ChatGPT
Adiguzel, T., Kaya, M. H., & Cansu, F. K. (2023) · Contemporary Educational Technology · doi:10.30935/cedtech/13152 · Cited by 975 · cited 1×
“This can be explained by the view that ethical issues cannot be ignored in AI-supported educational applications (Adıgüzel et al., 2023).”
BackgroundPavlik, J. V. (2023) · Journalism & Mass Communication Educator · doi:10.1177/10776958221149577 · Cited by 972 · cited 1×
“Trained on a massive Internet text data set to understand various topics and contexts, including blogs, novels and classical literature (Marr, 2022), one of its most important features is its ability to generate human-like texts (Pavlik, 2023; Qadir, 2022).”
BackgroundInteracting with educational chatbots: A systematic review
Kuhail, M. A., Alturki, N., Alramlawi, S., & Alhejori, K. (2023) · Education and Information Technologies · doi:10.1007/s10639-022-11177-3 · Cited by 841
Open AI in Education, the Responsible and Ethical Use of ChatGPT Towards Lifelong Learning
Mhlanga, D. (2023) · doi:10.2139/ssrn.4354422 · Cited by 719 · cited 2×
“Participating students formed groups and researched the answers to the questions using ChatGPT 3.5 language model developed by OpenAI (Mhlanga, 2023) for 15 minutes.”
MethodInfluentialTeacher support and student motivation to learn with Artificial Intelligence (AI) based chatbot
Chiu, T. K. F., Moorhouse, B. L., Chai, C. S., & Ismailov, M. (2024) · Interactive Learning Environments · doi:10.1080/10494820.2023.2172044 · Cited by 707
Open artificial intelligence platforms in nursing education: Tools for academic progress or abuse?
O’Connor, S., & ChatGPT (2023) · Nurse Education in Practice · doi:10.1016/j.nepr.2022.103537 · Cited by 585
Unleashing the Potential of Chatbots in Education: A State-Of-The-Art Analysis
Winkler, R., & Soellner, M. (2018) · Academy of Management Proceedings · doi:10.5465/ambpp.2018.15903abstract · Cited by 581
Investigating the impact of user trust on the adoption and use of ChatGPT: Survey analysis
Choudhury, A., & Shamszare, H. (2023) · Journal of Medical Internet Research · doi:10.2196/47184 · Cited by 470
Xia, Q., Chiu, T. K. F., Lee, M., Sanusi, I. T., Dai, Y., & Chai, C. S. (2022) · Computers & Education · doi:10.1016/j.compedu.2022.104582 · Cited by 469
Stuck in the middle: The use and interpretation of mid-points in items on questionnaires
Nadler, J. T., Weston, R., & Voyles, E. C. (2015) · The Journal of General Psychology · doi:10.1080/00221309.2014.994590 · Cited by 396 · cited 1×
“It is also accepted that a midpoint option may cause biases towards the center and the desire for social desirability (Nadler et al., 2015).”
BackgroundCan Large Language Models Provide Feedback to Students? A Case Study on ChatGPT
Dai, W., Lin, J., Jin, H., Li, T., Tsai, Y.-S., Gašević, D., & Chen, G. (2023) · 2023 IEEE International Conference on Advanced Learning Technologies (ICALT) · doi:10.1109/icalt58122.2023.00100 · Cited by 395 · cited 1×
“Tlili et al. (2023) and Dai et al. (2023) used case study in their studies on students' ChatGPT experiences.”
BackgroundCan Large Language Models Provide Feedback to Students? A Case Study on ChatGPT
Dai, W., Lin, J., Jin, F., Li, T., Tsai, Y.-S., Gasevic, D., & Chen, G. (2023) · doi:10.35542/osf.io/hcgzj · Cited by 395
Cox, A. M., Pinfield, S., & Rutter, S. (2019) · Library Hi Tech · doi:10.1108/lht-08-2018-0105 · Cited by 333
Is ChatGPT A Good Translator? Yes With GPT-4 As The Engine
Jiao, W., Wang, W., Huang, J.-T., Wang, X., Shi, S., & Tu, Z. (2023) · arXiv · doi:10.48550/arxiv.2301.08745 · Cited by 317
Engineering Education in the Era of ChatGPT: Promise and Pitfalls of Generative AI for Education
Qadir, J. (2022) · doi:10.36227/techrxiv.21789434.v1 · Cited by 264
Ethical issues in service robotics and artificial intelligence
Belk, R. (2021) · The Service Industries Journal · doi:10.1080/02642069.2020.1727892 · Cited by 228
Mapping out a research agenda for generative artificial intelligence in tertiary education
Lodge, J. M., Thompson, K., & Corrin, L. (2023) · Australasian Journal of Educational Technology · doi:10.14742/ajet.8695 · Cited by 209
Assessing the Usability of ChatGPT for Formal English Language Learning
Shaikh, S., Yayilgan, S. Y., Klimova, B., & Pikhart, M. (2023) · European Journal of Investigation in Health, Psychology and Education · doi:10.3390/ejihpe13090140 · Cited by 183
Gilson, A., Safranek, C., Huang, T., Socrates, V., Chi, L., Taylor, R. A., & Chartash, D. (2022) · doi:10.1101/2022.12.23.22283901 · Cited by 172
Let's have a chat! A Conversation with ChatGPT: Technology, Applications, and Limitations
Shahriar, S., & Hayawi, K. (2023) · arXiv · doi:10.48550/arxiv.2302.13817 · Cited by 167
Let’s Have a Chat! A Conversation with ChatGPT: Technology, Applications, and Limitations
Shahriar, S., & Hayawi, K. (2023) · Artificial Intelligence and Applications · doi:10.47852/bonviewaia3202939 · Cited by 167
Educational Research and AI-Generated Writing: Confronting the Coming Tsunami
Tate, T. P., Doroudi, S., Ritchie, D., Xu, Y., & uci, M. W. (2023) · doi:10.35542/osf.io/4mec3 · Cited by 137
Can ChatGPT Pass High School Exams on English Language Comprehension?
de Winter, J. C. F. (2024) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-023-00372-z · Cited by 115
Evaluating the logical reasoning ability of chatgpt and GPT-4
Liu, H., Ning, R., Teng, Z., Liu, J., Zhou, Q., & Zhang, Y. (2023) · arXiv · doi:10.48550/arxiv.2304.03439 · Cited by 100
Cited by
ChatGPT in the higher education: A systematic literature review and research challenges
Baig, M. I., & Yadegaridehkordi, E. (2024) · International Journal of Educational Research · doi:10.1016/j.ijer.2024.102411 · Cited by 208
“ChatGPT seems too good to be true”: College students’ use and perceptions of generative AI
Baek, C., Tate, T., & Warschauer, M. (2024) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2024.100294 · Cited by 306
Ahmed, Z., Shanto, S. S., Rime, M. H. K., Morol, M. K., Fahad, N., Hossen, M. J., & Abdullah-Al-Jubair, M. (2024) · IEEE Access · doi:10.1109/access.2024.3461874 · Cited by 123
“This convenience is especially beneficial in academic research and study, where time is crucial [32], [48], [49].”
BackgroundLiu, X., & Zhong, B. (2025) · Educational Research Review · doi:10.1016/j.edurev.2025.100741 · Cited by 78
AI in Tertiary Education: Progress on Research and Practice
Thompson, K., Corrin, L., & Lodge, J. M. (2023) · Australasian Journal of Educational Technology · doi:10.14742/ajet.9251 · Cited by 31
Metadata
- Authors
- Kayalı, B., Yavuz, M., Balat, Ş., & Çalışan, M.
- Venue
- Australasian Journal of Educational Technology
- Published
- 2023-12-22
- Volume
- 39
- Issue
- 5
- Pages
- 20-39
- ISSN
- 1449-3098 (ISSN-L)
- 1449-5554
- OpenAlex
- W4390099321
- Cited by
- 75
- References
- 33
- FWCI
- 17.62
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.