Exploring the impact of using Chat-GPT on student learning outcomes in technology learning: The comprehensive experiment
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
This experimental study investigates the impact of integrating Chat GPT (Generative Pre-trained Transformer) on student learning outcomes in technology education at Universitas Muhammadiyah Muara Bungo. The research involves an experimental group using Chat GPT and a control group with conventional methods. Data from 31 participants in each group were collected, assessing learning outcomes through final test scores. Analyzing the results with a t-test, the experimental group displayed significantly higher achievements than the control group, highlighting the positive effect of incorporating GPT Chat into educational technology. The study illuminates the potential of AI-powered chatbots like Chat GPT to enhance student learning outcomes. Further exploration is required to gauge its adaptability across diverse educational contexts for more enhanced learning results. T-test results, conducted at a 95% confidence level with α 0.05, and degrees of freedom dk = n1 + n2 - 2 = 60, showed tcount of 5.424 against ttable of 2.000, firmly establishing tcount > ttable (5.424 > 2.000). Consequently, the null hypothesis (H0) proposing no significant impact of Chat GPT utilization is refuted. Conversely, the alternative hypothesis (H1), signifying a significant influence from Chat GPT usage, is upheld, affirming its substantial role in students' technological education.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Artificial intelligence in higher education: the state of the field
Crompton, H., & Burke, D. (2023) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-023-00392-8 · Cited by 2,010 · cited 1×
“Through natural language processing and machine learning algorithms, Chat GPT enables interactive and personalized conversations, mimicking human-like interactions (Crompton and Burke 2023).”
BackgroundWhat if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education
Tlili, A., Shehata, B., Adarkwah, M. A., Bozkurt, A., Hickey, D. T., Huang, R., & Agyemang, B. (2023) · Smart Learning Environments · doi:10.1186/s40561-023-00237-x · Cited by 2,003 · cited 1×
“The results showed that the use of GPT Chat significantly improved student learning outcomes in learning (Tlili et al. 2023).”
ResultChatting about ChatGPT: how may AI and GPT impact academia and libraries?
Lund, B. D., & Wang, T. (2023) · Library Hi Tech News · doi:10.1108/lhtn-01-2023-0009 · Cited by 1,355
(2023) · Journal of Applied Learning & Teaching · doi:10.37074/jalt.2023.6.1.23 · Cited by 421
Tülübaş, T., Karakose, T., & Papadakis, S. (2023) · European Journal of Investigation in Health, Psychology and Education · doi:10.3390/ejihpe13100143 · Cited by 90
Karakose, T., Demirkol, M., Aslan, N., Köse, H., & Yirci, R. (2023) · Educational Process International Journal · doi:10.22521/edupij.2023.123.1 · Cited by 65 · cited 1×
“The availability of real-time feedback and customized guidance from Chat GPT helps to create a supportive learning environment, improve student learning outcomes, and encourage a deeper understanding of the learning material (Esplugas 2023), (Karakose et al. 2023).”
Method
Cited by
Fan, Y., Tang, L., Le, H., Shen, K., Tan, S., Zhao, Y., Shen, Y., Li, X., & Gašević, D. (2025) · British Journal of Educational Technology · doi:10.1111/bjet.13544 · Cited by 805
Sun, L., & Zhou, L. (2024) · Journal of Educational Computing Research · doi:10.1177/07356331241277937 · Cited by 129
“This result may indicate that medium-sized student groups can more effectively use the bene fi ts of Gen-AI, such as personalized learning paths and real-time feedback, to achieve signi fi cant gains in academic performance (Hakiki et al., 2023).”
Liu, X., Guo, B., He, W., & Hu, X. (2025) · Journal of Educational Computing Research · doi:10.1177/07356331251329185 · Cited by 89
Johnson, D. M., Doss, W., & Estepp, C. M. (2024) · Journal of Research in Technical Careers · doi:10.9741/2578-2118.1152 · Cited by 31
Zhang, Y., Lai, X., Yi, S., & Lu, Y. (2025) · Education and Information Technologies · doi:10.1007/s10639-024-13190-0 · Cited by 18
“Hakiki et al. (2023) and He et al. (2024) indicated that human-computer collaborative learning based on Generative AI could reduce learning anxiety.”
Metadata
- Authors
- Hakiki, M., Fadli, R., Samala, A. D., Fricticarani, A., Dayurni, P., Rahmadani, K., Astiti, A. D., & Sabir, A.
- Venue
- Advances in Mobile Learning Educational Research
- Publisher
- Syncsci Publishing Pte., Ltd.
- Published
- 2023-10-18
- Volume
- 3
- Issue
- 2
- Pages
- 859-872
- ISSN
- 2737-5676 (ISSN-L)
- OpenAlex
- W4387741388
- Cited by
- 56
- References
- 6
- FWCI
- 13.16
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Exploring the impact of using Chat-GPT on student learning outcomes in technology learning: The comprehensive experiment. https://app.cochat.ai/papers/10.25082/amler.2023.02.013
- The paper
- Hakiki, M., Fadli, R., Samala, A. D., Fricticarani, A., Dayurni, P., Rahmadani, K., Astiti, A. D., & Sabir, A. (2023). Exploring the impact of using Chat-GPT on student learning outcomes in technology learning: The comprehensive experiment. Advances in Mobile Learning Educational Research. https://doi.org/10.25082/amler.2023.02.013
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.