Are Lesson Plans Created by ChatGPT More Effective? An Experimental Study
Open accessThe DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
In this research, we aimed to determine whether students' math achievements improved using ChatGPT, one of the chatbot tools, to prepare lesson plans in primary school math courses. The research was conducted with a pretest-posttest control group experimental design. The study comprises 39 third-grade students (experimental group = 24, control group = 15). The implementation process lasted five weeks and 25 lesson hours. In the experimental group, lessons were taught according to plans prepared using ChatGPT, while in the control group, existing lesson plans were used. Students' academic achievement was measured with a multiple-choice achievement test of 25 questions with two separate questions for each learning objective. According to the results, students' academic achievement increased significantly (d = 1.268) in math lessons taught according to lesson plans prepared using the ChatGPT. Although there was a difference between the post-test scores of the experimental group and the control group in favor of the experimental group, it was determined that this difference was not significant. These results show that teaching primary school math according to lesson plans prepared using ChatGPT is effective in academic achievement. Teachers should consider ChatGPT and their plans, combining them and benefiting from both in the implementation process.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ChatGPT for Good? On Opportunities and Challenges of Large Language Models for Education
Kasneci, E., Seßler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · doi:10.35542/osf.io/5er8f · Cited by 7,552
ChatGPT for good? On opportunities and challenges of large language models for education
Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · Learning and Individual Differences · doi:10.1016/j.lindif.2023.102274 · Cited by 7,326 · cited 2×
“…software used as a solid bridge between users and the system, students can experience their knowledge and skills within the scope of AR/VR, especially in early childhood periods such as primary school, and enable students to learn the subject entertainingly and permanently (Kasneci et al., 2023).”
BackgroundMethodBAİDOO-ANU, D., & OWUSU ANSAH, L. (2023) · Journal of AI · doi:10.61969/jai.1337500 · Cited by 3,939
Baidoo-Anu, D., & Owusu Ansah, L. (2023) · doi:10.2139/ssrn.4337484 · Cited by 3,004
Gilson, A., Safranek, C. W., Huang, T., Socrates, V., Chi, L., Taylor, R. A., & Chartash, D. (2023) · JMIR Medical Education · doi:10.2196/45312 · Cited by 2,078
A SWOT analysis of ChatGPT: Implications for educational practice and research
Farrokhnia, M., Banihashem, S. K., Noroozi, O., & Wals, A. (2024) · Innovations in Education and Teaching International · doi:10.1080/14703297.2023.2195846 · Cited by 1,384 · cited 3×
“SWOT analyses (Farrokhnia et al., 2023) confirm this (Hirsh-Pasek & Blinkoff, 2023).”
BackgroundResultChatGPT for Language Teaching and Learning
Kohnke, L., Moorhouse, B. L., & Zou, D. (2023) · RELC Journal · doi:10.1177/00336882231162868 · Cited by 1,371 · cited 1×
“In another study by Kohnke et al. (2023), it is mentioned that ChatGPT risks causing ethical violations, giving misleading answers to its users, and being open to cultural prejudices.”
BackgroundExamining Science Education in ChatGPT: An Exploratory Study of Generative Artificial Intelligence
Cooper, G. (2023) · Journal of Science Education and Technology · doi:10.1007/s10956-023-10039-y · Cited by 1,263
Revolutionizing education with AI: Exploring the transformative potential of ChatGPT
Adiguzel, T., Kaya, M. H., & Cansu, F. K. (2023) · Contemporary Educational Technology · doi:10.30935/cedtech/13152 · Cited by 975 · cited 1×
“Adiguzel et al. (2023) state that educators, researchers, and politicians should cooperate to ethically and responsibly include the opportunities provided by ChatGPT in education systems.”
BackgroundInteracting with educational chatbots: A systematic review
Kuhail, M. A., Alturki, N., Alramlawi, S., & Alhejori, K. (2023) · Education and Information Technologies · doi:10.1007/s10639-022-11177-3 · Cited by 841
Teacher support and student motivation to learn with Artificial Intelligence (AI) based chatbot
Chiu, T. K. F., Moorhouse, B. L., Chai, C. S., & Ismailov, M. (2024) · Interactive Learning Environments · doi:10.1080/10494820.2023.2172044 · Cited by 707
ChatGPT in education: Strategies for responsible implementation
Halaweh, M. (2023) · Contemporary Educational Technology · doi:10.30935/cedtech/13036 · Cited by 607 · cited 1×
“OpenAI will continue to develop ChatGPT in line with demands shortly, enabling the introduction of versions that are less likely to make errors (e.g., ChatGPT Academia as an alternative to Google Scholar) (Halaweh, 2023).”
BackgroundEssel, H. B., Vlachopoulos, D., Tachie-Menson, A., Johnson, E. E., & Baah, P. K. (2022) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-022-00362-6 · Cited by 428 · cited 1×
“The ease of use of these applications, which have different features and capabilities, and the Ensuring the effective integration of chatbots into education and training activities can positively affect the academic success of students (Essel et al., 2022).”
BackgroundImpact of ChatGPT on Learning Motivation: Teachers and Students' Voices
Ali, J. K. M., Shamsan, M. A. A., Hezam, T. A., & Mohammed, A. A. Q. (2023) · Journal of English Studies in Arabia Felix · doi:10.56540/jesaf.v2i1.51 · Cited by 335 · cited 1×
“Ali et al. (2023) find it essential to integrate ChatGPT into various language programs, with teacher control, to make the learning process more accessible and encourage students.”
BackgroundGarcía-Peñalvo, F. J. (2023) · Education in the Knowledge Society (EKS) · doi:10.14201/eks.31279 · Cited by 331
ChatGPT: Fundamentals, Applications and Social Impacts
Abdullah, M., Madain, A., & Jararweh, Y. (2022) · 2022 Ninth International Conference on Social Networks Analysis, Management and Security (SNAMS) · doi:10.1109/snams58071.2022.10062688 · Cited by 310 · cited 1×
“ChatGPT's reliance on big data available in the literature (Abdullah et al., 2022) may have enabled it to propose inclusive activities with high teaching potential.”
BackgroundHow Chat GPT Can Transform Autodidactic Experiences and Open Education?
Firat, M. (2023) · doi:10.31219/osf.io/9ge8m · Cited by 280
Han, J.-W., Park, J., & Lee, H. (2022) · BMC Medical Education · doi:10.1186/s12909-022-03898-3 · Cited by 187
Exploring the potential of using ChatGPT in physics education
Liang, Y., Zou, D., Xie, H., & Wang, F. L. (2023) · Smart Learning Environments · doi:10.1186/s40561-023-00273-7 · Cited by 98 · cited 1×
“Liang et al. (2023) also found that ChatGPT could explain solutions to physics calculation problems and produce new exercises at the primary school level.”
BackgroundAdapting to the Future: ChatGPT as a Means for Supporting Constructivist Learning Environments
Kim, M., & Adlof, L. (2024) · TechTrends · doi:10.1007/s11528-023-00899-x · Cited by 97 · cited 2×
“Kim and Adlof (2023) emphasize that teachers should use ChatGPT as a tool rather than a goal to provide a constructivist learning environment.”
BackgroundMethodChatgpt for Designing Course Outlines: A Boon or Bane to Modern Technology
Gupta, P. K., Raturi, S., & Venkateswarlu, P. (2023) · doi:10.2139/ssrn.4386113 · Cited by 34
Cited by
Artificial intelligence in teaching and teacher professional development: A systematic review
Tan, X., Cheng, G., & Ling, M. H. (2025) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2024.100355 · Cited by 420
Wang, J., & Fan, W. (2025) · Humanities and Social Sciences Communications · doi:10.1057/s41599-025-04787-y · Cited by 322
RetractedGenerative AI in Education: Pedagogical, Theoretical, and Methodological Perspectives
Noroozi, O., Soleimani, S., Farrokhnia, M., & Banihashem, S. K. (2024) · International Journal of Technology in Education · doi:10.46328/ijte.845 · Cited by 165
Kong, S. C., Yang, Y., & Hou, C. (2024) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2024.100328 · Cited by 125
Mhasakar, M., Baker-Ramos, R., Carter, B., Helekahi-Kaiwi, E.-B., & Hester, J. (2025) · Proceedings of the Extended Abstracts of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706599.3720282 · Cited by 6
Metadata
- Authors
- Karaman, M. R., & Göksu, İ.
- Venue
- International Journal of Technology in Education
- Publisher
- ISTES Organization
- Published
- 2024-02-04
- Volume
- 7
- Issue
- 1
- Pages
- 107-127
- ISSN
- 2689-2758 (ISSN-L)
- OpenAlex
- W4392169966
- Cited by
- 96
- References
- 21
- FWCI
- 36.74
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.