Are Lesson Plans Created by ChatGPT More Effective? An Experimental Study
Open accessThe DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
In this research, we aimed to determine whether students' math achievements improved using ChatGPT, one of the chatbot tools, to prepare lesson plans in primary school math courses. The research was conducted with a pretest-posttest control group experimental design. The study comprises 39 third-grade students (experimental group = 24, control group = 15). The implementation process lasted five weeks and 25 lesson hours. In the experimental group, lessons were taught according to plans prepared using ChatGPT, while in the control group, existing lesson plans were used. Students' academic achievement was measured with a multiple-choice achievement test of 25 questions with two separate questions for each learning objective. According to the results, students' academic achievement increased significantly (d = 1.268) in math lessons taught according to lesson plans prepared using the ChatGPT. Although there was a difference between the post-test scores of the experimental group and the control group in favor of the experimental group, it was determined that this difference was not significant. These results show that teaching primary school math according to lesson plans prepared using ChatGPT is effective in academic achievement. Teachers should consider ChatGPT and their plans, combining them and benefiting from both in the implementation process.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ChatGPT for Good? On Opportunities and Challenges of Large Language Models for Education
Kasneci, E., Seßler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · doi:10.35542/osf.io/5er8f · Cited by 7,552
ChatGPT for good? On opportunities and challenges of large language models for education
Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · Learning and Individual Differences · doi:10.1016/j.lindif.2023.102274 · Cited by 7,326 · cited 2×
“…software used as a solid bridge between users and the system, students can experience their knowledge and skills within the scope of AR/VR, especially in early childhood periods such as primary school, and enable students to learn the subject entertainingly and permanently (Kasneci et al., 2023).”
BackgroundMethodBAİDOO-ANU, D., & OWUSU ANSAH, L. (2023) · Journal of AI · doi:10.61969/jai.1337500 · Cited by 3,939
Baidoo-Anu, D., & Owusu Ansah, L. (2023) · doi:10.2139/ssrn.4337484 · Cited by 3,004
Gilson, A., Safranek, C. W., Huang, T., Socrates, V., Chi, L., Taylor, R. A., & Chartash, D. (2023) · JMIR Medical Education · doi:10.2196/45312 · Cited by 2,078
A SWOT analysis of ChatGPT: Implications for educational practice and research
Farrokhnia, M., Banihashem, S. K., Noroozi, O., & Wals, A. (2024) · Innovations in Education and Teaching International · doi:10.1080/14703297.2023.2195846 · Cited by 1,384 · cited 3×
“SWOT analyses (Farrokhnia et al., 2023) confirm this (Hirsh-Pasek & Blinkoff, 2023).”
BackgroundResultChatGPT for Language Teaching and Learning
Kohnke, L., Moorhouse, B. L., & Zou, D. (2023) · RELC Journal · doi:10.1177/00336882231162868 · Cited by 1,371 · cited 1×
“In another study by Kohnke et al. (2023), it is mentioned that ChatGPT risks causing ethical violations, giving misleading answers to its users, and being open to cultural prejudices.”
BackgroundExamining Science Education in ChatGPT: An Exploratory Study of Generative Artificial Intelligence
Cooper, G. (2023) · Journal of Science Education and Technology · doi:10.1007/s10956-023-10039-y · Cited by 1,263
Revolutionizing education with AI: Exploring the transformative potential of ChatGPT
Adiguzel, T., Kaya, M. H., & Cansu, F. K. (2023) · Contemporary Educational Technology · doi:10.30935/cedtech/13152 · Cited by 975 · cited 1×
“Adiguzel et al. (2023) state that educators, researchers, and politicians should cooperate to ethically and responsibly include the opportunities provided by ChatGPT in education systems.”
BackgroundInteracting with educational chatbots: A systematic review
Kuhail, M. A., Alturki, N., Alramlawi, S., & Alhejori, K. (2023) · Education and Information Technologies · doi:10.1007/s10639-022-11177-3 · Cited by 841
Cited by
Artificial intelligence in teaching and teacher professional development: A systematic review
Tan, X., Cheng, G., & Ling, M. H. (2025) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2024.100355 · Cited by 420
Wang, J., & Fan, W. (2025) · Humanities and Social Sciences Communications · doi:10.1057/s41599-025-04787-y · Cited by 322
RetractedGenerative AI in Education: Pedagogical, Theoretical, and Methodological Perspectives
Noroozi, O., Soleimani, S., Farrokhnia, M., & Banihashem, S. K. (2024) · International Journal of Technology in Education · doi:10.46328/ijte.845 · Cited by 165
Kong, S. C., Yang, Y., & Hou, C. (2024) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2024.100328 · Cited by 125
Mhasakar, M., Baker-Ramos, R., Carter, B., Helekahi-Kaiwi, E.-B., & Hester, J. (2025) · Proceedings of the Extended Abstracts of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706599.3720282 · Cited by 6
Metadata
- Authors
- Karaman, M. R., & Göksu, İ.
- Venue
- International Journal of Technology in Education
- Publisher
- ISTES Organization
- Published
- 2024-02-04
- Volume
- 7
- Issue
- 1
- Pages
- 107-127
- ISSN
- 2689-2758 (ISSN-L)
- OpenAlex
- W4392169966
- Cited by
- 96
- References
- 21
- FWCI
- 36.74
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Are Lesson Plans Created by ChatGPT More Effective? An Experimental Study. https://app.cochat.ai/papers/10.46328/ijte.607
- The paper
- Karaman, M. R., & Göksu, İ. (2024). Are Lesson Plans Created by ChatGPT More Effective? An Experimental Study. International Journal of Technology in Education. https://doi.org/10.46328/ijte.607
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.