Using ChatGPT for Science Learning: A Study on Pre-service Teachers' Lesson Planning
Open accessThe DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index.
Abstract
While ongoing efforts have continuously emphasized the integration of ChatGPT with science teaching and learning, there are limited empirical studies exploring its actual utility in the classroom. This study aims to fill this gap by analyzing the lesson plans developed by 29 pre-service elementary teachers and assessing how they integrated ChatGPT into science learning activities. We first examined how ChatGPT was integrated with the subject domains, teaching methods/strategies and then evaluated the lesson plans using a GenAI-TPACK-based rubric. We further examined pre-service teachers' perceptions and concerns about integrating ChatGPT into science learning. Results show a diverse number of ChatGPT applications in different science domains—e.g., Biology (9/29), Chemistry (7/29), and Earth Science (7/29). Fourteen types of teaching methods/strategies were identified in the lesson plans. On average, the pre-service teachers' lesson plans scored high on the modified TPACK-based rubric (M = 3.29; SD = .91; on a 1-4 scale), indicating a reasonable envisage of integrating ChatGPT into science learning, particularly in ‘instructional strategies & ChatGPT’ (M = 3.48; SD = .99). However, they scored relatively lower on exploiting ChatGPT's functions toward its full potential (M = 3.00; SD = .93), compared to other aspects. We also identified several inappropriate use cases of ChatGPT in lesson planning (e.g., as a source of hallucinated internet material and technically unsupported visual guidance). Pre-service teachers anticipated ChatGPT to afford high-quality questioning, self-directed learning, individualized learning support, and formative assessment. Meanwhile, they also expressed concerns about its accuracy and the risks that students may be overly dependent on ChatGPT. They further suggested solutions to systemizing classroom dynamics between teachers and students. The study underscores the need for more research on the roles of generative AI in actual classroom settings and provides insights for future AI-integrated science learning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1978) · Medical Entomology and Zoology · Cited by 53,488
The Use of Cronbach’s Alpha When Developing and Reporting Research Instruments in Science Education
Taber, K. S. (2018) · Research in Science Education · doi:10.1007/s11165-016-9602-2 · Cited by 10,679 · cited 1×
“69,basedontheresultsfor29lessonplanevaluation, whichfallsintotherangeof“acceptable”[50].”
ChatGPT for Good? On Opportunities and Challenges of Large Language Models for Education
Kasneci, E., Seßler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · doi:10.35542/osf.io/5er8f · Cited by 7,552
ChatGPT for good? On opportunities and challenges of large language models for education
Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · Learning and Individual Differences · doi:10.1016/j.lindif.2023.102274 · Cited by 7,326 · cited 6×
“Some researchers have proposed the use of ChatGPT in educational settings and out-lined potential guidelines and considerations for its deployment [5], [7].”
BackgroundInfluentialThe Constant Comparative Method of Qualitative Analysis
Glaser, B. G. (1965) · Social Problems · doi:10.2307/798843 · Cited by 4,588
Mind in Society: Development of Higher Psychological Processes
VYGOTSKY, L. S. (1980) · doi:10.2307/j.ctvjf9vz4 · Cited by 3,123
Conceptualizing AI literacy: An exploratory review
Ng, D. T. K., Leung, J. K. L., Chu, S. K. W., & Qiao, M. S. (2021) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2021.100041 · Cited by 2,205
Artificial intelligence in education: Addressing ethical challenges in K-12 settings
Akgun, S., & Greenhow, C. (2022) · AI and Ethics · doi:10.1007/s43681-021-00096-7 · Cited by 1,473
Vision, challenges, roles and research issues of Artificial Intelligence in Education
Hwang, G.-J., Xie, H., Wah, B. W., & Gašević, D. (2020) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2020.100001 · Cited by 1,435 · cited 1×
“ThisoptimismisrootedintheanticipationthatAI, particularlythroughtools,suchasChatGPT,willrevolutionize theprovisionofpersonalizedguidance,support,andfeedbackto students,whilealsoaidingteachersandpolicymakersinmaking informedinstructionaldecisions[11].”
(2016) · Open Research Online (The Open University) · Cited by 1,410
(2016) · Wiley eBooks · doi:10.1002/9781119239086 · Cited by 1,341
Concrete Problems in AI Safety
Amodei, D., Olah, C., Steinhardt, J., Christiano, P., Schulman, J., & Mané, D. (2016) · arXiv · doi:10.48550/arxiv.1606.06565 · Cited by 1,314
Examining Science Education in ChatGPT: An Exploratory Study of Generative Artificial Intelligence
Cooper, G. (2023) · Journal of Science Education and Technology · doi:10.1007/s10956-023-10039-y · Cited by 1,263
Harris, J., Mishra, P., & Koehler, M. (2009) · Journal of Research on Technology in Education · doi:10.1080/15391523.2009.10782536 · Cited by 1,091
Celik, I. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107468 · Cited by 1,012 · cited 3×
“In response to the recent rise of AI in the educational field, Celik [48] suggested Intelligent-TPACK (I-TPACK) to measure teachers’ knowledge of AI-based instruction.”
BackgroundMethodThe promises and challenges of artificial intelligence for teachers: A systematic review of research
Celik, I., Dindar, M., Muukkonen, H., & Järvelä, S. (2022) · TechTrends · doi:10.1007/s11528-022-00715-y · Cited by 984 · cited 2×
“Research also suggests that the key to technology integration is the teacher’s willingness to use technology, the availability of supportive resources, and an interactive learning environment [30].”
BackgroundChatGPT User Experience: Implications for Education
Zhai, X. (2023) · doi:10.2139/ssrn.4312418 · Cited by 935 · cited 6×
“Critical thinking or digital literacy on what ChatGPT provides will be important expertise of future science teachers [4], [5].”
BackgroundInfluentialArt and the science of generative AI
Epstein, Z., Hertzmann, A., the Investigators of Human Creativity, Akten, M., Farid, H., Fjeld, J., Frank, M. R., Groh, M., Herman, L., Leach, N., et al. (2023) · Science · doi:10.1126/science.adh4451 · Cited by 788
The Constant Comparative Method of Qualitative Analysis
Glaser, B. G. (1965) · Social Problems · doi:10.1525/sp.1965.12.4.03a00070 · Cited by 758
Engineering Education in the Era of ChatGPT: Promise and Pitfalls of Generative AI for Education
Qadir, J. (2023) · 2023 IEEE Global Engineering Education Conference (EDUCON) · doi:10.1109/educon54358.2023.10125121 · Cited by 707 · cited 6×
“Some researchers have proposed the use of ChatGPT in educational settings and out-lined potential guidelines and considerations for its deployment [5], [7].”
BackgroundInfluentialJeon, J., & Lee, S. (2023) · Education and Information Technologies · doi:10.1007/s10639-023-11834-1 · Cited by 696 · cited 2×
“As the pioneering GenAI, ChatGPT shows the potential to lead transformative shifts in teaching and learning worldwide [4], [7], [8], [35].”
BackgroundComputer Technology Integration and Student Learning: Barriers and Promise
Keengwe, J., Onchwari, G., & Wachira, P. W. (2008) · Journal of Science Education and Technology · doi:10.1007/s10956-008-9123-5 · Cited by 374
Hong, W. C. H. (2023) · Journal of Educational Technology and Innovation · doi:10.61414/jeti.v5i1.103 · Cited by 365
Testing a TPACK-Based Technology Integration Assessment Rubric
Harris, J., Grandgenett, N. F., & Hofer, M. J. (2010) · DigitalCommons@UNO · Cited by 341
Applying Large Language Models and Chain-of-Thought for Automatic Scoring
Lee, G.-G., Latif, E., Wu, X., Liu, N.-H., & Zhai, X. (2023) · Computers and Education: Artificial Intelligence · doi:10.48550/arxiv.2312.03748 · Cited by 276
Self-citationFrom PCK to TPACK: Developing a Transformative Model for Pre-Service Science Teachers
Jang, S.-J., & Chen, K.-C. (2010) · Journal of Science Education and Technology · doi:10.1007/s10956-010-9222-y · Cited by 265
Fine-tuning ChatGPT for Automatic Scoring
Latif, E., & Zhai, X. (2023) · Computers and Education: Artificial Intelligence · doi:10.48550/arxiv.2310.10072 · Cited by 251
Self-citationBarak, M. (2017) · Research in Science Education · doi:10.1007/s11165-015-9501-y · Cited by 231
“We Need To Talk About ChatGPT”: The Future of AI and Higher Education
Neumann, M., Rauschenberger, M., & Schön, E.-M. (2023) · Hochschule Hannover · doi:10.25968/opus-2467 · Cited by 212
Pedagogical approaches for technology-integrated science teaching
Hennessy, S., Wishart, J., Whitelock, D., Deaney, R., Brawn, R., Velle, L. L., McFarlane, A., Ruthven, K., & Winterbottom, M. (2007) · Computers & Education · doi:10.1016/j.compedu.2006.02.004 · Cited by 205
Applying large language models and chain-of-thought for automatic scoring
Lee, G.-G., Latif, E., Wu, X., Liu, N., & Zhai, X. (2024) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2024.100213 · Cited by 186
Self-citationFine-tuning ChatGPT for automatic scoring
Latif, E., & Zhai, X. (2024) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2024.100210 · Cited by 179
Chatgpt for next generation science learning
Zhai, X. (2023) · XRDS Crossroads The ACM Magazine for Students · doi:10.1145/3589649 · Cited by 178 · cited 7×
“5andGPT-4models,showcasingtheevolutionofLLMsintouser-centric learning tools [8].”
BackgroundInfluentialKim, D.-R., & Bolger, M. S. (2016) · International Journal of Science and Mathematics Education · doi:10.1007/s10763-015-9709-3 · Cited by 165
Engineering Education in the Era of ChatGPT: Promise and Pitfalls of Generative AI for Education
Qadir, J. (2022) · doi:10.36227/techrxiv.21789434 · Cited by 161
Chan, C. K. Y. (2025) · Education and Information Technologies · doi:10.1007/s10639-024-13151-7 · Cited by 128
AI and formative assessment: The train has left the station
Zhai, X., & Nehm, R. H. (2023) · Journal of Research in Science Teaching · doi:10.1002/tea.21885 · Cited by 125
Technology Integration in a Science Classroom: Preservice Teachers’ Perceptions
Rehmat, A. P., & Bailey, J. M. (2014) · Journal of Science Education and Technology · doi:10.1007/s10956-014-9507-7 · Cited by 122
Bilici, S. C., Guzey, S. S., & Yamak, H. (2016) · Research in Science & Technological Education · doi:10.1080/02635143.2016.1144050 · Cited by 117
Kapıcı, H. Ö., & Akçay, H. (2020) · Educational Studies · doi:10.1080/03055698.2020.1835610 · Cited by 109
Koç, M. (2005) · Journal of Turkish Science Education · Cited by 86
Lee, G.-G., Mun, S., Shin, M.-K., & Zhaı, X. (2024) · Science & Education · doi:10.1007/s11191-024-00526-y · Cited by 84
Self-citationJacobs, C. L., Martin, S. N., & Otieno, T. (2008) · Science Education · doi:10.1002/sce.20277 · Cited by 83
Generative AI Professional Development Needs for Teacher Educators
Nyaaba, M., & Zhaı, X. (2024) · Journal of AI · doi:10.61969/jai.1385915 · Cited by 79
Sias, C. M., Nadelson, L. S., Juth, S. M., & Seifert, A. L. (2016) · The Journal of Educational Research · doi:10.1080/00220671.2016.1253539 · Cited by 75
Teachers’ agency in the era of LLM and generative AI: Designing pedagogical AI agents
Lan, Y.-J., & Chen, N.-S. (2024) · DOAJ (DOAJ: Directory of Open Access Journals) · doi:10.30191/ets.202401_27(1).pp01 · Cited by 70
ChatGPT for Next Generation Science Learning
Zhai, X. (2023) · doi:10.2139/ssrn.4331313 · Cited by 58
Großmann, L., & Krüger, D. (2023) · Science Education · doi:10.1002/sce.21832 · Cited by 55
ICT integration in teachers’ lesson plans: A scoping review of empirical studies
König, J., Heine, S., Jäger-Biela, D., & Rothland, M. (2024) · European Journal of Teacher Education · doi:10.1080/02619768.2022.2138323 · Cited by 55
ChatGPT and AI: The Game Changer for Education
Zhaı, X. (2023) · doi:10.13140/rg.2.2.31107.37923 · Cited by 50
Lesson plan analysis protocol (LPAP): A useful tool for researchers and educational evaluators
Ndihokubwayo, K., Byukusenge, C., Byusa, E., Habiyaremye, H. T., Mbonyiryivuze, A., & Mukagihana, J. (2022) · Heliyon · doi:10.1016/j.heliyon.2022.e08730 · Cited by 50
Uses of Artificial Intelligence in STEM Education
(2024) · doi:10.1093/oso/9780198882077.001.0001 · Cited by 48
Self-citationEduChat: A Large-Scale Language Model-based Chatbot System for Intelligent Education
Dan, Y., Lei, Z., Gu, Y., Li, Y., Yin, J., Lin, J., Ye, L., Tie, Z., Zhou, Y., Wang, Y., et al. (2023) · arXiv · doi:10.48550/arxiv.2308.02773 · Cited by 41
Zhaı, X., Li, M., & Guo, Y. (2018) · International Journal of Science Education · doi:10.1080/09500693.2018.1512772 · Cited by 30
Chan, C. K. Y. (2023) · arXiv · doi:10.48550/arxiv.2306.03358 · Cited by 29
Juhler, M. V. (2017) · Research in Science Education · doi:10.1007/s11165-016-9574-2 · Cited by 17
Lee, G.-G., Kang, D. Y., Kim, M. J., Hong, H., & Martin, S. N. (2023) · Cultural Studies of Science Education · doi:10.1007/s11422-023-10169-0 · Cited by 12
Self-citationSCIENCE TEACHERS’ THEORY-BASED TEACHING: CONNECTING A LEARNING CYCLE MODEL TO A LESSON PLAN
Lee, I., Park, J., & Yoon, H. (2022) · Journal of Baltic Science Education · doi:10.33225/jbse/22.21.462 · Cited by 7
Generative AI Professional Development Needs for Teacher EducatorsPreprint
Nyaaba, M., & Zhaı, X. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4628126 · Cited by 6
Lee, G.-G., Mun, S., Shin, M.-K., & Zhai, X. (2024) · arXiv · doi:10.48550/arxiv.2401.05400 · Cited by 4
Self-citation
Research works printed but not linked: 2
- Herdliska, 2023, AI-based Scientific Inquiry
- Holmes, 2019, Artificial intelligence
Cited by
Does ChatGPT enhance student learning? A systematic review and meta-analysis of experimental studies
Deng, R., Jiang, M., Yu, X., Lu, Y., & Liu, S. (2025) · Computers & Education · doi:10.1016/j.compedu.2024.105224 · Cited by 531
Artificial intelligence in teaching and teacher professional development: A systematic review
Tan, X., Cheng, G., & Ling, M. H. (2025) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2024.100355 · Cited by 420
Multimodality of AI for Education: Toward Artificial General Intelligence
Lee, G., Shi, L., Latif, E., Gao, Y., Bewersdorff, A., Nyaaba, M., Guo, S., Liu, Z., Mai, G., Liu, T., et al. (2025) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2025.3574466 · Cited by 55
Self-citationZhai, X. (2025) · Journal of Science Education and Technology · doi:10.1007/s10956-024-10174-0 · Cited by 184
ChatGPT Promises and Challenges in Education: Computational and Ethical Perspectives
Adel, A., Ahsan, A., & Davison, C. (2024) · Education Sciences · doi:10.3390/educsci14080814 · Cited by 108
Metadata
- Authors
- Lee, G.-G., & Zhai, X.
- Affiliations
- University of Georgia (US)
- Mary Frances Early College of Education, University of Georgia, Athens, GA, USA
- Venue
- IEEE Transactions on Learning Technologies
- Published
- 2024
- Volume
- 17
- Pages
- 1643-1660
- ISSN
- 1939-1382 (ISSN-L)
- 2372-0050
- OpenAlex
- W4396941333
- Semantic Scholar
- 7223eb86633616cecf484006cad2584655fed90b
- Cited by
- 269
- References
- 53
- Citations by year
- 2026: 135 · 2025: 109 · 2024: 25
- FWCI
- 106.03
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Transactions on Learning Technologies (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by-nc-nd)
- arXiv (Cornell University) (cc-by-nc-nd)
- Topics
- Social Sciences › Education › Artificial Intelligence in Education
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Education › Education and Technology Integration
- Keywords
- ChatGPT, generative AI in education, science learning, pre-service teachers, lesson planning, TPACK, elementary science teaching, teacher perceptions, AI hallucination, teacher-student relationship, self-directed learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.