Assessment of Students Use of Generative Artificial Intelligence: Prompting Strategies and Prompt Engineering in Chemistry Education
Open accessAbstract
High Resolution Image Download MS PowerPoint Slide The rapid integration of generative artificial intelligence (AI) into educational settings prompts an urgent examination of its efficacy and the strategies that students employ to harness its potential. This study focuses on preservice chemistry teachers use of generative AI for chemistry-specific problem-solving and task completion. We found that there is a prevalent reliance on copy-pasting tactics in initial prompting approaches, and students need guidance to improve their prompting abilities. By implementing the “Five S” prompting framework, we explore the evolution of student prompts and the resultant satisfaction with AI-generated responses. Our findings indicate that, while students initially struggle with the nuances of effective prompting, the adoption of structured frameworks significantly enhances their perceived quality of AI-generated answers. This research sheds light on the current state of AI use among students but also underscores the importance of targeted educational frameworks to refine AI interaction in academic contexts. In particular, we suggest critical engagement and methodological prompt engineering strategies to maximize the educational benefits of generative AI technologies.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
GenAI tools, if not used effectively, can short-circuit students' learning process.
“These findings provide preliminary evidence that genAI tools, if not used effectively, can short-circuit students' learning process.”
From Scaffold or Crutch? Examining College Students' Use and Views of Generative AI Tools for STEM Education (2025) · cites this paper as Tassoti (2024)
Tassoti (2024) found that undergraduate students in a chemistry course predominantly relied on copying-pasting problems as their prompting strategy when interacting with genAI-based chatbots.
“Tassoti (2024) examined the prompting strategies of undergraduate students in a chemistry course and found that students predominantly relied on copying-pasting problems as their prompting strategy when interacting with genAI-based chatbots.”
From Scaffold or Crutch? Examining College Students' Use and Views of Generative AI Tools for STEM Education (2025) · cites this paper as Tassoti (2024)
Cites
ChatGPT for good? On opportunities and challenges of large language models for education
Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · Learning and Individual Differences · doi:10.1016/j.lindif.2023.102274 · Cited by 7,326 · see citing works
Liu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2023) · ACM Computing Surveys · doi:10.1145/3560815 · Cited by 4,361 · see citing works
Liu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2021) · arXiv · doi:10.48550/arxiv.2107.13586 · Cited by 4,352 · see citing works
Sallam, M. (2023) · Healthcare · doi:10.3390/healthcare11060887 · Cited by 3,126 · see citing works
What Is the Impact of ChatGPT on Education? A Rapid Review of the Literature
Lo, C. K. (2023) · Education Sciences · doi:10.3390/educsci13040410 · Cited by 2,024 · see citing works
What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education
Tlili, A., Shehata, B., Adarkwah, M. A., Bozkurt, A., Hickey, D. T., Huang, R., & Agyemang, B. (2023) · Smart Learning Environments · doi:10.1186/s40561-023-00237-x · Cited by 2,003 · see citing works
Examining Science Education in ChatGPT: An Exploratory Study of Generative Artificial Intelligence
Cooper, G. (2023) · Journal of Science Education and Technology · doi:10.1007/s10956-023-10039-y · Cited by 1,263 · see citing works
Tree of Thoughts: Deliberate Problem Solving with Large Language Models
Yao, S., Yu, D., Zhao, J., Shafran, I., Griffiths, T. L., Cao, Y., & Narasimhan, K. (2023) · arXiv · doi:10.48550/arxiv.2305.10601 · Cited by 1,158 · see citing works
Revolutionizing education with AI: Exploring the transformative potential of ChatGPT
Adiguzel, T., Kaya, M. H., & Cansu, F. K. (2023) · Contemporary Educational Technology · doi:10.30935/cedtech/13152 · Cited by 975 · see citing works
Pavlik, J. V. (2023) · Journalism & Mass Communication Educator · doi:10.1177/10776958221149577 · Cited by 972 · see citing works
ChatGPT in education: Strategies for responsible implementation
Halaweh, M. (2023) · Contemporary Educational Technology · doi:10.30935/cedtech/13036 · Cited by 607 · see citing works
The rise of <scp>ChatGPT</scp> : Exploring its potential in medical education
Lee, H. (2024) · Anatomical Sciences Education · doi:10.1002/ase.2270 · Cited by 596 · see citing works
Generative AI in Education and Research: Opportunities, Concerns, and Solutions
Alasadi, E. A., & Baiz, C. R. (2023) · Journal of Chemical Education · doi:10.1021/acs.jchemed.3c00323 · Cited by 463 · see citing works
Artificial intelligence applications in Latin American higher education: a systematic review
Salas-Pilco, S. Z., & Yang, Y. (2022) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-022-00326-w · Cited by 330 · see citing works
A systematic review of <scp>ChatGPT</scp> use in K‐12 education
Zhang, P., & Tur, G. (2024) · European Journal of Education · doi:10.1111/ejed.12599 · Cited by 280 · see citing works
Hornberger, M., Bewersdorff, A., & Nerdel, C. (2023) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2023.100165 · Cited by 276 · see citing works
Can ChatGPT support prospective teachers in physics task development?
Küchemann, S., Steinert, S., Revenga, N., Schweinberger, M., Dinc, Y., Avila, K. E., & Kuhn, J. (2023) · Physical Review Physics Education Research · doi:10.1103/physrevphyseducres.19.020128 · Cited by 132 · see citing works
Krupp, L., Steinert, S., Kiefer-Emmanouilidis, M., Avila, K. E., Lukowicz, P., Kuhn, J., Küchemann, S., & Karolus, J. (2024) · Frontiers in Artificial Intelligence and Applications · doi:10.3233/faia240195 · Cited by 82 · see citing works
West, J. K., Franz, J. L., Hein, S. M., Leverentz-Culp, H. R., Mauser, J. F., Ruff, E. F., & Zemke, J. M. (2023) · Journal of Chemical Education · doi:10.1021/acs.jchemed.3c00581 · Cited by 79 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Artificial intelligence in teaching and teacher professional development: A systematic review
Tan, X., Cheng, G., & Ling, M. H. (2025) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2024.100355 · Cited by 420 · see citing works
Cheah, Y. H., Lu, J., & Kim, J. (2025) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2025.100363 · Cited by 134 · see citing works
Guo, Q., Zhen, J., Wu, F., He, Y., & Qiao, C. (2025) · Journal of Educational Computing Research · doi:10.1177/07356331241312365 · Cited by 28 · see citing works
Yuriev, E., Burton, M. G., Knott, D., Terrill, A. E., Jackson, N. R. C., & Chen, S. (2025) · Journal of Chemical Education · doi:10.1021/acs.jchemed.4c01499 · Cited by 26 · see citing works
Wang, K. D., Wu, Z., Tufts, L., Wieman, C., Salehi, S., & Haber, N. (2025) · 2025 IEEE Global Engineering Education Conference (EDUCON) · doi:10.1109/educon62633.2025.11016406 · Cited by 28 · see citing works
- Authors
- Tassoti, S.
- Affiliations
- University of Graz (AT)
- Corresponding author
- Tassoti, Sebastian
- ORCID
- Tassoti, Sebastian
- Venue
- Journal of Chemical Education
- Publisher
- American Chemical Society (ACS)
- Published
- 2024-05-22
- Volume
- 101
- Issue
- 6
- Pages
- 2475-2482
- ISSN
- 0021-9584 (ISSN-L)
- 1938-1328
- OpenAlex
- W4398194304
- Cited by
- 129
- References
- 19
- Citations by year
- 2026: 65 · 2025: 48 · 2024: 16
- FWCI
- 48.50
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Journal of Chemical Education (publishedVersion, cc-by)
- Funders
- Karl-Franzens-Universit?t Graz
- Joachim Herz Stiftung
- Topics
- Physical Sciences › Computer Science › Information Systems › Artificial Intelligence in Education
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Keywords
- generative AI, prompt engineering, prompting strategies, pre-service chemistry teachers, chemistry problem solving, AI-generated responses, student use of AI, chemistry education
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review