The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index; 1 of the 10 sources its claims cite were checked for support.
Examining Science Education in ChatGPT: An Exploratory Study of Generative Artificial Intelligence
Open accessAbstract
Examining Science Education in ChatGPT: An Exploratory Study of Generative Artificial Intelligence Grant Cooper · 2023 · Journal of Science Education and Technology The advent of generative artificial intelligence (AI) offers transformative potential in the… [465 chars total — truncated for storage]
Overview
CoChat Summary
TL;DR
This exploratory self-study examines how ChatGPT answered science education questions, how educators might use it in science pedagogy, and the author’s reflections on it as a research tool. It finds ChatGPT output often aligned with research themes and could help design units, rubrics, and quizzes, but warns about lack of evidence, epistemic authority, and ethical concerns.
Key findings
- ChatGPT responses to prompts 1 and 3 often aligned with key research themes; the prompt 1 list overlapped with Hackling and Prain’s six elements on inquiry, real-world connections, differentiation, technology, assessment, and collaboration, while ChatGPT added professional development and Hackling/Prain stressed broader community connections.
- For pedagogy, output to prompts 4, 5, and 6 illustrated helpful idea generation for science units, rubrics, and quizzes; the 5Es unit embedded renewable/non-renewable energy in a pedagogical framework, but some output seemed “a little generic and in need of further refinement,” and the rubric categories were “too vague to identify specific indicators.”
- A major criticism is the absence of evidence: ChatGPT runs the risk of positioning itself as “the ultimate epistemic authority,” assuming a single truth without proper grounding; prompt 2’s balance claim lacked evidence and context, and it has been reported to provide false and misleading references.
- Ethical concerns include potential environmental impact, content moderation issues (Kenyan workers paid about $2 per hour), and copyright infringement; the author used ChatGPT mainly for editing and clarity, with some sentences improved and others better before rewriting.
Methods
- Exploratory self-study methodology; the author posed a series of ChatGPT prompts broadly related to science education, collected responses in January 2023, and critically analysed the output against key themes in the research literature.
- Three research questions: how ChatGPT answered science education questions; ways educators could utilise ChatGPT in science pedagogy; and how ChatGPT was used in the study plus reflections on it as a research tool.
- Prompts included key characteristics of effective science teaching, chalk-and-talk versus student-centred pedagogies, what happens if a student is failing science, a 5Es teaching unit, a rubric, and a quiz; the author also used ChatGPT for editing and rewriting sentences.
Limitations
- The paper states it is exploratory and “in no way intended to be a comprehensive discussion”; results are “a moment-in-time response,” the same questions could yield different responses, and the author has “more questions than answers.”
- The paper states it does not extensively probe ethical implications related to ChatGPT.
- Evident from the text: this is a single-author self-study with a small set of prompts, no systematic coding or quantitative evaluation, and no independent verification of ChatGPT outputs; findings are tied to the January 2023 version and the author’s contexts.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
1 Valid · 3 Not valid · 9 Not checked · 20 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Impressively, ChatGPT's output often aligned with key themes in the research.”
- Also stated in: § [ChatGPT Prompt 1]: What Are Key Characteristics of Effective Science Teaching? · boosted
“Overall, there seems strong alignment between the two lists.”
- Also stated in: § [ChatGPT Prompt 3]: What Happens if a Student Is Failing in Science, Should I Care? · plain
“There are several helpful suggestions in the ChatGPT response that align with the research literature.”
§ Examining Science Education in ChatGPT: An Exploratory Study of Generative Artificial Intelligence > Abstract
boostedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § [ChatGPT Prompt 1]: What Are Key Characteristics of Effective Science Teaching? · boosted
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“I was particularly impressed by its capacity to generate a science unit underpinned by the 5Es model, even if some of the output seemed a little generic and in need of further refinement.”
§ Examining Science Education in ChatGPT: An Exploratory Study of Generative Artificial Intelligence > RQ2: What Are Some Ways Educators Could Utilise ChatGPT in Their Science Pedagogy?
plainstates a causeSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Broadly speaking, the ChatGPT response commonly aligned with key research themes in the literature.”
§ Examining Science Education in ChatGPT: An Exploratory Study of Generative Artificial Intelligence > RQ1: How Did ChatGPT Answer Questions Related to Science Education?
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“As it currently stands, ChatGPT runs the risk of positioning itself as the ultimate epistemic authority, where a single truth is assumed, without a proper grounding in evidence or presented with sufficient qualifications.”
§ Examining Science Education in ChatGPT: An Exploratory Study of Generative Artificial Intelligence > RQ1: How Did ChatGPT Answer Questions Related to Science Education?
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Probably not a substantial claim. 27
- It may state two separate claims as one. 9
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, the same study reported that, despite its transformative potential, GenAI's impact often remains subtle.”
From Knowledge (Co-)Construction Among Artificial Intelligence, Novice Teachers, and Experienced Teachers in an Online Professional Learning Community (2025) · cites this paper as Cooper(2023)
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Moreover, Cooper concluded that by observing peers' interactions with GenAI or engaging with it themselves, teachers can gradually develop a clearer understanding of its practical advantages and limitations; and that this iterative process helps dispel misconceptions and fosters a more nuanced appreciation of AI's role in professional learning.”
From Knowledge (Co-)Construction Among Artificial Intelligence, Novice Teachers, and Experienced Teachers in an Online Professional Learning Community (2025) · cites this paper as Cooper(2023)
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“That is, when using it independently, teachers may default to a behaviourist approach, treating GenAI as an authoritative source of information rather than engaging in reflective and collaborative practices.”
From Knowledge (Co-)Construction Among Artificial Intelligence, Novice Teachers, and Experienced Teachers in an Online Professional Learning Community (2025) · cites this paper as Cooper(2023)
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Previous research by Cooper(2023) reported that GenAI can serve as a powerful catalyst for knowledge construction in OPLCs, acting as an inspirational resource that prompts discussion and reflection rather than delivering a single truth for all to accept or deny.”
From Knowledge (Co-)Construction Among Artificial Intelligence, Novice Teachers, and Experienced Teachers in an Online Professional Learning Community (2025) · cites this paper as Cooper(2023)
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In medical education, where accuracy and reliability of knowledge are paramount, the inability to guarantee the truthfulness of the information poses a significant challenge [32–34].”
From Exploring the potential of artificial intelligence to enhance the writing of english academic papers by non-native english-speaking medical students - the educational application of ChatGPT (2024) · cites this paper as [33]
Experimental — accuracy not yet measured
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Kirschner, P. A., Sweller, J., & Clark, R. E. (2006) · Educational Psychologist · doi:10.1207/s15326985ep4102_1 · Cited by 7,776 · cited 1×
“The former is more closely aligned with a teaching model that emphasises direct instruction (Kirschner et al., 2006).”
BackgroundCelik, I. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107468 · Cited by 1,012 · cited 1×
“Celik (2023) claims that educators have not maximised the potential of AI in teaching and learning contexts.”
BackgroundPavlik, J. V. (2023) · Journalism & Mass Communication Educator · doi:10.1177/10776958221149577 · Cited by 972 · cited 1×
“For instance, there have been increasing concerns about significant job losses and debates about classifying AI output as art (e.g. WALL-E 2, Midjourney) (Pavlik, 2023).”
BackgroundChatGPT User Experience: Implications for Education
Zhai, X. (2023) · doi:10.2139/ssrn.4312418 · Cited by 935 · cited 1×
“This can lead to unequal and unfair outcomes for students, particularly if the bias is related to factors such as race, gender, or socio-economic status” (Zhai, 2022, p. 7).”
BackgroundChatGPT listed as author on research papers: many scientists disapprove
Stokel-Walker, C. (2023) · Nature · doi:10.1038/d41586-023-00107-z · Cited by 868 · cited 1×
“There is presently a debate among journal editors, researchers, and publishers regarding the role of such AI tools in published literature and whether it is acceptable to attribute authorship to the bot (Stokel-Walker, 2023).”
BackgroundOn Defining Artificial Intelligence
Wang, P. (2019) · Journal of Artificial General Intelligence · doi:10.2478/jagi-2019-0002 · Cited by 740 · cited 1×
“Technological advancements such as machine learning and neural networks have sparked further discussion about how to define AI (Wang, 2019).”
BackgroundArtificial intelligence for education: Knowledge and its assessment in AI-enabled learning ecologies
Cope, B., Kalantzis, M., & Searsmith, D. (2021) · Educational Philosophy and Theory · doi:10.1080/00131857.2020.1728732 · Cited by 518 · cited 2×
““All tools do more than human minds and bodies can achieve unaided, which is why we create and use them” (Cope et al., 2021, p. 1230).”
BackgroundYang, W. (2022) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2022.100061 · Cited by 431 · cited 1×
“AI’s capability to automate tasks, process large quantities of data, and provide predictive insights will increasingly revolutionise various aspects of our daily lives (Yang, 2022).”
BackgroundSustainable AI: Environmental Implications, Challenges and Opportunities
Wu, C.-J., Raghavendra, R., Gupta, U., Acun, B., Ardalani, N., Maeng, K., Chang, G., Behram, F. A., Huang, J., Bai, C., et al. (2021) · arXiv · doi:10.48550/arxiv.2111.00364 · Cited by 405 · cited 1×
“Although the information is not readily available on ChatGPT, machine learning models require substantial processing power, and data centres hosting cloud networks must be effectively cooled (Boudreau, 2023; Wu et al, 2022).”
MethodHamilton, M. L., Smith, L., & Worthington, K. (2008) · Studying Teacher Education · doi:10.1080/17425960801976321 · Cited by 329 · cited 1×
“This exploratory study applies a self-study methodology to investigate the technology (Hamilton et al., 2009).”
Method
Research works printed but not linked: 2
- Nature. (2023). Tools such as ChatGPT threaten transparent science; here are our ground rules for their use. https://www.nature.com/articles/d41586-023-00191-1
- Stockman, C., & Nottingham, E. (2022). Surveillance capitalism in schools: What’s the problem? Digital Culture & Education, 14(1), 1–15.
Cited by
Generative AI and ChatGPT: applications, challenges, and AI-human collaboration
Fui-Hoon Nah, F., Zheng, R., Cai, J., Siau, K., & Chen, L. (2023) · Journal of Information Technology Case and Application Research · doi:10.1080/15228053.2023.2233814 · Cited by 1,363
Role of AI chatbots in education: systematic literature review
Labadze, L., Grigolia, M., & Machaidze, L. (2023) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-023-00426-1 · Cited by 1,043
“The expertise, experience, and comprehension of the teacher are essential in making informed pedagogical choices, as AI is not yet capable of replacing the role of a science teacher (Cooper, 2023).”
BackgroundChiu, T. K. F. (2024) · Interactive Learning Environments · doi:10.1080/10494820.2023.2253861 · Cited by 852
“These skills go beyond critical reasoning and thinking and enable an instant or immediate judgment on the information whether they are generated by GenAI (Cooper, 2023; Dwivedi et al., 2023).”
Strzelecki, A. (2024) · Interactive Learning Environments · doi:10.1080/10494820.2023.2209881 · Cited by 807
“To explore the ChatGPT ’ s potential applications in higher education, di ff erent areas can be discussed as software is producing fake citations (Cooper, 2023), developing assignments (Sullivan et al., 2023), supporting essay writing (Crawford et al., 2023), and encouraging critical re fl ection on…”
BackgroundBahroun, Z., Anane, C., Ahmed, V., & Zacca, A. (2023) · Sustainability · doi:10.3390/su151712983 · Cited by 784
Metadata
- Authors
- Cooper, G.
- Affiliations
- Curtin University (AU)
- Corresponding author
- Cooper, Grant
- ORCID
- Cooper, Grant
- Venue
- Journal of Science Education and Technology
- Published
- 2023-03-22
- Volume
- 32
- Issue
- 3
- Pages
- 444-452
- ISSN
- 1059-0145 (ISSN-L)
- 1573-1839
- OpenAlex
- W4360980141
- Cited by
- 1,263
- References
- 19
- Citations by year
- 2026: 246 · 2025: 419 · 2024: 441 · 2023: 157
- FWCI
- 295.68
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Journal of Science Education and Technology (publishedVersion, cc-by)
- eSpace (Curtin University) (submittedVersion, cc-by)
- Funders
- Curtin University
- Topics
- Social Sciences › Education › Artificial Intelligence in Education
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Education › Science Education and Pedagogy
- Keywords
- ChatGPT, generative AI, science education, science pedagogy, AI-assisted research, epistemic authority, AI ethics, environmental impact of AI, content moderation, copyright infringement, critical thinking, responsible AI use
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-06, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-06 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Examining Science Education in ChatGPT: An Exploratory Study of Generative Artificial Intelligence. https://app.cochat.ai/papers/10.1007/s10956-023-10039-y
- The paper
- Cooper, G. (2023). Examining Science Education in ChatGPT: An Exploratory Study of Generative Artificial Intelligence. Journal of Science Education and Technology. https://doi.org/10.1007/s10956-023-10039-y
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.