Enhancing STEM learning with ChatGPT and Bing Chat as objects to think with: A case study
Open accessThe DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
This study investigates the potential of ChatGPT and Bing Chat, advanced conversational AIs, as “objects-to-think-with,” resources that foster reflective and critical thinking, and concept comprehension in enhancing STEM education, using a constructionist theoretical framework. A single-case study methodology was used to analyze extensive interaction logs between students and both AI systems in simulated STEM learning experiences. The results highlight the ability of ChatGPT and Bing Chat to help learners develop reflective and critical thinking, creativity, problem-solving skills, and concept comprehension. However, integrating AIs with collaborative learning and other educational activities is crucial, as is addressing potential limitations like concerns about AI information accuracy and reliability of the AIs’ information and diminished human interaction. The study concludes that ChatGPT and Bing Chat as objects-to-think-with offer promising avenues to revolutionize STEM education through a constructionist lens, fostering engagement in inclusive and accessible learning environments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Baidoo-Anu, D., & Owusu Ansah, L. (2023) · doi:10.2139/ssrn.4337484 · Cited by 3,004
Revolutionizing education with AI: Exploring the transformative potential of ChatGPT
Adiguzel, T., Kaya, M. H., & Cansu, F. K. (2023) · Contemporary Educational Technology · doi:10.30935/cedtech/13152 · Cited by 975 · cited 2×
“We agree with Gregorcic and Pendrill (2023) that further research is needed to fully understand their impact, especially the need for careful use to tackle ChatGPT limitations and biases, as pointed out by Bitzenbauer (2023) and the responsible and ethical use of AI technologies, as pointed by Adiguzel et al. (2023).”
BackgroundMethodInteracting with educational chatbots: A systematic review
Kuhail, M. A., Alturki, N., Alramlawi, S., & Alhejori, K. (2023) · Education and Information Technologies · doi:10.1007/s10639-022-11177-3 · Cited by 841
ChatGPT in education: Strategies for responsible implementation
Halaweh, M. (2023) · Contemporary Educational Technology · doi:10.30935/cedtech/13036 · Cited by 607
A Categorical Archive of ChatGPT Failures
Borji, A. (2023) · doi:10.21203/rs.3.rs-2895792/v1 · Cited by 514
A Categorical Archive of ChatGPT Failures
Borji, A. (2023) · arXiv · doi:10.48550/arxiv.2302.03494 · Cited by 514
Mathematical Capabilities of ChatGPT
Frieder, S., Pinchetti, L., Chevalier, A., Griffiths, R.-R., Salvatori, T., Lukasiewicz, T., Petersen, P. C., & Berner, J. (2023) · arXiv · doi:10.48550/arxiv.2301.13867 · Cited by 385
ChatGPT in physics education: A pilot study on easy-to-implement activities
Bitzenbauer, P. (2023) · Contemporary Educational Technology · doi:10.30935/cedtech/13176 · Cited by 181
New Modes of Learning Enabled by AI Chatbots: Three Methods and Assignments
Mollick, E. R., & Mollick, L. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4300783 · Cited by 176 · cited 1×
“Mollick and Mollick (2022) contend that GenAIbots can address classroom challenges such as promoting transfer, correcting overestimated comprehension, and fostering critical evaluation.”
BackgroundChatGPT and the frustrated Socrates
Gregorcic, B., & Pendrill, A.-M. (2023) · Physics Education · doi:10.1088/1361-6552/acc299 · Cited by 125
P dos Santos, R. (2023) · doi:10.2139/ssrn.4447416 · Cited by 31
Santos, R. P. D. (2023) · arXiv · doi:10.48550/arxiv.2305.11890 · Cited by 6
Self-citation
Cited by
Exploring the potential of artificial intelligence tools in educational measurement and assessment
Owan, V. J., Abang, K. B., Idika, D. O., Etta, E. O., & Bassey, B. A. (2023) · Eurasia Journal of Mathematics, Science and Technology Education · doi:10.29333/ejmste/13428 · Cited by 448
Yu, H. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e24289 · Cited by 225
“However, it is essential to integrate these AI tools within H. Yu collaborative learning frameworks and address potential limitations, such as the accuracy and reliability of AI-provided information [64].”
BackgroundRetractedSardi, J., Darmansyah, Candra, O., Yuliana, D. F., Habibullah, Yanto, D. T. P., & Eliza, F. (2025) · International Journal of Engineering Pedagogy (iJEP) · doi:10.3991/ijep.v15i1.53379 · Cited by 105
Performance of ChatGPT on the test of understanding graphs in kinematics
Polverini, G., & Gregorcic, B. (2024) · Physical Review Physics Education Research · doi:10.1103/physrevphyseducres.20.010109 · Cited by 70
Lin, M. P.-C., & Chang, D. (2023) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2023.100167 · Cited by 69
Metadata
- Authors
- Vasconcelos, M. A. R., & dos Santos, R. P.
- Venue
- Eurasia Journal of Mathematics, Science and Technology Education
- Publisher
- Modestum Ltd
- Published
- 2023-07-01
- Volume
- 19
- Issue
- 7
- Pages
- em2296
- ISSN
- 1305-8215 (ISSN-L)
- 1305-8223
- OpenAlex
- W4378194664
- Cited by
- 123
- References
- 13
- FWCI
- 28.90
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.