CoChat

Chemistry Students’ Artificial Intelligence Literacy through their Critical Reflections of Chatbot Responses

Young, Jessica D., Dawood, Lisa, Lewis, Scott E. · 2024 · Journal of Chemical Education

The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.

Abstract

High Resolution Image Download MS PowerPoint Slide Instructors use of Artificial Intelligence (AI) language models (i.e., chatbots) as an educational resource will require an understanding of students’ AI literacy, namely their ability to critically reflect on the relevance, trustworthiness, and quality of these tools in the context of chemistry. This study sought to describe students' AI literacy via open-ended surveys of general chemistry I students and students in an upper-level chemistry elective. Thematic analysis was used to create a deeper understanding of chemistry students’ AI literacy when considering chatbots. Based on students’ responses, they were categorized as either with reservations toward chatbots or without reservations toward chatbots. Thematically, students tended to either reason with the utility/benefit of the tool or reason with concern toward the accuracy of the tool. Results suggest that students are more of a range between these two extremes. This new deeper understanding of AI literacy in chemistry can support instructional practices and inform future research efforts in AI literacy.

Overview

Integrity signals

Registry

Crossref · 10.1021/acs.jchemed.4c00154

Cites

25 of 25 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Citations

Cites

Show all 25 references

Research works printed but not linked: 4

  1. 10.1080/10494820.2023.225385 · doi:10.1080/10494820.2023.225385
  2. Bhatia A., 2023, The New York Times
  3. Cisco Annual Internet Report, (2018–2023) White Paper
  4. Sahin I., 2006, Turkish Online Journal of Educational Technology-TOJET, 5, 14

Cited by

See all 47

Metadata

Authors
Young, J. D., Dawood, L., & Lewis, S. E.
Affiliations
University of South Florida (US)
Corresponding author
Lewis, Scott E.
Venue
Journal of Chemical Education
Published
2024-05-26
Volume
101
Issue
6
Pages
2466-2474
ISSN
  • 0021-9584 (ISSN-L)
  • 1938-1328
OpenAlex
W4399027682
Cited by
35
References
25
Citations by year
2026: 16 · 2025: 16 · 2024: 3
FWCI
13.16
Type
journal article
Language
en
Open access
closed
Locations
Journal of Chemical Education (publishedVersion)
Topics
  • Social Sciences › Education › Artificial Intelligence in Education
  • Social Sciences › Education › Digital literacy in education
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
Keywords
AI literacy, chatbots, large language models, chemistry students, critical reflection, student attitudes toward AI, trustworthy AI, general chemistry, chemistry education

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Chemistry Students’ Artificial Intelligence Literacy through their Critical Reflections of Chatbot Responses. https://app.cochat.ai/papers/10.1021/acs.jchemed.4c00154
The paper
Young, J. D., Dawood, L., & Lewis, S. E. (2024). Chemistry Students’ Artificial Intelligence Literacy through their Critical Reflections of Chatbot Responses. Journal of Chemical Education. https://doi.org/10.1021/acs.jchemed.4c00154

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.