Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.

Interview with the Chatbot: How Does It Reason?

Open access
Talanquer, Vicente · 2023 · Journal of Chemical Education

Abstract

High Resolution Image Download MS PowerPoint Slide Artificial Intelligence (AI) Chatbots that can generate answers to a variety of questions and engage in conversation have become widely available to the public. The potential use and misuse of these systems in education are currently the subject of great debate. These discussions can be more productive if they are informed by a better understanding of the scope and limitations of these tools. This commentary seeks to provide some insights into how AI Chatbots seem to reason about chemical entities and processes, analyzing the extent to which these systems express misconceptions, explanatory biases, and limited or flawed explanations. This analysis reveals fascinating similarities between the answers generated by AI Chatbots and chemistry learners when engaged in an explanatory activity.

Overview

Integrity signals

Registry

Crossref · 10.1021/acs.jchemed.3c00472

Cites

13 of 13 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 13 references

Research works printed but not linked: 4

  1. Kind V., 2004, Beyond Appearances: Students’ Misconceptions about Basic Chemical Ideas
  2. Taber K., 2002, Chemical Misconceptions─Prevention, Diagnosis and Cure. Vol. I: Theoretical Background
  3. Open AI. GPT-4 Technical Report. arXiv, 2023.https://arxiv.org/abs/2303.08774.
  4. Amin T. G., 2018, Converging Perspectives on Conceptual Change

Cited by

See all 69

Metadata

Authors
Talanquer, V.
Affiliations
University of Arizona (US)
Corresponding author
Talanquer, Vicente
Venue
Journal of Chemical Education
Published
2023-07-12
Volume
100
Issue
8
Pages
2821-2824
ISSN
  • 0021-9584 (ISSN-L)
  • 1938-1328
OpenAlex
W4384008291
Cited by
56
References
13
Citations by year
2026: 10 · 2025: 12 · 2024: 24 · 2023: 10
Type
journal article
Language
en
Open access
Locations
Journal of Chemical Education (publishedVersion)
Topics
  • Social Sciences › Education › Artificial Intelligence in Education
  • Social Sciences › Education › Science Education and Pedagogy
  • Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
Keywords
AI chatbots, chemistry education, misconceptions, explanation, AI limitations

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Interview with the Chatbot: How Does It Reason? https://app.cochat.ai/papers/10.1021/acs.jchemed.3c00472
The paper
Talanquer, V. (2023). Interview with the Chatbot: How Does It Reason? Journal of Chemical Education. https://doi.org/10.1021/acs.jchemed.3c00472

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.