CoChat

Scaffold or Crutch? Examining College Students' Use and Views of Generative AI Tools for STEM Education

Open access
Wang, Karen D., Wu, Zhangyang, Tufts, L'Nard, Wieman, Carl, Salehi, Shima, Haber, Nick · 2025 · 2025 IEEE Global Engineering Education Conference (EDUCON)

The DOI matches its Crossref record; 48 of the 49 references it cites were found in a registry or an index, and 1 are not checked yet; 8 of the 25 sources its claims cite were checked for support.

Abstract

Developing problem-solving competency is central to Science, Technology, Engineering, and Mathematics (STEM) education, yet translating this priority into effective approaches to problem-solving instruction and assessment has been a significant challenge. The recent proliferation of generative artificial intelligence (genAI) tools like ChatGPT in higher education introduces new considerations: how to define problem-solving competency in a genAI era, and how these tools can help or hinder students' development of STEM problem-solving competency. Our research takes steps in examining these considerations by studying how and why college students are currently using genAI tools in their STEM coursework, with a specific focus on how they employ these tools to support their problem-solving. We conducted an online survey of 40 STEM college students from diverse institutions across the US. In addition, we surveyed 28 STEM faculty to understand instructor views on effective and ineffective genAI tool use in STEM courses and their guidance for students. Our findings reveal high adoption rates and diverse applications of genAI tools among STEM students. The most common use cases of genAI tools in STEM coursework include finding explanations, exploring related topics, summarizing readings, and helping with problem-set questions. The primary motivation for using genAI tools in STEM coursework was to save time. Moreover, we found that over half of the student participants reported simply inputting a problem for AI to generate solutions, potentially bypassing their own problem-solving processes. These findings indicate that despite high adoption rates, students' current approaches to utilizing genAI tools often fall short in enhancing their own STEM problem-solving competencies. The study also explored students' and STEM instructors' perceptions of the benefits and risks associated with using genAI tools in STEM education. Our findings provide insights into how to guide students on appropriate genAI use in STEM courses and how to design genAI-based tools to foster students' problem-solving competency.

Verified 2026-11-19 · 1 reference not checked yet

Overview

CoChat Summary

TL;DR

This survey of 40 STEM college students and 28 STEM faculty found high student adoption of generative AI tools, especially free ChatGPT, for STEM coursework. Although students used genAI for explanations and other tasks, over half reported prompting it to directly solve problems, raising concerns that current use may bypass students’ own problem-solving.

Key findings

  • GenAI adoption was high: 37 of 40 students reported using genAI tools, with free ChatGPT most common (n = 37), followed by free Gemini (n = 11) and Copilot (n = 10); only 3 students (7.5%) had not used any genAI tools, and 34 students (85%) used them in STEM courses.
  • The most common STEM uses were finding explanations (n = 30, 75%), exploring related topics (n = 25, 62.5%), summarizing papers/readings (n = 24, 60%), supporting in-class activities (n = 23, 57.5%), and helping with problem-set questions (n = 23, 57.5%); the main reason for use was saving time (n = 20, 50%).
  • In a physics problem prompt task, 54% preferred direct solution generation (38% copy/paste or paraphrase and ask AI to solve; 16% add instructions for AI to solve), while 46% asked specific questions that did not directly lead to a solution.
  • Students rated genAI most helpful for explaining relevant physics knowledge (n = 33, 82.5% helpful/highly helpful) and calculations (n = 26, 65%), but were skeptical about collecting missing information (n = 24, 60% unsure/unhelpful/very unhelpful) and verifying solution correctness (n = 28, 70% unsure/unhelpful/very unhelpful); faculty recommendations were lower, with less than one-third recommending explaining concepts (n = 8, 29%) or gathering missing information (n = 9, 32%), and only 2 (7%) for calculations and 3 (11%) for verifying correctness.

Methods

  • The study used an online survey developed iteratively with STEM instructor and expert review plus think-aloud pilot testing with college students; the student survey covered usage, prompt engineering skills, perceived helpfulness in problem-solving, perceived benefits and risks, and demographics/academic background.
  • Data collection occurred in two phases: 28 faculty were recruited in November 2023 from American Physical Society listserv and Slack channels, and 40 STEM college students were recruited in May 2024 via Prolific, prescreened as current US undergraduates in specified STEM subjects excluding computer science.
  • Analyses combined quantitative aggregation in RStudio with qualitative open coding and a coding framework; two researchers independently coded at least 20% of open-ended responses, with mean inter-rater agreement of 83.4% and disagreements resolved through discussion.

Limitations

  • The paper states that the small sample of 40 students and 28 instructors limits generalizability, voluntary online participation may introduce selection bias toward students more familiar with or interested in genAI, and the STEM problem-solving focus limits applicability to non-STEM disciplines.
  • The text also makes evident that the faculty sample was physics instructors only, while students came from multiple STEM fields, and the study measured self-reported use and perceptions rather than actual learning outcomes.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1109/educon62633.2025.11016406

Cites

48 of 49 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

8 Valid · 0 Not valid · 12 Not checked · 67 Own results and interpretations

46 more claims

Create a free account to see all 87 claims and every source verdict.

See all claims — free account
  • It may state two separate claims as one. 24
  • Probably not a substantial claim. 20

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

1 of 1

Citations

Cites

Show all 49 references

Research works printed but not linked: 7

  1. 2024, Report of the NEA task force on artificial intelligence in education
  2. Shiohira, 2021, Understanding the impact of artificial intelligence on skills development. education 2030, UNESCO-UNEVOC International Centre for Technical and Vocational Education and Training
  3. Honey, Stem education for the future - 2020 visioning report
  4. 2021, Criteria for accrediting engineering programs, 2022–2023
  5. Levy, 2013, Dancing with robots: Human skills for computerized work
  6. Salehi, 2018, Improving problem-solving through reflection
  7. Goldberg, Generative ai in higher education: Insights from a campus-wide student survey at a large public university, 757

Cited by

See all 28

Metadata

Authors
Wang, K. D., Wu, Z., Tufts, L., Wieman, C., Salehi, S., & Haber, N.
Affiliations
  • Graduate School of Education
  • Department of Physics
  • Stanford University (US)
Venue
2025 IEEE Global Engineering Education Conference (EDUCON)
Publisher
IEEE
Published
2025-04-22
Pages
1-10
OpenAlex
W4410986723
Cited by
28
References
33
Citations by year
2026: 19 · 2025: 9
FWCI
32.02
Type
conference paper
Language
en
Open access
Locations
  • IEEE Global Engineering Education Conference (EDUCON) (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Social Sciences › Education › Artificial Intelligence in Education
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Social Sciences › Education › Problem and Project Based Learning
Keywords
generative AI, ChatGPT, STEM education, problem-solving competencies, university students, student use of AI tools, teacher perceptions, AI adoption in higher education, student motivation, AI-based learning tools

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-26, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-26 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Scaffold or Crutch? Examining College Students' Use and Views of Generative AI Tools for STEM Education. https://app.cochat.ai/papers/10.1109/educon62633.2025.11016406
The paper
Wang, K. D., Wu, Z., Tufts, L., Wieman, C., Salehi, S., & Haber, N. (2025). Scaffold or Crutch? Examining College Students' Use and Views of Generative AI Tools for STEM Education. 2025 IEEE Global Engineering Education Conference (EDUCON). https://doi.org/10.1109/educon62633.2025.11016406

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.