Cited by 13Artificial Intelligence in EducationScience Education and PedagogyIntelligent Tutoring Systems and Adaptive Learning

Unlocking Scientific Concepts: How Effective Are LLM-Generated Analogies for Student Understanding and Classroom Practice?

Open access
Shao, Zekai, Yuan, Siyu, Gao, Lin, He, Yixuan, Yang, Deqing, Chen, Siming·2025·Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems

Abstract

Teaching scientific concepts is essential but challenging, and analogies help students connect new concepts to familiar ideas. Advancements in large language models (LLMs) enable generating analogies, yet their effectiveness in education remains underexplored. In this paper, we first conducted a two-stage study involving high school students and teachers to assess the effectiveness of LLM-generated analogies in biology and physics through a controlled in-class test and a classroom field study. Test results suggested that LLM-generated analogies could enhance student understanding particularly in biology, but require teachers' guidance to prevent over-reliance and overconfidence. Classroom experiments suggested that teachers could refine LLM-generated analogies to their satisfaction and inspire new analogies from generated ones, encouraged by positive classroom feedback and homework performance boosts. Based on findings, we developed and evaluated a practical system to help teachers generate and refine teaching analogies. We discussed future directions for developing and evaluating LLM-supported teaching and learning by analogy.

Integrity signals

Registry

Crossref · 10.1145/3706598.3714313

Cites

74 of 74 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • GenAI is employed to support student engagement with challenging topics such as quantum theory, interdisciplinary knowledge transfer, and experimental design and hypothesis formulation.

    “GenAI is employed to address these goals by supporting student engagement with challenging topics such as quantum theory, interdisciplinary knowledge transfer, and experimental design and hypothesis formulation-areas often limited by insufficient teacher resources and the lack of personalized instruction [91-94].”
  • As a learning partner, AI provides high-quality concept maps, instructional analogies, and personalized feedback, creating deep learning experiences and prompting reflection on socio-ethical implications of technology, thus seeding epistemic insight.

    “As a learning partner, AI provides high-quality concept maps [146], instructional analogies [94], and personalized feedback [128,130], creating deep learning experiences [95] and prompting reflection on socio-ethical implications of technology-thus seeding epistemic insight [117,132,135,138,151].”

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Shao, Z., Yuan, S., Gao, L., He, Y., Yang, D., & Chen, S.
Affiliations
Fudan University (CN)
Venue
Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems
Publisher
ACM
Published
2025-04-25
Pages
1-19
OpenAlex
W4409747868
Cited by
13
References
74
Citations by year
2026: 9 · 2025: 4
FWCI
14.87
Type
conference paper
Language
en
Open access
Locations
  • CHI Conference on Human Factors in Computing Systems (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
Natural Science Foundation of China (No.62472099, No.62202105)
Topics
  • Physical Sciences › Computer Science › Information Systems › Artificial Intelligence in Education
  • Social Sciences › Education › Science Education and Pedagogy
  • Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
Keywords
large language models, analogical reasoning, science education, student understanding, teaching practice, conceptual understanding

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review