CoChat

Improving Human Verification of LLM Reasoning through Interactive Explanation Interfaces

Open access
Zhou, Runtao, Nguyen, Giang, Kharya, Nikita, Nguyen, Anh, Agarwal, Chirag · 2026 · Proceedings of the 31st International Conference on Intelligent User Interfaces

The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.

Abstract

The reasoning capabilities of Large Language Models (LLMs) have led to their increasing employment in several critical applications, particularly education, where they support problem-solving, tutoring, and personalized study. While there are a plethora of works showing the effectiveness of LLMs in generating step-by-step solutions through chain-of-thought (CoT) reasoning on reasoning benchmarks, little is understood about whether the generated CoT is helpful for end-users in improving their ability to comprehend mathematical reasoning problems and detect errors/hallucinations in LLM-generated solutions. To address this gap and contribute to understanding how reasoning can improve human-AI interaction, we present three new interactive reasoning interfaces: interactive CoT (iCoT), interactive Program-of-Thought (iPoT), and interactive Graph (iGraph), and a novel framework that generates the LLM’s reasoning from traditional CoT to alternative, interactive formats. Across 125 participants, we found that interactive interfaces significantly improved performance. Specifically, the iGraph interface yielded the highest clarity and error detection rate (\(85.6\%\)), followed by iPoT (\(82.5\%\)), iCoT (\(80.6\%\)), all outperforming standard CoT (\(73.5\%\)). Interactive interfaces also led to faster response times, where participants using iGraph were fastest (57.9 secs), compared to iCoT and iPoT (60 secs), and the standard CoT baseline (64.7 secs). Furthermore, participants prefer…

Overview

Integrity signals

Registry

Crossref · 10.1145/3742413.3789134

Cites

46 of 46 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Citations

Cites

Show all 46 references

Research works printed but not linked: 16

  1. Karl Cobbe Vineet Kosaraju Mohammad Bavarian Mark Chen Heewoo Jun Lukasz Kaiser Matthias Plappert Jerry Tworek Jacob Hilton Reiichiro Nakano et al. 2021. Training verifiers to solve math word problems. arXiv preprint arXiv:https://arXiv.org/abs/2110.14168 (2021). · arXiv
  2. Ali Forootani. 2025. A survey on mathematical reasoning and optimization with large language models. arXiv preprint arXiv:https://arXiv.org/abs/2503.17726 (2025). · arXiv
  3. Jenny Kunz and Marco Kuhlmann. 2024. Properties and challenges of llm-generated explanations. arXiv preprint arXiv:https://arXiv.org/abs/2402.10532 (2024). · arXiv
  4. Khai Le-Duc Duy MH Nguyen Phuong TH Trinh Tien-Phat Nguyen Nghiem T Diep An Ngo Tung Vu Trinh Vuong Anh-Tien Nguyen Mau Nguyen et al. 2025. S-chain: Structured visual chain-of-thought for medicine. arXiv preprint arXiv:https://arXiv.org/abs/2510.22728 (2025). · arXiv
  5. Xiaoyuan Li Wenjie Wang Moxin Li Junrong Guo Yang Zhang and Fuli Feng. 2024. Evaluating mathematical reasoning of large language models: A focus on error identification and correction. arXiv preprint arXiv:https://arXiv.org/abs/2406.00755 (2024). · arXiv
  6. Giang Nguyen Ivan Brugere Shubham Sharma Sanjay Kariyappa Anh Totti Nguyen and Freddy Lecue. 2024. Interpretable llm-based table question answering. arXiv preprint arXiv:https://arXiv.org/abs/2412.12386 (2024). · arXiv
  7. Giang Nguyen, Mohammad Reza Taesiri, Sunnie SY Kim, and Anh Nguyen. 2024. Allowing humans to interactively guide machines where to look does not always improve human-AI team’s classification accuracy. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 8169–8175.
  8. Tin Nguyen Logan Bolton Mohammad Reza Taesiri and Anh Totti Nguyen. 2025. HoT: Highlighted Chain of Thought for Referencing Supporting Facts from Inputs. arXiv preprint arXiv:https://arXiv.org/abs/2503.02003 (2025). · arXiv
  9. Mahsan Nourani Chiradeep Roy Tahrima Rahman Eric D Ragan Nicholas Ruozzi and Vibhav Gogate. 2020. Don’t explain without verifying veracity: an evaluation of explainable ai with video activity recognition. arXiv preprint arXiv:https://arXiv.org/abs/2005.02335 (2020). · arXiv
  10. Suleyman Ozdel Can Sarpkaya Efe Bozkir Hong Gao and Enkelejda Kasneci. 2025. Examining the Role of LLM-Driven Interactions on Attention and Cognitive Engagement in Virtual Classrooms. arXiv preprint arXiv:https://arXiv.org/abs/2505.07377 (2025). · arXiv
  11. Aaron Springer and Steve Whittaker. 2018. Progressive disclosure: designing for effective transparency. arXiv preprint arXiv:https://arXiv.org/abs/1811.02164 (2018). · arXiv
  12. Boshi Wang Sewon Min Xiang Deng Jiaming Shen You Wu Luke Zettlemoyer and Huan Sun. 2022. Towards understanding chain-of-thought prompting: An empirical study of what matters. arXiv preprint arXiv:https://arXiv.org/abs/2212.10001 (2022). · arXiv
  13. Shen Wang Tianlong Xu Hang Li Chaoli Zhang Joleen Liang Jiliang Tang Philip S Yu and Qingsong Wen. 2024. Large language models for education: A survey and outlook. arXiv preprint arXiv:https://arXiv.org/abs/2403.18105 (2024). · arXiv
  14. Yuhao Zhang Jiaxin An Ben Wang Yan Zhang and Jiqun Liu. 2025. Human-Centered Explainability in Interactive Information Systems: A Survey. arXiv preprint arXiv:https://arXiv.org/abs/2507.02300 (2025). · arXiv
  15. Zhuosheng Zhang Aston Zhang Mu Li and Alex Smola. 2022. Automatic chain of thought prompting in large language models. arXiv preprint arXiv:https://arXiv.org/abs/2210.03493 (2022). · arXiv
  16. Joerg Zumbach. 2006. Cognitive overhead in hypertext learning reexamined: Overcoming the myths. Journal of Educational Multimedia and Hypermedia 15 4 (2006) 411–432.

Cited by

See all 16

Metadata

Authors
Zhou, R., Nguyen, G., Kharya, N., Nguyen, A., & Agarwal, C.
Affiliations
  • University of Virginia (US)
  • GuideLabs, GuideLabs, San Francisco, California, USA
  • Independent Researcher, Charlottesville, Virginia, USA
  • Auburn University (US)
Venue
Proceedings of the 31st International Conference on Intelligent User Interfaces
Publisher
ACM
Published
2026-03-22
Pages
456-473
OpenAlex
W7133356125
Cited by
2
References
39
Citations by year
2026: 2
FWCI
17.87
Type
conference paper
Language
en
Open access
Licence
cc-by
Locations
ACM International Conference on Intelligent User Interfaces (IUI) (publishedVersion, cc-by)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
  • Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
Keywords
large language models, chain-of-thought reasoning, hallucination detection, mathematical reasoning, human-AI interaction

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Improving Human Verification of LLM Reasoning through Interactive Explanation Interfaces. https://app.cochat.ai/papers/10.1145/3742413.3789134
The paper
Zhou, R., Nguyen, G., Kharya, N., Nguyen, A., & Agarwal, C. (2026). Improving Human Verification of LLM Reasoning through Interactive Explanation Interfaces. Proceedings of the 31st International Conference on Intelligent User Interfaces. https://doi.org/10.1145/3742413.3789134

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.