CoChat

A State-Aware Dual-Tool Architecture for Improved Tool Use in Multi-Turn LLM Dialogue

Open access

The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index; 14 of the 19 sources its claims cite were checked for support.

Abstract

This study investigates whether the dominant single-tool paradigm is sufficient for reliable tool use in multi-turn dialogues in which data are provided incrementally and constrained by conditional validation rules. To address the limitations of this approach, we propose a state-aware dual-tool architecture that separates data preparation and validation from final action execution, and we complement it with Token-Optimized Notation Language (TONL) as a compact representation of tool-facing state. The approach was evaluated in a controlled Django-based test platform for an insurance quotation task. Two configurations were compared across four language models (GPT-4o, GPT-5.4, Qwen3.5-122B, Nemotron-3-Super-120B) under four scripted scenarios, with 80 runs per scenario, model, and configuration (2560 total runs). Scenario-level success was defined as correct tool-use behavior over a full scripted dialogue replay, including no premature execution, no fabrication of missing values, and no payload inconsistency with the final validated state. Under this definition, the single-tool baseline achieved 74.8% success, whereas the proposed dual-tool architecture achieved 99.4% success across all evaluated runs. The strongest gain was observed for Qwen3.5-122B in the pressure scenario, where success increased from 5% (4/80) to 100% (80/80). In addition, TONL reduced the size of a representative tool-state payload by 34.0%. The results indicate that explicit completeness feedback and deterministic readiness-based execution gating can substantially improve the reliability of tool-augmented LLM systems while reducing the recurring token cost of repeated tool interactions.

Overview

CoChat Summary

TL;DR

The paper proposes a state-aware dual-tool architecture that separates incremental data preparation/validation from final tool execution, with deterministic gating via a `ready_to_execute` signal and TONL-encoded tool outputs. Across four LLMs and 2,560 scripted multi-turn runs, it reports raising tool-use success from 74.8% to 99.4%.

Key findings

Dual-tool improved aggregate success from 74.8% (958/1280) to 99.4% (1272/1280), an absolute gain of 24.5 percentage points; a two-proportion z-test gave p < 0.001 and Cohen’s h = 0.85.

  • The largest gain was Qwen3.5-122B in the pressure scenario: 5% (4/80) single-tool to 100% (80/80) dual-tool. Single-tool pressure failures were GPT-4o 36/80, Qwen3.5-122B 76/80, and Nemotron-3-Super-120B 68/80; GPT-5.4 had 0/80 pressure failures but over-confirmed elsewhere.
  • Dual-tool produced only 8 recorded errors across 1280 runs: GPT-5.4 100%, GPT-4o and Qwen3.5-122B 99.7%, Nemotron-3-Super-120B 98.1%. Single-tool overall success was GPT-4o 79.4%, GPT-5.4 79.4%, Qwen3.5-122B 67.8%, Nemotron-3-Super-120B 72.8%.
  • TONL reduced a representative tool-state payload from 144 tokens to 95 tokens, a 49-token (34.0%) reduction.

Methods

Controlled Django-based web test platform replaying scripted multi-turn dialogues for an insurance quotation task, with four models in tool-calling mode: GPT-4o, GPT-5.4, Qwen3.5-122B, and Nemotron-3-Super-120B.

  • Four fixed scenarios (`scn_memory`, `scn_pressure`, `scn_corrections`, `scn_rules`) were each run 80 times per model and configuration, yielding 320 runs per model and 1280 runs per architecture (2560 total).
  • Primary metric was scenario-level success over a full scripted replay, counting errors for failure to invoke the required tool, premature execution, fabricated missing values, or payload inconsistent with the final validated state; aggregate comparison used a two-proportion z-test.

Limitations

Stated in the paper: evaluation was in a controlled, scripted environment; the task was limited to a structured insurance quotation use case; architecture effects were not isolated from prompt effects because the two conditions used different system prompts; and no direct end-to-end latency measurements were provided.

  • Also stated: residual dual-tool errors were associated with rare cases where the model did not invoke the prepare-tool early enough to preserve first relevant facts in session state.
  • Also stated: no formal significance tests were conducted separately per model or scenario, and no multiple-comparison correction was applied.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.3390/app16094329

Cites

29 of 29 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

8 Valid · 6 Not valid · 3 Not checked · 133 Own results and interpretations

56 more claims

Create a free account to see all 150 claims and to verify the 4 references still open.

See all claims — free account
  • It may state two separate claims as one. 71
  • Probably not a substantial claim. 35
  • Borderline: one of the tests for a substantial claim is unclear. 2
  • The quote only partly states this claim. 1

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

2 of 2

Citations

Cites

Show all 29 references

Research works printed but not linked: 1

  1. Wu, Q., Bansal, G., Zhang, J., Wu, Y., Li, B., Zhu, E., Jiang, L., Zhang, X., Zhang, S., and Awadallah, A.H. (2024, January 7–9). AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation Framework. Proceedings of the Conference on Language Modeling (COLM 2024), Philadelphia, PA, USA.

Metadata

Authors
Pałgan, B., Wawryszczuk, M., Chwał, J., Tkacz, E., & Dzik, R.
Affiliations
Akademia Śląska (PL)
Corresponding author
Wawryszczuk, Marcin
Venue
Applied Sciences
Publisher
MDPI AG
Published
2026-04-29
Volume
16
Issue
9
Pages
4329
ISSN
2076-3417 (ISSN-L)
OpenAlex
W7160130809
Cited by
1
References
11
Citations by year
2026: 1
FWCI
3.46
Type
journal article
Language
en
Open access
Locations
  • Applied Sciences (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
Ministry of Science and Higher Education
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
  • Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
  • Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
Keywords
multi-turn dialogue, data validation, token cost reduction, large language models

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: A State-Aware Dual-Tool Architecture for Improved Tool Use in Multi-Turn LLM Dialogue. https://app.cochat.ai/papers/10.3390/app16094329
The paper
Pałgan, B., Wawryszczuk, M., Chwał, J., Tkacz, E., & Dzik, R. (2026). A State-Aware Dual-Tool Architecture for Improved Tool Use in Multi-Turn LLM Dialogue. Applied Sciences. https://doi.org/10.3390/app16094329

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.