CoChat

AdaptDuplex: From Static to Adaptive Full-Duplex Spoken Dialogue

Open access
Zhou, Zhiyang, Shang, Yingxin, Wang, Zhou, Cai, Hongwei, Wang, Weixu, Zhou, Shuran, Zhao, Shuofeng, Fan, Wenke, Guo, Qingxiang, Yang, Dawei, Yang, Lin, Song, Yang · 2026 · arXiv

The DOI matches its DataCite record; 12 of the 12 references it cites were found in a registry or an index; none of the 15 sources its claims cite is checked for support yet.

Abstract

Full-duplex spoken dialogue requires simultaneous listening and speaking at sub-second latency, under conversational timing and cognitive demands that change moment to moment. Yet current models mostly impose static operating points, lacking a systematic mechanism for adaptive decisions. We present AdaptDuplex, which extends Qwen3-Omni with such a mechanism, co-designed across three layers. A compact token-level protocol represents every window as a canonical sequence, trains dual-stream alignment through a bounded text lead over speech, and exposes every behavioral decision as an explicit token for training-free runtime control via logits bias. Adaptive mechanisms dynamically predict among discrete window durations and augment direct response as needed with non-blocking cognitive consolidation and multi-flight external reasoning. A progressive pipeline introduces these behaviors through a three-stage Thinker curriculum, then Talker-only and joint SFT, with GRPO as a preliminary increment. On Full-Duplex-Bench v1 and v1.5, AdaptDuplex outperforms DuplexOmni on 18 of 21 comparable turn-taking, overlap-behavior, and timing metrics and MiniCPM-o 4.5 on 19 of 22, with gains in both interaction decisions and response timing. On human-recorded HumDial-FDBench, it attains the top Final score (69.6) of the compared duplex models.

Overview

CoChat Summary

TL;DR

AdaptDuplex upgrades Qwen3-Omni with a token-level full-duplex protocol, adaptive window/action decisions, and a progressive training pipeline. It outperforms DuplexOmni and MiniCPM-o 4.5 on most comparable turn-taking, overlap, and timing metrics, reaching the highest Final score (72.9) on HumDial-FDBench among compared duplex models.

Key findings

  • On FDB-v1 and FDB-v1.5, AdaptDuplex improves interaction decisions and timing: backchannel takeover rate 0.334 vs. DuplexOmni’s 0.491; FDB-v1.5 backchannel behavior 0.55 vs. 0.28 and background-speech behavior 0.43 vs. 0.07; interruption TOR 0.985 vs. 0.746 with response latency 0.131 vs. 0.158 s.
  • On human-recorded HumDial-FDBench, it attains the highest Final score among compared duplex models (72.9), with delays of 0.835 s (ZH) and 1.345 s (EN); the cascaded Qwen3-Omni+VAD is more accurate at interruption (88.8 vs. 82.2 ALL) but delays over 8.5 s.
  • Canonical serialization cuts tokens per window by 78%, protocol share of output tokens from 93.88% to 68.70%, invalid outputs to 0.00%, and decoding P50/P90/P99 by 47%/49%/42%; Text-ahead training raises UTMOSv2 from 2.90 to 3.65 and ValidEnd from 50.00% to 86.37%.
  • Dynamic windowing stays near-short latency (0.37 s, 1.32 s) with near-long backchannel (0.55) and is best on talking-to-others (0.35); L1 memory action F1 is 80.66%, L2 action EM 76.84%, launch F1 68.63%, cancellation F1 54.06%, with concurrency stress lowering EM to 65.17% and raising invalid-action rate from 3.80% to 7.10%.

Methods

  • AdaptDuplex is initialized from Qwen3-Omni-30B-A3B-Instruct and trained on 8 NVIDIA H100 GPUs, using a compact token-level protocol, bounded Text-ahead dual-stream alignment, dynamic window prediction among 0.48/0.64/0.96 s, and conditional L1 memory/L2 multi-flight external reasoning actions.
  • Training uses a three-stage Thinker curriculum, then Talker-only SFT and joint SFT, with GRPO as a further increment; curriculum SFT and Mixed SFT use an internally constructed synthetic corpus of 765,424 dialogues (17,259 h, 10,857 h assistant speech), and joint SFT continues on a high-quality DuplexDrama subset.
  • Evaluation uses Full-Duplex-Bench v1, FDB-v1.5, and HumDial-FDBench, plus controlled serialization, Text-ahead, window-policy, logit-bias, and training-recipe comparisons; L1/L2 action prediction is evaluated from gold prefixes.

Limitations

  • The paper states that evaluation covers Chinese and English only, the window controller selects among three discrete durations rather than a continuous horizon, and external reasoning is bounded to four concurrent requests.
  • Evident in the text: L2 cancellation is the weakest sub-decision (F1 54.06%), and with at least two in-flight requests action EM falls to 65.17% while invalid-action rate nearly doubles (3.80%→7.10%), marking the current limit of multi-flight control.
  • Evident in the text: the cascaded Qwen3-Omni+VAD reference remains more accurate at interruption (88.8 vs. 82.2 ALL), though it delays over 8.5 s.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

DataCite · 10.48550/arxiv.2609.29217

Cites

12 of 12 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

0 Valid · 0 Not valid · 8 Not checked · 49 Own results and interpretations

15 more claims

Create a free account to see all 57 claims and every source verdict.

See all claims — free account
  • It may state two separate claims as one. 26
  • Probably not a substantial claim. 17
  • The quote only partly states this claim. 1

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

1 of 1

Citations

Cites

Show all 12 references

Cited by

Still being checked.

Metadata

Authors
Zhou, Z., Shang, Y., Wang, Z., Cai, H., Wang, W., Zhou, S., Zhao, S., Fan, W., Guo, Q., Yang, D., Yang, L., & Song, Y.
Venue
arXiv
Publisher
arXiv
Published
2026
ISSN
2331-8422 (ISSN-L)
OpenAlex
W7214079271
Cited by
0
References
12
Type
posted content
Language
en
Open access
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
  • Zenodo (CERN European Organization for Nuclear Research) (cc-by-nc-nd)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
  • Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
Keywords
turn-taking, overlapping speech, runtime control

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-11-22, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-11-22 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: AdaptDuplex: From Static to Adaptive Full-Duplex Spoken Dialogue. https://app.cochat.ai/papers/10.48550/arxiv.2609.29217
The paper
Zhou, Z., Shang, Y., Wang, Z., Cai, H., Wang, W., Zhou, S., Zhao, S., Fan, W., Guo, Q., Yang, D., Yang, L., & Song, Y. (2026). AdaptDuplex: From Static to Adaptive Full-Duplex Spoken Dialogue. arXiv. https://doi.org/10.48550/arxiv.2609.29217

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.