AdaptDuplex: From Static to Adaptive Full-Duplex Spoken Dialogue
Open accessThe DOI matches its DataCite record; 12 of the 12 references it cites were found in a registry or an index; none of the 15 sources its claims cite is checked for support yet.
Abstract
Full-duplex spoken dialogue requires simultaneous listening and speaking at sub-second latency, under conversational timing and cognitive demands that change moment to moment. Yet current models mostly impose static operating points, lacking a systematic mechanism for adaptive decisions. We present AdaptDuplex, which extends Qwen3-Omni with such a mechanism, co-designed across three layers. A compact token-level protocol represents every window as a canonical sequence, trains dual-stream alignment through a bounded text lead over speech, and exposes every behavioral decision as an explicit token for training-free runtime control via logits bias. Adaptive mechanisms dynamically predict among discrete window durations and augment direct response as needed with non-blocking cognitive consolidation and multi-flight external reasoning. A progressive pipeline introduces these behaviors through a three-stage Thinker curriculum, then Talker-only and joint SFT, with GRPO as a preliminary increment. On Full-Duplex-Bench v1 and v1.5, AdaptDuplex outperforms DuplexOmni on 18 of 21 comparable turn-taking, overlap-behavior, and timing metrics and MiniCPM-o 4.5 on 19 of 22, with gains in both interaction decisions and response timing. On human-recorded HumDial-FDBench, it attains the top Final score (69.6) of the compared duplex models.
Overview
CoChat Summary
TL;DR
AdaptDuplex upgrades Qwen3-Omni with a token-level full-duplex protocol, adaptive window/action decisions, and a progressive training pipeline. It outperforms DuplexOmni and MiniCPM-o 4.5 on most comparable turn-taking, overlap, and timing metrics, reaching the highest Final score (72.9) on HumDial-FDBench among compared duplex models.
Key findings
- On FDB-v1 and FDB-v1.5, AdaptDuplex improves interaction decisions and timing: backchannel takeover rate 0.334 vs. DuplexOmni’s 0.491; FDB-v1.5 backchannel behavior 0.55 vs. 0.28 and background-speech behavior 0.43 vs. 0.07; interruption TOR 0.985 vs. 0.746 with response latency 0.131 vs. 0.158 s.
- On human-recorded HumDial-FDBench, it attains the highest Final score among compared duplex models (72.9), with delays of 0.835 s (ZH) and 1.345 s (EN); the cascaded Qwen3-Omni+VAD is more accurate at interruption (88.8 vs. 82.2 ALL) but delays over 8.5 s.
- Canonical serialization cuts tokens per window by 78%, protocol share of output tokens from 93.88% to 68.70%, invalid outputs to 0.00%, and decoding P50/P90/P99 by 47%/49%/42%; Text-ahead training raises UTMOSv2 from 2.90 to 3.65 and ValidEnd from 50.00% to 86.37%.
- Dynamic windowing stays near-short latency (0.37 s, 1.32 s) with near-long backchannel (0.55) and is best on talking-to-others (0.35); L1 memory action F1 is 80.66%, L2 action EM 76.84%, launch F1 68.63%, cancellation F1 54.06%, with concurrency stress lowering EM to 65.17% and raising invalid-action rate from 3.80% to 7.10%.
Methods
- AdaptDuplex is initialized from Qwen3-Omni-30B-A3B-Instruct and trained on 8 NVIDIA H100 GPUs, using a compact token-level protocol, bounded Text-ahead dual-stream alignment, dynamic window prediction among 0.48/0.64/0.96 s, and conditional L1 memory/L2 multi-flight external reasoning actions.
- Training uses a three-stage Thinker curriculum, then Talker-only SFT and joint SFT, with GRPO as a further increment; curriculum SFT and Mixed SFT use an internally constructed synthetic corpus of 765,424 dialogues (17,259 h, 10,857 h assistant speech), and joint SFT continues on a high-quality DuplexDrama subset.
- Evaluation uses Full-Duplex-Bench v1, FDB-v1.5, and HumDial-FDBench, plus controlled serialization, Text-ahead, window-policy, logit-bias, and training-recipe comparisons; L1/L2 action prediction is evaluated from gold prefixes.
Limitations
- The paper states that evaluation covers Chinese and English only, the window controller selects among three discrete durations rather than a continuous horizon, and external reasoning is bounded to four concurrent requests.
- Evident in the text: L2 cancellation is the weakest sub-decision (F1 54.06%), and with at least two in-flight requests action EM falls to 65.17% while invalid-action rate nearly doubles (3.80%→7.10%), marking the current limit of multi-flight control.
- Evident in the text: the cascaded Qwen3-Omni+VAD reference remains more accurate at interruption (88.8 vs. 82.2 ALL), though it delays over 8.5 s.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 Valid · 0 Not valid · 8 Not checked · 49 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Canonical serialization cuts tokens per window by 78% and the protocol's share of output tokens from 93.88% to 68.70%, removes structurally invalid outputs, and lowers decoding-time P50/P90/P99 by 47%/49%/42%.”
§ ADAPTDUPLEX: FROM STATIC TO ADAPTIVE FULL-DUPLEX SPOKEN DIALOGUE > 3.3. Protocol Efficiency, Alignment, and Control
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Canonical serialization cuts tokens per window by 78% and the protocol's share of output tokens from 93.88% to 68.70%, removes structurally invalid outputs, and lowers decoding-time P50/P90/P99 by 47%/49%/42%.”
§ ADAPTDUPLEX: FROM STATIC TO ADAPTIVE FULL-DUPLEX SPOKEN DIALOGUE > 3.3. Protocol Efficiency, Alignment, and Control
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Canonical serialization cuts tokens per window by 78% and the protocol's share of output tokens from 93.88% to 68.70%, removes structurally invalid outputs, and lowers decoding-time P50/P90/P99 by 47%/49%/42%.”
§ ADAPTDUPLEX: FROM STATIC TO ADAPTIVE FULL-DUPLEX SPOKEN DIALOGUE > 3.3. Protocol Efficiency, Alignment, and Control
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Canonical serialization cuts tokens per window by 78% and the protocol's share of output tokens from 93.88% to 68.70%, removes structurally invalid outputs, and lowers decoding-time P50/P90/P99 by 47%/49%/42%.”
§ ADAPTDUPLEX: FROM STATIC TO ADAPTIVE FULL-DUPLEX SPOKEN DIALOGUE > 3.3. Protocol Efficiency, Alignment, and Control
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Any look-ahead helps sharply over Aligned training: Fixed Ahead and Random Ahead raise pooled UTMOSv2 from 2.90 to 3.55 and 3.65, roughly halve bilingual CER/WER, and lift ValidEnd from 50.00% to 84.75% and 86.37%.”
§ ADAPTDUPLEX: FROM STATIC TO ADAPTIVE FULL-DUPLEX SPOKEN DIALOGUE > 3.3. Protocol Efficiency, Alignment, and Control
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
15 more claims
Create a free account to see all 57 claims and every source verdict.
- It may state two separate claims as one. 26
- Probably not a substantial claim. 17
- The quote only partly states this claim. 1
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ ADAPTDUPLEX: FROM STATIC TO ADAPTIVE FULL-DUPLEX SPOKEN DIALOGUE > 3.2. Overall Full-Duplex Performance
“response latency is sub-second in all reported FDB scenarios and lowest in every FDB-v1.5 scenario”
§ ADAPTDUPLEX: FROM STATIC TO ADAPTIVE FULL-DUPLEX SPOKEN DIALOGUE > 4. CONCLUSION
“| Back-channel | Behavior↑ Stop lat.↑ Resp. lat.↓ 3.00 0.06 0.42 | 0.80 0.66 2.16 | 0.00 -4.37 | 0.46 0.76 2.34 | 0.28 0.80 0.82 | 0.55 0.84 0.43 |”
Citations
Cites
Moshi: a speech-text foundation model for real-time dialogue
Défossez, A., Mazaré, L., Orsini, M., Royer, A., Pérez, P., Jégou, H., Grave, E., & Zeghidour, N. (2024) · arXiv · doi:10.48550/arxiv.2410.00037 · Cited by 1,027
Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLMPreprint
Wang, X., Li, Y., Fu, C., Shen, Y., Xie, L., Li, K., Sun, X., & Ma, L. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2411.00774 · Cited by 176
Lin, G.-T., Lian, J., Li, T., Wang, Q., Anumanchipalli, G. K., Liu, A. H., & Lee, H.-Y. (2025) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru65441.2025.11433838 · Cited by 171
MiniCPM-o 4.5: Towards Real-Time Full-Duplex Omni-Modal InteractionPreprint
Cui, J., Xu, B., Wang, C., Yu, T., Sun, W.-Y., Xu, Y., Wang, T., He, Z., Ma, W., Cai, T., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.27393 · Cited by 145
OmniFlatten: An End-to-end GPT Model for Seamless Voice Conversation
Zhang, Q., Cheng, L., Deng, C., Chen, Q., Wang, W., Zheng, S., Liu, J., Yu, H., Tan, C.-H., Du, Z., et al. (2025) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2025.acl-long.709 · Cited by 112
SALMONN-omni: A Codec-free LLM for Full-duplex Speech Understanding and GenerationPreprint
Yu, W., Wang, S., Yang, X., Chen, X., Tian, X., Zhang, J., Sun, G., Lu, L., Wang, Y., & Zhang, C. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2411.18138 · Cited by 64
Wang, C., Xue, H., Li, G., Zhao, Z., Wang, S., Wang, S., Xu, X., Bu, H., & Xie, L. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.21406 · Cited by 23
DuplexOmni: Real-Time Listening, Seeing, Thinking, and Speaking for Full-Duplex InteractionPreprint
Huang, M., Zhang, L., Yu, X., Shi, L., Ma, Z., Xu, J., Gao, J., Hao, J., He, R., & Liu, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.09186 · Cited by 18
Wu, D., (188439), T. Z., Li, Y., Liu, H., Chen, C., Chng, E. S., & Bengio, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2603.17837 · Cited by 13
Decoupling Conversational Dynamics in Full-Duplex Spoken Models through Reinforcement LearningPreprint
Li, Y., Wu, D., Lin, G.-T., Lee, H.-Y., Qin, C., Chen, Z., & Chen, C. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.07148 · Cited by 9
Cited by
Still being checked.
Metadata
- Authors
- Zhou, Z., Shang, Y., Wang, Z., Cai, H., Wang, W., Zhou, S., Zhao, S., Fan, W., Guo, Q., Yang, D., Yang, L., & Song, Y.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2026
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2609.29217
- OpenAlex
- W7214079271
- Semantic Scholar
- 60c6088390c1de30f62f2ac06f009f99053b727b
- Cited by
- 0
- References
- 12
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Zenodo (CERN European Organization for Nuclear Research) (cc-by-nc-nd)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Keywords
- turn-taking, overlapping speech, runtime control
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-22, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-22 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: AdaptDuplex: From Static to Adaptive Full-Duplex Spoken Dialogue. https://app.cochat.ai/papers/10.48550/arxiv.2609.29217
- The paper
- Zhou, Z., Shang, Y., Wang, Z., Cai, H., Wang, W., Zhou, S., Zhao, S., Fan, W., Guo, Q., Yang, D., Yang, L., & Song, Y. (2026). AdaptDuplex: From Static to Adaptive Full-Duplex Spoken Dialogue. arXiv. https://doi.org/10.48550/arxiv.2609.29217
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.