MOSS Transcribe Diarize Technical Report
Open accessAbstract
Speaker-Attributed, Time-Stamped Transcription (SATS) aims to transcribe what is said and to precisely determine the timing of each speaker, which is particularly valuable for meeting transcription. Existing SATS systems rarely adopt an end-to-end formulation and are further constrained by limited context windows, weak long-range speaker memory, and the inability to output timestamps. To address these limitations, we present MOSS Transcribe Diarize, a unified multimodal large language model that jointly performs Speaker-Attributed, Time-Stamped Transcription in an end-to-end paradigm. Trained on extensive real wild data and equipped with a 128k context window for up to 90-minute inputs, MOSS Transcribe Diarize scales well and generalizes robustly. Across comprehensive evaluations, it outperforms state-of-the-art commercial systems on multiple public and in-house benchmarks.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Recent end-to-end speaker-attributed transcription systems such as MOSS-Transcribe-Diarize emphasize the need to jointly model lexical content, speaker identity, and timestamps over long recordings.
“recent end-to-end speaker-attributed transcription systems such as MOSS-Transcribe-Diarize [23] further emphasize the need to jointly model lexical content, speaker identity, and timestamps over long recordings.”
From MOSS-Audio Technical Report (2026) · cites this paper as [23]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Still being checked.
Research works printed but not linked: 20
- Max Bain, Jaesung Huh, Tengda Han, and Andrew Zisserman. Whisperx: Time-accurate speech transcription of long-form audio. arXiv preprint arXiv:2303.00747, 2023. · arXiv
- Hervé Bredin, Ruiqing Yin, Juan Manuel Coria, Gregory Gelly, Pavel Korshunov, Marvin Lavechin, Diego Fustes, Hadrien Titeux, Wassim Bouaziz, and Marie-Philippe Gill. Pyannote.audio: neural building blocks for speaker diarization. In ICASSP, pages 7124-7128, 2020.
- J. Chen, Y. Wang, S. Watanabe, J. Le Roux, and J. R. Hershey. Continuous speech separation: Dataset and analysis. In Proceedings of ICASSP, 2020.
- Shimin Chen, Xiaohan Lan, Yitian Yuan, Zequn Jie, and Lin Ma. Timemarker: A versatile video-llm for long and short video understanding with superior temporal localization ability. arXiv preprint arXiv:2411.18211, 2024. · arXiv
- Yunfei Chu, Zhifang Jin, Weihan Xu, Yuchen Wei, et al. Qwen-audio: Advancing universal audio understanding via unified large-scale audio-language models. arXiv preprint arXiv:2311.07919, 2023. · arXiv
- Ying Fu, Li Cheng, Shuo Lv, Yuting Jv, Yu Kong, Yan Hu, Lei Xie, Chenglin Zhu, Jian Wu, Hao Bu, Xiong Xu, Jun Du, and Jian Chen. AISHELL-4: An open source dataset for speech enhancement, separation, recognition and speaker diarization in conference scenario. In Proceedings of Interspeech, pages 3660-3664, 2021.
- Yusuke Fujita, Takuya Yoshioka, Xuankai Chang, and Shinji Watanabe. End-to-end neural speaker diarization with self-attention. In Proceedings of ASRU, 2019.
- Adam Janin, Don Baron, Jane Edwards, Dan Ellis, David Gelbart, Nelson Morgan, Barbara Peskin, Thilo Pfau, Eliz- abeth Shriberg, and Andreas Stolcke. The icsi meeting corpus. In Proceedings of ICASSP, 2003.
- Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang, Zhong Meng, and Takuya Yoshioka. Serialized output training for end-to-end overlapping speech recognition. In Interspeech, pages 2797-2801, 2020.
- Federico Landini, Jan Profant, Mireia Díez, and Lukáš Burget. From simulated mixtures to simulated conversations as training data for neural diarization. In Proceedings of Interspeech, pages 143-147, 2022.
- Michael McAuliffe, Michaela Socolof, Sarah Mihuc, Michael Wagner, and Morgan Sonderegger. Montreal forced aligner: A trainable text-speech alignment system. In Proceedings of Interspeech, 2017.
- T. Park, I. Medennikov, K. Dhawan, W. Wang, H. Huang, N. R. Koluguri, K. C. Puvvada, J. Balam, and B. Ginsburg. Sortformer: Seamless integration of speaker diarization and asr by bridging timestamps and tokens. arXiv preprint, 2024.
- T. J. Park, H. Huang, C. Hooper, N. Koluguri, K. Dhawan, I. Medennikov, A. Jukic, J. Balam, and B. Ginsburg. Property-aware multi-speaker data simulation: A probabilistic modelling technique for synthetic data generation. In Proceedings of the CHiME-2023 Workshop, 2023.
- Alec Radford, Jong Wook Kim, Tao Xu, Greg Brockman, Christine McLeavey, and Ilya Sutskever. Robust speech recognition via large-scale weak supervision. ICML, 2023.
- Mohan Shi, Xiong Xiao, Ruchao Fan, Shaoshi Ling, and Jinyu Li. Train short, infer long: Speech-llm enables zero- shot streamable joint asr and diarization on long audio. arXiv preprint arXiv:2511.16046, 2025. · arXiv
- David Snyder, Daniel Garcia-Romero, Gregory Sell, Daniel Povey, and Sanjeev Khudanpur. X-vectors: Robust dnn embeddings for speaker recognition. In Proceedings of ICASSP, 2018.
- Changli Tang, Wenyi Yu, Guangzhi Sun, Xianzhe Chen, et al. Salmonn: Towards generic hearing abilities for large language models. arXiv preprint arXiv:2310.13289, 2023. · arXiv
- Q. Wang et al. Diarizationlm: Speaker diarization post-processing with large language models. In Proc. Interspeech, 2024.
- H. Yin, Y. Chen, C. Deng, L. Cheng, H. Wang, C.-H. Tan, Q. Chen, W. Wang, and X. Li. Speakerlm: End-to-end versatile speaker diarization and recognition with multimodal large language models. arXiv preprint, 2025.
- Dong Zhang, Shimin Li, Xin Zhang, Jun Zhan, Pengyu Wang, Yunfei Zhou, and Xipeng Qiu. Speechgpt: Empow- ering large language models with intrinsic cross-modal conversational abilities. In EMNLP, 2023.
Cited by
Sorted by citations
Yang, C., Yu, C., Chen, H., Zhu, J., Chen, J., Chen, K., Wang, W., Wang, Y., Jiang, Y., Jiang, Y., et al. (2026) · arXiv · doi:10.48550/arxiv.2606.01802
“…long been a practical target in speech recognition systems such as Whisper [5], while recent end-to-end speaker-attributed transcription systems such as MOSS-Transcribe-Diarize [23] further emphasize the need to jointly model lexical content, speaker identity, and timestamps over long recordings.”
Self-citation
- Authors
- AI, M., :, Yu, D., Lin, Z., Chen, H., Yang, C., Zhang, Y., Chen, J., Chen, K., Fan, L., Jiang, Y., Zhu, J., Li, M., Wang, W., Wang, Y., Xu, Z., Jiang, B., Gong, Y., Zhang, Y., Zhang, W., Wang, S., Wu, Z., Fei, Z., Cheng, Q., Li, S., & Qiu, X.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2026
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2601.01554
- OpenAlex
- W7118660679
- Cited by
- 0
- References
- 0
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Funders
- Strong
- H2020 European Research Council
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- speaker diarization, meeting transcription, multimodal large language models, timestamping
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
