Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 32 of the 37 references it cites were found in a registry or an index, and 1 are not checked yet; none of the 11 sources its claims cite is checked for support yet.

State-of-the-Art Speech Recognition with Sequence-to-Sequence Models

Open access

Abstract

Attention-based encoder-decoder architectures such as Listen, Attend, and Spell (LAS), subsume the acoustic, pronunciation and language model components of a traditional automatic speech recognition (ASR) system into a single neural network. In previous work, we have shown that such architectures are comparable to state-of-the-art ASR systems on dictation tasks, but it was not clear if such architectures would be practical for more challenging tasks such as voice search. In this work, we explore a variety of structural and optimization improvements to our LAS model which significantly improve performance. On the structural side, we show that word piece models can be used instead of graphemes. We also introduce a multi-head attention architecture, which offers improvements over the commonly-used single-head attention. On the optimization side, we explore synchronous training, scheduled sampling, label smoothing, and minimum word error rate optimization, which are all shown to improve accuracy. We present results with a unidirectional LSTM encoder for streaming recognition. On a 12, 500 hour voice search task, we find that the proposed changes improve the WER from 9.2% to 5.6%, while the best conventional system achieves 6.7%; on a dictation task our model achieves a WER of 4.1% compared to 5% for the conventional system.

Checked 2026-10-11 · 1 reference not checked yet

Overview

CoChat Summary

## TL;DR

This paper shows that a LAS sequence-to-sequence ASR system can beat a strong conventional system on large-scale voice search by combining word pieces, multi-head attention, several optimization tricks, and second-pass language-model rescoring. On voice search, WER improved from 9.2% to 5.6%, and on dictation the model reached 4.1% vs. 5.0% for the conventional system.

## Key findings

  • Word piece models (WPM) slightly improved over graphemes: WER went from 9.2% to 9.0% (2.2% relative WERR).
  • Adding multi-head attention on top of WPM reduced WER from 9.0% to 8.0% (11.1% relative WERR).
  • Optimization changes further improved WER: synchronous training to 7.7%, scheduled sampling to 7.1%, label smoothing to 6.7%, and MWER training to 5.8%; the paper reports an overall 27.5% gain from these optimizations, moving from 8.0% to 5.8%.
  • Second-pass rescoring with an external LM improved WER from 5.8% to 5.6% (3.4% relative improvement); overall, the proposed model achieved 5.6% WER on voice search and 4.1% on dictation, compared with 6.7% and 5.0% for the conventional system.

## Methods

  • Sequence-to-sequence LAS model with an encoder-attender-decoder architecture; experiments used 5-layer LSTM encoders and a 2-layer LSTM decoder, with both unidirectional and bidirectional variants.
  • Data: about 12,500 hours of training data from 15 million English utterances, artificially corrupted with noise/reverberation; evaluation on about 14.8K voice-search utterances and 15.7K dictation utterances.
  • Analysis: compared graphemes vs. word pieces, single-head vs. multi-head attention, and several training/decoding strategies including synchronous training, scheduled sampling, label smoothing, MWER training, and second-pass LM rescoring.

## Limitations

  • The paper states that the unidirectional LAS system requires the entire utterance to be seen by the encoder before any labels can be decoded, even though encoding is done in a streaming fashion.
  • The paper says the second-pass LM is very large: 80 GB, and it still dominates model size.
  • Evident from the text: the strongest reported comparison is on voice search and dictation only, so generalization beyond these tasks is not established in this paper.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1109/icassp.2018.8462105

Cites

32 of 33 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

0 Valid · 1 Not valid · 9 Not checked · 30 Own results and interpretations

18 more claims

Create a free account to see all 40 claims and to verify the 10 references still open.

See all claims — free account
  • It may state two separate claims as one. 12
  • The quote only partly states this claim. 2
  • Probably not a substantial claim. 6

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 37 references

Research works printed but not linked: 1

  1. abadi, 2015, Tensorflow Large-scale machine learning on heterogeneous distributed systems

Cited by

See all 1,043

Metadata

Authors
Chiu, C.-C., Sainath, T. N., Wu, Y., Prabhavalkar, R., Nguyen, P., Chen, Z., Kannan, A., Weiss, R. J., Rao, K., Gonina, E., Jaitly, N., Li, B., Chorowski, J., & Bacchiani, M.
Affiliations
Google (United States) (US)
Venue
2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
Publisher
IEEE
Published
2018-04
Pages
4774-4778
ISSN
1520-6149 (ISSN-L)
OpenAlex
W2775304348
Cited by
1,043
References
37
Citations by year
2026: 10 · 2025: 42 · 2024: 53 · 2023: 102 · 2022: 143 · 2021: 230 · 2020: 215 · 2019: 180 · 2018: 67
FWCI
70.66
Type
conference paper
Language
en
Open access
Locations
  • IEEE International Conference on Acoustics Speech and Signal Processing (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
  • Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Handwritten Text Recognition Techniques
Keywords
speech recognition, sequence-to-sequence models, attention-based encoder-decoder, multi-head attention, scheduled sampling, label smoothing, synchronous training, voice search, dictation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: State-of-the-Art Speech Recognition with Sequence-to-Sequence Models. https://app.cochat.ai/papers/10.1109/icassp.2018.8462105
The paper
Chiu, C.-C., Sainath, T. N., Wu, Y., Prabhavalkar, R., Nguyen, P., Chen, Z., Kannan, A., Weiss, R. J., Rao, K., Gonina, E., Jaitly, N., Li, B., Chorowski, J., & Bacchiani, M. (2018). State-of-the-Art Speech Recognition with Sequence-to-Sequence Models. 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). https://doi.org/10.1109/icassp.2018.8462105

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.