Cited by 218Speech Recognition and SynthesisSpeech and Audio ProcessingSpeech and dialogue systems

Learning hidden unit contributions for unsupervised speaker adaptation of neural network acoustic models

Open access
Swietojanski, Pawel, Renals, Steve·2014·2014 IEEE Spoken Language Technology Workshop (SLT)

Abstract

This paper proposes a simple yet effective model-based neural network speaker adaptation technique that learns speaker-specific hidden unit contributions given adaptation data, without requiring any form of speaker-adaptive training, or labelled adaptation data. An additional amplitude parameter is defined for each hidden unit; the amplitude parameters are tied for each speaker, and are learned using unsupervised adaptation. We conducted experiments on the TED talks data, as used in the International Workshop on Spoken Language Translation (IWSLT) evaluations. Our results indicate that the approach can reduce word error rates on standard IWSLT test sets by about 8-15% relative compared to unadapted systems, with a further reduction of 4-6% relative when combined with feature-space maximum likelihood linear regression (fMLLR). The approach can be employed in most existing feed-forward neural network architectures, and we report results using various hidden unit activation functions: sigmoid, maxout, and rectifying linear units (ReLU).

Integrity signals

Registry

Crossref · 10.1109/slt.2014.7078569

Cites

42 of 42 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Swietojanski, P., & Renals, S.
Affiliations
University of Edinburgh (GB)
Venue
2014 IEEE Spoken Language Technology Workshop (SLT)
Publisher
IEEE
Published
2014-12
Pages
171-176
OpenAlex
W2094147890
Cited by
218
References
42
Citations by year
2026: 3 · 2025: 1 · 2024: 3 · 2023: 7 · 2022: 13 · 2021: 15 · 2020: 20 · 2019: 18 · 2018: 36 · 2017: 31 · 2016: 43 · 2015: 26 · 2014: 2
FWCI
20.02
Type
conference paper
Language
en
Open access
Licence
other-oa
Locations
  • IEEE Spoken Language Technology Workshop (SLT) (publishedVersion)
  • Edinburgh Research Explorer (University of Edinburgh) (submittedVersion, other-oa)
Funders
Engineering and Physical Sciences Research Council (EP/I031022/1)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
  • Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
Keywords
unsupervised speaker adaptation, model-based adaptation, TED Talks, speech translation, word error rate reduction, rectified linear units

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review