CoChat
Sign Up
PreprintCited by 584Natural Language Processing TechniquesTopic ModelingSpeech Recognition and Synthesis

Unsupervised Machine Translation Using Monolingual Corpora Only

Open access
Lample, Guillaume, Conneau, Alexis, Denoyer, Ludovic, Ranzato, Marc'Aurelio·2017·arXiv
DOI 10.48550/arxiv.1711.00043arXiv 1711.00043
Open this paper in CoChat — free accountOpen PDF

Abstract

Machine translation has recently achieved impressive performance thanks to recent advances in deep learning and the availability of large-scale parallel corpora. There have been numerous attempts to extend these successes to low-resource language pairs, yet requiring tens of thousands of parallel sentences. In this work, we take this research direction to the extreme and investigate whether it is possible to learn to translate even without any parallel data. We propose a model that takes sentences from monolingual corpora in two different languages and maps them into the same latent space. By learning to reconstruct in both languages from this shared feature space, the model effectively learns to translate without using any labeled data. We demonstrate our model on two widely used datasets and two language pairs, reporting BLEU scores of 32.8 and 15.1 on the Multi30k and WMT English-French datasets, without using even a single parallel sentence at training time.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.1711.00043

Cites

4 of 4 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Even the unsupervised machine translation literature relies on large bilingual dictionaries, strong pre-trained language models, or synthetic datasets.

    “Even the unsupervised machine translation literature relies on large bilingual dictionaries, strong pre-trained language models, or synthetic datasets [14, 1, 23].”

    From Multimodal Generative Models for Scalable Weakly-Supervised Learning (2018) · cites this paper as [14]

    The Introduction (p. 2) and Overview of the Method (p. 3) say the model initializes with an inferred bilingual dictionary and trains iteratively on translations it generates itself. That supports reliance on a bilingual lexicon and synthetic translations, but the paper does not establish that the dictionary is large or that the model requires a strong pre-trained language model or a pre-existing synthetic dataset. (LLM, conf=0.82)

    Experimental — accuracy not yet measured

  • The informal to formal translation data for this phase can be generated using cycle-consistency training together with the small but increasing amounts of human-verified formalization of informal statements.

    “The informal to formal translation data for this phase can be generated using cycle-consistency training (Lample et al., 2017) together with the small but increasing amounts of humanverified formalization of informal statements.”

    From Towards Guaranteed Safe AI: A Framework for Ensuring Robust and Reliable AI Systems (2024) · cites this paper as Lample et al., 2017

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Part of this paper’s reference list could not be split into single entries.

Flagged first, then by citations

Research works printed but not linked: 1

  1. [6]6. D.L. Donoho. Compressed sensing. IEEE Transactions on Information Theory, 2006.

Cited by

Sorted by citations

Authors
Lample, G., Conneau, A., Denoyer, L., & Ranzato, M.
Affiliations
  • Centre National de la Recherche Scientifique (FR)
  • Meta (Israel) (IL)
Venue
arXiv
Publisher
arXiv
Published
2017
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.1711.00043
arXiv
1711.00043
OpenAlex
W2765961751
Cited by
584
References
4
Citations by year
2025: 11 · 2024: 24 · 2023: 74 · 2022: 74 · 2021: 109 · 2020: 102 · 2019: 113 · 2018: 76 · 2017: 1
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
Keywords
unsupervised machine translation, monolingual corpora, low-resource languages, shared latent space, cross-lingual representation learning

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review