Cited by 9,645Topic ModelingNatural Language Processing TechniquesAdvanced Graph Neural Networks

The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.

Enriching Word Vectors with Subword Information

Open access
Bojanowski, Piotr, Grave, Edouard, Joulin, Armand, Mikolov, Tomas·2017·Transactions of the Association for Computational Linguistics

Abstract

Continuous word representations, trained on large unlabeled corpora are useful for many natural language processing tasks. Popular models that learn such representations ignore the morphology of words, by assigning a distinct vector to each word. This is a limitation, especially for languages with large vocabularies and many rare words. In this paper, we propose a new approach based on the skipgram model, where each word is represented as a bag of character n-grams. A vector representation is associated to each character n-gram; words being represented as the sum of these representations. Our method is fast, allowing to train models on large corpora quickly and allows us to compute word representations for words that did not appear in the training data. We evaluate our word representations on nine different languages, both on word similarity and analogy tasks. By comparing to recently proposed morphological word representations, we show that our vectors achieve state-of-the-art performance on these tasks.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1162/tacl_a_00051

Cites

47 of 47 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Flagged first, then by citations

Show all 47 references

Research works printed but not linked: 1

  1. Cui Qing, 2015, ACM Transactions on Information Systems, 34, 1

Cited by

Sorted by citations

Items 301–400 of 1,029

Metadata

Authors
Bojanowski, P., Grave, E., Joulin, A., & Mikolov, T.
Affiliations
  • Meta (United States) (US)
  • Facebook AI Research,
Corresponding author
  • Bojanowski, Piotr
  • Joulin, Armand
Venue
Transactions of the Association for Computational Linguistics
Publisher
MIT Press
Published
2017-12
Volume
5
Pages
135-146
ISSN
2307-387X (ISSN-L)
OpenAlex
W2493916176
Cited by
9,645
References
47
Citations by year
2026: 389 · 2025: 677 · 2024: 790 · 2023: 1188 · 2022: 1253 · 2021: 1691 · 2020: 1561 · 2019: 1288 · 2018: 648 · 2017: 142
FWCI
593.75
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Transactions of the Association for Computational Linguistics (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
  • Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
  • Physical Sciences › Computer Science › Artificial Intelligence › Advanced Graph Neural Networks
Keywords
word embeddings, character n-grams, skip-gram model, out-of-vocabulary words, word similarity, word analogy, multilingual word representation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review