The DOI matches its OpenAlex record; 2 of the 2 references it cites were found in a registry or an index.
Building Large Monolingual Dictionaries at the Leipzig Corpora Collection: From 100 to 200 Languages
Open accessAbstract
The Leipzig Corpora Collection offers free online access to 136 monolingual dictionaries enriched with statistical information.In this paper we describe current advances of the project in collecting and processing text data automatically for a large number of languages.Our main interest lies in languages of "low density", where only few text data exists online.The aim of this approach is to create monolingual dictionaries and statistical information for a high number of new languages and to expand the existing dictionaries, opening up new possibilities for linguistic typology and other research.Focus of this paper will be set on the infrastructure for the automatic acquisition of large amounts of monolingual text in many languages from various sources.Preliminary results of the collection of text data will be presented.The mainly language-independent framework for preprocessing, cleaning and creating the corpora and computing the necessary statistics will also be depicted.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Corpus Portal for Search in Monolingual Corpora
Quasthoff, U., Richter, M., & Biemann, C. (2006) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/4e84ygei5ryc · Cited by 176
Self-citationThe Crúbadán Project: Corpus building for under-resourced languages
Scannell, K. P. (2007) · Cited by 98
Cited by
All-optical spiking neurosynaptic networks with self-learning capabilities
Feldmann, J., Youngblood, N., Wright, C. D., Bhaskaran, H., & Pernice, W. H. P. (2019) · Nature · doi:10.1038/s41586-019-1157-8 · Cited by 1,529
Kakwani, D., Kunchukuttan, A., Golla, S., N.C., G., Bhattacharyya, A., Khapra, M. M., & Kumar, P. (2020) · Findings of the Association for Computational Linguistics: EMNLP 2020 · doi:10.18653/v1/2020.findings-emnlp.445 · Cited by 446
Resources and benchmark corpora for hate speech detection: a systematic review
Poletto, F., Basile, V., Sanguinetti, M., Bosco, C., & Patti, V. (2021) · Language Resources and Evaluation · doi:10.1007/s10579-020-09502-8 · Cited by 385
The Low/High Index of Pupillary Activity
Duchowski, A. T., Krejtz, K., Gehrer, N. A., Bafna, T., & Bækgaard, P. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376394 · Cited by 94
Mitigating Language-Dependent Ethnic Bias in BERT
Ahn, J., & Oh, A. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.42 · Cited by 64
The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Dataset
Laurençon, H., Saulnier, L., Wang, T., Akiki, C., del Moral, A. V., Scao, T. L., Von Werra, L., Mou, C., Ponferrada, E. G., Nguyen, H., et al. (2023) · arXiv · doi:10.48550/arxiv.2303.03915 · Cited by 93
“Leipzig Corpora Collection ur Goldhahn et al. (2012) Mann Ki Baat bn, gu, hi, ml, mr, or, ta, te, ur Siripragada et al.”
BackgroundClos, M., Bunzeck, N., & Sommer, T. (2019) · The Journal of Neuroscience · doi:10.1523/jneurosci.0495-19.2019 · Cited by 32
C4Corpus: Multilingual Web-size Corpus with Free License
Habernal, I., Zayed, O., & Gurevych, I. (2016) · Proceedings of the Language Resources and Evaluation Conference · doi:10.63317/3iti4i8msr33 · Cited by 30
“Second, they are usually available as either n-grams (Brants and Franz, 2006) or shuffled sentences, e.g., COW (Sch¨afer and Bildhauer, 2012) or Leipzig Corpora (Goldhahn et al., 2012).”
BackgroundKobrock, K., Ohmer, X., Bruni, E., & Gotzner, N. (2026) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1014326
“We use the Leipzig Corpora Collection [93] and specifically the News copora with 10K words for English (2024) and Arabic (2022) including words and their frequencies in the corpus.”
Metadata
- Authors
- Goldhahn, D., Eckart, T., & Quasthoff, U.
- Venue
- Language Resources and Evaluation Conference (LREC)
- Published
- 2012-05
- Pages
- 759-765
- ISSN
- 2522-2686
- OpenAlex
- W2250600805
- Cited by
- 345
- References
- 2
- FWCI
- 3.45
- Type
- conference paper
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.