The DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index.
MasakhaNER: Named Entity Recognition for African Languages
Open accessAbstract
We take a step towards addressing the under- representation of the African continent in NLP research by bringing together different stakeholders to create the first large, publicly available, high-quality dataset for named entity recognition (NER) in ten African languages. We detail the characteristics of these languages to help researchers and practitioners better understand the challenges they pose for NER tasks. We analyze our datasets and conduct an extensive empirical evaluation of state- of-the-art methods across both supervised and transfer learning settings. Finally, we release the data, code, and models to inspire future research on African NLP.1
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
Lafferty, J., McCallum, A., & Pereira, F. C. N. (2001) · ScholarlyCommons (University of Pennsylvania) · Cited by 12,935
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
Reimers, N., & Gurevych, I. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1410 · Cited by 12,778
Advances in Neural Information Processing Systems 25
Zhang, Y., Sutton, C. A., Storkey, A., & Zoubin Ghahramani, A. (2012) · Cited by 12,653
Enriching Word Vectors with Subword Information
Bojanowski, P., Grave, E., Joulin, A., & Mikolov, T. (2017) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00051 · Cited by 9,645
Measuring nominal scale agreement among many raters.
Fleiss, J. L. (1971) · Psychological Bulletin · doi:10.1037/h0031619 · Cited by 8,733
Unsupervised Cross-lingual Representation Learning at Scale
Conneau, A., Khandelwal, K., Goyal, N., Chaudhary, V., Wenzek, G., Guzmán, F., Grave, E., Ott, M., Zettlemoyer, L., & Stoyanov, V. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.747 · Cited by 5,637
Neural Architectures for Named Entity Recognition
Lample, G., Ballesteros, M., Subramanian, S., Kawakami, K., & Dyer, C. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1030 · Cited by 4,401
Universal Language Model Fine-tuning for Text Classification
Howard, J., & Ruder, S. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1031 · Cited by 4,100
Self-citationHuggingFace's Transformers: State-of-the-art Natural Language Processing
Wolf, T., Debut, L., Sanh, V., Chaumond, J., Delangue, C., Moi, A., Cistac, P., Rault, T., Louf, R., Funtowicz, M., et al. (2019) · arXiv · doi:10.48550/arxiv.1910.03771 · Cited by 3,347
Introduction to the CoNLL-2003 Shared Task: Language-Independent Named Entity Recognition
Tjong Kim Sang, E. F., & De Meulder, F. (2003) · Proceedings of the seventh conference on Natural language learning at HLT-NAACL 2003 - · doi:10.3115/1119176.1119195 · Cited by 2,788
End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF
Ma, X., & Hovy, E. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1101 · Cited by 2,567
Ethnologue. Languages of the World
(2014) · African Studies Companion Online · doi:10.1163/_afco_asc_441 · Cited by 2,162
Don’t Stop Pretraining: Adapt Language Models to Domains and Tasks
Gururangan, S., Marasović, A., Swayamdipta, S., Lo, K., Beltagy, I., Downey, D., & Smith, N. A. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.740 · Cited by 2,103
Named Entity Recognition with Bidirectional LSTM-CNNs
Chiu, J. P. C., & Nichols, E. (2016) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00104 · Cited by 1,909
Introduction to the CoNLL-2002 Shared Task: Language-Independent Named Entity Recognition
Sang, E. T. K. (2002) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/0209010 · Cited by 1,560
Design challenges and misconceptions in named entity recognition
Ratinov, L., & Roth, D. (2009) · Proceedings of the Thirteenth Conference on Computational Natural Language Learning - CoNLL '09 · doi:10.3115/1596374.1596399 · Cited by 1,448
Parallel Data, Tools and Interfaces in OPUS
Tiedemann, J. (2012) · Language Resources and Evaluation · Cited by 1,421
LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attention
Yamada, I., Asai, A., Shindo, H., Takeda, H., & Matsumoto, Y. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.523 · Cited by 590
Proceedings of the Eighteenth International Conference on Machine Learning
Brodley, C. E., & Danyluk, A. (2001) · Cited by 568
Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC-2014)
Calzolari, N., Choukri, K., Declerck, T., Loftsson, H., Mægaard, B., Mariani, J., Moreno, A., Odijk, J., & Piperidis, S. (2014) · Language Resources and Evaluation · Cited by 561
Introduction to the CoNLL-2002 shared task: language-independent named entity recognition
Tjong Kim Sang, E. F. (2002) · proceeding of the 6th conference on Natural language learning - COLING-02 · doi:10.3115/1118853.1118877 · Cited by 519
Ethnologue: Languages of the World
(1999) · Electronic Resources Review · doi:10.1108/err.1999.3.11.129.120 · Cited by 499
A Survey on Recent Advances in Named Entity Recognition from Deep Learning models
Yadav, V., & Bethard, S. J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.11470 · Cited by 464
MAD-X: An Adapter-Based Framework for Multi-Task Cross-Lingual Transfer
Pfeiffer, J., Vulić, I., Gurevych, I., & Ruder, S. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.617 · Cited by 437
Self-citationXTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalisation
Hu, J., Ruder, S., Siddhant, A., Neubig, G., Fırat, O., & Johnson, M. (2020) · International Conference on Machine Learning · Cited by 325
Self-citationCross-lingual Name Tagging and Linking for 282 Languages
Pan, X., Zhang, B., May, J., Nothman, J., Knight, K., & Ji, H. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1178 · Cited by 312
DyNet: The Dynamic Neural Network Toolkit
Neubig, G., Dyer, C., Goldberg, Y., Matthews, A., Ammar, W., Anastasopoulos, A., Ballesteros, M., Chiang, D., Clothiaux, D., Cohn, T., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.03980 · Cited by 302
Self-citationXTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization
Hu, J., Ruder, S., Siddhant, A., Neubig, G., Fırat, O., & Johnson, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.11080 · Cited by 278
Self-citationEthnologue languages of the world
Eberhard, D. M., Simons, G. F. 1., & Fenning, C. D. (2022) · Cited by 276
From Zero to Hero: On the Limitations of Zero-Shot Language Transfer with Multilingual Transformers
Lauscher, A., Ravishankar, V., Vulić, I., & Glavaš, G. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.363 · Cited by 236
A Survey of Arabic Named Entity Recognition and Classification
Shaalan, K. (2014) · Computational Linguistics · doi:10.1162/coli_a_00178 · Cited by 213
JW300: A Wide-Coverage Parallel Corpus for Low-Resource Languages
Agić, Ž., & Vulić, I. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1310 · Cited by 199
Participatory Research for Low-resourced Machine Translation: A Case Study in African Languages
Nekoto, W., Marivate, V., Matsila, T., Fasubaa, T., Fagbohungbe, T., Akinola, S. O., Muhammad, S., Kabongo Kabenamualu, S., Osei, S., Sackey, F., et al. (2020) · Findings of the Association for Computational Linguistics: EMNLP 2020 · doi:10.18653/v1/2020.findings-emnlp.195 · Cited by 182
Self-citationCCAligned: A Massive Collection of Cross-Lingual Web-Document Pairs
El-Kishky, A., Chaudhary, V., Guzmán, F., & Koehn, P. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.480 · Cited by 141
UNKs Everywhere: Adapting Multilingual Language Models to New Scripts
Pfeiffer, J., Vulić, I., Gurevych, I., & Ruder, S. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.800 · Cited by 107
Self-citationStrassel, S. M., & Tracey, J. (2016) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/3xtxb975en3d · Cited by 95
NoSta-D Named Entity Annotation for German: Guidelines and Dataset
Benikova, D., Biemann, C., & Reznicek, M. (2014) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/4kdtmaceeavd · Cited by 94
Interpretable Multi-dataset Evaluation for Named Entity Recognition
Fu, J., Liu, P., & Neubig, G. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.489 · Cited by 88
Self-citationA Focus on Neural Machine Translation for African LanguagesPreprint
Martinus, L., & Abbott, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.05685 · Cited by 57
Self-citationSoft Gazetteers for Low-Resource Named Entity Recognition
Rijhwani, S., Zhou, S., Neubig, G., & Carbonell, J. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.722 · Cited by 43
Self-citationKINNEWS and KIRNEWS: Benchmarking Cross-Lingual Text Classification for Kinyarwanda and Kirundi
Niyongabo, R. A., Hong, Q., Kreutzer, J., & Huang, L. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.480 · Cited by 37
Self-citationIgbo-English Machine Translation: An Evaluation BenchmarkPreprint
Ezeani, I., Rayson, P., Onyenwe, I., Uchechukwu, C., & Hepple, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.00648 · Cited by 31
Self-citationElements of modern Igbo grammar : a descriptive approach
Emenanjọ, E. N. (1987) · MPG.PuRe (Max Planck Society) · Cited by 26
Government Domain Named Entity Recognition for South African Languages
Eiselen, R. (2016) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/5mcyozqscxag · Cited by 19
The Effect of Domain and Diacritics in Yorùbá-English Neural Machine TranslationPreprint
Adelani, D. I., Ruiter, D., Alabi, J. O., Adebonojo, D., Ayeni, A., Adeyemi, M., Awokoya, A., & España-Bonet, C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.08647 · Cited by 18
Self-citationGrammaticalization in Nigerian Pidgin
Mensah, E. O. (2012) · Íkala Revista de Lenguaje y Cultura · doi:10.17533/udea.ikala.10748 · Cited by 14
Platforms for Non-speakers Annotating Names in Any Language
Lin, Y., Costello, C. J., Zhang, B., Lu, D., Ji, H., Mayfield, J., & McNamee, P. (2018) · doi:10.18653/v1/p18-4001 · Cited by 14
Massive vs. Curated Word Embeddings for Low-Resourced Languages. The Case of Yorùbá and TwiPreprint
Alabi, J. O., Amponsah-Kaakyire, K., Adelani, D. I., & España-Bonet, C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.02481 · Cited by 11
Self-citationUnsupervised induction of Dholuo word classes using maximum entropy learning
Pauw, G. D., Wagacha, P. W., & Abade, D. A. (2013) · Cited by 9
Predicting Morphologically-Complex Unknown Words in Igbo
Onyenwe, I., & Hepple, M. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-45510-5_24 · Cited by 7
(2015) · doi:10.4230/oasics.slate.2021.8 · Cited by 1
Cited by
Advances, challenges and opportunities in creating data for trustworthy AI
Liang, W., Tadesse, G. A., Ho, D., Fei-Fei, L., Zaharia, M., Zhang, C., & Zou, J. (2022) · Nature Machine Intelligence · doi:10.1038/s42256-022-00516-1 · Cited by 559
Garrido-Muñoz, I., Montejo-Ráez, A., Martínez-Santiago, F., & Ureña-López, L. A. (2021) · Applied Sciences · doi:10.3390/app11073184 · Cited by 123
What Artificial Neural Networks Can Tell Us about Human Language Acquisition
Warstadt, A., & Bowman, S. R. (2022) · Algebraic Structures in Natural Language · doi:10.1201/9781003205388-2 · Cited by 111
Contrasting Linguistic Patterns in Human and LLM-Generated News Text
Muñoz-Ortiz, A., Gómez-Rodríguez, C., & Vilares, D. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10903-2 · Cited by 94
Don’t Take the Premise for Granted: Mitigating Artifacts in Natural Language Inference
Belinkov, Y., Poliak, A., Shieber, S., Van Durme, B., & Rush, A. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1084 · Cited by 73
Metadata
- Authors
- Adelani, D. I., Abbott, J., Neubig, G., D’souza, D., Kreutzer, J., Lignos, C., Palen-Michel, C., Buzaaba, H., Rijhwani, S., Ruder, S., Mayhew, S., Azime, I. A., Muhammad, S. H., Emezue, C. C., Nakatumba-Nabende, J., Ogayo, P., Anuoluwapo, A., Gitau, C., Mbaye, D., Alabi, J., Yimam, S. M., Gwadabe, T. R., Ezeani, I., Niyongabo, R. A., Mukiibi, J., Otiende, V., Orife, I., David, D., Ngom, S., Adewumi, T., Rayson, P., Adeyemi, M., Muriuki, G., Anebi, E., Chukwuneke, C., Odu, N., Wairagala, E. P., Oyerinde, S., Siro, C., Bateesa, T. S., Oloyede, T., Wambui, Y., Akinode, V., Nabagereka, D., Katusiime, M., Awokoya, A., MBOUP, M., Gebreyohannes, D., Tilaye, H., Nwaike, K., Wolde, D., Faye, A., Sibanda, B., Ahia, O., Dossou, B. F. P., Ogueji, K., DIOP, T. I., Diallo, A., Akinfaderin, A., Marengereke, T., & Osei, S.
- Venue
- Transactions of the Association for Computational Linguistics
- Publisher
- MIT Press
- Published
- 2021
- Volume
- 9
- Pages
- 1116-1131
- ISSN
- 2307-387X (ISSN-L)
- OpenAlex
- W3207937903
- Cited by
- 257
- References
- 57
- FWCI
- 16.23
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.