The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Cross-lingual Name Tagging and Linking for 282 Languages
Open accessAbstract
The ambitious goal of this work is to develop a cross-lingual name tagging and linking framework for 282 languages that exist in Wikipedia.Given a document in any of these languages, our framework is able to identify name mentions, assign a coarse-grained or fine-grained type to each mention, and link it to an English Knowledge Base (KB) if it is linkable.We achieve this goal by performing a series of new KB mining methods: generating "silver-standard" annotations by transferring annotations from English to other languages through crosslingual links and KB properties, refining annotations through self-training and topic selection, deriving language-specific morphology features from anchor links, and mining word translation pairs from crosslingual links.Both name tagging and linking results for 282 languages are promising on Wikipedia data and on-Wikipedia data.All the data sets, resources and systems for 282 languages are made publicly available as a new benchmark 1 .
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Stanford CoreNLP Natural Language Processing Toolkit
Manning, C., Surdeanu, M., Bauer, J., Finkel, J., Bethard, S., & McClosky, D. (2014) · Proceedings of 52nd Annual Meeting of the Association for Computational Linguistics: System Demonstrations · doi:10.3115/v1/p14-5010 · Cited by 7,037
Freebase: a collaboratively created graph database for structuring human knowledge
Bollacker, K., Evans, C., Paritosh, P., Sturge, T., & Taylor, J. (2008) · Proceedings of the 2008 ACM SIGMOD international conference on Management of data · doi:10.1145/1376616.1376746 · Cited by 4,852
Neural Architectures for Named Entity Recognition
Lample, G., Ballesteros, M., Subramanian, S., Kawakami, K., & Dyer, C. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1030 · Cited by 4,401
A Systematic Comparison of Various Statistical Alignment Models
Och, F. J., & Ney, H. (2003) · Computational Linguistics · doi:10.1162/089120103321337421 · Cited by 3,854
Word association norms, mutual information, and lexicography
Church, K., & Hanks, P. (1990) · doi:10.5555/89086.89095 · Cited by 3,590
Distant supervision for relation extraction without labeled data
Mintz, M., Bills, S., Snow, R., & Jurafsky, D. (2009) · Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 2 - ACL-IJCNLP '09 · doi:10.3115/1690219.1690287 · Cited by 2,752
(2013) · Cited by 1,117
Normalized (pointwise) mutual information in collocation extraction
Bouma, G. (2009) · Cited by 845
Fine-Grained Entity Recognition
Ling, X., & Weld, D. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v26i1.8122 · Cited by 476
Learning multilingual named entity recognition from Wikipedia
Nothman, J., Ringland, N., Radford, W., Murphy, T., & Curran, J. R. (2013) · Artificial Intelligence · doi:10.1016/j.artint.2012.03.006 · Cited by 360
Self-citationExploiting semantic role labeling, WordNet and Wikipedia for coreference resolution
Ponzetto, S. P., & Strube, M. (2006) · Proceedings of the main conference on Human Language Technology Conference of the North American Chapter of the Association of Computational Linguistics - · doi:10.3115/1220835.1220860 · Cited by 257
Fine grained classification of named entities
Fleischman, M., & Hovy, E. (2002) · Proceedings of the 19th international conference on Computational linguistics - · doi:10.3115/1072228.1072358 · Cited by 186
HYENA: Hierarchical Type Classification for Entity Names
Yosef, M. A., Bauer, S., Hoffart, J., Spaniol, M., & Weikum, G. (2012) · HAL · Cited by 150
ClusType: Effective Entity Recognition and Typing by Relation Phrase-Based Clustering
Ren, X., El-Kishky, A., Wang, C., Tao, F., Voss, C. R., & Han, J. (2015) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2783258.2783362 · Cited by 123
Embedding Methods for Fine Grained Entity Type Classification
Yogatama, D., Gillick, D., & Lazic, N. (2015) · doi:10.3115/v1/p15-2048 · Cited by 119
FINET: Context-Aware Fine-Grained Named Entity Typing
Corro, L. D., Abujabal, A., Gemulla, R., & Weikum, G. (2015) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d15-1103 · Cited by 117
Revisiting Embedding Features for Simple Semi-supervised Learning
Guo, J., Che, W., Wang, H., & Liu, T. (2014) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1012 · Cited by 112
Cross-Lingual Named Entity Recognition via Wikification
Tsai, C.-T., Mayhew, S., & Roth, D. (2016) · Conference on Computational Natural Language Learning · doi:10.18653/v1/k16-1022 · Cited by 103
Transforming Wikipedia into Named Entity Training Data
Nothman, J., Curran, J., & Murphy, T. (2008) · Cited by 101
Self-citationContext-Dependent Fine-Grained Entity Type TaggingPreprint
Gillick, D., Lazic, N., Ganchev, K., Kirchner, J., & Huynh, D. F. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.1820 · Cited by 99
Cross-lingual Projected Expectation Regularization for Weakly Supervised Learning
Wang, M., & Manning, C. D. (2014) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00165 · Cited by 97
Named Entity Recognition with Bilingual Constraints
Che, W., Wang, M., Manning, C. D., & Liu, T. (2013) · North American Chapter of the Association for Computational Linguistics · Cited by 97
Word Association Norms, Mutual Information, and Lexicography
Church, K., & Hanks, P. (2008) · Oxford University Press eBooks · doi:10.1093/oso/9780199292332.003.0019 · Cited by 97
Exploiting Background Knowledge for Relation Extraction
Chan, Y. S., & Roth, D. (2010) · Cited by 88
Augmenting Wikipedia with Named Entity Tags.
Dakka, W., & Cucerzan, S. (2008) · Cited by 56
Joint bilingual name tagging for parallel corpora
Li, Q., Li, H., Ji, H., Wang, W., Zheng, J., & Huang, F. (2012) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2396761.2398506 · Cited by 50
Self-citationA Comparative Study of Minimally Supervised Morphological Segmentation
Ruokolainen, T., Kohonen, O., Sirts, K., Grönroos, S.-A., Kurimo, M., & Virpioja, S. (2016) · Computational Linguistics · doi:10.1162/coli_a_00243 · Cited by 49
Joint Word Alignment and Bilingual Named Entity Recognition Using Dual Decomposition
Wang, M., Che, W., & Manning, C. D. (2013) · Cited by 48
Automatic acquisition of named entity tagged corpus from world wide web
An, J., Lee, S., & Lee, G. G. (2003) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/1075178.1075207 · Cited by 38
Learning to Tag and Tagging to Learn: A Case Study on Wikipedia
Mika, P., Ciaramita, M., Zaragoza, H., & Atserias, J. (2008) · IEEE Intelligent Systems · doi:10.1109/mis.2008.85 · Cited by 36
Assessing the Challenge of Fine-Grained Named Entity Recognition and Classification
Ekbal, A., Sourjikova, E., Frank, A., & Ponzetto, S. P. (2010) · Cited by 33
Building a Cross-Language Entity Linking Collection in Twenty-One Languages
Mayfield, J., Lawrie, D., McNamee, P., & Oard, D. W. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-23708-9_3 · Cited by 18
A Semi-supervised Learning Approach to Arabic Named Entity Recognition
Althobaiti, M. J., Kruschwitz, U., & Poesio, M. (2013) · Open Access at Essex (University of Essex) · Cited by 14
Bitext Name Tagging for Cross-lingual Entity Annotation Projection
Zhang, D., Zhang, B., Pan, X., Feng, X., Ji, H., & Xu, W. (2016) · International Conference on Computational Linguistics · Cited by 9
Self-citation
Cited by
mT5: A Massively Multilingual Pre-trained Text-to-Text Transformer
Xue, L., Constant, N., Roberts, A., Kale, M., Al-Rfou, R., Siddhant, A., Barua, A., & Raffel, C. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.41 · Cited by 1,629
Kakwani, D., Kunchukuttan, A., Golla, S., N.C., G., Bhattacharyya, A., Khapra, M. M., & Kumar, P. (2020) · Findings of the Association for Computational Linguistics: EMNLP 2020 · doi:10.18653/v1/2020.findings-emnlp.445 · Cited by 446
Power Hungry Processing: Watts Driving the Cost of AI Deployment?
Luccioni, S., Jernite, Y., & Strubell, E. (2024) · The 2024 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3630106.3658542 · Cited by 392
“…SD Prompts [46] IMDB [32] Rotten Tomatoes [39] SST 2 [48] maskedlanguagemodeling BookCorpus [59] C4 [42] OSCAR [37] WikiText [33] BookCorpus [59] OSCAR [37] Visual Genome [24] CPPE-5 [9] COCO [29] ReCoRD [53] WikiANN [38] CoNLL 2003 [50] Table 1: A list of the tasks and datasets used in our study.”
ByT5: Towards a Token-Free Future with Pre-trained Byte-to-Byte Models
Xue, L., Barua, A., Constant, N., Al-Rfou, R., Narang, S., Kale, M., Roberts, A., & Raffel, C. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00461 · Cited by 330
XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization
Hu, J., Ruder, S., Siddhant, A., Neubig, G., Fırat, O., & Johnson, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.11080 · Cited by 278
Metadata
- Authors
- Pan, X., Zhang, B., May, J., Nothman, J., Knight, K., & Ji, H.
- Venue
- Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Published
- 2017
- Pages
- 1946-1958
- OpenAlex
- W2742113707
- Cited by
- 312
- References
- 34
- FWCI
- 7.11
- Type
- conference paper
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.