Named Entity Recognition and Relation Extraction: State-of-the-Art
The DOI matches its Crossref record; 75 of the 78 references it cites were found in a registry or an index.
Abstract
With the advent of Web 2.0, there exist many online platforms that result in massive textual-data production. With ever-increasing textual data at hand, it is of immense importance to extract information nuggets from this data. One approach towards effective harnessing of this unstructured textual data could be its transformation into structured text. Hence, this study aims to present an overview of approaches that can be applied to extract key insights from textual data in a structured way. For this, Named Entity Recognition and Relation Extraction are being majorly addressed in this review study. The former deals with identification of named entities, and the latter deals with problem of extracting relation between set of entities. This study covers early approaches as well as the developments made up till now using machine learning models. Survey findings conclude that deep-learning-based hybrid and joint models are currently governing the state-of-the-art. It is also observed that annotated benchmark datasets for various textual-data generators such as Twitter and other social forums are not available. This scarcity of dataset has resulted into relatively less progress in these domains. Additionally, the majority of the state-of-the-art techniques are offline and computationally expensive. Last, with increasing focus on deep-learning frameworks, there is need to understand and explain the under-going processes in deep architectures.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“SLR task: ExaCT, Dextr, and Iris.ai perform Named Entity Recognition (NER) (Nasar et al. 2021) to extract various types of information from the relevant articles.”
From Artificial intelligence for literature reviews: opportunities and challenges (2024) · cites this paper as Nasar et al. 2021
Citations
Cites
Deep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
Proceedings of the 19th International Joint Conference on Artificial Intelligence
Pujol, J. M., Delgado, J., Ramon Sangüesa, A., & Flache, A. (2005) · International Joint Conference on Artificial Intelligence · Cited by 5,771
Proceedings of the 25th international conference on Machine learning
Cohen, W. W., McCallum, A., & Roweis, S. T. (2008) · Cited by 5,691
Efficient Processing of Deep Neural Networks: A Tutorial and Survey
Sze, V., Chen, Y.-H., Yang, T.-J., & Emer, J. S. (2017) · Proceedings of the IEEE · doi:10.1109/jproc.2017.2761740 · Cited by 4,215 · cited 1×
“These types of solutions require understanding of the datasets at hand along with the idea about current and future computational requirements, as discussed in Reference [157].”
BackgroundEnd-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF
Ma, X., & Hovy, E. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1101 · Cited by 2,567 · cited 2×
“A hybrid approach that uses CNN, Bi-LSTMs and CRF to solve the problems of POS tagging and NER is proposed in Reference [33].”
BackgroundMethodA survey of named entity recognition and classification
Nadeau, D., & Sekine, S. (2007) · Lingvisticae Investigationes · doi:10.1075/li.30.1.03nad · Cited by 2,507 · cited 2×
“Various survey studies that are determined to present the state-of-the-art research in domain of NER are carried out in the literature [14]–[18].”
BackgroundCollins, M. (2002) · Proceedings of the ACL-02 conference on Empirical methods in natural language processing - EMNLP '02 · doi:10.3115/1118693.1118694 · Cited by 1,862
Shickel, B., Tighe, P. J., Bihorac, A., & Rashidi, P. (2018) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2017.2767063 · Cited by 1,688
Design challenges and misconceptions in named entity recognition
Ratinov, L., & Roth, D. (2009) · Proceedings of the Thirteenth Conference on Computational Natural Language Learning - CoNLL '09 · doi:10.3115/1596374.1596399 · Cited by 1,448
End-to-End Relation Extraction using LSTMs on Sequences and Tree Structures
Miwa, M., & Bansal, M. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1105 · Cited by 1,322
Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI 2017)
Amendola, G., Ricca, F., & Truszczyński, M. (2017) · International Joint Conference on Artificial Intelligence · Cited by 1,179
Unsupervised named-entity extraction from the Web: An experimental study
Etzioni, O., Cafarella, M., Downey, D., Popescu, A.-M., Shaked, T., Soderland, S., Weld, D. S., & Yates, A. (2005) · Artificial Intelligence · doi:10.1016/j.artint.2005.03.001 · Cited by 1,124
BioCreative V CDR task corpus: a resource for chemical disease relation extraction
Li, J., Sun, Y., Johnson, R. J., Sciaky, D., Wei, C.-H., Leaman, R., Davis, A. P., Mattingly, C. J., Wiegers, T. C., & Lu, Z. (2016) · Database · doi:10.1093/database/baw068 · Cited by 870
NCBI disease corpus: A resource for disease name recognition and concept normalization
Doğan, R. I., Leaman, R., & Lu, Z. (2014) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2013.12.006 · Cited by 820
An Algorithm that Learns What's in a Name
Bikel, D. M., Schwartz, R., & Weischedel, R. M. (1999) · Machine Learning · doi:10.1023/a:1007558221122 · Cited by 776
Web-scale information extraction in knowitall: (preliminary results)
Etzioni, O., Cafarella, M., Downey, D., Kok, S., Popescu, A.-M., Shaked, T., Soderland, S., Weld, D. S., & Yates, A. (2004) · Proceedings of the 13th international conference on World Wide Web · doi:10.1145/988672.988687 · Cited by 747
Kambhatla, N. (2004) · Proceedings of the ACL 2004 on Interactive poster and demonstration sessions - · doi:10.3115/1219044.1219066 · Cited by 607
RelEx—Relation extraction using dependency parse trees
Fundel, K., Küffner, R., & Zimmer, R. (2007) · Bioinformatics · doi:10.1093/bioinformatics/btl616 · Cited by 563
(2016) · doi:10.18653/v1/2026.acl-long · Cited by 524
Silberer, C., & Lapata, M. (2012) · The Association for Computational Linguistics · Cited by 520
Proceedings of The 12th International Workshop on Semantic Evaluation
(2018) · doi:10.18653/v1/2026.semeval-1 · Cited by 452
Adaptive Subgradient Methods for Online Learning and Stochastic Optimization
(2011) · Journal of Machine Learning Research · doi:10.5555/1953048.2021068 · Cited by 346
Unsupervised biomedical named entity recognition: Experiments with clinical and biological texts
Zhang, S., & Elhadad, N. (2013) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2013.08.004 · Cited by 249
Learning to Parse Natural Language with Maximum Entropy Models
Ratnaparkhi, A. (1999) · Machine Learning · doi:10.1023/a:1007502103375 · Cited by 242
A neural joint model for entity and relation extraction from biomedical text
Li, F., Zhang, M., Fu, G., & Ji, D. (2017) · BMC Bioinformatics · doi:10.1186/s12859-017-1609-9 · Cited by 238
Unsupervised Named-Entity Recognition: Generating Gazetteers and Resolving Ambiguity
Nadeau, D., Turney, P. D., & Matwin, S. (2006) · Lecture Notes in Computer Science · doi:10.1007/11766247_23 · Cited by 230
Proceedings of the 23rd International Conference on Computational Linguistics: Posters
Joshi, A. K., Huang, C., & Jurafsky, D. (2010) · Cited by 215
Typed Tensor Decomposition of Knowledge Bases for Relation Extraction
Chang, K.-W., Yih, W.-T., Yang, B., & Meek, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1165 · Cited by 185
Eftimov, T., Koroušić Seljak, B., & Korošec, P. (2017) · PLOS ONE · doi:10.1371/journal.pone.0179488 · Cited by 171
Information extraction from scientific articles: a survey
Nasar, Z., Jaffry, S. W., & Malik, M. K. (2018) · Scientometrics · doi:10.1007/s11192-018-2921-5 · Cited by 160
Self-citationGlobal Inference for Entity and Relation Identification via a Linear Programming Formulation
Roth, D., & Yih, W.-T. (2007) · The MIT Press eBooks · doi:10.7551/mitpress/7432.003.0022 · Cited by 153
Relation Extraction Using Distant Supervision: A Survey
Smirnova, A., & Cudré-Mauroux, P. (2019) · ACM Computing Surveys · doi:10.1145/3241741 · Cited by 139
Proceedings - 2011 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2011
Tsai, T., Tadesse, M. G., Wang, Y., & Ressom, H. W. (2011) · Bioinformatics and Biomedicine · Cited by 108
Weakly-supervised relation classification for information extraction
Zhang, Z. (2004) · Proceedings of the thirteenth ACM international conference on Information and knowledge management · doi:10.1145/1031171.1031279 · Cited by 89
The potential use of SUISEKI as a protein interaction discovery tool.
Blaschke, C., & Valencia, A. (2001) · PubMed · Cited by 82
Malay Named Entity Recognition Based on Rule-Based Approach
Alfred, R., Leong, L. C., On, C. K., & Anthony, P. (2014) · International Journal of Machine Learning and Computing · doi:10.7763/ijmlc.2014.v4.428 · Cited by 82
Zhang, M., Zhou, G., & Aw, A. T. (2007) · Information Processing & Management · doi:10.1016/j.ipm.2007.07.013 · Cited by 73
Unsupervised Feature Selection for Relation Extraction
Chen, J., Ji, D., Tan, C. L., & Niu, Z.-Y. (2005) · Cited by 71
Chinese named entity recognition using lexicalized HMMs
Fu, G., & Luke, K. K. (2005) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1089815.1089819 · Cited by 69
Transformation-based error-driven learning and natural language processing
BrillEric (1995) · Computational Linguistics · doi:10.5555/218355.218367 · Cited by 66
J-NERD: Joint Named Entity Recognition and Disambiguation with Rich Linguistic Features
Nguyen, D. B., Theobald, M., & Weikum, G. (2016) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00094 · Cited by 65
A Survey of Bioinformatics Database and Software Usage through Mining the Literature
Duck, G., Nenadic, G., Filannino, M., Brass, A., Robertson, D. L., & Stevens, R. (2016) · PLOS ONE · doi:10.1371/journal.pone.0157989 · Cited by 57
Díaz, C., & Riff, M. C. (2017) · International Conference on Tools with Artificial Intelligence · doi:10.1109/ictai.2016.56 · Cited by 57
Review of Relation Extraction Methods: What Is New Out There?
Konstantinova, N. (2014) · Communications in computer and information science · doi:10.1007/978-3-319-12580-0_2 · Cited by 56
Using semantic similarity to reduce wrong labels in distant supervision for relation extraction
Ru, C., Tang, J., Li, S., Xie, S., & Wang, T. (2018) · Information Processing & Management · doi:10.1016/j.ipm.2018.04.002 · Cited by 51
Urdu Named Entity Recognition and Classification System Using Artificial Neural Network
Malik, M. K. (2017) · ACM Transactions on Asian and Low-Resource Language Information Processing · doi:10.1145/3129290 · Cited by 50
Self-citationQu, J., Ouyang, D., Hua, W., Ye, Y., & Li, X. (2018) · Neural Networks · doi:10.1016/j.neunet.2018.01.006 · Cited by 42
Proceedings of the 11th Linguistic Annotation Workshop
(2017) · doi:10.18653/v1/w17-08 · Cited by 38
Survey of Named Entity Recognition Systems with respect to Indian and Foreign Languages
Patil, N., Ajay, S., & Bakaraniya Parul, V. (2016) · International Journal of Computer Applications · doi:10.5120/ijca2016908197 · Cited by 36
Improving NER Tagging Performance in Low-Resource Languages via Multilingual Learning
Murthy, R., Khapra, M. M., & Bhattacharyya, P. (2018) · ACM Transactions on Asian and Low-Resource Language Information Processing · doi:10.1145/3238797 · Cited by 34
Cross-Domain and Semisupervised Named Entity Recognition in Chinese Social Media: A Unified Model
Xu, J., He, H., Sun, X., Ren, X., & Li, S. (2018) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2018.2856625 · Cited by 31
KeyphraseDS: Automatic generation of survey by exploiting keyphrase information
Yang, S., Lü, W., Yang, D., Li, X., Wu, C., & Wei, B. (2016) · Neurocomputing · doi:10.1016/j.neucom.2016.10.052 · Cited by 30
LSTM-CRF Models for Named Entity Recognition
Lee, C. (2017) · IEICE Transactions on Information and Systems · doi:10.1587/transinf.2016edp7179 · Cited by 27
FS-NER: a lightweight filter-stream approach to named entity recognition on twitter data
de Oliveira, D. M., Laender, A. H. F., Veloso, A., & da Silva, A. S. (2013) · International World Wide Web Conference (WWW) · doi:10.1145/2487788.2488003 · Cited by 26
Multiple relations extraction among multiple entities in unstructured text
Liu, J., Ren, H., Wu, M., Wang, J., & Kim, H.-J. (2017) · Soft Computing · doi:10.1007/s00500-017-2852-8 · Cited by 25
Proceedings of the 2010 Named Entities Workshop
Li, H., & Kumaran, A. (2010) · Cited by 24
Towards Large-Scale Unsupervised Relation Extraction from the Web
Min, B., Shi, S., Grishman, R., & Lin, C.-Y. (2012) · International Journal on Semantic Web and Information Systems · doi:10.4018/jswis.2012070101 · Cited by 21
Capturing Long-range Contextual Dependencies with Memory-enhanced Conditional Random FieldsPreprint
Liu, F., Baldwin, T., & Cohn, T. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.03637 · Cited by 15
Dual Coordinate Descent Algorithms for Efficient Large Margin Structured Prediction
Chang, M.-W., & Yih, W.-T. (2013) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00221 · Cited by 13
Modeling semantic compositionality of relational patterns
Takase, S., Okazaki, N., & Inui, K. (2016) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2016.01.027 · Cited by 10
Domain-specific Named Entity Recognition with Document-Level Optimization
Wang, L., Li, S., Yan, Q., & Zhou, G. (2018) · ACM Transactions on Asian and Low-Resource Language Information Processing · doi:10.1145/3213544 · Cited by 8
He, D., Zhang, H., Hao, W., Zhang, R., & Cheng, K. (2017) · Neural Computation · doi:10.1162/neco_a_00970 · Cited by 5
Buco, Q. L. L., Capcap, J. L. L., Hermocilla, J. C. A., Yumul, C. S., Sagum, R. A., & Pastrana, A. G. (2013) · Journal of Industrial and Intelligent Information · doi:10.12720/jiii.1.1.1-5 · Cited by 3
Improving Few Occurrence Feature Performance in Distant Supervision for Relation Extraction
Zhang, H., & Zhao, Y. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-53917-6_37 · Cited by 1
Optimal Hyperparameters for Deep LSTM-Networks for Sequence Labeling Tasks
Reimers, N., & Gurevych, I. (2017) · arXiv · doi:10.48550/arxiv.1707.06799
Research works printed but not linked: 83
- Muslea I., 1999, Proceedings of the AAAI Workshop on Machine Learning for Information Extraction.
- Simoes G., Proceedings of the INForum.
- National Institute of Standards and Technology (NIST)., 2017, Proceedings of the Text Analytic Conference.
- Augenstein I., 2017, Apr.
- Merchant R., 1996, Proceedings of a Workshop on held at Vienna
- Asian Federation of Natural Language Processing., 2008, IJCNLP-08 Workshop on NER for South and South East Asian Languages.
- Peng N., Proceedings of the Conference on Empirical Methods in Natural Language Processing. 548--554
- Wang W., Proceedings of the International Conference on Asian Language Processing (IALP’15)
- Kanya N., Proceedings of the IET Chennai 3rd International on Sustainable Energy and Intelligent Systems (SEISCON’12)
- Palshikar G. K., 2013, Techniques for named entity recognition. Bioinforma. Concepts Methodol. Tools Appl. 400
- Rizzolo N., Proceedings of the International Conference on Semantic Computing (ICSC’07)
- Klein D., Proceedings of the 7th Conference on Natural Language Learning at HLT-NAACL, 4
- Liao W., 1829, Proceedings of the NAACL HLT Workshop on Semi-Supervised Learning for Natural Language Processing. 58--65
- 10.5555/1090483.1644538 · doi:10.5555/1090483.1644538
- Passos A., 2014, Apr.
- Peters M., Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 1756--1765, 17
- Rondeau M. A., Proceedings of the IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU’15)
- Strubell E., 2017, Feb.
- Ageishi R., Proceedings of the 1st International Conference on the Applications of Digital Information and Web Technologies (ICADIWT’08)
- McCallum A., Proceedings of the 7th Conference on Natural Language Learning at HLT-NAACL, 4
- Yu X., Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing Association for Computational Linguistics. 3073--3077
- Khashabi D., 2018, Proceedings of the 11th International Conference on Language Resources and Evaluation (LREC’18)
- Strassel S., Proceedings of the 10th International Conference on Language Resources and Evaluation (LREC’16)
- Cucerzan S., Proceedings of the 6th Conference on Natural Language Learning, 20
- Leonandya R. A., Proceedings of the 3rd International Symposium on Computational and Business Intelligence (ISCBI’15)
- Straková J., Proceedings of the International Conference on Text, Speech, and Dialogue. 173--181
- Liu L., 2018, Proceedings of the AAAI Conference on Artificial Intelligence.
- Doan X.-D., Proceedings of the 32nd Pacific Asia Conference on Language, Information and Computation.
- Lample G., Proceedings of NAACL-HLT, Association for Computational Linguistics. 260--270, 16
- 10.5555/2390426.2390435 · doi:10.5555/2390426.2390435
- Täckström O., 2096, Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies.
- Qu L., Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics. 899--905, 16
- Chen L., 2018, Proceedings of the 2nd Workshop on Natural Language for Artificial Intelligence (NL4AI’18)
- P. Cao Y. Chen K. Liu J. Zhao and S. Liu. 2018. Adversarial transfer learning for Chinese named entity recognition with self-attention mechanism. 182--192. Retrieved from https://aclweb.org/anthology/papers/D/D18/D18-1017/. P. Cao Y. Chen K. Liu J. Zhao and S. Liu. 2018. Adversarial transfer learning for Chinese named entity recognition with self-attention mechanism. 182--192. Retrieved from https://aclweb.org/anthology/papers/D/D18/D18-1017/.
- Rahimi A., Proceedings of the 57th Conference of the Association for Computational Linguistics. 151--164
- Bharadwaj A., Proceedings of the Conference on Empirical Methods in Natural Language Processing. 1462--1472
- Xie J., Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. 369--379, 18
- Z. Nasar S. W. Jaffry and M. K. Malik. 2018. Information extraction from scientific articles: A survey. Scientometrics. DOI:10.1007/s11192-018-2921-5 · DOI
- Abdelmagid M., 2014, Survey on information extraction from chemical compound literatures: Techniques and challenges, J. Theor. Appl. Inf. Technol., 67, 284
- Bonadiman D., Proceedings of the 2nd Italian Conference on Computational Linguistics (CLiC It’15)
- J. Li et al. 2016. BioCreative V CDR task corpus: A resource for chemical disease relation extraction. Datab.- J. Biol. Datab. Curat. May (2016). DOI:10.1093/database/baw068 · DOI · Paper page
- Dong X., Proceedings of the New York Scientific Data Summit (NYSDS’16)
- Finkel J. R., Proceedings of the Conference on Empirical Methods in Natural Language Processing, 1
- Lu W., Proceedings of the Conference on Empirical Methods in Natural Language Processing. 857--867
- Katiyar A., Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 1
- Ju M., Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 1
- Mai K., 2018, Proceedings of the 27th International Conference on Computational Linguistics. 711--722
- F. Li M. Zhang G. Fu and D. Ji. 2017. A neural joint model for entity and relation extraction from biomedical text. BMC Bioinf. 18 (2017). DOI:10.1186/s12859-017-1609-9 · DOI · Paper page
- N. Konstantinova. 2014. Review of relation extraction methods: What is new out there? In Analysis of Images Social Networks and Texts. 15--28. DOI:10.1007/978-3-319-12580-0_2 · DOI
- Asghar N., 2016, Automatic extraction of causal relations from natural language texts: A comprehensive survey. ArXiv Prepr. ArXiv160507895
- Brin S., 1998, Proceedings of the International Workshop on the World Wide Web and Databases. 172--183
- Agichtein E., Proceedings of the 5th ACM Conference on Digital Libraries. 85--94
- McDonald R., Proceedings of the 43rd Meeting on Association for Computational Linguistics. 491--498
- Kumar S., 2017, May
- A. Smirnova and P. Cudré-Mauroux. 2018. Relation extraction using distant supervision: A survey. ACM Comput. Surv. 51 5 (2018) 106:1--106:35. DOI:10.1145/3241741 · DOI · Paper page
- Nédellec C., 2005, Proceedings of the 4th Learning Language in Logic Workshop (LLL’05)
- 2013, Proceedings of the 2013th International Conference on NLP 8 DBpedia (NLP-DBPEDIA'13), 1064
- Leroy G., Proceedings of the Pacific Symposium on Biocomputing.
- GuoDong Z., Proceedings of the 43rd Meeting on Association for Computational Linguistics. 427--434
- Chan Y. S., 2002, Proceedings of the 49th Meeting of the Association for Computational Linguistics: Human Language Technologies, 1
- Zelenko D., Proceedings of the ACL Conference on Empirical Methods in Natural Language Processing, 10
- Carlson A., Proceedings of the 3rd ACM International Conference on Web Search and Data Mining. 101--110
- De S., Proceedings of the Conference on Empirical Methods in Natural Language Processing.
- Riedel S., Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (HLT-NAACL’13)
- Mintz M., Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP, 2
- Riedel S., Proceedings of the Joint European Conference on Machine Learning and Knowledge Discovery in Databases. 148--163
- Takamatsu S., 2012, Reducing wrong labels in distant supervision for relation extraction. In Proceedings of the 50th Meeting of the Association for Computational Linguistics, Long Papers, 1, 721
- Sekine S., 2005, Proceedings of the International Workshop on Paraphrasing (IWP’05)
- Downey D., Proceedings of the Meeting of the Association for Computational Linguistics.
- Miwa M., 1869, Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP’14). 1858
- Mejer A., Proceedings of the Conference on Empirical Methods in Natural Language Processing. 971--981
- Crammer K., Proceedings of the Conference on Advances in Neural Information Processing Systems. 414--422
- Zeng D., 2014, Proceedings of the International Conference on Computational Linguistics (COLING’14)
- S. Takase N. Okazaki and K. Inui. 2016. Modeling semantic compositionality of relational patterns. Eng. Appl. Artif. Intell. 50 C (2016) 256--264. DOI:10.1016/j.engappai.2016.01.027 · DOI
- Zhang X., 2019, Proceedings of the AAAI Conference on Artificial Intelligence. 33
- J. Qu D. Ouyang W. Hua Y. Ye and X. Li. 2018. Distant supervision for neural relation extraction integrated with word attention and property features. Neural Netw. 100 C (2018) 59--69. DOI:10.1016/j.neunet.2018.01.006 · DOI
- Li Y., 2076, Proceedings of the 2nd International Conference on Computer Science and Application Engineering. 119:1--119:7. DOI:10
- Li Q., Proceedings of the Meeting of the Association for Computational Linguistics. 402--412
- Di S., Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery 8 Data Mining. 1348--1357
- Ling X., Proceedings of the AAAI Conference on Artificial Intelligence. 94--100
- Liu T., Proceedings of the Conference on Empirical Methods in Natural Language Processing. 2195--2204, 18
- Hasegawa T., Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics. 415--422
- Yao L., 1870, Proceedings of the Conference on Empirical Methods in Natural Language Processing. 1013--1023
Cited by
Large language models for generative information extraction: a survey
Xu, D., Chen, W., Peng, W., Zhang, C., Xu, T., Zhao, X., Wu, X., Zheng, Y., Wang, Y., & Chen, E. (2024) · Frontiers of Computer Science · doi:10.1007/s11704-024-40555-y · Cited by 326
Named Entity Recognition and Classification in Historical Documents: A Survey
Ehrmann, M., Hamdi, A., Pontes, E. L., Romanello, M., & Doucet, A. (2024) · ACM Computing Surveys · doi:10.1145/3604931 · Cited by 181
Impact of word embedding models on text analytics in deep learning environment: a review
Asudani, D. S., Nagwani, N. K., & Singh, P. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-023-10419-1 · Cited by 274
Artificial intelligence for literature reviews: opportunities and challenges
Bolaños, F., Salatino, A., Osborne, F., & Motta, E. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10902-3 · Cited by 246
Graph Retrieval-Augmented Generation: A Survey
Peng, B., Zhu, Y., Liu, Y., Bo, X., Shi, H., Hong, C., Zhang, Y., & Tang, S. (2026) · ACM Transactions on Information Systems · doi:10.1145/3777378 · Cited by 206
Metadata
- Authors
- Nasar, Z., Jaffry, S. W., & Malik, M. K.
- Affiliations
- University of the Punjab (PK)
- Venue
- ACM Computing Surveys
- Published
- 2021-02-11
- Volume
- 54
- Issue
- 1
- Pages
- 1-39
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W3131198033
- Cited by
- 245
- References
- 78
- Citations by year
- 2026: 35 · 2025: 69 · 2024: 63 · 2023: 47 · 2022: 28 · 2021: 3
- FWCI
- 12.46
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Computing Surveys (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Advanced Text Analysis Techniques
- Keywords
- named entity recognition, relation extraction, information extraction, unstructured text, social media text, Twitter, deep learning, hybrid model, joint modeling, benchmark dataset, explainability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.