Named Entity Recognition and Relation Extraction: State-of-the-Art
The DOI matches its Crossref record; 75 of the 78 references it cites were found in a registry or an index.
Abstract
With the advent of Web 2.0, there exist many online platforms that result in massive textual-data production. With ever-increasing textual data at hand, it is of immense importance to extract information nuggets from this data. One approach towards effective harnessing of this unstructured textual data could be its transformation into structured text. Hence, this study aims to present an overview of approaches that can be applied to extract key insights from textual data in a structured way. For this, Named Entity Recognition and Relation Extraction are being majorly addressed in this review study. The former deals with identification of named entities, and the latter deals with problem of extracting relation between set of entities. This study covers early approaches as well as the developments made up till now using machine learning models. Survey findings conclude that deep-learning-based hybrid and joint models are currently governing the state-of-the-art. It is also observed that annotated benchmark datasets for various textual-data generators such as Twitter and other social forums are not available. This scarcity of dataset has resulted into relatively less progress in these domains. Additionally, the majority of the state-of-the-art techniques are offline and computationally expensive. Last, with increasing focus on deep-learning frameworks, there is need to understand and explain the under-going processes in deep architectures.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“SLR task: ExaCT, Dextr, and Iris.ai perform Named Entity Recognition (NER) (Nasar et al. 2021) to extract various types of information from the relevant articles.”
From Artificial intelligence for literature reviews: opportunities and challenges (2024) · cites this paper as Nasar et al. 2021
Citations
Cites
Deep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
Proceedings of the 19th International Joint Conference on Artificial Intelligence
Pujol, J. M., Delgado, J., Ramon Sangüesa, A., & Flache, A. (2005) · International Joint Conference on Artificial Intelligence · Cited by 5,771
Proceedings of the 25th international conference on Machine learning
Cohen, W. W., McCallum, A., & Roweis, S. T. (2008) · Cited by 5,691
Efficient Processing of Deep Neural Networks: A Tutorial and Survey
Sze, V., Chen, Y.-H., Yang, T.-J., & Emer, J. S. (2017) · Proceedings of the IEEE · doi:10.1109/jproc.2017.2761740 · Cited by 4,215 · cited 1×
“These types of solutions require understanding of the datasets at hand along with the idea about current and future computational requirements, as discussed in Reference [157].”
BackgroundEnd-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF
Ma, X., & Hovy, E. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1101 · Cited by 2,567 · cited 2×
“A hybrid approach that uses CNN, Bi-LSTMs and CRF to solve the problems of POS tagging and NER is proposed in Reference [33].”
BackgroundMethodA survey of named entity recognition and classification
Nadeau, D., & Sekine, S. (2007) · Lingvisticae Investigationes · doi:10.1075/li.30.1.03nad · Cited by 2,507 · cited 2×
“Various survey studies that are determined to present the state-of-the-art research in domain of NER are carried out in the literature [14]–[18].”
BackgroundCollins, M. (2002) · Proceedings of the ACL-02 conference on Empirical methods in natural language processing - EMNLP '02 · doi:10.3115/1118693.1118694 · Cited by 1,862
Shickel, B., Tighe, P. J., Bihorac, A., & Rashidi, P. (2018) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2017.2767063 · Cited by 1,688
Design challenges and misconceptions in named entity recognition
Ratinov, L., & Roth, D. (2009) · Proceedings of the Thirteenth Conference on Computational Natural Language Learning - CoNLL '09 · doi:10.3115/1596374.1596399 · Cited by 1,448
Research works printed but not linked: 83
- Muslea I., 1999, Proceedings of the AAAI Workshop on Machine Learning for Information Extraction.
- Simoes G., Proceedings of the INForum.
- National Institute of Standards and Technology (NIST)., 2017, Proceedings of the Text Analytic Conference.
- Augenstein I., 2017, Apr.
- Merchant R., 1996, Proceedings of a Workshop on held at Vienna
- Asian Federation of Natural Language Processing., 2008, IJCNLP-08 Workshop on NER for South and South East Asian Languages.
- Peng N., Proceedings of the Conference on Empirical Methods in Natural Language Processing. 548--554
- Wang W., Proceedings of the International Conference on Asian Language Processing (IALP’15)
- Kanya N., Proceedings of the IET Chennai 3rd International on Sustainable Energy and Intelligent Systems (SEISCON’12)
- Palshikar G. K., 2013, Techniques for named entity recognition. Bioinforma. Concepts Methodol. Tools Appl. 400
- Rizzolo N., Proceedings of the International Conference on Semantic Computing (ICSC’07)
- Klein D., Proceedings of the 7th Conference on Natural Language Learning at HLT-NAACL, 4
- Liao W., 1829, Proceedings of the NAACL HLT Workshop on Semi-Supervised Learning for Natural Language Processing. 58--65
- 10.5555/1090483.1644538 · doi:10.5555/1090483.1644538
- Passos A., 2014, Apr.
- Peters M., Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 1756--1765, 17
- Rondeau M. A., Proceedings of the IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU’15)
- Strubell E., 2017, Feb.
- Ageishi R., Proceedings of the 1st International Conference on the Applications of Digital Information and Web Technologies (ICADIWT’08)
- McCallum A., Proceedings of the 7th Conference on Natural Language Learning at HLT-NAACL, 4
- Yu X., Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing Association for Computational Linguistics. 3073--3077
- Khashabi D., 2018, Proceedings of the 11th International Conference on Language Resources and Evaluation (LREC’18)
- Strassel S., Proceedings of the 10th International Conference on Language Resources and Evaluation (LREC’16)
- Cucerzan S., Proceedings of the 6th Conference on Natural Language Learning, 20
- Leonandya R. A., Proceedings of the 3rd International Symposium on Computational and Business Intelligence (ISCBI’15)
- Straková J., Proceedings of the International Conference on Text, Speech, and Dialogue. 173--181
- Liu L., 2018, Proceedings of the AAAI Conference on Artificial Intelligence.
- Doan X.-D., Proceedings of the 32nd Pacific Asia Conference on Language, Information and Computation.
- Lample G., Proceedings of NAACL-HLT, Association for Computational Linguistics. 260--270, 16
- 10.5555/2390426.2390435 · doi:10.5555/2390426.2390435
- Täckström O., 2096, Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies.
- Qu L., Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics. 899--905, 16
- Chen L., 2018, Proceedings of the 2nd Workshop on Natural Language for Artificial Intelligence (NL4AI’18)
- P. Cao Y. Chen K. Liu J. Zhao and S. Liu. 2018. Adversarial transfer learning for Chinese named entity recognition with self-attention mechanism. 182--192. Retrieved from https://aclweb.org/anthology/papers/D/D18/D18-1017/. P. Cao Y. Chen K. Liu J. Zhao and S. Liu. 2018. Adversarial transfer learning for Chinese named entity recognition with self-attention mechanism. 182--192. Retrieved from https://aclweb.org/anthology/papers/D/D18/D18-1017/.
- Rahimi A., Proceedings of the 57th Conference of the Association for Computational Linguistics. 151--164
- Bharadwaj A., Proceedings of the Conference on Empirical Methods in Natural Language Processing. 1462--1472
- Xie J., Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. 369--379, 18
- Z. Nasar S. W. Jaffry and M. K. Malik. 2018. Information extraction from scientific articles: A survey. Scientometrics. DOI:10.1007/s11192-018-2921-5 · DOI
- Abdelmagid M., 2014, Survey on information extraction from chemical compound literatures: Techniques and challenges, J. Theor. Appl. Inf. Technol., 67, 284
- Bonadiman D., Proceedings of the 2nd Italian Conference on Computational Linguistics (CLiC It’15)
- J. Li et al. 2016. BioCreative V CDR task corpus: A resource for chemical disease relation extraction. Datab.- J. Biol. Datab. Curat. May (2016). DOI:10.1093/database/baw068 · DOI · Paper page
- Dong X., Proceedings of the New York Scientific Data Summit (NYSDS’16)
- Finkel J. R., Proceedings of the Conference on Empirical Methods in Natural Language Processing, 1
- Lu W., Proceedings of the Conference on Empirical Methods in Natural Language Processing. 857--867
- Katiyar A., Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 1
- Ju M., Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 1
- Mai K., 2018, Proceedings of the 27th International Conference on Computational Linguistics. 711--722
- F. Li M. Zhang G. Fu and D. Ji. 2017. A neural joint model for entity and relation extraction from biomedical text. BMC Bioinf. 18 (2017). DOI:10.1186/s12859-017-1609-9 · DOI · Paper page
- N. Konstantinova. 2014. Review of relation extraction methods: What is new out there? In Analysis of Images Social Networks and Texts. 15--28. DOI:10.1007/978-3-319-12580-0_2 · DOI
- Asghar N., 2016, Automatic extraction of causal relations from natural language texts: A comprehensive survey. ArXiv Prepr. ArXiv160507895
- Brin S., 1998, Proceedings of the International Workshop on the World Wide Web and Databases. 172--183
- Agichtein E., Proceedings of the 5th ACM Conference on Digital Libraries. 85--94
- McDonald R., Proceedings of the 43rd Meeting on Association for Computational Linguistics. 491--498
- Kumar S., 2017, May
- A. Smirnova and P. Cudré-Mauroux. 2018. Relation extraction using distant supervision: A survey. ACM Comput. Surv. 51 5 (2018) 106:1--106:35. DOI:10.1145/3241741 · DOI · Paper page
- Nédellec C., 2005, Proceedings of the 4th Learning Language in Logic Workshop (LLL’05)
- 2013, Proceedings of the 2013th International Conference on NLP 8 DBpedia (NLP-DBPEDIA'13), 1064
- Leroy G., Proceedings of the Pacific Symposium on Biocomputing.
- GuoDong Z., Proceedings of the 43rd Meeting on Association for Computational Linguistics. 427--434
- Chan Y. S., 2002, Proceedings of the 49th Meeting of the Association for Computational Linguistics: Human Language Technologies, 1
- Zelenko D., Proceedings of the ACL Conference on Empirical Methods in Natural Language Processing, 10
- Carlson A., Proceedings of the 3rd ACM International Conference on Web Search and Data Mining. 101--110
- De S., Proceedings of the Conference on Empirical Methods in Natural Language Processing.
- Riedel S., Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (HLT-NAACL’13)
- Mintz M., Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP, 2
- Riedel S., Proceedings of the Joint European Conference on Machine Learning and Knowledge Discovery in Databases. 148--163
- Takamatsu S., 2012, Reducing wrong labels in distant supervision for relation extraction. In Proceedings of the 50th Meeting of the Association for Computational Linguistics, Long Papers, 1, 721
- Sekine S., 2005, Proceedings of the International Workshop on Paraphrasing (IWP’05)
- Downey D., Proceedings of the Meeting of the Association for Computational Linguistics.
- Miwa M., 1869, Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP’14). 1858
- Mejer A., Proceedings of the Conference on Empirical Methods in Natural Language Processing. 971--981
- Crammer K., Proceedings of the Conference on Advances in Neural Information Processing Systems. 414--422
- Zeng D., 2014, Proceedings of the International Conference on Computational Linguistics (COLING’14)
- S. Takase N. Okazaki and K. Inui. 2016. Modeling semantic compositionality of relational patterns. Eng. Appl. Artif. Intell. 50 C (2016) 256--264. DOI:10.1016/j.engappai.2016.01.027 · DOI
- Zhang X., 2019, Proceedings of the AAAI Conference on Artificial Intelligence. 33
- J. Qu D. Ouyang W. Hua Y. Ye and X. Li. 2018. Distant supervision for neural relation extraction integrated with word attention and property features. Neural Netw. 100 C (2018) 59--69. DOI:10.1016/j.neunet.2018.01.006 · DOI
- Li Y., 2076, Proceedings of the 2nd International Conference on Computer Science and Application Engineering. 119:1--119:7. DOI:10
- Li Q., Proceedings of the Meeting of the Association for Computational Linguistics. 402--412
- Di S., Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery 8 Data Mining. 1348--1357
- Ling X., Proceedings of the AAAI Conference on Artificial Intelligence. 94--100
- Liu T., Proceedings of the Conference on Empirical Methods in Natural Language Processing. 2195--2204, 18
- Hasegawa T., Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics. 415--422
- Yao L., 1870, Proceedings of the Conference on Empirical Methods in Natural Language Processing. 1013--1023
Cited by
Large language models for generative information extraction: a survey
Xu, D., Chen, W., Peng, W., Zhang, C., Xu, T., Zhao, X., Wu, X., Zheng, Y., Wang, Y., & Chen, E. (2024) · Frontiers of Computer Science · doi:10.1007/s11704-024-40555-y · Cited by 326
Named Entity Recognition and Classification in Historical Documents: A Survey
Ehrmann, M., Hamdi, A., Pontes, E. L., Romanello, M., & Doucet, A. (2024) · ACM Computing Surveys · doi:10.1145/3604931 · Cited by 181
Impact of word embedding models on text analytics in deep learning environment: a review
Asudani, D. S., Nagwani, N. K., & Singh, P. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-023-10419-1 · Cited by 274
Artificial intelligence for literature reviews: opportunities and challenges
Bolaños, F., Salatino, A., Osborne, F., & Motta, E. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10902-3 · Cited by 246
Graph Retrieval-Augmented Generation: A Survey
Peng, B., Zhu, Y., Liu, Y., Bo, X., Shi, H., Hong, C., Zhang, Y., & Tang, S. (2026) · ACM Transactions on Information Systems · doi:10.1145/3777378 · Cited by 206
Landolsi, M. Y., Hlaoua, L., & Romdhane, L. B. (2022) · Knowledge and Information Systems · doi:10.1007/s10115-022-01779-1 · Cited by 174
Knowledge graph quality control: A survey
Wang, X., Chen, L., Ban, T., Usman, M., Guan, Y., Liu, S., Wu, T., & Chen, H. (2021) · Fundamental Research · doi:10.1016/j.fmre.2021.09.003 · Cited by 117
Zero-shot information extraction from radiological reports using ChatGPT
Hu, D., Liu, B., Zhu, X., Lü, X., & Wu, N. (2023) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2023.105321 · Cited by 118
Mansourian, A., & Oucheikh, R. (2024) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi13100348 · Cited by 118
Yuan, L., Cai, Y., Wang, J., & Li, Q. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i9.26309 · Cited by 84
Jose, S., Nguyen, K. T. P., Medjaher, K., Zemouri, R. M., Lévesque, M., & Tahan, A. S. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124603 · Cited by 93
Abdullah, M. H. A., Aziz, N., Abdulkadir, S. J., Alhussian, H., & Talpur, N. (2023) · IEEE Access · doi:10.1109/access.2023.3240898 · Cited by 71
Information extraction from clinical notes: are we ready to switch to large language models?
Hu, Y., Zuo, X., Zhou, Y., Peng, X., Huang, J., Keloth, V. K., Zhang, V., Weng, R.-L., Shyr, C., Chen, Q., et al. (2025) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaf213 · Cited by 69
A survey on semantic processing techniques
Mao, R., He, K., Zhang, X., Chen, G., Ni, J., Yang, Z., & Cambria, E. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101988 · Cited by 72
Context-Aware Attentive Multilevel Feature Fusion for Named Entity Recognition
Yang, Z., Ma, J., Chen, H., Zhang, J., & Chang, Y. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3178522 · Cited by 57
A review of named entity recognition: from learning methods to modelling paradigms and tasks
Seow, W. L., Chaturvedi, I., Hogarth, A., Mao, R., & Cambria, E. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11321-8 · Cited by 75
iText2KG: Incremental Knowledge Graphs Construction Using Large Language Models
Lairgi, Y., Moncla, L., Cazabet, R., Benabdeslem, K., & Cléau, P. (2025) · Lecture Notes in Computer Science · doi:10.1007/978-981-96-0573-6_16 · Cited by 31
Nielbo, K. L., Karsdorp, F., Wevers, M., Lassche, A., Baglini, R., Kestemont, M., & Tahmasebi, N. (2024) · Nature Reviews Methods Primers · doi:10.1038/s43586-024-00302-w · Cited by 49
On the Evolution of Knowledge Graphs: A Survey and Perspective
Jiang, X., Xu, C., Shen, Y., Sun, X., Tang, L., Wang, S., Chen, Z., Wang, Y., & Guo, J. (2023) · arXiv · doi:10.48550/arxiv.2310.04835 · Cited by 42
MemoCRS: Memory-enhanced Sequential Conversational Recommender Systems with Large Language Models
Xi, Y., Liu, W., Lin, J., Chen, B., Tang, R., Zhang, W., & Yu, Y. H. (2024) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3627673.3679599 · Cited by 76
Prompt Tuning in Biomedical Relation Extraction
He, J., Li, F., Li, J., Hu, X., Nian, Y., Xiang, Y., Wang, J., Wei, Q., Li, Y., Xu, H., et al. (2024) · Journal of Healthcare Informatics Research · doi:10.1007/s41666-024-00162-9 · Cited by 42
Retrieval-Augmented Generation with Graphs (GraphRAG)
Han, H., Wang, Y., Shomer, H., Guo, K., Ding, J., Lei, Y., Halappanavar, M., Rossi, R. A., Mukherjee, S., Tang, X., et al. (2025) · arXiv · doi:10.48550/arxiv.2501.00309 · Cited by 34
Few-shot Named Entity Recognition: Definition, Taxonomy and Research Directions
Moscato, V., Postiglione, M., & Sperlí, G. (2023) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3609483 · Cited by 41
ALGAN: Time Series Anomaly Detection with Adjusted-LSTM GAN
Bashar, M. A., & Nayak, R. (2025) · International Journal of Data Science and Analytics · doi:10.1007/s41060-025-00810-2 · Cited by 40
He, K., Mao, R., Huang, Y., Gong, T., Li, C., & Cambria, E. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3314807 · Cited by 40
de Oliveira, V. A., Nogueira, G., Faleiros, T. D. P., & Marcacini, R. M. (2024) · Artificial Intelligence and Law · doi:10.1007/s10506-023-09388-1 · Cited by 45
DanXe: An extended artificial intelligence framework to analyze and promote dance heritage
Stacchio, L., Garzarella, S., Cascarano, P., Filippo, A. D., Cervellati, E., & Marfia, G. (2024) · Digital Applications in Archaeology and Cultural Heritage · doi:10.1016/j.daach.2024.e00343 · Cited by 42
Relationship Extraction Method for Urban Rail Transit Operation Emergencies Records
Zhu, G., Huang, X., Yang, R., & Sun, R. (2022) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2022.3160502 · Cited by 31
An Attention Based Bi-LSTM DenseNet Model for Named Entity Recognition in English Texts
VeeraSekharReddy, B., Rao, K. S., & Koppula, N. (2023) · Wireless Personal Communications · doi:10.1007/s11277-023-10339-x · Cited by 31
Suwaileh, R., Elsayed, T., & Imran, M. (2023) · Information Processing & Management · doi:10.1016/j.ipm.2023.103340 · Cited by 30
DAE-NER: Dual-channel attention enhancement for Chinese named entity recognition
Liu, J., Sun, M., Zhang, W., Xie, G., Jing, Y., Li, X., & Shi, Z. (2023) · Computer Speech & Language · doi:10.1016/j.csl.2023.101581 · Cited by 31
A Fine-Grained Network for Joint Multimodal Entity-Relation Extraction
Li, Y., Cai, Y., Xu, J., Li, Q., & Wang, T. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3485107 · Cited by 35
Multi-View Graph Neural Architecture Search for Biomedical Entity and Relation Extraction
Al-Sabri, R., Gao, J., Chen, J., Olouladé, B. M., & Lyu, T. (2022) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2022.3205113 · Cited by 27
Knowledge graph-based intelligent question answering system for ancient Chinese costume heritage
Yuan, H., Li, Y., Wang, B., Liu, K., & Zhang, J. (2025) · npj Heritage Science · doi:10.1038/s40494-025-01776-x · Cited by 26
Zhang, G., Lu, C., & Luo, Q. (2025) · Buildings · doi:10.3390/buildings15111944 · Cited by 31
CIDOC-CRM and Machine Learning: A Survey and Future Research
Tzitzikas, Y., Mountantonakis, M., Fafalios, P., & Marketakis, Y. (2022) · Heritage · doi:10.3390/heritage5030084 · Cited by 27
Extracting interrelated information from road-related social media data
Zhou, S., Ng, S. T., Huang, G., Dao, J., & Li, D. (2022) · Advanced Engineering Informatics · doi:10.1016/j.aei.2022.101780 · Cited by 24
Delving into Commit-Issue Correlation to Enhance Commit Message Generation Models
Wang, L., Tang, X., He, Y., Ren, C., Shi, S., Yan, C., & Li, Z. (2023) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase56229.2023.00050 · Cited by 28
Loukachevitch, N., Artemova, E., Batura, T. V., Braslavski, P., Ivanov, V. V., Manandhar, S., Pugachev, A., Рожков, І. М., Shelmanov, A., Tutubalina, E. V., et al. (2023) · Language Resources and Evaluation · doi:10.1007/s10579-023-09674-z · Cited by 24
Deep learning of electrochemical CO 2 conversion literature reveals research trends and directions
Choi, J., Bang, K., Jang, S., Choi, J., Ordoñez, J., Buttler, D. J., Hiszpanski, A. M., Han, T. Y.-J., Sohn, S. S., Lee, B., et al. (2023) · Journal of Materials Chemistry A · doi:10.1039/d3ta02780e · Cited by 18
Gill, J. K., Chetty, M., Lim, S., & Hallinan, J. S. (2024) · PLoS ONE · doi:10.1371/journal.pone.0303231 · Cited by 22
Asimopoulos, D. C., Siniosoglou, I., Argyriou, V., Karamitsou, T., Fountoukidis, E., Goudos, S. K., Moscholios, I. D., Psannis, K. E., & Sarigiannidis, P. G. (2024) · International Conference on Modern Circuits and Systems Technologies · doi:10.1109/mocast61810.2024.10615642 · Cited by 18
Knowledge Engineering Using Large Language Models
Allen, B. P., Stork, L., & Groth, P. (2023) · Transactions on Graph Data and Knowledge · doi:10.4230/tgdk.1.1.3 · Cited by 21
A Survey on Deep Learning Techniques for Joint Named Entities and Relation Extraction
Kambar, M. E. Z. N., Esmaeilzadeh, A., & Heidari, M. (2022) · IEEE World AI IoT Congress (AIIoT) · doi:10.1109/aiiot54504.2022.9817231 · Cited by 20
Discovery of topic evolution path and semantic relationship based on patent entity representation
Zhang, J., Liu, Y., Jiang, L., & Shi, J. (2022) · Aslib Journal of Information Management · doi:10.1108/ajim-03-2022-0124 · Cited by 16
EduNER: a Chinese named entity recognition dataset for education research
Li, X., Wei, C., Jiang, Z., Meng, W., Ouyang, F., Zhang, Z., & Chen, W. (2023) · Neural Computing and Applications · doi:10.1007/s00521-023-08635-5 · Cited by 21
Document-level relation extraction with hierarchical dependency tree and bridge path
Wan, Q., Du, S., Liu, Y., Fang, J., Wei, L., & Liu, S. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110873 · Cited by 20
Su, Y., Wang, M., Wang, P., Zheng, C.-H., Liu, Y., & Zeng, X. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbac342 · Cited by 18
Yang, Y., Xiang, P., & Wang, D. (2025) · Automation in Construction · doi:10.1016/j.autcon.2025.106419 · Cited by 17
Zhuang, Z., Hou, Y., Yang, L., Gong, J., & Wang, L. (2024) · International Journal of Computational Intelligence Systems · doi:10.1007/s44196-024-00705-3 · Cited by 15
TASTEset -- Recipe Dataset and Food Entities Recognition BenchmarkPreprint
Wróblewska, A., Kaliska, A. K., Pawłowski, M., Wiśniewski, D., Sosnowski, W., & Ławrynowicz, A. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2204.07775 · Cited by 21
Natural Language Processing and Text Mining (Turning Unstructured Data into Structured)
Bagheri, A., Giachanou, A., Mosteiro, P. J., & Verberne, S. (2023) · Springer eBooks · doi:10.1007/978-3-031-36678-9_5 · Cited by 21
Biographical Semi-Supervised Relation Extraction Dataset
Plum, A., Ranasinghe, T., Jones, S., Orǎsan, C., & Mitkov, R. (2022) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3477495.3531742 · Cited by 14
Landolsi, M. Y., Hlaoua, L., & Romdhane, L. B. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-15080-y · Cited by 15
Guo, B., Liu, H., & Niu, L. (2023) · Frontiers in Neuroscience · doi:10.3389/fnins.2023.1266771 · Cited by 19
Data augmented large language models for medical record generation
Zhang, X., Zhao, G., Ren, Y., Wang, W., Cai, W., Zhao, Y., Zhang, X., & Liu, J. (2024) · Applied Intelligence · doi:10.1007/s10489-024-05934-9 · Cited by 13
Ling, Y., Qin, Z., & Ma, Z. (2025) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2025.105428 · Cited by 20
PBa-LLM: Privacy- and Bias-Aware NLP Using Named-Entity Recognition (NER)
Mancera, G., Morales, A., Fiérrez, J., Tolosana, R., Peña, A., Lopez-Duran, M., Jurado, F., & Ortigosa, Á. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-09368-4_1 · Cited by 22
K-RET: knowledgeable biomedical relation extraction system
Sousa, D., & Couto, F. M. (2023) · Bioinformatics · doi:10.1093/bioinformatics/btad174 · Cited by 13
Samuel, J., Khanna, T., Esguerra, J., Sundar, S., Pelaez, A., & Bhuyan, S. S. (2025) · IEEE Access · doi:10.1109/access.2025.3588179 · Cited by 19
A literature review of literature reviews in pattern analysis and machine intelligence
Zhao, P., Zhang, X., Cao, J., Cheng, M.-M., Yang, J., & Li, X. (2026) · Science China Information Sciences · doi:10.1007/s11432-025-4816-6 · Cited by 13
Gu, R., Wang, T., Deng, J., & Cheng, L. (2023) · Applied Sciences · doi:10.3390/app13074299 · Cited by 12
Zhang, J., Yu, X., Wang, Z., & Zheng, X. (2023) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2023.101654 · Cited by 12
Backdoor Attacks with Input-Unique Triggers in NLP
Zhou, X., Li, J., Zhang, T., Lyu, L., Yang, M., & He, J. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-70341-6_18 · Cited by 20
Named-Entity Recognition for Hindi language using context pattern-based maximum entropy
Jain, A., Yadav, D., Tayal, D. K., & Arora, A. (2022) · Computer Science · doi:10.7494/csci.2022.23.1.3977 · Cited by 14
Text Analytics and Natural Language Processing for Business Insights: A Comprehensive Review
Sinjanka, Y. (2023) · International Journal for Research in Applied Science and Engineering Technology · doi:10.22214/ijraset.2023.55893 · Cited by 11
Identifying the driving factors of word co-occurrence: a perspective of semantic relations
Zhao, Y., Yin, J., Zhang, J., & Wu, L. (2023) · Scientometrics · doi:10.1007/s11192-023-04851-x · Cited by 12
Huang, F., & Cheng, L. (2024) · Autonomous Intelligent Systems · doi:10.1007/s43684-024-00064-y · Cited by 11
Zhang, Z., Jasaitis, T., Freeman, R., Alfrjani, R., & Funk, A. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2301.03458 · Cited by 11
A diffusion enhanced CRF and BiLSTM framework for accurate entity recognition
Qiu, Y., Dong, L., Zhang, W., Xing, H., & Huang, J. (2025) · Scientific Reports · doi:10.1038/s41598-025-04036-x · Cited by 17
The construction and refined extraction techniques of knowledge graph based on large language models
Peng, L., Yang, P., Juexiang, Y., & Li, Y. (2026) · Scientific Reports · doi:10.1038/s41598-026-38066-w · Cited by 14
Hu, X., Hong, Z., Zhang, C., Liu, A., Meng, S., Wen, L., King, I., & Yu, P. S. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2023.3317139 · Cited by 10
Caño-Marín, E., Sánchez‐Alonso, S., & Mora‐Cantallops, M. (2023) · IEEE Transactions on Engineering Management · doi:10.1109/tem.2023.3326233 · Cited by 13
Few-shot relational triple extraction with hierarchical prototype optimization
Gao, C., Zhang, X., Jin, Z. G., Shang, W., Ma, Y., Li, L., Ding, Z., & Liang, Y. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.110779 · Cited by 11
MiDTD: A Simple and Effective Distillation Framework for Distantly Supervised Relation Extraction
Li, R., Yang, C. H., Li, T., & Su, S. (2022) · ACM Transactions on Information Systems · doi:10.1145/3503917 · Cited by 10
A study on the design of a universal signage system for the Ruijin Soviet cultural heritage site
Shi-zhu, L., Qiuyu, H., Ziyi, M., & Pengjiang, J. (2024) · Heritage Science · doi:10.1186/s40494-024-01526-5 · Cited by 11
A novel assembly knowledge graph construction framework enhanced by large language model
Shao, P., Huang, Z., Qiao, L., Xu, X., Wan, Y., Chen, C., Li, Z., Anwer, N., & Qie, Y. (2025) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s00170-025-16290-4 · Cited by 9
Chemical identification and indexing in PubMed full-text articles using deep learning and heuristics
de Almeida, T. D., Antunes, R., Silva, J., Almeida, J. R., & Matos, S. (2022) · Database · doi:10.1093/database/baac047 · Cited by 11
Duplicate Bug Report detection using Named Entity Recognition
Zheng, W., Li, Y., Wu, X., Yu, T., Cheng, J., & Zhao, Y. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.111258 · Cited by 10
Adaptive feature extraction for entity relation extraction
Yang, W., Qin, Y., Huang, R., & Chen, Y. (2024) · Computer Speech & Language · doi:10.1016/j.csl.2024.101712 · Cited by 9
Lee, S. Y.-T., & Ma, K. (2024) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2024.3459961 · Cited by 9
Abisheka, P., Deisy, C., & Sharmila, P. (2024) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2024.102257 · Cited by 9
Wan, L., An, Q., & Su, H. (2022) · Journal of the Franklin Institute · doi:10.1016/j.jfranklin.2022.09.045 · Cited by 9
Hybrid method to automatically extract medical document tree structure
Landolsi, M. Y., Hlaoua, L., & Romdhane, L. B. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.105922 · Cited by 9
Zu, L., Lin, L., Liu, J., Fu, S., Tong, C., & Guo, H. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121759 · Cited by 9
Liu, W., Yin, M., Zhang, J., & Cui, L. (2024) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2023.046475 · Cited by 9
Ma, L., Tian, X., Huang, L., Yang, F., & Shi, X. (2024) · Proceedings of the Institution of Mechanical Engineers Part B Journal of Engineering Manufacture · doi:10.1177/09544054241272920 · Cited by 8
Deep mining the textual gold in relation extraction
Sharma, T., & Emmert‐Streib, F. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-11042-4 · Cited by 12
Discontinuous named entities in clinical text: A systematic literature review
Alhassan, A., Schlegel, V., Aloud, M., Batista-Navarro, R., & Nenadić, G. (2025) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2025.104783 · Cited by 11
StructVizor: Interactive Profiling of Semi-Structured Textual Data
Huang, Y., Miao, Y., Weng, D., Perer, A., & Wu, Y. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713484 · Cited by 8
Chinese Named Entity Recognition Method Based on Dictionary Semantic Knowledge Enhancement
Wang, T., Huang, R., Nan, H. U., Wang, H., & Chu, G. (2023) · IEICE Transactions on Information and Systems · doi:10.1587/transinf.2022edp7168 · Cited by 8
Knowledge Graph Extraction of Business Interactions from News Text for Business Networking Analysis
Gohourou, D., & Kuwabara, K. (2024) · Machine Learning and Knowledge Extraction · doi:10.3390/make6010007 · Cited by 7
Chen, W., Qiu, P., & Cauteruccio, F. (2024) · Big Data and Cognitive Computing · doi:10.3390/bdcc8080086 · Cited by 7
Liang, Y., Xu, N., Chang, H., Qian, S., & Liu, Y. (2025) · Scientific Reports · doi:10.1038/s41598-025-99561-0 · Cited by 7
LLM-empowered literature mining for material substitution studies in sustainable concrete
Duan, Y., Tian, Y., Ghosh, S., Venugopal, V., Chen, J., & Olivetti, E. (2025) · Resources Conservation and Recycling · doi:10.1016/j.resconrec.2025.108379 · Cited by 9
Xu, Q., Xu, X., Zhou, C., Liu, Z., Huang, F., Li, S., Zhu, L., Bai, Z., Xu, Y., & Hu, W. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.126585 · Cited by 12
A deep neural framework for named entity recognition with boosted word embeddings
Goyal, A., Gupta, V., & Kumar, M. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-16176-1 · Cited by 6
Tian, C., Yin, W., Li, D., & Moens, M. (2024) · IEEE Access · doi:10.1109/access.2024.3374727 · Cited by 6
Pooja, H., & Jagadeesh, P. (2024) · Journal of Advances in Information Technology · doi:10.12720/jait.15.6.704-713 · Cited by 6
Internet of Things and Machine Learning for Smart Healthcare
da Costa, C. A., Zeiser, F. A., Righi, R. D. R., Antunes, R. S., Alegretti, A. P., Bertoni, A. P. S., Ramos, G. D. O., de Mello, B. H., Vanin, F. N. D. S., Bertoletti, O. A., et al. (2024) · Studies in computational intelligence · doi:10.1007/978-981-97-5624-7_3 · Cited by 9
Metadata
- Authors
- Nasar, Z., Jaffry, S. W., & Malik, M. K.
- Affiliations
- University of the Punjab (PK)
- Venue
- ACM Computing Surveys
- Published
- 2021-02-11
- Volume
- 54
- Issue
- 1
- Pages
- 1-39
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W3131198033
- Cited by
- 245
- References
- 78
- Citations by year
- 2026: 35 · 2025: 69 · 2024: 63 · 2023: 47 · 2022: 28 · 2021: 3
- FWCI
- 12.46
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Computing Surveys (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Advanced Text Analysis Techniques
- Keywords
- named entity recognition, relation extraction, information extraction, unstructured text, social media text, Twitter, deep learning, hybrid model, joint modeling, benchmark dataset, explainability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.