Natural Language Processing for Information Extraction
Open accessAbstract
With rise of digital age, there is an explosion of information in the form of news, articles, social media, and so on. Much of this data lies in unstructured form and manually managing and effectively making use of it is tedious, boring and labor intensive. This explosion of information and need for more sophisticated and efficient information handling tools gives rise to Information Extraction(IE) and Information Retrieval(IR) technology. Information Extraction systems takes natural language text as input and produces structured information specified by certain criteria, that is relevant to a particular application. Various sub-tasks of IE such as Named Entity Recognition, Coreference Resolution, Named Entity Linking, Relation Extraction, Knowledge Base reasoning forms the building blocks of various high end Natural Language Processing (NLP) tasks such as Machine Translation, Question-Answering System, Natural Language Understanding, Text Summarization and Digital Assistants like Siri, Cortana and Google Now. This paper introduces Information Extraction technology, its various sub-tasks, highlights state-of-the-art research in various IE subtasks, current challenges and future research directions.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
LongMemEval assesses five core memory abilities: information extraction, multi-session reasoning, temporal reasoning, knowledge updates, and abstention.
“The benchmark assesses five core memory abilities: information extraction (Singh, 2018; Peng et al., 2024), multisession reasoning, temporal reasoning, knowledge updates, and abstention (Xin et al., 2021).”
From Hippocampus: An Efficient and Scalable Memory Module for Agentic AI (2026) · cites this paper as Singh, 2018
Cites
WordNet: a lexical database for English
Miller, G. A. (1995) · Communications of the ACM · doi:10.1145/219717.219748 · Cited by 14,015 · see citing works
Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
Lafferty, J., McCallum, A., & Pereira, F. C. N. (2001) · ScholarlyCommons (University of Pennsylvania) · Cited by 12,953 · see citing works
(2013) · Cited by 5,726 · see citing works
Freebase: a collaboratively created graph database for structuring human knowledge
Bollacker, K., Evans, C., Paritosh, P., Sturge, T., & Taylor, J. (2008) · Proceedings of the 2008 ACM SIGMOD international conference on Management of data · doi:10.1145/1376616.1376746 · Cited by 4,852 · see citing works
Knowledge Graph Embedding by Translating on Hyperplanes
Wang, Z., Zhang, J., Feng, J., & Chen, Z. (2014) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v28i1.8870 · Cited by 3,915 · see citing works
Suchanek, F. M., Kasneci, G., & Weikum, G. (2007) · International World Wide Web Conference (WWW) · doi:10.1145/1242572.1242667 · Cited by 3,886 · see citing works
Learning Entity and Relation Embeddings for Knowledge Graph Completion
Lin, Y., Liu, Z., Sun, M., Liu, Y., & Zhu, X. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9491 · Cited by 3,749 · see citing works
A TUTORIAL ON SUPPORT VECTOR MACHINES FOR PATTERN RECOGNITION, DATA MINING AND KNOWLEDGE DISCOVERY
Burger, C. J. C. (1998) · Cited by 3,261 · see citing works
Linguistic Regularities in Continuous Space Word Representations
Mikolov, T., Yih, W.-T., & Zweig, G. (2013) · Cited by 2,913 · see citing works
Distant supervision for relation extraction without labeled data
Mintz, M. D., Bills, S., Snow, R., & Jurafsky, D. (2009) · Annual Meeting of the Association for Computational Linguistics · doi:10.3115/1690219.1690287 · Cited by 2,799 · see citing works
Embedding Entities and Relations for Learning and Inference in Knowledge Bases
Yang, B., Yih, W.-T., He, X., Gao, J., & Deng, L. (2014) · arXiv · doi:10.48550/arxiv.1412.6575 · Cited by 2,252 · see citing works
A Three-Way Model for Collective Learning on Multi-Relational Data
Nickel, M., Tresp, V., & Kriegel, H. (2011) · Cited by 1,806 · see citing works
A Review of Relational Machine Learning for Knowledge Graphs
Nickel, M., Murphy, K. P., Tresp, V., & Gabrilovich, E. (2015) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2483592 · Cited by 1,684 · see citing works
Reasoning With Neural Tensor Networks for Knowledge Base Completion
Socher, R., Chen, D., Manning, C. D., & Ng, A. Y. (2013) · Cited by 1,656 · see citing works
Modeling Relations and Their Mentions without Labeled Text
Riedel, S., Yao, L., & McCallum, A. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15939-8_10 · Cited by 1,342 · see citing works
A Machine Learning Approach to Coreference Resolution of Noun Phrases
Soon, W. M., Ng, H. T., & Lim, D. C. Y. (2001) · Computational Linguistics · doi:10.1162/089120101753342653 · Cited by 1,000 · see citing works
Knowledge-Based Weak Supervision for Information Extraction of Overlapping Relations
Hoffmann, R., Zhang, C., Ling, X., Zettlemoyer, L., & Weld, D. S. (2011) · Cited by 882 · see citing works
Learning Structured Embeddings of Knowledge Bases
Bordes, A., Weston, J., Collobert, R., & Bengio, Y. (2011) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.1609/aaai.v25i1.7917 · Cited by 849 · see citing works
Improving machine learning approaches to coreference resolution
Ng, V., & Cardie, C. (2001) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/1073083.1073102 · Cited by 704 · see citing works
Relation Extraction with Matrix Factorization and Universal Schemas
Riedel, S., Yao, L., McCallum, A., & Marlin, B. M. (2013) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 575 · see citing works
TransG : A Generative Model for Knowledge Graph Embedding
Xiao, H., Huang, M., & Zhu, X. (2016) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p16-1219 · Cited by 370 · see citing works
A Multi-Pass Sieve for Coreference Resolution
Raghunathan, K., Lee, H., Rangarajan, S., Chambers, N., Surdeanu, M., Jurafsky, D., & Manning, C. D. (2010) · Cited by 335 · see citing works
Traversing Knowledge Graphs in Vector Space
Guu, K., Miller, J., & Liang, P. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1038 · Cited by 319 · see citing works
CRYSTAL: Inducing a Conceptual DictionaryPreprint
Soderland, S. G., Fisher, D., Aseltine, J., & Lehnert, W. G. (1995) · arXiv (Cornell University) · doi:10.48550/arxiv.cmp-lg/9505020 · Cited by 303 · see citing works
Easy Victories and Uphill Battles in Coreference Resolution
Durrett, G., & Klein, D. (2013) · Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1203 · Cited by 279 · see citing works
Learning to Extract Relations from the Web using Minimal Supervision
Bunescu, R., & Mooney, R. J. (2007) · Cited by 265 · see citing works
Understanding the value of features for coreference resolution
Bengtson, E., & Roth, D. (2008) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/1613715.1613756 · Cited by 256 · see citing works
Typed Tensor Decomposition of Knowledge Bases for Relation Extraction
Chang, K.-W., Yih, W.-T., Yang, B., & Meek, C. (2014) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1165 · Cited by 190 · see citing works
STransE: a novel embedding model of entities and relationships in knowledge bases
Nguyen, D. Q., Sirts, K., Qu, L., & Johnson, M. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1054 · Cited by 177 · see citing works
Noun Phrase Coreference as Clustering
Cardie, C., & Wagstaff, K. L. (1999) · Cited by 159 · see citing works
Attention-Based Convolutional Neural Network for Semantic Relation Extraction
Shen, Y., & Huang, X. (2016) · International Conference on Computational Linguistics · Cited by 143 · see citing works
Compositional Learning of Embeddings for Relation Paths in Knowledge Base and Text
Toutanova, K., Lin, V., Yih, W.-T., Poon, H., & Quirk, C. (2016) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p16-1136 · Cited by 139 · see citing works
BART: A modular toolkit for coreference resolution
Versley, Y., Ponzetto, S. P., Poesio, M., Eidelman, V., Jern, A., Smith, J., Yang, X., & Moschitti, A. (2008) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/28a2xqhvmavx · Cited by 138 · see citing works
Conundrums in noun phrase coreference resolution
Stoyanov, V., Gilbert, N., Cardie, C., & Riloff, E. (2009) · doi:10.3115/1690219.1690238 · Cited by 129 · see citing works
Coreference Resolution with World Knowledge
Rahman, A., & Ng, V. (2011) · Cited by 117 · see citing works
Classifying Relations by Ranking with Convolutional Neural NetworksPreprint
dos Santos, C. N., Xiang, B., & Zhou, B. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.06580 · Cited by 110 · see citing works
CATENA: CAusal and TEmporal relation extraction from NAtural language texts
Mirza, P., & Tonelli, S. (2016) · MPG.PuRe (Max Planck Society) · Cited by 104 · see citing works
Spectra, Euclidean representations and clusterings of hypergraphs
Bolla, M. (1993) · Discrete Mathematics · doi:10.1016/0012-365x(93)90322-k · Cited by 96 · see citing works
Dependency-Based Open Information Extraction
Gamallo, P., García, M., & Lanza, S. F. (2012) · Cited by 93 · see citing works
Employing Word Representations and Regularization for Domain Adaptation of Relation Extraction
Nguyen, T. H., & Grishman, R. (2014) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/v1/p14-2012 · Cited by 84 · see citing works
Multi-level Spectral Hypergraph Partitioning with Arbitrary Vertex Sizes
Zien, J. Y., Schlag, M. D. F., & Chan, P. K. (1996) · Cited by 83 · see citing works
A Hierarchical Distance-dependent Bayesian Model for Event Coreference Resolution
Yang, B., Cardie, C., & Frazier, P. I. (2015) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00155 · Cited by 62 · see citing works
Infusion of Labeled Data into Distant Supervision for Relation Extraction
Pershina, M., Min, B., Xu, W. H., & Grishman, R. (2014) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/v1/p14-2119 · Cited by 52 · see citing works
Statistical anaphora resolution in biomedical texts
Gasperin, C., & Briscoe, T. (2008) · International Conference on Computational Linguistics · doi:10.3115/1599081.1599114 · Cited by 50 · see citing works
Neighborhood Mixture Model for Knowledge Base Completion
Nguyen, D. Q., Sirts, K., Qu, L., & Johnson, M. (2016) · Conference on Computational Natural Language Learning · doi:10.18653/v1/k16-1005 · Cited by 49 · see citing works
Big Data versus the Crowd: Looking for Relationships in All the Right Places
Zhang, C., Niu, F., Ré, C., & SHAVLIK, J. W. (2012) · Cited by 46 · see citing works
Classifying Temporal Relations with Rich Linguistic Knowledge
D’Souza, J., & Ng, V. (2013) · Cited by 43 · see citing works
A Semantic Matching Energy Function for Learning with Multi-relational DataPreprint
Glorot, X., Bordes, A., Weston, J., & Bengio, Y. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1301.3485 · Cited by 42 · see citing works
Chinese Open Relation Extraction for Knowledge Acquisition
Tseng, Y., Lee, L., Lin, S.-Y., Liao, B. S., Liu, M., Chen, H., Etzioni, O., & Fader, A. (2014) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.3115/v1/e14-4003 · Cited by 42 · see citing works
Unsupervised Induction of Cross-Lingual Semantic Relations
Lewis, M., & Steedman, M. J. (2013) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d13-1064 · Cited by 33 · see citing works
Cross-Document Coreference Resolution Based on Automatic Text Summary
Gao, S., Si, L., Xu, W., & Guo, J. (2010) · doi:10.1109/wkdd.2010.56 · Cited by 4 · see citing works
Tribble, A., & Fahlman, S. E. (2007) · International Workshop on Semantic Evaluation (SemEval) · doi:10.3115/1621474.1621497 · Cited by 3 · see citing works
Combining syntactic patterns and Wikipedia's hierarchy of hyperlinks to extract meronym relations
Gemechu, D. T., Zock, M., & Teferra, S. (2016) · doi:10.18653/v1/n16-2005 · Cited by 3 · see citing works
N-ary Biographical Relation Extraction using Shortest Path Dependencies.
Khirbat, G., Qi, J., & Zhang, R. (2016) · Cited by 2 · see citing works
Flagged first, then by citations
1 of the 55 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Sen, O., Fuad, M., Islam, M. N., Rabbi, J., Masud, M., Hasan, M. K., Awal, M. A., Fime, A. A., Fuad, M. T. H., Sikder, D., et al. (2022) · IEEE Access · doi:10.1109/access.2022.3165563 · Cited by 90 · see citing works
Ren, R., & Zhang, J. (2021) · Journal of Computing in Civil Engineering · doi:10.1061/(asce)cp.1943-5487.0000971 · Cited by 43 · see citing works
An Intelligent Decision Support System For Recruitment: Resumes Screening And Applicants Ranking
Najjar, A., Amro, B., & Macedo, M. (2021) · Informatica · doi:10.31449/inf.v45i4.3356 · Cited by 32 · see citing works
Blanchy, G., Albrecht, L., Koestel, J., & Garré, S. (2023) · SOIL · doi:10.5194/soil-9-155-2023 · Cited by 30 · see citing works
Preprocessing of unstructured medical data: the impact of each preprocessing stage on classification
Kashina, M., Lenivtceva, I. D., & Kopanitsa, G. (2020) · Procedia Computer Science · doi:10.1016/j.procs.2020.11.030 · Cited by 32 · see citing works
Artificial Intelligence Tools in Misinformation Management during Natural Disasters
Komendantova, N., & Erokhin, D. V. (2025) · Public Organization Review · doi:10.1007/s11115-025-00815-2 · Cited by 23 · see citing works
Identifying stroke-related quantified evidence from electronic health records in real-world studies
Yang, L., Huang, X., Wang, J., Yang, X., Ding, L., Li, Z., & Li, J. (2023) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2023.102552 · Cited by 15 · see citing works
Kpodo, J., & Nejadhashemi, A. P. (2025) · Artificial Intelligence in Agriculture · doi:10.1016/j.aiia.2025.04.001 · Cited by 19 · see citing works
Using large language models to extract plant functional traits from unstructured text
Domazetoski, V., Kreft, H., Bestová, H., Wieder, P., Koynov, R., Zarei, A., & Weigelt, P. (2025) · Applications in Plant Sciences · doi:10.1002/aps3.70011 · Cited by 18 · see citing works
Improving humanitarian needs assessments through natural language processing
Kreutzer, T., Vinck, P., Pham, P. N., An, A., Appel, L., DeLuca, E., Tang, G., Alzghool, M., Hachhethu, K., Morris, B., et al. (2019) · IBM Journal of Research and Development · doi:10.1147/jrd.2019.2947014 · Cited by 13 · see citing works
Sentiment Analysis on Social Media
Wadawadagi, R. S., & Pagi, V. B. (2022) · IGI Global eBooks · doi:10.4018/978-1-6684-6303-1.ch041 · Cited by 11 · see citing works
Chong, W. J., Chua, H. N., & Gan, M. F. (2022) · IEEE International Conference on Artificial Intelligence in Engineering and Technology (IICAIET) · doi:10.1109/iicaiet55139.2022.9936821 · Cited by 10 · see citing works
Comparative Semantic Resume Analysis for Improving Candidate-Career Matching
Alderham, A. H., & Jaha, E. S. (2022) · International Conference on Computational Intelligence and Communication Networks (CICN) · doi:10.1109/cicn56167.2022.10008255 · Cited by 9 · see citing works
Understanding the Pandemic Through Mining Covid News Using Natural Language Processing
Sadman, N., Anjum, N., Gupta, K. D., & Mahmud, M. A. P. (2021) · IEEE Annual Computing and Communication Workshop and Conference (CCWC) · doi:10.1109/ccwc51732.2021.9376002 · Cited by 7 · see citing works
Sentiment Analysis on Social Media
Wadawadagi, R. S., & Pagi, V. B. (2020) · Advances in computational intelligence and robotics book series · doi:10.4018/978-1-5225-9643-1.ch024 · Cited by 6 · see citing works
Landu, T. T., Bousso, M., Loum, M. A., Sall, O., Faty, L., Dia, Y., & Sawadogo, I. (2022) · Iberian Conference on Information Systems and Technologies (CISTI) · doi:10.23919/cisti54924.2022.9820408 · Cited by 4 · see citing works
Buhl, D., Szafarski, D., Welz, L., & Lanquillon, C. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-35894-4_3 · Cited by 3 · see citing works
Zhou, H., Xie, T., Liu, Q., & Hu, S. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3397832 · Cited by 3 · see citing works
SEPHWIR: Search Engine Parsing for Hidden Web Information Retrieval
Sehgal, M. S., Gupta, S. K., & Sehgal, T. (2022) · International Conference on Smart and Sustainable Technologies in Energy and Power Sectors (SSTEPS) · doi:10.1109/ssteps57475.2022.00038 · Cited by 3 · see citing works
The Less the Merrier? Investigating Language Representation in Multilingual Models
Nigatu, H. H., Tonja, A. L., & Kalita, J. K. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.837 · Cited by 3 · see citing works
Structural Vetting of Academic Proposals
Iwashokun, O., & Ade-Ibijola, A. (2022) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2022.0130790 · Cited by 2 · see citing works
Improved Candidate-Career Matching Using Comparative Semantic Resume Analysis
Alderham, A. H., & Jaha, E. S. (2024) · Advances in Science Technology and Engineering Systems Journal · doi:10.25046/aj090103 · Cited by 2 · see citing works
Operating Under Constraints: Identifying Requirements for Enhanced Cyber Resilience Management
Naa, F. W., Cuppens-Boulahia, N., & Cuppens, F. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-96590-6_4 · Cited by 1 · see citing works
Enhancing online dispute resolution through natural language processing: a case study of kleros
Zhuk, A. (2025) · International Cybersecurity Law Review · doi:10.1365/s43439-025-00161-5 · Cited by 1 · see citing works
Mining textual fields from patent documents: systematic review
Cunha, K. C. T., Martens, C. D. P., & Marcolin, C. B. (2025) · Management Review Quarterly · doi:10.1007/s11301-025-00555-z · Cited by 1 · see citing works
Trend Extraction from High Dimensional Stock News based on Markov Chain
Khaing, E. T., Thein, M., & Lwin, M. M. (2020) · International Conference on Advanced Information Technologies (ICAIT) · doi:10.1109/icait51105.2020.9261802 · Cited by 1 · see citing works
A Systematic Survey of Techniques for Document Processing and Natural Language Understanding
Suresh, S. R., Shraddha, C., kiran, S., & Chidaravalli, S. (2024) · IJARCCE · doi:10.17148/ijarcce.2024.13126 · Cited by 1 · see citing works
Comparative Analysis of Large Language Models in Structured Information Extraction from Job Postings
Sioziou, K., Zervas, P., Giotopoulos, K., & Tzimas, G. E. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-62495-7_7 · Cited by 1 · see citing works
Mulyawan, M., Dana, R. D., Bahtiar, A., & Ali, I. (2024) · JTIM Jurnal Teknologi Informasi dan Multimedia · doi:10.35746/jtim.v6i3.617 · Cited by 3 · see citing works
Pilot Testing of an Information Extraction (IE) Prototype for Legal Research
Scholtz, B. M., Padayachy, T., & Adewoyin, O. (2020) · The African Journal of Information and Communication (AJIC) · doi:10.23962/10539/29192 · Cited by 1 · see citing works
Study of State of Arts Methods for Event Extraction
Chaturvedi, N., & Dubey, J. (2021) · Learning and analytics in intelligent systems · doi:10.1007/978-981-15-9293-5_10 · Cited by 1 · see citing works
Simpson, B. C., Selva, D., & Richardson, D. (2022) · AIAA SciTech Forum · doi:10.2514/6.2022-1182 · Cited by 1 · see citing works
Bib2Auth: Deep Learning Approach for Author Disambiguation using Bibliographic DataPreprint
Boukhers, Z., Asundi, N. B., Chandrasekaran, A. T., Anand, A., Prasadand, S. M. G., & Aralappa, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.04382 · Cited by 1 · see citing works
Hippocampus: An Efficient and Scalable Memory Module for Agentic AI
Li, Y., Cao, L., Ahmed, F., Sharma, P., & Li, B. (2026) · arXiv · doi:10.48550/arxiv.2602.13594
“The benchmark assesses five core memory abilities: information extraction (Singh, 2018; Peng et al., 2024), multi-session reasoning, temporal reasoning, knowledge updates, and abstention (Xin et al., 2021).”
Analysis on Natural Language Processing Using Page Ranking Algorithm on YouTube Videos
Costales, J. A., Abellana, J. A., Gracia, J., & Devaraj, M. (2021) · International Conference on Computing and Artificial Intelligence (ICCAI) · doi:10.1145/3467707.3467732
Web based Content Extraction and Retrieval in Web Engineering
(2019) · International Journal of Recent Technology and Engineering (IJRTE) · doi:10.35940/ijrte.b1013.0982s1119
Padronização da Descrição de Produtos Comerciais utilizando NER
Lucchesi, L., Escovedo, T., & Kalinowski, M. (2022) · Simpósio Brasileiro de Bancos de Dados (SBBD) · doi:10.5753/sbbd.2022.224347
Blanchy, G. (2023) · doi:10.5194/egusphere-2022-535-ac1
Blanchy, G. (2023) · doi:10.5194/egusphere-2022-535-ac2
High Dimensional Computing on Arabic Language ClassificationPreprint
Rady, G. S., Mohamed, S. S., Mohamed, M. F., & Hussain, K. F. (2021) · Research Square · doi:10.21203/rs.3.rs-938888/v1
Application of NLP Based Knowledge Extraction for Polypropylene and Polybutadiene Research
Kadam, P. P., Gupta, V. K., & Venkateswaran, N. (2023) · International Conference on Information Science and Systems (ICISS) · doi:10.1145/3625156.3625160
Trích xuất và phân tích thông tin trên Google về sản phẩm chăm sóc sắc đẹp
Võ, H. Q. H., & Đỗ, P. (2024) · Can Tho University Journal of Science · doi:10.22144/ctujos.2024.263
Ong, A. Y., Nguyen, Q., Barai, I., Engelmann, J., Antaki, F., Sevgi, M., Merle, D. A., Ju, L., Dow, E. R., Zhou, Y., et al. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-03136-w
Collaborative Large Language Models for Automated Data Extraction in Living Systematic Reviews
Khan, M. A., Ayub, U., Naqvi, S. A. A., Khakwani, K. Z. R., Sipra, Z. B. R., Raina, A., Zou, S., He, H., Hossein, S. A., Hasan, B., et al. (2024) · doi:10.1101/2024.09.20.24314108 · Cited by 54 · see citing works
“Historically, natural language processing (NLP) techniques[13] such as Latent Dirichlet Allocation (LDA), Conditional Random Fields (CRFs), and support vector machines (SVM) were used for text mining unstructured publication text.”
Method
- Authors
- Singh, S.
- Corresponding author
- Singh, Sonit
- ORCID
- Singh, Sonit
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1807.02383
- OpenAlex
- W2870668188
- Cited by
- 45
- References
- 55
- Citations by year
- 2026: 1 · 2025: 6 · 2024: 6 · 2023: 7 · 2022: 12 · 2021: 7 · 2020: 4 · 2019: 2
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Advanced Text Analysis Techniques
- Keywords
- information extraction, named entity recognition, coreference resolution, named entity linking, relation extraction, knowledge base reasoning, information retrieval, unstructured text, virtual assistants, question answering
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review