Text mining approaches for dealing with the rapidly expanding literature on COVID-19
Open accessThe DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Abstract
More than 50 000 papers have been published about COVID-19 since the beginning of 2020 and several hundred new papers continue to be published every day. This incredible rate of scientific productivity leads to information overload, making it difficult for researchers, clinicians and public health officials to keep up with the latest findings. Automated text mining techniques for searching, reading and summarizing papers are helpful for addressing information overload. In this review, we describe the many resources that have been introduced to support text mining applications over the COVID-19 literature; specifically, we discuss the corpora, modeling resources, systems and shared tasks that have been introduced for COVID-19. We compile a list of 39 systems that provide functionality such as search, discovery, visualization and summarization over the COVID-19 literature. For each system, we provide a qualitative description and assessment of the system’s performance, unique data or user interface features and modeling decisions. Many systems focus on search and discovery, though several systems provide novel features, such as the ability to summarize findings over multiple documents or linking between scientific articles and clinical trials. We also describe the public corpora, models and shared tasks that have been introduced to help reduce repeated effort among community members; some of these resources (especially shared tasks) can provide a basis for comparing the performance of different systems. Finally, we summarize promising results and open challenges for text mining the COVID-19 literature.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Rayyan-a web and mobile app for systematic reviews.
Ouzzani, M., Hammady, H., Fedorowicz, Z., & Elmagarmid, A. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0384-4 · Cited by 26,092
The FAIR Guiding Principles for scientific data management and stewardship
Wilkinson, M. D., Dumontier, M., Aalbersberg, I. J., Appleton, G., Axton, M., Baak, A., Blomberg, N., Boiten, J.-W., da Silva Santos, L. B., Bourne, P. E., et al. (2016) · Scientific Data · doi:10.1038/sdata.2016.18 · Cited by 18,423
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
Reimers, N., & Gurevych, I. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1410 · Cited by 12,778
Deep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
A new coronavirus associated with human respiratory disease in China
Wu, F., Zhao, S., Yu, B., Chen, Y.-M., Wang, W., Song, Z.-G., Hu, Y., Tao, Z.-W., Tian, J.-H., Pei, Y.-Y., et al. (2020) · Nature · doi:10.1038/s41586-020-2008-3 · Cited by 11,688 · cited 1×
“Since the discovery of the novel coronavirus SARS-CoV-2 [4, 107] toward the tail end of 2019, the disease caused by the virus, COVID-19, has swept through the globe and drastically altered all aspects of our lives.”
BackgroundExploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2019) · arXiv · doi:10.48550/arxiv.1910.13461 · Cited by 8,816
BioBERT: a pre-trained biomedical language representation model for biomedical text mining
Lee, J., Yoon, W., Kim, S., Kim, D., Kim, S., So, C. H., & Kang, J. (2020) · Bioinformatics · doi:10.1093/bioinformatics/btz682 · Cited by 7,218 · cited 1×
“Many projects in Section on “Text mining systems” leverage domain-adapted BERT [24] models such as SciBERT [6] and BioBERT [49], which have been fine-tuned to scientific and biomedical text, respectively.”
BackgroundSQuAD: 100,000+ Questions for Machine Comprehension of Text
Rajpurkar, P., Zhang, J., Lopyrev, K., & Liang, P. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1264 · Cited by 6,208 · cited 1×
“…to a lack of abundant training data specific to COVID-19, most existing QA systems needed to bootstrap their own QA training data or are trained on non-scientific domain datasets like SQuAD [73] or smaller biomedical domain QA datasets like BioASQ [91], which may result in less performant systems.”
BackgroundThe proximal origin of SARS-CoV-2
Andersen, K. G., Rambaut, A., Lipkin, W. I., Holmes, E. C., & Garry, R. F. (2020) · Nature Medicine · doi:10.1038/s41591-020-0820-9 · Cited by 5,081
Neural Architectures for Named Entity Recognition
Lample, G., Ballesteros, M., Subramanian, S., Kawakami, K., & Dyer, C. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1030 · Cited by 4,401
Billion-scale similarity search with GPUs
Johnson, J., Douze, M., & Jegou, H. (2021) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2019.2921572 · Cited by 4,228
Billion-scale similarity search with GPUs
Johnson, J., Douze, M., & Jégou, H. (2017) · arXiv · doi:10.48550/arxiv.1702.08734 · Cited by 4,140
A large annotated corpus for learning natural language inference
Bowman, S. R., Angeli, G., Potts, C., & Manning, C. D. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1075 · Cited by 3,377
A Broad-Coverage Challenge Corpus for Sentence Understanding through Inference
Williams, A., Nangia, N., & Bowman, S. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1101 · Cited by 3,342
SciBERT: A Pretrained Language Model for Scientific Text
Beltagy, I., Lo, K., & Cohan, A. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1371 · Cited by 3,218 · cited 2×
“Many projects in Section on “Text mining systems” leverage domain-adapted BERT [24] models such as SciBERT [6] and BioBERT [49], which have been fine-tuned to scientific and biomedical text, respectively.”
BackgroundMethodSelf-citationPiñero, J., Bravo, À., Queralt-Rosinach, N., Gutiérrez-Sacristán, A., Deu-Pons, J., Centeno, E., García-García, J., Sanz, F., & Furlong, L. I. (2017) · Nucleic Acids Research · doi:10.1093/nar/gkw943 · Cited by 2,680
Natural Questions: A benchmark for question answering research
Kwiatkowski, T., Palomaki, J., Redfield, O., Collins, M., Parikh, A., Alberti, C., Epstein, D., Polosukhin, I., Devlin, J., Lee, K., et al. (2019) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00276 · Cited by 2,069
Five steps to conducting a systematic review
Khan, K. S., Kunz, R., Kleijnen, J., & Antes, G. (2003) · Journal of the Royal Society of Medicine · doi:10.1177/014107680309600304 · Cited by 1,873 · cited 1×
“In Figure 2, we show the steps of systematic review construction [38].”
BackgroundAlsentzer, E., Murphy, J., Boag, W., Weng, W.-H., Jindi, D., Naumann, T., & McDermott, M. (2019) · Proceedings of the 2nd Clinical Natural Language Processing Workshop · doi:10.18653/v1/w19-1909 · Cited by 1,736
The nuts and bolts of PROSPERO: an international prospective register of systematic reviews
Booth, A., Clarke, M., Dooley, G., Ghersi, D., Moher, D., Petticrew, M., & Stewart, L. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-2 · Cited by 1,433 · cited 1×
“They have become a fixture in the biomedical literature, with many established protocol around their registration, production, publication and update [10, 15, 81].”
BackgroundEvidence summaries: the evolution of a rapid review approach
Khangura, S., Konnyu, K., Cushman, R., Grimshaw, J., & Moher, D. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-10 · Cited by 1,232 · cited 1×
“Rapid reviews, which condense and shorten the typically months-or years-long systematic review process [39, 89], have been common.”
BackgroundUnified Language Model Pre-training for Natural Language Understanding and Generation
Dong, L., Yang, N., Wang, W., Wei, F., Liu, X., Wang, Y., Gao, J., Zhou, M., & Hon, H.-W. (2019) · arXiv · doi:10.48550/arxiv.1905.03197 · Cited by 1,225
A scoping review of rapid review methods
Tricco, A. C., Antony, J., Zarin, W., Strifler, L., Ghassemi, M., Ivory, J., Perrier, L., Hutton, B., Moher, D., & Straus, S. E. (2015) · BMC Medicine · doi:10.1186/s12916-015-0465-6 · Cited by 1,146 · cited 1×
“Rapid reviews, which condense and shorten the typically months-or years-long systematic review process [39, 89], have been common.”
BackgroundSPECTER: Document-level Representation Learning using Citation-informed Transformers
Cohan, A., Feldman, S., Beltagy, I., Downey, D., & Weld, D. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.207 · Cited by 1,108
Tsatsaronis, G., Balikas, G., Malakasiotis, P., Partalas, I., Zschunke, M., Alvers, M. R., Weissenborn, D., Krithara, A., Petridis, S., Polychronopoulos, D., et al. (2015) · BMC Bioinformatics · doi:10.1186/s12859-015-0564-6 · Cited by 598 · cited 1×
“…to a lack of abundant training data specific to COVID-19, most existing QA systems needed to bootstrap their own QA training data or are trained on non-scientific domain datasets like SQuAD [73] or smaller biomedical domain QA datasets like BioASQ [91], which may result in less performant systems.”
BackgroundA brief history of research synthesis
Chalmers, I., Hedges, L. V., & Cooper, H. (2002) · Evaluation & the Health Professions · doi:10.1177/0163278702025001003 · Cited by 552 · cited 1×
“They have become a fixture in the biomedical literature, with many established protocol around their registration, production, publication and update [10, 15, 81].”
BackgroundSystematic review automation technologies
Tsafnat, G., Glasziou, P., Choong, M. K., Dunn, A., Galgani, F., & Coiera, E. (2014) · Systematic Reviews · doi:10.1186/2046-4053-3-74 · Cited by 472 · cited 1×
“Several existing systems focusonautomatingpartsofthesystematicreviewprocessmore broadly [90].”
S2ORC: The Semantic Scholar Open Research Corpus
Lo, K., Wang, L. L., Neumann, M., Kinney, R., & Weld, D. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.447 · Cited by 457
Self-citationSultan, S., Altayar, O., Siddique, S. M., Davitkov, P., Feuerstein, J. D., Lim, J. K., Falck-Ytter, Y., & El-Serag, H. B. (2020) · Gastroenterology · doi:10.1053/j.gastro.2020.05.001 · Cited by 437
Keep up with the latest coronavirus research
Chen, Q., Allot, A., & Lu, Z. (2020) · Nature · doi:10.1038/d41586-020-00694-1 · Cited by 295
Nye, B., Li, J. J., Patel, R., Yang, Y., Marshall, I., Nenkova, A., & Wallace, B. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1019 · Cited by 224
ExaCT: automatic extraction of clinical trial characteristics from journal publications
Kiritchenko, S., de Bruijn, B., Carini, S., Martin, J., & Sim, I. (2010) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-10-56 · Cited by 188 · cited 1×
“These systems focus on supporting the identification of relevant studies [5, 64, 70, 71, 94] or extracting PICO elements [22,42,55,62].”
BackgroundClassification and Clustering of Arguments with Contextualized Word Embeddings
Reimers, N., Schiller, B., Beck, T., Daxenberger, J., Stab, C., & Gurevych, I. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1054 · Cited by 157 · cited 1×
“There are dozens of different embedding methodologies; for more information on their use, see [13, 76].”
BackgroundPrioritising references for systematic reviews with RobotAnalyst: A user study
Przybyła, P., Brockmeier, A. J., Kontonatsios, G., Le Pogam, M., McNaught, J., von Elm, E., Nolan, K., & Ananiadou, S. (2018) · Research Synthesis Methods · doi:10.1002/jrsm.1311 · Cited by 148
Automating Biomedical Evidence Synthesis: RobotReviewer
Marshall, I., Kuiper, J., Banner, E., & Wallace, B. C. (2017) · Proceedings of ACL 2017, System Demonstrations · doi:10.18653/v1/p17-4002 · Cited by 96 · cited 1×
“These systems focus on supporting the identification of relevant studies [5, 64, 70, 71, 94] or extracting PICO elements [22,42,55,62].”
BackgroundBiomedical text mining for research rigor and integrity: tasks, challenges, directions
Kilicoglu, H. (2017) · Briefings in Bioinformatics · doi:10.1093/bib/bbx057 · Cited by 61
Research works printed but not linked: 66
- Almeida, 2020, Calling attention to passages for biomedical question answering, 69
- Ananiadou, 2006, Text mining and its potential applications in systems biology, Trends Biotechnol, 24, 571, 10.1016/j.tibtech.2006.10.002 · DOI · Paper page
- ASReview Core Development Team, 2019, ASReview: Active Learning for Systematic Reviews
- Bhatia, 2019, Comprehend medical: a named entity recognition and relationship extraction web service, 1844, 10.1109/ICMLA.2019.00297 · DOI
- Bodenreider, 2004, The unified medical language system (UMLS): integrating biomedical terminology, Nucleic Acids Res, 32, D267, 10.1093/nar/gkh061 · DOI · Paper page
- Bravo, 2015, Extraction of relations between genes and diseases from text and large-scale data analysis: implications for translational research, BMC Bioinform, 16, 10.1186/s12859-015-0472-9 · DOI · Paper page
- Camacho-Collados, 2018, From word to sense embeddings: a survey on vector representations of meaning, J Artif Intell Res, 63, 743, 10.1613/jair.1.11259 · DOI · Paper page
- Campos, 2016, MS MARCO: a human generated machine reading comprehension dataset
- Chen, 2019, BioSentVec: creating sentence embeddings for biomedical texts, 1, 10.1109/ICHI.2019.8904728 · DOI · Paper page
- Cohen, 2005, A survey of current work in biomedical text mining, Brief Bioinform, 6, 57, 10.1093/bib/6.1.57 · DOI · Paper page
- Crisan-Dabija, 2020, Tuberculosis and COVID-19 in 2020: lessons from the past viral outbreaks and possible future outcomes, Canadian Respiratory Journal, 2020, 10.1155/2020/1401053 · DOI
- Danesh, 2015, SGRank: combining statistical and graphical methods to improve the state of the art in unsupervised keyphrase extraction, 117, 10.18653/v1/S15-1013 · DOI
- de Bruijn, 2008, Automated information extraction of key trial design elements from clinical trial publications, AMIA Annu Symp Proc, 141
- Demner-Fushman, 2017, MetaMap Lite: an evaluation of a new Java implementation of MetaMap, J Am Med Inform Assoc, 24, 841, 10.1093/jamia/ocw177 · DOI · Paper page
- Dinh, 2015, Network clustering via maximizing modularity: approximation algorithms and theoretical limits, 101, 10.1109/ICDM.2015.139 · DOI
- El-shafeey, 2020, A systematic scoping review of COVID-19 during pregnancy and childbirth, Int J Gynaecol Obstet, 150, 47, 10.1002/ijgo.13182 · DOI · Paper page
- Espinosa-Anke, 2018, SeVeN: augmenting word embeddings with unsupervised relation vectors, 2653
- Yang, 2020, Who is more susceptible to COVID-19 infection and mortality in the states?, medRxiv, 10.1101/2020.05.01.20087403 · DOI
- Hoang, 2020, COVID-19 in 7780 pediatric patients: a systematic review, EClinicalMedicine, 24, 100433, 10.1016/j.eclinm.2020.100433 · DOI · Paper page
- Hope, 2020, SciSight: combining faceted navigation and research group detection for COVID-19 exploratory scientific search, Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations. Online
- Huang, 2016, Community challenges in biomedical text mining over 10 years: success, failure and the future, Brief Bioinform, 17, 132, 10.1093/bib/bbv024 · DOI · Paper page
- Huang, 2020, CODA-19: reliably annotating research aspects on 10,000+ CORD-19 abstracts using a non-expert crowd
- Ilievski, 2020, KGTK: a toolkit for large knowledge graph manipulation and analysis, 10.1007/978-3-030-62466-8_18 · DOI
- Kim, 2019, A neural named entity recognition and multi-type normalization tool for biomedical text mining, IEEE Access, 7, 73729, 10.1109/ACCESS.2019.2920708 · DOI
- Köksal, 2020, Vapur: a search engine to find related protein—compound pairs in COVID-19 literature, 10.1101/2020.09.05.284224 · doi:10.1101/2020.09.05.284224
- Korn, 2020, COVID-KOP: integrating emerging COVID-19 data with the ROBOKOP database, ChemRxiv
- Lan, 2020, ALBERT: a lite BERT for self-supervised learning of language representations
- Lee, 2020, Answering questions on COVID-19 in real-time, 10.18653/v1/2020.nlpcovid19-2.1 · DOI
- Lee, 2016, BEST: next-generation biomedical entity search tool for knowledge discovery from biomedical literature, PLoS One, 11
- Lin, 2006, Will pyramids built of nuggets topple over, 383
- McDonald, 2018, Deep relevance ranking using enhanced document-query interactions, 10.18653/v1/D18-1211 · DOI
- Mikolov, Distributed representations of words and phrases and their compositionality
- Nance, 2020, Stepping up to the CORD-19 challenge: a semi-automated rapid review workflow for literature related to COVID-19 and blood clotting
- Neumann, 2019, ScispaCy: fast and robust models for biomedical natural language processing, 319, 10.18653/v1/W19-5034 · DOI · Paper page
- Newman-Griffis, 2018, Jointly embedding entities and text with distant supervision, 195, 10.18653/v1/W18-3026 · DOI
- Nye, 2020, Trialstreamer: mapping and browsing medical evidence in real-time, 63, 10.18653/v1/2020.acl-demos.9 · DOI · Paper page
- Oniani, 2020, Constructing co-occurrence network embeddings to assist association extraction for COVID-19 and other coronavirus infectious diseases, J Am Med Inform Assoc, 27, 1259, 10.1093/jamia/ocaa117 · DOI
- Panahi, 2020, Clinical characteristics of COVID-19 infection in newborns and pediatrics: a systematic review, Arch Acad Emerg Med, 8
- Parasa, 2020, Prevalence of gastrointestinal symptoms and fecal viral shedding in patients with coronavirus disease 2019, JAMA Netw Open, 3, 10.1001/jamanetworkopen.2020.11335 · DOI · Paper page
- Poerner, Inexpensive domain adaptation of pretrained language models: case studies on biomedical NER and COVID-19 QA, 10.18653/v1/2020.findings-emnlp.134 · DOI
- Popa, 2020, COVID-19 and inflammatory bowel diseases: risk assessment, shared molecular pathways and therapeutic challenges, Gastroenterol Res Pract, 2020, 10.1155/2020/1918035 · DOI
- Portenoy, 2020, Constructing and evaluating automated literature review systems, Scientometrics, 1
- Reimers, 2019, Sentence-BERT: sentence embeddings using Siamese BERT-networks, 3982, 10.18653/v1/D19-1410 · DOI · Paper page
- Roberts, 2020, TREC-COVID: rationale and structure of an information retrieval shared task for COVID-19, J Am Med Inform Assoc, 27, 1431, 10.1093/jamia/ocaa091 · DOI · Paper page
- Sadegh, 2020, Exploring the SARS-CoV-2 virus-host-drug interactome for drug repurposing, 10.1038/s41467-020-17189-2 · DOI · Paper page
- Seo, 2019, Real-time open-domain question answering with dense-sparse phrase index, 4430, 10.18653/v1/P19-1436 · DOI · Paper page
- Škrlj, 2019, Rakun: rank-based keyword extraction via unsupervised learning and meta vertex aggregation, 311, 10.1007/978-3-030-31372-2_26 · DOI
- Starr, 2009, The origins, evolution, and future of the cochrane database of systematic reviews, Int J Technol Assess Health Care, 25, 182, 10.1017/S026646230909062X · DOI · Paper page
- Dan, 2019, Generalizing question answering system with pre-trained language model fine-tuning, 203
- Su, 2020, CAiRE-COVID: a question answering and multi-document summarization system for COVID-19 research
- Sung, 2020, Biomedical entity representations with synonym marginalization, 10.18653/v1/2020.acl-main.335 · DOI · Paper page
- Taboureau, 2011, Chemprot: a disease chemical biology database, Nucleic Acids Res, 39, D367, 10.1093/nar/gkq906 · DOI
- Tabib, 2020, Interactive extractive search over biomedical corpora, 28, 10.18653/v1/2020.bionlp-1.3 · DOI
- Valenzuela-Escárcega, 2020, Odinson: a fast rule-based information extraction framework, 2183
- Voorhees, 2020, TREC-COVID: constructing a pandemic information retrieval test collection, SIGIR Forum, 54, 1, 10.1145/3451964.3451965 · DOI · Paper page
- Wadden, 2020, Fact or fiction: verifying scientific claims, 10.18653/v1/2020.emnlp-main.609 · DOI · Paper page
- Wang, 2020, CORD-19: the COVID-19 open research dataset
- Wang, 2020, EVIDENCEMINER: textual evidence discovery for life sciences, 56, 10.18653/v1/2020.acl-demos.8 · DOI
- Yaacoub, 2020, Safe management of bodies of deceased persons with suspected or confirmed COVID-19: a rapid systematic review, BMJ Glob Health, 5, 10.1136/bmjgh-2020-002650 · DOI
- Yang, 2017, Anserini: enabling the use of Lucene for information retrieval research, 1253, 10.1145/3077136.3080721 · DOI · Paper page
- Yang, 2020, Multilingual universal sentence encoder for semantic retrieval, 87, 10.18653/v1/2020.acl-demos.12 · DOI · Paper page
- Yongkiatpanich, 2019, Extractive text summarization using ontology and graph-based method, 105, 10.1109/CCOMS.2019.8821755 · DOI
- Zaki, 2020, The influence of comorbidity on the severity of COVID-19 disease: systematic review and analysis, medRxiv
- Zaki, 2020, Association of hypertension, diabetes, stroke, cancer, kidney disease, and high-cholesterol with COVID-19 disease severity and fatality: a systematic review, Diabetes Metab Syndr, 14, 1133, 10.1016/j.dsx.2020.07.005 · DOI · Paper page
- Zhang, 2020, Rapidly Deploying a Neural Search Engine for the COVID-19 Open Research Dataset: Preliminary Thoughts and Lessons Learned
- Zweigenbaum, 2007, Frontiers of biomedical text mining: current progress, Brief Bioinform, 8, 358, 10.1093/bib/bbm045 · DOI · Paper page
Cited by
(2023) · doi:10.21203/rs.3.rs-2856011/v1 · Cited by 145
Boetje, J., & van de Schoot, R. (2024) · Systematic Reviews · doi:10.1186/s13643-024-02502-7 · Cited by 146
“However, automation can be used to accelerate several steps in the process, particularly the screening phase [1, 13, 16, 23, 26, 31, 33, 34, 36, 43, 45, 48, 51].”
MethodLanguage models for materials discovery and sustainability: Progress, challenges, and opportunities
Pei, Z., Yin, J., & Zhang, J. (2025) · Progress in Materials Science · doi:10.1016/j.pmatsci.2025.101495 · Cited by 30
Large-scale simulation study of active learning models for systematic reviews
Teijema, J. J., de Bruin, J., Bagheri, A., & van de Schoot, R. (2025) · International Journal of Data Science and Analytics · doi:10.1007/s41060-025-00777-0 · Cited by 13
Simulation-based Active Learning for Systematic Reviews: A Scoping Review of Literature
Teijema, J. J., Ribeiro, G., Seuren, S., Anadria, D., Bagheri, A., & van de Schoot, R. (2023) · doi:10.31234/osf.io/67zmt · Cited by 10
Metadata
- Authors
- Wang, L. L., & Lo, K.
- Venue
- Briefings in Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2020-12-07
- Volume
- 22
- Issue
- 2
- Pages
- 781-799
- ISSN
- 1467-5463 (ISSN-L)
- 1477-4054
- OpenAlex
- W3111412136
- Cited by
- 116
- References
- 40
- FWCI
- 5.88
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.