CoChat

Text mining approaches for dealing with the rapidly expanding literature on COVID-19

Open access
Wang, Lucy Lu, Lo, Kyle · 2021 · Briefings in Bioinformatics
Cited by 116

The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.

Abstract

More than 50 000 papers have been published about COVID-19 since the beginning of 2020 and several hundred new papers continue to be published every day. This incredible rate of scientific productivity leads to information overload, making it difficult for researchers, clinicians and public health officials to keep up with the latest findings. Automated text mining techniques for searching, reading and summarizing papers are helpful for addressing information overload. In this review, we describe the many resources that have been introduced to support text mining applications over the COVID-19 literature; specifically, we discuss the corpora, modeling resources, systems and shared tasks that have been introduced for COVID-19. We compile a list of 39 systems that provide functionality such as search, discovery, visualization and summarization over the COVID-19 literature. For each system, we provide a qualitative description and assessment of the system’s performance, unique data or user interface features and modeling decisions. Many systems focus on search and discovery, though several systems provide novel features, such as the ability to summarize findings over multiple documents or linking between scientific articles and clinical trials. We also describe the public corpora, models and shared tasks that have been introduced to help reduce repeated effort among community members; some of these resources (especially shared tasks) can provide a basis for comparing the performance of different systems. Finally, we summarize promising results and open challenges for text mining the COVID-19 literature.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1093/bib/bbaa296

Cites

40 of 40 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 40 references

Research works printed but not linked: 66

  1. Almeida, 2020, Calling attention to passages for biomedical question answering, 69
  2. Ananiadou, 2006, Text mining and its potential applications in systems biology, Trends Biotechnol, 24, 571, 10.1016/j.tibtech.2006.10.002 · DOI · Paper page
  3. ASReview Core Development Team, 2019, ASReview: Active Learning for Systematic Reviews
  4. Bhatia, 2019, Comprehend medical: a named entity recognition and relationship extraction web service, 1844, 10.1109/ICMLA.2019.00297 · DOI
  5. Bodenreider, 2004, The unified medical language system (UMLS): integrating biomedical terminology, Nucleic Acids Res, 32, D267, 10.1093/nar/gkh061 · DOI · Paper page
  6. Bravo, 2015, Extraction of relations between genes and diseases from text and large-scale data analysis: implications for translational research, BMC Bioinform, 16, 10.1186/s12859-015-0472-9 · DOI · Paper page
  7. Camacho-Collados, 2018, From word to sense embeddings: a survey on vector representations of meaning, J Artif Intell Res, 63, 743, 10.1613/jair.1.11259 · DOI · Paper page
  8. Campos, 2016, MS MARCO: a human generated machine reading comprehension dataset
  9. Chen, 2019, BioSentVec: creating sentence embeddings for biomedical texts, 1, 10.1109/ICHI.2019.8904728 · DOI · Paper page
  10. Cohen, 2005, A survey of current work in biomedical text mining, Brief Bioinform, 6, 57, 10.1093/bib/6.1.57 · DOI · Paper page
  11. Crisan-Dabija, 2020, Tuberculosis and COVID-19 in 2020: lessons from the past viral outbreaks and possible future outcomes, Canadian Respiratory Journal, 2020, 10.1155/2020/1401053 · DOI
  12. Danesh, 2015, SGRank: combining statistical and graphical methods to improve the state of the art in unsupervised keyphrase extraction, 117, 10.18653/v1/S15-1013 · DOI
  13. de Bruijn, 2008, Automated information extraction of key trial design elements from clinical trial publications, AMIA Annu Symp Proc, 141
  14. Demner-Fushman, 2017, MetaMap Lite: an evaluation of a new Java implementation of MetaMap, J Am Med Inform Assoc, 24, 841, 10.1093/jamia/ocw177 · DOI · Paper page
  15. Dinh, 2015, Network clustering via maximizing modularity: approximation algorithms and theoretical limits, 101, 10.1109/ICDM.2015.139 · DOI
  16. El-shafeey, 2020, A systematic scoping review of COVID-19 during pregnancy and childbirth, Int J Gynaecol Obstet, 150, 47, 10.1002/ijgo.13182 · DOI · Paper page
  17. Espinosa-Anke, 2018, SeVeN: augmenting word embeddings with unsupervised relation vectors, 2653
  18. Yang, 2020, Who is more susceptible to COVID-19 infection and mortality in the states?, medRxiv, 10.1101/2020.05.01.20087403 · DOI
  19. Hoang, 2020, COVID-19 in 7780 pediatric patients: a systematic review, EClinicalMedicine, 24, 100433, 10.1016/j.eclinm.2020.100433 · DOI · Paper page
  20. Hope, 2020, SciSight: combining faceted navigation and research group detection for COVID-19 exploratory scientific search, Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations. Online
  21. Huang, 2016, Community challenges in biomedical text mining over 10 years: success, failure and the future, Brief Bioinform, 17, 132, 10.1093/bib/bbv024 · DOI · Paper page
  22. Huang, 2020, CODA-19: reliably annotating research aspects on 10,000+ CORD-19 abstracts using a non-expert crowd
  23. Ilievski, 2020, KGTK: a toolkit for large knowledge graph manipulation and analysis, 10.1007/978-3-030-62466-8_18 · DOI
  24. Kim, 2019, A neural named entity recognition and multi-type normalization tool for biomedical text mining, IEEE Access, 7, 73729, 10.1109/ACCESS.2019.2920708 · DOI
  25. Köksal, 2020, Vapur: a search engine to find related protein—compound pairs in COVID-19 literature, 10.1101/2020.09.05.284224 · doi:10.1101/2020.09.05.284224
  26. Korn, 2020, COVID-KOP: integrating emerging COVID-19 data with the ROBOKOP database, ChemRxiv
  27. Lan, 2020, ALBERT: a lite BERT for self-supervised learning of language representations
  28. Lee, 2020, Answering questions on COVID-19 in real-time, 10.18653/v1/2020.nlpcovid19-2.1 · DOI
  29. Lee, 2016, BEST: next-generation biomedical entity search tool for knowledge discovery from biomedical literature, PLoS One, 11
  30. Lin, 2006, Will pyramids built of nuggets topple over, 383
  31. McDonald, 2018, Deep relevance ranking using enhanced document-query interactions, 10.18653/v1/D18-1211 · DOI
  32. Mikolov, Distributed representations of words and phrases and their compositionality
  33. Nance, 2020, Stepping up to the CORD-19 challenge: a semi-automated rapid review workflow for literature related to COVID-19 and blood clotting
  34. Neumann, 2019, ScispaCy: fast and robust models for biomedical natural language processing, 319, 10.18653/v1/W19-5034 · DOI · Paper page
  35. Newman-Griffis, 2018, Jointly embedding entities and text with distant supervision, 195, 10.18653/v1/W18-3026 · DOI
  36. Nye, 2020, Trialstreamer: mapping and browsing medical evidence in real-time, 63, 10.18653/v1/2020.acl-demos.9 · DOI · Paper page
  37. Oniani, 2020, Constructing co-occurrence network embeddings to assist association extraction for COVID-19 and other coronavirus infectious diseases, J Am Med Inform Assoc, 27, 1259, 10.1093/jamia/ocaa117 · DOI
  38. Panahi, 2020, Clinical characteristics of COVID-19 infection in newborns and pediatrics: a systematic review, Arch Acad Emerg Med, 8
  39. Parasa, 2020, Prevalence of gastrointestinal symptoms and fecal viral shedding in patients with coronavirus disease 2019, JAMA Netw Open, 3, 10.1001/jamanetworkopen.2020.11335 · DOI · Paper page
  40. Poerner, Inexpensive domain adaptation of pretrained language models: case studies on biomedical NER and COVID-19 QA, 10.18653/v1/2020.findings-emnlp.134 · DOI
  41. Popa, 2020, COVID-19 and inflammatory bowel diseases: risk assessment, shared molecular pathways and therapeutic challenges, Gastroenterol Res Pract, 2020, 10.1155/2020/1918035 · DOI
  42. Portenoy, 2020, Constructing and evaluating automated literature review systems, Scientometrics, 1
  43. Reimers, 2019, Sentence-BERT: sentence embeddings using Siamese BERT-networks, 3982, 10.18653/v1/D19-1410 · DOI · Paper page
  44. Roberts, 2020, TREC-COVID: rationale and structure of an information retrieval shared task for COVID-19, J Am Med Inform Assoc, 27, 1431, 10.1093/jamia/ocaa091 · DOI · Paper page
  45. Sadegh, 2020, Exploring the SARS-CoV-2 virus-host-drug interactome for drug repurposing, 10.1038/s41467-020-17189-2 · DOI · Paper page
  46. Seo, 2019, Real-time open-domain question answering with dense-sparse phrase index, 4430, 10.18653/v1/P19-1436 · DOI · Paper page
  47. Škrlj, 2019, Rakun: rank-based keyword extraction via unsupervised learning and meta vertex aggregation, 311, 10.1007/978-3-030-31372-2_26 · DOI
  48. Starr, 2009, The origins, evolution, and future of the cochrane database of systematic reviews, Int J Technol Assess Health Care, 25, 182, 10.1017/S026646230909062X · DOI · Paper page
  49. Dan, 2019, Generalizing question answering system with pre-trained language model fine-tuning, 203
  50. Su, 2020, CAiRE-COVID: a question answering and multi-document summarization system for COVID-19 research
  51. Sung, 2020, Biomedical entity representations with synonym marginalization, 10.18653/v1/2020.acl-main.335 · DOI · Paper page
  52. Taboureau, 2011, Chemprot: a disease chemical biology database, Nucleic Acids Res, 39, D367, 10.1093/nar/gkq906 · DOI
  53. Tabib, 2020, Interactive extractive search over biomedical corpora, 28, 10.18653/v1/2020.bionlp-1.3 · DOI
  54. Valenzuela-Escárcega, 2020, Odinson: a fast rule-based information extraction framework, 2183
  55. Voorhees, 2020, TREC-COVID: constructing a pandemic information retrieval test collection, SIGIR Forum, 54, 1, 10.1145/3451964.3451965 · DOI · Paper page
  56. Wadden, 2020, Fact or fiction: verifying scientific claims, 10.18653/v1/2020.emnlp-main.609 · DOI · Paper page
  57. Wang, 2020, CORD-19: the COVID-19 open research dataset
  58. Wang, 2020, EVIDENCEMINER: textual evidence discovery for life sciences, 56, 10.18653/v1/2020.acl-demos.8 · DOI
  59. Yaacoub, 2020, Safe management of bodies of deceased persons with suspected or confirmed COVID-19: a rapid systematic review, BMJ Glob Health, 5, 10.1136/bmjgh-2020-002650 · DOI
  60. Yang, 2017, Anserini: enabling the use of Lucene for information retrieval research, 1253, 10.1145/3077136.3080721 · DOI · Paper page
  61. Yang, 2020, Multilingual universal sentence encoder for semantic retrieval, 87, 10.18653/v1/2020.acl-demos.12 · DOI · Paper page
  62. Yongkiatpanich, 2019, Extractive text summarization using ontology and graph-based method, 105, 10.1109/CCOMS.2019.8821755 · DOI
  63. Zaki, 2020, The influence of comorbidity on the severity of COVID-19 disease: systematic review and analysis, medRxiv
  64. Zaki, 2020, Association of hypertension, diabetes, stroke, cancer, kidney disease, and high-cholesterol with COVID-19 disease severity and fatality: a systematic review, Diabetes Metab Syndr, 14, 1133, 10.1016/j.dsx.2020.07.005 · DOI · Paper page
  65. Zhang, 2020, Rapidly Deploying a Neural Search Engine for the COVID-19 Open Research Dataset: Preliminary Thoughts and Lessons Learned
  66. Zweigenbaum, 2007, Frontiers of biomedical text mining: current progress, Brief Bioinform, 8, 358, 10.1093/bib/bbm045 · DOI · Paper page

Cited by

Metadata

Authors
Wang, L. L., & Lo, K.
Venue
Briefings in Bioinformatics
Published
2020-12-07
Volume
22
Issue
2
Pages
781-799
ISSN
  • 1467-5463 (ISSN-L)
  • 1477-4054
OpenAlex
W3111412136
Cited by
116
References
40
FWCI
5.88
Type
journal article
Language
en
Open access
hybrid

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.