Cited by 74Biomedical Text Mining and OntologiesTopic ModelingMachine Learning in Healthcare

Identifying relations of medications with adverse drug events using recurrent convolutional neural networks and gradient boosting

Open access
Yang, Xi, Bian, Jiang, Fang, Ruogu, Bjarnadottir, Ragnhildur I, Hogan, William R, Wu, Yonghui·2020·Journal of the American Medical Informatics Association

Abstract

Objective: To develop a natural language processing system that identifies relations of medications with adverse drug events from clinical narratives. This project is part of the 2018 n2c2 challenge. Materials and Methods: We developed a novel clinical named entity recognition method based on an recurrent convolutional neural network and compared it to a recurrent neural network implemented using the long-short term memory architecture, explored methods to integrate medical knowledge as embedding layers in neural networks, and investigated 3 machine learning models, including support vector machines, random forests and gradient boosting for relation classification. The performance of our system was evaluated using annotated data and scripts provided by the 2018 n2c2 organizers. Results: Our system was among the top ranked. Our best model submitted during this challenge (based on recurrent neural networks and support vector machines) achieved lenient F1 scores of 0.9287 for concept extraction (ranked third), 0.9459 for relation classification (ranked fourth), and 0.8778 for the end-to-end relation extraction (ranked second). We developed a novel named entity recognition model based on a recurrent convolutional neural network and further investigated gradient boosting for relation classification. The new methods improved the lenient F1 scores of the 3 subtasks to 0.9292, 0.9633, and 0.8880, respectively, which are comparable to the best performance reported in this challenge. Conclusion: This study demonstrated the feasibility of using machine learning methods to extract the relations of medications with adverse drug events from clinical narratives.

Integrity signals

Registry

Crossref · 10.1093/jamia/ocz144

Cites

44 of 44 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Cites

Flagged first, then by citations

2 of the 46 references couldn’t be matched to a known paper.

Cited by

Sorted by citations

Authors
Yang, X., Bian, J., Fang, R., Bjarnadottir, R. I., Hogan, W. R., & Wu, Y.
Affiliations
  • University of Florida Health (US)
  • University of Florida (US)
  • Department of Family, Community and Health Systems Science, College of Nursing, University of Florida, Gainesville, Florida, USA
Corresponding author
Wu, Yonghui
Venue
Journal of the American Medical Informatics Association
Published
2019-08-28
Volume
27
Issue
1
Pages
65-72
ISSN
  • 1067-5027 (ISSN-L)
  • 1527-974X
OpenAlex
W2970198438
Cited by
74
References
46
Citations by year
2026: 4 · 2025: 12 · 2024: 13 · 2023: 14 · 2022: 11 · 2021: 12 · 2020: 7 · 2019: 1
FWCI
2.56
Type
journal article
Language
en
Open access
Locations
  • Journal of the American Medical Informatics Association (publishedVersion)
  • PubMed Central (publishedVersion)
  • PubMed (publishedVersion)
Funders
  • University of Florida Clinical
  • Translational Science Institute
  • NIH National Center for Advancing Translational Sciences (UL1TR001427, NIA R21AG062884)
  • NIH
Topics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Biomedical Text Mining and Ontologies
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
  • Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
Keywords
adverse drug reactions, medical named entity recognition, recurrent convolutional neural network, gradient boosting, relation classification, clinical text mining, long short-term memory
MeSH terms
Deep Learning, Humans, Natural Language Processing, Information Storage and Retrieval, Neural Networks, Computer, Narration, Electronic Health Records, Drug-Related Side Effects and Adverse Reactions

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review