The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Portable automatic text classification for adverse drug reaction detection via multi-corpus training
Open accessAbstract
OBJECTIVE: Automatic detection of adverse drug reaction (ADR) mentions from text has recently received significant interest in pharmacovigilance research. Current research focuses on various sources of text-based information, including social media-where enormous amounts of user posted data is available, which have the potential for use in pharmacovigilance if collected and filtered accurately. The aims of this study are: (i) to explore natural language processing (NLP) approaches for generating useful features from text, and utilizing them in optimized machine learning algorithms for automatic classification of ADR assertive text segments; (ii) to present two data sets that we prepared for the task of ADR detection from user posted internet data; and (iii) to investigate if combining training data from distinct corpora can improve automatic classification accuracies. METHODS: One of our three data sets contains annotated sentences from clinical reports, and the two other data sets, built in-house, consist of annotated posts from social media. Our text classification approach relies on generating a large set of features, representing semantic properties (e.g., sentiment, polarity, and topic), from short text nuggets. Importantly, using our expanded feature sets, we combine training data from different corpora in attempts to boost classification accuracies. RESULTS: Our feature-rich classification approach performs significantly better than previously published approaches with ADR class F-scores of 0.812 (previously reported best: 0.770), 0.538 and 0.678 for the three data sets. Combining training data from multiple compatible corpora further improves the ADR F-scores for the in-house data sets to 0.597 (improvement of 5.9 units) and 0.704 (improvement of 2.6 units) respectively. CONCLUSIONS: Our research results indicate that using advanced NLP techniques for generating information rich features from text can significantly improve classification accuracies over existing benchmarks. Our experiments illustrate the benefits of incorporating various semantic features such as topics, concepts, sentiments, and polarities. Finally, we show that integration of information from compatible corpora can significantly improve classification performance. This form of multi-corpus training may be particularly useful in cases where data sets are heavily imbalanced (e.g., social media data), and may reduce the time and costs associated with the annotation of data in the future.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
Blei, D. M., Ng, A. Y., & Jordan, M. I. (2002) · Advances in Neural Information Processing Systems 14 · doi:10.7551/mitpress/1120.003.0082 · Cited by 12,223
An algorithm for suffix stripping
Porter, M. F. (1980) · Program · doi:10.1108/eb046814 · Cited by 8,096
Text categorization with Support Vector Machines: Learning with many relevant features
Joachims, T. (1998) · Lecture Notes in Computer Science · doi:10.1007/bfb0026683 · Cited by 7,999
Thumbs up?: sentiment classification using machine learning techniques
Pang, B., Lee, L., & Vaithyanathan, S. (2002) · Proceedings of the ACL-02 conference on Empirical methods in natural language processing - EMNLP '02 · doi:10.3115/1118693.1118704 · Cited by 7,024
(2005) · PubMed · Cited by 7,011
Incidence of Adverse Drug Reactions in Hospitalized Patients: A Meta-analysis of Prospective Studies
Lazarou, J., Pomeranz, B. H., & Corey, P. N. (1998) · JAMA · doi:10.1001/jama.279.15.1200 · Cited by 4,807
Rajaraman, A., & Ullman, J. D. (2011) · Cambridge University Press eBooks · doi:10.1017/cbo9781139058452 · Cited by 2,262
Generating Typed Dependency Parses from Phrase Structure Parses
de Marneffe, M.-C., MacCartney, B., & Manning, C. D. (2006) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/3wtkaidk6ea8 · Cited by 2,258
Assessing Agreement on Classification Tasks: The Kappa Statistic
Carletta, J. (1996) · arXiv · doi:10.48550/arxiv.cmp-lg/9602004 · Cited by 2,088
Quantitative signal detection using spontaneous ADR reporting
Bate, A., & Evans, S. J. W. (2009) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.1742 · Cited by 912
A side effect resource to capture phenotypic effects of drugs
Kuhn, M., Campillos, M., Letunic, I., Jensen, L. J., & Bork, P. (2010) · Molecular Systems Biology · doi:10.1038/msb.2009.98 · Cited by 899
Who talks? The social psychology of illness support groups.
Davison, K. P., Pennebaker, J. W., & Dickerson, S. S. (2000) · American Psychologist · doi:10.1037//0003-066x.55.2.205 · Cited by 696
Improved Part-of-Speech Tagging for Online Conversational Text with Word Clusters
Owoputi, O., O'Connor, B., Dyer, C., Gimpel, K., Schneider, N., & Smith, N. A. (2018) · Figshare · doi:10.1184/r1/6473408 · Cited by 662
Gurulingappa, H., Rajput, A. M., Roberts, A., Fluck, J., Hofmann-Apitius, M., & Toldo, L. (2012) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2012.04.008 · Cited by 446
Novel Data-Mining Methodologies for Adverse Drug Event Discovery and Analysis
Harpaz, R., DuMouchel, W., Shah, N. H., Madigan, D., Ryan, P., & Friedman, C. (2012) · Clinical Pharmacology & Therapeutics · doi:10.1038/clpt.2012.50 · Cited by 393
More accurate tests for the statistical significance of result differences
Yeh, A. (2000) · Proceedings of the 18th conference on Computational linguistics - · doi:10.3115/992730.992783 · Cited by 378
Wang, X., Hripcsak, G., Markatou, M., & Friedman, C. (2009) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m3028 · Cited by 288
Digital Drug Safety Surveillance: Monitoring Pharmaceutical Products in Twitter
Freifeld, C. C., Brownstein, J. S., Menone, C. M., Bao, W., Filice, R., Kass-Hout, T., & Dasgupta, N. (2014) · Drug Safety · doi:10.1007/s40264-014-0155-x · Cited by 267
Leaman, R., Wojtulewicz, L. B., Sullivan, R., Skariah, A. M., Yang, J. G., & Gonzalez‐Hernandez, G. (2010) · Cited by 256
Adverse drug event monitoring at the food and drug administration: Your report can make a difference
Ahmad, S. R. (2003) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2003.20130.x · Cited by 249
Extraction of potential adverse drug events from medical case reports
Gurulingappa, H., Mateen‐Rajpu, A., & Toldo, L. (2012) · Journal of Biomedical Semantics · doi:10.1186/2041-1480-3-15 · Cited by 211
Harpaz, R., Vilar, S., DuMouchel, W., Salmasian, H., Haerian, K., Shah, N. H., Chase, H. S., & Friedman, C. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2012-000930 · Cited by 173
Identifying potential adverse effects using the web: A new approach to medical hypothesis generation
Benton, A., Ungar, L., Hill, S., Hennessy, S., Mao, J., Chung, A., Leonard, C. E., & Holmes, J. H. (2011) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2011.07.005 · Cited by 171
Predicting adverse drug events from personal health messages.
Chee, B. W., Berlin, R. B., & Schatz, B. R. (2011) · PubMed · Cited by 157
Pattern mining for extraction of mentions of Adverse Drug Reactions from user comments.
Nikfarjam, A., & Gonzalez‐Hernandez, G. (2011) · PubMed · Cited by 154
Data mining for signals in spontaneous reporting databases: proceed with caution
Stephenson, W. P., & Hauben, M. (2006) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.1323 · Cited by 147
Social media mining for drug safety signal detection
Yang, C. C., Yang, H., Jiang, L., & Zhang, M. (2012) · doi:10.1145/2389707.2389714 · Cited by 141
Extraction of Adverse Drug Effects from Clinical Records
Aramaki, E., Miura, Y., Tonoike, M., Ohkuma, T., Masuichi, H., Waki, K., & Ohe, K. (2010) · Studies in health technology and informatics · doi:10.3233/978-1-60750-588-4-739 · Cited by 130
Tuarob, S., Tucker, C. S., Salathé, M., & Ram, N. (2014) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2014.03.005 · Cited by 128
Extending the NegEx lexicon for multiple languages.
Chapman, W. W., Hillert, D. G., Velupillai, S. U., Kvist, M., Skeppstedt, M., Chapman, B. E., Conway, M., Tharp, M., Mowery, D. L., & Deléger, L. (2013) · PubMed · Cited by 120
Analysis of polarity information in medical text.
Niu, Y., Zhu, X., Li, J., & Hirst, G. (2005) · PubMed · Cited by 112
Liu, X., & Chen, H. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-39844-5_16 · Cited by 110
Sentiment Analysis: How to Derive Prior Polarities from SentiWordNet
Guerini, M., Gatti, L., & Turchi, M. (2013) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d13-1125 · Cited by 98
Using information mining of the medical literature to improve drug safety
Shetty, K. D., & Dalal, S. R. (2011) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000096 · Cited by 91
Xu, R., & Wang, Q. (2014) · BMC Bioinformatics · doi:10.1186/1471-2105-15-17 · Cited by 85
Matthews, E. J., Ursem, C. J., Kruhlak, N. L., Benz, R. D., Sabaté, D., Yang, C., Klopman, G., & Contrera, J. F. (2009) · Regulatory Toxicology and Pharmacology · doi:10.1016/j.yrtph.2009.01.009 · Cited by 75
Mining Twitter Data for Potential Drug Effects
Jiang, K., & Zheng, Y. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-53914-5_37 · Cited by 68
Vilar, S., Harpaz, R., Chase, H. S., Costanzi, S., Rabadán, R., & Friedman, C. (2011) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000417 · Cited by 64
A pipeline to extract drug-adverse event pairs from multiple data sources
Yeleswarapu, S. J., Rao, A., Joseph, T., et al. (2014) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-14-13 · Cited by 58
Friedman, C. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-02976-9_1 · Cited by 56
Mainous, A. G., Eschenbach, S. L., Wells, B. J., Everett, C. J., & Gill, J. M. (2005) · PubMed · Cited by 51
An Approach for Query-Focused Text Summarisation for Evidence Based Medicine
Sarker, A., Mollá, D., & Paris, C. L. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-38326-7_41 · Cited by 19
Self-citationWadman, M. (2005) · Nature Medicine · doi:10.1038/nm0505-465 · Cited by 14
(2001) · doi:10.1002/pds.4850 · Cited by 7
Automatic Prediction of Evidence-based Recommendations via Sentence-level Polarity Classification
Sarker, A., Mollá, D., & Paris, C. L. (2013) · International Joint Conference on Natural Language Processing · Cited by 4
Self-citation
Cited by
Clinical information extraction applications: A literature review
Wang, Y., Wang, L., Rastegar-Mojarad, M., Moon, S., Shen, F., Afzal, N., Liu, S., Zeng, Y., Mehrabi, S., Sohn, S., et al. (2018) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2017.11.011 · Cited by 910
Nikfarjam, A., Sarker, A., O’Connor, K., Ginn, R., & Gonzalez, G. (2015) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocu041 · Cited by 543
Self-citationUtilizing social media data for pharmacovigilance: A review
Sarker, A., Ginn, R., Nikfarjam, A., O’Connor, K., Smith, K., Jayaraman, S., Upadhaya, T., & Gonzalez, G. (2015) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2015.02.004 · Cited by 497
Self-citationA Systematic Review on Imbalanced Data Challenges in Machine Learning: Applications and Solutions
Kaur, H., Pannu, H. S., & Malhi, A. K. (2020) · ACM Computing Surveys · doi:10.1145/3343440 · Cited by 488
Natural Language Processing in Oncology: A Review
Yim, W.-W., Yetisgen, M., Harris, W. P., & Kwan, S. W. (2016) · JAMA Oncology · doi:10.1001/jamaoncol.2016.0213 · Cited by 298
Metadata
- Authors
- Sarker, A., & Gonzalez, G.
- Venue
- Journal of Biomedical Informatics
- Publisher
- Elsevier BV
- Published
- 2015-02
- Volume
- 53
- Pages
- 196-207
- ISSN
- 1532-0464 (ISSN-L)
- OpenAlex
- W2071478164
- Cited by
- 356
- References
- 47
- FWCI
- 40.31
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.