Utilizing social media data for pharmacovigilance: A review
Open accessThe DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: Automatic monitoring of Adverse Drug Reactions (ADRs), defined as adverse patient outcomes caused by medications, is a challenging research problem that is currently receiving significant attention from the medical informatics community. In recent years, user-posted data on social media, primarily due to its sheer volume, has become a useful resource for ADR monitoring. Research using social media data has progressed using various data sources and techniques, making it difficult to compare distinct systems and their performances. In this paper, we perform a methodical review to characterize the different approaches to ADR detection/extraction from social media, and their applicability to pharmacovigilance. In addition, we present a potential systematic pathway to ADR monitoring from social media. METHODS: We identified studies describing approaches for ADR detection from social media from the Medline, Embase, Scopus and Web of Science databases, and the Google Scholar search engine. Studies that met our inclusion criteria were those that attempted to extract ADR information posted by users on any publicly available social media platform. We categorized the studies according to different characteristics such as primary ADR detection approach, size of corpus, data source(s), availability, and evaluation criteria. RESULTS: Twenty-two studies met our inclusion criteria, with fifteen (68%) published within the last two years. However, publicly available annotated data is still scarce, and we found only six studies that made the annotations used publicly available, making system performance comparisons difficult. In terms of algorithms, supervised classification techniques to detect posts containing ADR mentions, and lexicon-based approaches for extraction of ADR mentions from texts have been the most popular. CONCLUSION: Our review suggests that interest in the utilization of the vast amounts of available social media data for ADR monitoring is increasing. In terms of sources, both health-related and general social media data have been used for ADR detection-while health-related sources tend to contain higher proportions of relevant data, the volume of data from general social media websites is significantly higher. There is still very limited amount of annotated data publicly available , and, as indicated by the promising results obtained by recent supervised learning approaches, there is a strong need to make such data available to the research community.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Incidence of Adverse Drug Reactions in Hospitalized Patients: A Meta-analysis of Prospective Studies
Lazarou, J., Pomeranz, B. H., & Corey, P. N. (1998) · JAMA · doi:10.1001/jama.279.15.1200 · Cited by 4,807
Knowledge Discovery in Databases
Piateski, G., & Frawley, W. (1991) · The MIT Press eBooks · Cited by 1,749
Social media use in the United States: implications for health communication
Chou, W.-Y. S., Hunt, Y. M., Beckjord, E. B., Moser, R. P., & Hesse, B. W. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1249 · Cited by 1,082
Knowledge discovery in databases
FrawleyWilliam, J., Piatetsky-ShapiroGregory, & MatheusChristopher, J. (1992) · AI Magazine · doi:10.5555/140629.140633 · Cited by 1,055
Improved Part-of-Speech Tagging for Online Conversational Text with Word Clusters
Owoputi, O., O'Connor, B., Dyer, C., Gimpel, K., Schneider, N., & Smith, N. A. (2018) · Figshare · doi:10.1184/r1/6473408 · Cited by 662
Nikfarjam, A., Sarker, A., O’Connor, K., Ginn, R., & Gonzalez, G. (2015) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocu041 · Cited by 543
Self-citationNovel Data-Mining Methodologies for Adverse Drug Event Discovery and Analysis
Harpaz, R., DuMouchel, W., Shah, N. H., Madigan, D., Ryan, P., & Friedman, C. (2012) · Clinical Pharmacology & Therapeutics · doi:10.1038/clpt.2012.50 · Cited by 393
Portable automatic text classification for adverse drug reaction detection via multi-corpus training
Sarker, A., & Gonzalez, G. (2015) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2014.11.002 · Cited by 356
Self-citationLeaman, R., Wojtulewicz, L. B., Sullivan, R., Skariah, A. M., Yang, J. G., & Gonzalez‐Hernandez, G. (2010) · Cited by 337
Digital Drug Safety Surveillance: Monitoring Pharmaceutical Products in Twitter
Freifeld, C. C., Brownstein, J. S., Menone, C. M., Bao, W., Filice, R., Kass-Hout, T., & Dasgupta, N. (2014) · Drug Safety · doi:10.1007/s40264-014-0155-x · Cited by 267
VELASCO, E., AGHENEZA, T., DENECKE, K., KIRCHNER, G., & ECKMANNS, T. (2014) · The Milbank Quarterly · doi:10.1111/1468-0009.12038 · Cited by 256
Adverse drug event monitoring at the food and drug administration: Your report can make a difference
Ahmad, S. R. (2003) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2003.20130.x · Cited by 249
Towards large-scale twitter mining for drug-related adverse events
Bian, J., Topaloglu, U., & Yu, F. (2012) · Proceedings of the 2012 international workshop on Smart health and wellbeing · doi:10.1145/2389707.2389713 · Cited by 247
MedWatch: The FDA Safety Information and Adverse Event Reporting Program
Craigle, V. (2007) · Journal of the Medical Library Association · doi:10.3163/1536-5050.95.2.224 · Cited by 227
Text Mining for Adverse Drug Events: the Promise, Challenges, and State of the Art
Harpaz, R., Callahan, A., Tamang, S., Low, Y., Odgers, D., Finlayson, S., Jung, K., LePendu, P., & Shah, N. H. (2014) · Drug Safety · doi:10.1007/s40264-014-0218-z · Cited by 222
Detection, verification, and quantification of adverse drug reactions
Stricker, B. H., & Psaty, B. M. (2004) · BMJ · doi:10.1136/bmj.329.7456.44 · Cited by 221
The Wisdom of Patients: Health Care Meets Online Social Media
Sarasohn-Kahn, J. (2008) · Issue Lab (Candid) · Cited by 213
Extraction of potential adverse drug events from medical case reports
Gurulingappa, H., Mateen‐Rajpu, A., & Toldo, L. (2012) · Journal of Biomedical Semantics · doi:10.1186/2041-1480-3-15 · Cited by 211
Predicting adverse drug events from personal health messages.
Chee, B. W., Berlin, R. B., & Schatz, B. R. (2011) · PubMed · Cited by 181
Identifying potential adverse effects using the web: A new approach to medical hypothesis generation
Benton, A., Ungar, L., Hill, S., Hennessy, S., Mao, J., Chung, A., Leonard, C. E., & Holmes, J. H. (2011) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2011.07.005 · Cited by 171
An Exploration of Social Circles and Prescription Drug Abuse Through Twitter
Hanson, C. L., Cannon, B., Burton, S. H., & Giraud-Carrier, C. G. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2741 · Cited by 170
Kass‐Hout, T., & Alhinnawi, H. (2013) · British Medical Bulletin · doi:10.1093/bmb/ldt028 · Cited by 170
Pattern mining for extraction of mentions of Adverse Drug Reactions from user comments.
Nikfarjam, A., & Gonzalez‐Hernandez, G. (2011) · PubMed · Cited by 154
Self-citationPharmacovigilance on twitter? Mining tweets for adverse drug reactions.
O’Connor, K., Pimpalkhute, P., Nikfarjam, A., Ginn, R., Smith, K. L., & Gonzalez‐Hernandez, G. (2014) · PubMed · Cited by 148
Self-citationSocial media mining for drug safety signal detection
Yang, C. C., Yang, H., Jiang, L., & Zhang, M. (2012) · doi:10.1145/2389707.2389714 · Cited by 141
FDA adverse event reporting system (FAERS)
正博, 頭. (2015) · ファルマシア · doi:10.14894/faruawpsj.51.7_682_3 · Cited by 138
Tuarob, S., Tucker, C. S., Salathé, M., & Ram, N. (2014) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2014.03.005 · Cited by 128
Liu, X., & Chen, H. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-39844-5_16 · Cited by 126
Mining Adverse Drug Reactions from online healthcare forums using Hidden Markov Model
Sampathkumar, H., Chen, X.-W., & Luo, B. (2014) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-14-91 · Cited by 114
Struik, L. L., & Baskerville, N. B. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3189 · Cited by 105
Xu, R., & Wang, Q. (2014) · BMC Bioinformatics · doi:10.1186/1471-2105-15-17 · Cited by 94
Mining Twitter Data for Potential Drug Effects
Jiang, K., & Zheng, Y. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-53914-5_37 · Cited by 86
A pipeline to extract drug-adverse event pairs from multiple data sources
Yeleswarapu, S. J., Rao, A., Joseph, T., Saipradeep, V. G., & Srinivasan, R. (2014) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-14-13 · Cited by 67
Social Media Analytics for Smart Health
Abbasi, A., Adjeroh, D., Dredze, M. H., Paul, M. J., Zahedi, F. M., Zhao, H., Walia, N., Jain, H. K., Sanvanson, P. P., Shaker, R., et al. (2014) · IEEE Intelligent Systems · doi:10.1109/mis.2014.29 · Cited by 58
Using Web and Social Media for Influenza Surveillance
Corley, C. D., Cook, D. J., Mikler, A. R., & Singh, K. P. (2010) · Advances in experimental medicine and biology · doi:10.1007/978-1-4419-5913-3_61 · Cited by 55
A systematic review to evaluate the accuracy of electronic adverse drug event detection
Forster, A. J., Jennings, A., Chow, C., Leeder, C., & van Walraven, C. (2011) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000454 · Cited by 55
A Fast and Efficient Algorithm for Mapping Short Sequences to a Reference Genome
Antoniou, P., Iliopoulos, C. S., Mouchard, L., & Pissis, S. P. (2010) · Advances in experimental medicine and biology · doi:10.1007/978-1-4419-5913-3_45 · Cited by 32
Using Social Media and Internet Data for Public Health Surveillance: The Importance of Talking
Hartley, D. (2014) · Milbank Quarterly · doi:10.1111/1468-0009.12039 · Cited by 22
(2001) · doi:10.1002/pds.4850 · Cited by 7
Cited by
Twitter as a Tool for Health Research: A Systematic Review
Sinnenberg, L., Buttenheim, A. M., Padrez, K., Mancheno, C., Ungar, L., & Merchant, R. M. (2017) · American Journal of Public Health · doi:10.2105/ajph.2016.303512 · Cited by 634
Artificial Intelligence for Drug Toxicity and Safety
Basile, A. O., Yahi, A., & Tatonetti, N. P. (2019) · Trends in Pharmacological Sciences · doi:10.1016/j.tips.2019.07.005 · Cited by 363
Charles-Smith, L. E., Reynolds, T. L., Cameron, M. A., Conway, M., Lau, E. H. Y., Olsen, J. M., Pavlin, J. A., Shigematsu, M., Streichert, L. C., Suda, K. J., et al. (2015) · PLOS ONE · doi:10.1371/journal.pone.0139701 · Cited by 324
Utilizing graph machine learning within drug discovery and development
Gaudelet, T., Day, B., Jamasb, A. R., Soman, J., Regep, C., Liu, G., Hayter, J. B. R., Vickers, R., Roberts, C., Tang, J., et al. (2021) · Briefings in Bioinformatics · doi:10.1093/bib/bbab159 · Cited by 313
Information retrieval and text mining technologies for chemistry
Krallinger, M., Rabal, O., Lourenço, A., Oyarzabal, J., & Valencia, A. (2017) · Chemical Reviews · doi:10.1021/acs.chemrev.6b00851 · Cited by 281
Metadata
- Authors
- Sarker, A., Ginn, R., Nikfarjam, A., O’Connor, K., Smith, K., Jayaraman, S., Upadhaya, T., & Gonzalez, G.
- Venue
- Journal of Biomedical Informatics
- Publisher
- Elsevier BV
- Published
- 2015-04
- Volume
- 54
- Pages
- 202-212
- ISSN
- 1532-0464 (ISSN-L)
- OpenAlex
- W2102742655
- Cited by
- 497
- References
- 39
- FWCI
- 102.88
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.