The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Pharmacovigilance from social media: mining adverse drug reaction mentions using sequence labeling with word embedding cluster features
Open accessAbstract
Objective Social media is becoming increasingly popular as a platform for sharing personal health-related information. This information can be utilized for public health monitoring tasks, particularly for pharmacovigilance, via the use of natural language processing (NLP) techniques. However, the language in social media is highly informal, and user-expressed medical concepts are often nontechnical, descriptive, and challenging to extract. There has been limited progress in addressing these challenges, and thus far, advanced machine learning-based NLP techniques have been underutilized. Our objective is to design a machine learning-based approach to extract mentions of adverse drug reactions (ADRs) from highly informal text in social media. Methods We introduce ADRMine, a machine learning-based concept extraction system that uses conditional random fields (CRFs). ADRMine utilizes a variety of features, including a novel feature for modeling words’ semantic similarities. The similarities are modeled by clustering words based on unsupervised, pretrained word representation vectors (embeddings) generated from unlabeled user posts in social media using a deep learning technique. Results ADRMine outperforms several strong baseline systems in the ADR extraction task by achieving an F-measure of 0.82. Feature analysis demonstrates that the proposed word cluster features significantly improve extraction performance. Conclusion It is possible to extract complex medical concepts, with relatively high performance, from informal, user-generated content. Our approach is particularly scalable, suitable for social media mining, as it relies on large volumes of unlabeled data, thus diminishing the need for large, annotated training data sets.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
WordNet: a lexical database for English
Miller, G. A. (1995) · Communications of the ACM · doi:10.1145/219717.219748 · Cited by 14,015
Text categorization with Support Vector Machines: Learning with many relevant features
Joachims, T. (1998) · Lecture Notes in Computer Science · doi:10.1007/bfb0026683 · Cited by 7,999
(2005) · PubMed · Cited by 7,011
Advances in kernel methods: support vector learning
Schölkopf, B., Burges, C. J. C., & Smola, A. J. (1999) · doi:10.5555/299094 · Cited by 5,789
Natural Language Processing (almost) from Scratch
Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., & Kuksa, P. P. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1103.0398 · Cited by 4,962
Making Large-Scale SVM Learning Practical
Joachims, T. (1998) · RePEc: Research Papers in Economics · doi:10.17877/de290r-14262 · Cited by 4,411
Deep Learning: Methods and Applications
Deng, L., & Yu, D. (2014) · Foundations and Trends® in Signal Processing · doi:10.1561/2000000039 · Cited by 3,480
Adverse drug reactions as cause of admission to hospital: prospective analysis of 18 820 patients
Pirmohamed, M., James, S., Meakin, S., Green, C., Scott, A. K., Walley, T. J., Farrar, K., Park, B. K., & Breckenridge, A. M. (2004) · BMJ · doi:10.1136/bmj.329.7456.15 · Cited by 3,230
Accurate unlexicalized parsing
Klein, D., & Manning, C. D. (2003) · Proceedings of the 41st Annual Meeting on Association for Computational Linguistics - ACL '03 · doi:10.3115/1075096.1075150 · Cited by 3,008
A neural probabilistic language model
BengioYoshua, DucharmeRéjean, VincentPascal, & JanvinChristian (2003) · Journal of Machine Learning Research · doi:10.5555/944919.944966 · Cited by 2,644
Under-Reporting of Adverse Drug Reactions: A Systematic Review
Hazell, L., & Shakir, S. A. W. (2006) · Drug Safety · doi:10.2165/00002018-200629050-00003 · Cited by 1,931
(2010) · Cited by 1,906
Named Entity Recognition in Tweets: An Experimental Study
Ritter, A., Clark, S., & Etzioni, O. (2011) · Cited by 1,181
A side effect resource to capture phenotypic effects of drugs
Kuhn, M., Campillos, M., Letunic, I., Jensen, L. J., & Bork, P. (2010) · Molecular Systems Biology · doi:10.1038/msb.2009.98 · Cited by 899
Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics
Gimpel, K., Schneider, N., O’Connor, B., Das, D., Mills, D. Q., Eisenstein, J., Heilman, M., Yogatama, D., Flanigan, J., & Smith, N. A. (2011) · The Association for Computational Linguistics · Cited by 890
Clinical and economic burden of adverse drug reactions
Sultana, J., Cutroneo, P., & Trifirò, G. (2013) · Journal of Pharmacology and Pharmacotherapeutics · doi:10.4103/0976-500x.120957 · Cited by 528
BANNER: AN EXECUTABLE SURVEY OF ADVANCES IN BIOMEDICAL NAMED ENTITY RECOGNITION
LEAMAN, R., & GONZALEZ, G. (2007) · Biocomputing 2008 · doi:10.1142/9789812776136_0062 · Cited by 479
Self-citationGurulingappa, H., Rajput, A. M., Roberts, A., Fluck, J., Hofmann-Apitius, M., & Toldo, L. (2012) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2012.04.008 · Cited by 446
Novel Data-Mining Methodologies for Adverse Drug Event Discovery and Analysis
Harpaz, R., DuMouchel, W., Shah, N. H., Madigan, D., Ryan, P., & Friedman, C. (2012) · Clinical Pharmacology & Therapeutics · doi:10.1038/clpt.2012.50 · Cited by 393
More accurate tests for the statistical significance of result differences
Yeh, A. (2000) · Proceedings of the 18th conference on Computational linguistics - · doi:10.3115/992730.992783 · Cited by 378
Wicks, P., Vaughan, T. E., Massagli, M. P., & Heywood, J. (2011) · Nature Biotechnology · doi:10.1038/nbt.1837 · Cited by 362
Portable automatic text classification for adverse drug reaction detection via multi-corpus training
Sarker, A., & Gonzalez, G. (2015) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2014.11.002 · Cited by 356
Self-citationAvery, A., Anderson, C., Bond, C., Fortnum, H., Gifford, A., Hannaford, P., Hazell, L., Krska, J., Lee, A., McLernon, D., et al. (2011) · Health Technology Assessment · doi:10.3310/hta15200 · Cited by 331
Leaman, R., Wojtulewicz, L. B., Sullivan, R., Skariah, A. M., Yang, J. G., & Gonzalez‐Hernandez, G. (2010) · Cited by 256
Extraction of potential adverse drug events from medical case reports
Gurulingappa, H., Mateen‐Rajpu, A., & Toldo, L. (2012) · Journal of Biomedical Semantics · doi:10.1186/2041-1480-3-15 · Cited by 211
Web-scale pharmacovigilance: listening to signals from the crowd
White, R. W., Tatonetti, N. P., Shah, N. H., Altman, R. B., & Horvitz, E. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2012-001482 · Cited by 199
Identifying potential adverse effects using the web: A new approach to medical hypothesis generation
Benton, A., Ungar, L., Hill, S., Hennessy, S., Mao, J., Chung, A., Leonard, C. E., & Holmes, J. H. (2011) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2011.07.005 · Cited by 171
Predicting adverse drug events from personal health messages.
Chee, B. W., Berlin, R. B., & Schatz, B. R. (2011) · PubMed · Cited by 157
Pattern mining for extraction of mentions of Adverse Drug Reactions from user comments.
Nikfarjam, A., & Gonzalez‐Hernandez, G. (2011) · PubMed · Cited by 154
Self-citationSocial media mining for drug safety signal detection
Yang, C. C., Yang, H., Jiang, L., & Zhang, M. (2012) · doi:10.1145/2389707.2389714 · Cited by 141
Syntactic dependency based heuristics for biological event extraction
Halil Kilicoglu, B., & Bergler, S. (2009) · Workshop on BioNLP Open Shared Tasks (BioNLP-OST) · doi:10.3115/1572340.1572361 · Cited by 135
Extraction of Adverse Drug Effects from Clinical Records
Aramaki, E., Miura, Y., Tonoike, M., Ohkuma, T., Masuichi, H., Waki, K., & Ohe, K. (2010) · Studies in health technology and informatics · doi:10.3233/978-1-60750-588-4-739 · Cited by 130
Various criteria in the evaluation of biomedical named entity recognition
Tsai, R. T., Wu, S.-H., Chou, W., Lin, Y., He, D., Hsiang, J., Sung, T., & Hsu, W. (2006) · BMC Bioinformatics · doi:10.1186/1471-2105-7-92 · Cited by 128
MedDRA: An Overview of the Medical Dictionary for Regulatory Activities
Mozzicato, P. (2009) · Pharmaceutical Medicine · doi:10.1007/bf03256752 · Cited by 123
Pharmacovigilance on twitter? Mining tweets for adverse drug reactions.
O’Connor, K., Pimpalkhute, P., Nikfarjam, A., Ginn, R., Smith, K. L., & Gonzalez‐Hernandez, G. (2014) · PubMed · Cited by 121
Self-citationConsumer Reporting of Adverse Drug Reactions
Aagaard, L., Nielsen, L. H., & Hansen, E. H. (2009) · Drug Safety · doi:10.2165/11316680-000000000-00000 · Cited by 113
Liu, X., & Chen, H. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-39844-5_16 · Cited by 110
Foundations and Trends in Signal Processing: DEEP LEARNING – Methods and Applications
Deng, L., & Yu, D. (2014) · Cited by 81
ATM network: goals and challenges
Kim, B. G., & Wang, P. (1995) · Communications of the ACM · doi:10.1145/204826.204832 · Cited by 76
GeneTUKit: a software for document-level gene normalization
Huang, M., Liu, J., & Zhu, X. (2011) · Bioinformatics · doi:10.1093/bioinformatics/btr042 · Cited by 71
A Q'tron Neural-Network Approach to Solve the Graph Coloring Problems
Yue, T.-W., & Lee, Z. (2007) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai.2007.90 · Cited by 58
Friedman, C. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-02976-9_1 · Cited by 56
van Geffen, E. C. V., van der Wal, S., van Hulten, R. V., de Groot, M. D., Egberts, A. C. G., & Heerdink, E. (2007) · European Journal of Clinical Pharmacology · doi:10.1007/s00228-007-0375-4 · Cited by 55
Wang, W., Haerian, K., Salmasian, H., Harpaz, R., Chase, H. S., & Friedman, C. (2011) · PubMed Central · Cited by 46
Zhou, X., Zhang, X., & Hu, X. (2007) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai.2007.117 · Cited by 46
Ramesh, B. P., Belknap, S. M., Li, Z., Frid, N., West, D. P., & Yu, H. Q. (2014) · JMIR Medical Informatics · doi:10.2196/medinform.3022 · Cited by 35
Proceedings of the Workshop on Current Trends in Biomedical Natural Language Processing: Shared Task
Tsujii, J., & Association for Computing Machinery-Digital Library (2009) · Cited by 30
Sentence Simplification Aids Protein-Protein Interaction ExtractionPreprint
Jonnalagadda, S., & Gonzalez‐Hernandez, G. (2010) · arXiv (Cornell University) · doi:10.48550/arxiv.1001.4273 · Cited by 26
Vilhelmsson, A., Svensson, T., Meeuwisse, A., & Carlsten, A. (2011) · BMC Clinical Pharmacology · doi:10.1186/1472-6904-11-16 · Cited by 23
(2001) · doi:10.1002/pds.4850 · Cited by 7
Cited by
Deep learning for healthcare: review, opportunities and challenges
Miotto, R., Wang, F., Wang, S., Jiang, X., & Dudley, J. T. (2018) · Briefings in Bioinformatics · doi:10.1093/bib/bbx044 · Cited by 3,076
“social media for pharmacovigilance [104, 105]), wearable devices,”
Machine learning in mental health: a scoping review of methods and applications
Shatte, A. B. R., Hutchinson, D. M., & Teague, S. J. (2019) · Psychological Medicine · doi:10.1017/s0033291719000151 · Cited by 1,047
Attention is not not Explanation
Wiegreffe, S., & Pinter, Y. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1002 · Cited by 966
Utilizing social media data for pharmacovigilance: A review
Sarker, A., Ginn, R., Nikfarjam, A., O’Connor, K., Smith, K., Jayaraman, S., Upadhaya, T., & Gonzalez, G. (2015) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2015.02.004 · Cited by 497
Self-citationJain, S., & Wallace, B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.10186 · Cited by 467
Metadata
- Authors
- Nikfarjam, A., Sarker, A., O’Connor, K., Ginn, R., & Gonzalez, G.
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2015-03-09
- Volume
- 22
- Issue
- 3
- Pages
- 671-681
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- OpenAlex
- W2171469118
- Cited by
- 543
- References
- 53
- FWCI
- 98.53
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.