The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Active Computerized Pharmacovigilance Using Natural Language Processing, Statistics, and Electronic Health Records: A Feasibility Study
Open accessAbstract
OBJECTIVE It is vital to detect the full safety profile of a drug throughout its market life. Current pharmacovigilance systems still have substantial limitations, however. The objective of our work is to demonstrate the feasibility of using natural language processing (NLP), the comprehensive Electronic Health Record (EHR), and association statistics for pharmacovigilance purposes. DESIGN Narrative discharge summaries were collected from the Clinical Information System at New York Presbyterian Hospital (NYPH). MedLEE, an NLP system, was applied to the collection to identify medication events and entities which could be potential adverse drug events (ADEs). Co-occurrence statistics with adjusted volume tests were used to detect associations between the two types of entities, to calculate the strengths of the associations, and to determine their cutoff thresholds. Seven drugs/drug classes (ibuprofen, morphine, warfarin, bupropion, paroxetine, rosiglitazone, ACE inhibitors) with known ADEs were selected to evaluate the system. RESULTS One hundred thirty-two potential ADEs were found to be associated with the 7 drugs. Overall recall and precision were 0.75 and 0.31 for known ADEs respectively. Importantly, qualitative evaluation using historic roll back design suggested that novel ADEs could be detected using our system. CONCLUSIONS This study provides a framework for the development of active, high-throughput and prospective systems which could potentially unveil drug safety profiles throughout their entire market life. Our results demonstrate that the framework is feasible although there are some challenging issues. To the best of our knowledge, this is the first study using comprehensive unstructured data from the EHR for pharmacovigilance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Evans, S. J. W., Waller, P. C., & Davis, S. (2001) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.677 · Cited by 1,802
Atypical antipsychotic drugs and the risk of sudden cardiac death
Ray, W. A., Chung, C. P., Murray, K. T., Hall, K., & Stein, C. M. (2009) · New England Journal of Medicine · doi:10.1056/nejmoa0806994 · Cited by 1,194
Szarfman, A., Machado, S. G., & O??Neill, R. T. (2002) · Drug Safety · doi:10.2165/00002018-200225060-00001 · Cited by 700
Automated Encoding of Clinical Documents Based on Natural Language Processing
Friedman, C., Shagina, L., Lussier, Y., & Hripcsak, G. (2004) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1552 · Cited by 551
Self-citationRindflesch, T. C., & Fiszman, M. (2003) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2003.11.003 · Cited by 518
Wysowski, D. K., & Swartz, L. (2005) · Archives of Internal Medicine · doi:10.1001/archinte.165.12.1363 · Cited by 471
Detecting Adverse Events Using Information Technology
Bates, D. W., Evans, R. S., Murff, H., Stetson, P. D., Pizziferri, L., & Hripcsak, G. (2003) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1074 · Cited by 467
Self-citationEDGAR: Extraction of Drugs, Genes And Relations from the Biomedical Literature
Rindflesch, T. C., Tanabe, L., Weinstein, J. N., & Hunter, L. (1999) · Biocomputing 2000 · doi:10.1142/9789814447331_0049 · Cited by 418
The General Practice Research Database: Role in Pharmacovigilance
Wood, L., & Martinez, C. (2004) · Drug Safety · doi:10.2165/00002018-200427120-00004 · Cited by 331
Hershman, D., Neugut, A. I., Jacobson, J. S., Wang, J., Tsai, W.-Y., McBride, R., Bennett, C. L., & Grann, V. R. (2007) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/djk028 · Cited by 279
The role of data mining in pharmacovigilance
Hauben, M., Madigan, D., Gerrits, C. M., Walsh, L., & Van Puijenbroek, E. P. (2005) · Expert Opinion on Drug Safety · doi:10.1517/14740338.4.5.929 · Cited by 276
RxNorm: prescription for electronic drug information exchange
Liu, S., Ma, W., Moore, R., Ganesan, V., & Nelson, S. (2005) · IT Professional · doi:10.1109/mitp.2005.122 · Cited by 274
Attitudinal survey of voluntary reporting of adverse drug reactions
Eland, Belton, Grootheest, V., Meiners, Rawlins, & Stricker (1999) · British Journal of Clinical Pharmacology · doi:10.1046/j.1365-2125.1999.00060.x · Cited by 256
Getting Started in Text Mining
Cohen, K. B., & Hunter, L. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0040020 · Cited by 230
Using Computerized Data to Identify Adverse Drug Events in Outpatients
Honigman, B., Lee, J., Rothschild, J., Light, P., Pulling, R. M., Yu, T., & Bates, D. W. (2001) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2001.0080254 · Cited by 226
EBIMed—text crunching to gather facts for proteins from Medline
Rebholz-Schuhmann, D., Kirsch, H., Arregui, M., Gaudan, S., Riethoven, M., & Stoehr, P. (2007) · Bioinformatics · doi:10.1093/bioinformatics/btl302 · Cited by 217
Chen, E. S., Hripcsak, G., Xu, H., Markatou, M., & Friedman, C. (2008) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2401 · Cited by 210
Self-citationUsing MedDRA: Implications for Risk Management
Brown, E. G. (2004) · Drug Safety · doi:10.2165/00002018-200427080-00010 · Cited by 204
Quantitative Methods in Pharmacovigilance: Focus on Signal Detection
Hauben, M., & Zhou, X. (2003) · Drug Safety · doi:10.2165/00002018-200326030-00003 · Cited by 177
Accounting for Multiplicities in Assessing Drug Safety: A Three‐Level Hierarchical Mixture Model
Berry, S. M., & Berry, D. A. (2004) · Biometrics · doi:10.1111/j.0006-341x.2004.00186.x · Cited by 158
Data mining for signals in spontaneous reporting databases: proceed with caution
Stephenson, W. P., & Hauben, M. (2006) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.1323 · Cited by 147
Brown, J. S., Kulldorff, M., Chan, K. A., Davis, R. L., Graham, D. J., Pettus, P. T., Andrade, S. E., Raebel, M. A., Herrinton, L. J., Roblin, D. W., et al. (2007) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.1509 · Cited by 126
Hahn, U., Romacker, M., & Schulz, S. (2002) · International Journal of Medical Informatics · doi:10.1016/s1386-5056(02)00053-9 · Cited by 109
Comparing data mining methods on the VAERS database
Banks, D., Woo, E. J., Burwen, D. R., Perucci, P., Braun, M. M., & Ball, R. (2005) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.1107 · Cited by 79
Extracting Phenotypic Information from the Literature via Natural Language Processing
Lifeng, C., & Friedman, C. (2004) · Studies in health technology and informatics · doi:10.3233/978-1-60750-949-3-758 · Cited by 74
Self-citationCao, H., Markatou, M., Melton, G. B., Chiang, M. F., & Hripcsak, G. M. (2005) · PubMed Central · Cited by 64
Self-citationDuMouchel, W., Smith, E. T., Beasley, R. W., Nelson, H. S., Yang, X., Fram, D. M., & Almenoff, J. S. (2004) · Clinical Therapeutics · doi:10.1016/s0149-2918(04)90181-6 · Cited by 63
Implementation of automated signal generation in pharmacovigilance using a knowledge-based approach
Cédric Bousquet, B., Hénégar, C., Louët, A. L., et al. (2005) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2005.04.006 · Cited by 55
A statistical methodology for analyzing co-occurrence data from a large sample
Cao, H., Hripcsak, G. M., & Markatou, M. (2006) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2006.11.003 · Cited by 46
Self-citationEvaluating adverse events after vaccination in the Medicare population
Burwen, D. R., Voie, L. L., Braun, M. M., Houck, P. M., & Ball, R. (2007) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.1390 · Cited by 37
Wang, X.-Y., Hripcsak, G. M., & Friedman, C. (2009) · BMC Bioinformatics · doi:10.1186/1471-2105-10-s9-s13 · Cited by 36
Self-citationWhy there is a need for pharmacovigilance
Amery, W. K. (1999) · Pharmacoepidemiology and Drug Safety · Cited by 31
Parker, R., & Miller, R. A. (1989) · Methods of Information in Medicine · doi:10.1055/s-0038-1636784 · Cited by 30
Berlowitz, D. R., Miller, D. R., Oliveria, S. A., Cunningham, F., Gomez‐Caminero, A., & Rothendler, J. A. (2006) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.1301 · Cited by 21
Evans, J. M. M., McNaughton, D., Donnan, P. T., & MacDonald, T. M. (2001) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.627.abs · Cited by 20
Possible strategies for early recognition of potential drug safety problems.
Venulet, J. (1988) · PubMed · Cited by 11
Halpern, S. D., Barton, T. D., Gross, R., Hennessy, S., Berlin, J. A., & Strom, B. L. (2004) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.1059 · Cited by 8
(2001) · doi:10.1002/pds.4850 · Cited by 7
Cited by
Natural language processing: an introduction
Nadkarni, P. M., Ohno-Machado, L., & Chapman, W. W. (2011) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000464 · Cited by 1,975
Mining electronic health records: towards better research applications and clinical care
Jensen, P. B., Jensen, L. J., & Brunak, S. (2012) · Nature Reviews Genetics · doi:10.1038/nrg3208 · Cited by 1,680
PheWAS: demonstrating the feasibility of a phenome-wide scan to discover gene–disease associations
Denny, J. C., Ritchie, M. D., Basford, M. A., Pulley, J. M., Bastarache, L., Brown-Gentry, K., Wang, D., Masys, D. R., Roden, D. M., & Crawford, D. C. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq126 · Cited by 1,219
Clinical information extraction applications: A literature review
Wang, Y., Wang, L., Rastegar-Mojarad, M., Moon, S., Shen, F., Afzal, N., Liu, S., Zeng, Y., Mehrabi, S., Sohn, S., et al. (2018) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2017.11.011 · Cited by 910
Koleck, T. A., Dreisbach, C., Bourne, P. E., & Bakken, S. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy173 · Cited by 408
Metadata
- Authors
- Wang, X., Hripcsak, G., Markatou, M., & Friedman, C.
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2009-05-01
- Volume
- 16
- Issue
- 3
- Pages
- 328-337
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- OpenAlex
- W2160194473
- Cited by
- 288
- References
- 38
- FWCI
- 22.20
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.