Development and evaluation of an ensemble resource linking medications to their indications
Open accessThe DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: To create a computable MEDication Indication resource (MEDI) to support primary and secondary use of electronic medical records (EMRs). MATERIALS AND METHODS: We processed four public medication resources, RxNorm, Side Effect Resource (SIDER) 2, MedlinePlus, and Wikipedia, to create MEDI. We applied natural language processing and ontology relationships to extract indications for prescribable, single-ingredient medication concepts and all ingredient concepts as defined by RxNorm. Indications were coded as Unified Medical Language System (UMLS) concepts and International Classification of Diseases, 9th edition (ICD9) codes. A total of 689 extracted indications were randomly selected for manual review for accuracy using dual-physician review. We identified a subset of medication-indication pairs that optimizes recall while maintaining high precision. RESULTS: MEDI contains 3112 medications and 63 343 medication-indication pairs. Wikipedia was the largest resource, with 2608 medications and 34 911 pairs. For each resource, estimated precision and recall, respectively, were 94% and 20% for RxNorm, 75% and 33% for MedlinePlus, 67% and 31% for SIDER 2, and 56% and 51% for Wikipedia. The MEDI high-precision subset (MEDI-HPS) includes indications found within either RxNorm or at least two of the three other resources. MEDI-HPS contains 13 304 unique indication pairs regarding 2136 medications. The mean±SD number of indications for each medication in MEDI-HPS is 6.22 ± 6.09. The estimated precision of MEDI-HPS is 92%. CONCLUSIONS: MEDI is a publicly available, computable resource that links medications with their indications as represented by concepts and billing codes. MEDI may benefit clinical EMR applications and reuse of EMR data for research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“DrugBank primarily contains drug indications extracted from drug labels, while MEDI utilizes public internet sources to drug indications, and is a well utilized resource of drug indications.”
From OnSIDES database: Extracting adverse drug events from drug labels using natural language processing models (2025) · cites this paper as [49]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Collaborators, C. T. T. (. (2008) · The Lancet · doi:10.1016/s0140-6736(08)60104-x · Cited by 2,081
Internet encyclopaedias go head to head
Giles, J. (2005) · Nature · doi:10.1038/438900a · Cited by 1,978
An overview of MetaMap: historical perspective and recent advances
Aronson, A. R., & Lang, F.-M. (2010) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2009.002733 · Cited by 1,519
Preiss, D. (2011) · JAMA · doi:10.1001/jama.2011.860 · Cited by 1,390
PheWAS: demonstrating the feasibility of a phenome-wide scan to discover gene–disease associations
Denny, J. C., Ritchie, M. D., Basford, M. A., Pulley, J. M., Bastarache, L., Brown-Gentry, K., Wang, D., Masys, D. R., Roden, D. M., & Crawford, D. C. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq126 · Cited by 1,219
Self-citationA side effect resource to capture phenotypic effects of drugs
Kuhn, M., Campillos, M., Letunic, I., Jensen, L. J., & Bork, P. (2010) · Molecular Systems Biology · doi:10.1038/msb.2009.98 · Cited by 899
Next-generation phenotyping of electronic health records
Hripcsak, G., & Albers, D. J. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2012-001145 · Cited by 795
the eMERGE Team, McCarty, C. A., Chisholm, R. L., Chute, C. G., Kullo, I. J., Jarvik, G. P., Larson, E. B., Li, R., Masys, D. R., Ritchie, M. D., et al. (2011) · BMC Medical Genomics · doi:10.1186/1755-8794-4-13 · Cited by 699
Therapeutic target database update 2012: a resource for facilitating target-oriented drug discovery
Zhu, F., Shi, Z., Qin, C., Tao, L., Liu, X., Xu, F., Zhang, L., Song, Y., Liu, X., Zhang, J., et al. (2012) · Nucleic Acids Research · doi:10.1093/nar/gkr797 · Cited by 480
Deep phenotyping for precision medicine
Robinson, P. N. (2012) · Human Mutation · doi:10.1002/humu.22080 · Cited by 470
Normalized names for clinical drugs: RxNorm at 6 years
Nelson, S. J., Zeng, K., Kilbourne, J., Powell, T., & Moore, R. (2011) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000116 · Cited by 453
Electronic Health Records and Quality of Diabetes Care
Cebul, R. D., Love, T. E., Jain, A. K., & Hebert, C. J. (2011) · New England Journal of Medicine · doi:10.1056/nejmsa1102519 · Cited by 332
Ritchie, M. D., Denny, J. C., Crawford, D. C., Ramirez, A. H., Weiner, J. B., Pulley, J. M., Basford, M. A., Brown-Gentry, K., Balser, J. R., Masys, D. R., et al. (2010) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2010.03.003 · Cited by 323
Self-citationKho, A. N., Hayes, M. G., Rasmussen-Torvik, L., Pacheco, J. A., Thompson, W. K., Armstrong, L. L., Denny, J. C., Peissig, P. L., Miller, A. W., Wei, W.-Q., et al. (2012) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000439 · Cited by 299
Self-citationLiu, M., Wu, Y., Chen, Y., Sun, J., Zhao, Z., Chen, X.-W., Matheny, M. E., & Xu, H. (2012) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000699 · Cited by 289
Self-citationEffectiveness of Metformin on Weight Loss in Non-Diabetic Individuals with Obesity
Seifarth, C., Schehler, B., & Schneider, H. (2012) · Experimental and Clinical Endocrinology & Diabetes · doi:10.1055/s-0032-1327734 · Cited by 258
Denny, J. C., Crawford, D. C., Ritchie, M. D., Bielinski, S. J., Basford, M. A., Bradford, Y., Chai, H. S., Bastarache, L., Zuvich, R., Peissig, P., et al. (2011) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2011.09.008 · Cited by 246
Self-citationPortability of an algorithm to identify rheumatoid arthritis in electronic health records
Carroll, R. J., Thompson, W. K., Eyler, A. E., Mandelin, A. M., Cai, T., Zink, R. M., Pacheco, J. A., Boomershine, C. S., Lasko, T. A., Xu, H., et al. (2012) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000583 · Cited by 235
Self-citationGlueck, C. J., Fontaine, R. N., Wang, P., Subbiah, M. T. R., Weber, K., Illig, E., Streicher, P., Sieve-Smith, L., Tracy, T. M., Lang, J. E., et al. (2001) · Metabolism · doi:10.1053/meta.2001.24192 · Cited by 188
The Emerging Role of Electronic Medical Records in Pharmacogenomics
Wilke, R. A., Xu, H., Denny, J. C., Roden, D. M., Krauss, R. M., McCarty, C. A., Davis, R. L., Skaar, T., Lamba, J., & Savova, G. (2011) · Clinical Pharmacology & Therapeutics · doi:10.1038/clpt.2010.260 · Cited by 171
Self-citationCAPTOPRIL: A NEW TREATMENT FOR RHEUMATOID ARTHRITIS?
Martin, M. F. R., Mckenna, F., Bird, H. A., Surrall, K. E., Dixon, J. S., & Wright, V. (1984) · The Lancet · doi:10.1016/s0140-6736(84)91821-x · Cited by 159
Duke, J. D., Han, X., Wang, Z., Subhadarshini, A., Karnik, S. D., Li, X., Hall, S. D., Jin, Y., Callaghan, J. T., Overhage, M. J., et al. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002614 · Cited by 128
Denny, J. C., Ritchie, M. D., Crawford, D. C., Schildcrout, J. S., Ramirez, A. H., Pulley, J. M., Basford, M. A., Masys, D. R., Haines, J. L., & Roden, D. M. (2010) · Circulation · doi:10.1161/circulationaha.110.948828 · Cited by 121
Self-citationThe Challenge of Measuring Quality of Care From the Electronic Health Record
Roth, C. P., Lim, Y.-W., Pevnick, J. M., Asch, S. M., & McGlynn, E. A. (2009) · American Journal of Medical Quality · doi:10.1177/1062860609336627 · Cited by 121
"Understanding" Medical School Curriculum Content Using KnowledgeMap
Denny, J. C. (2003) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1176 · Cited by 117
Self-citationWei, W.-Q., Leibson, C. L., Ransom, J. E., Kho, A. N., Caraballo, P. J., Chai, H. S., Yawn, B. P., Pacheco, J. A., & Chute, C. G. (2012) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000597 · Cited by 112
Self-citationLongterm management of Polycystic Ovarian Syndrome (PCOS)
Bates, G. W., & Legro, R. S. (2013) · Molecular and Cellular Endocrinology · doi:10.1016/j.mce.2012.10.029 · Cited by 106
‘Deep phenotyping’: characterizing populations in the era of genomics and systems biology
Tracy, R. P. (2008) · Current Opinion in Lipidology · doi:10.1097/mol.0b013e3282f73893 · Cited by 90
Extracting timing and status descriptors for colonoscopy testing from electronic medical records
Denny, J. C., Peterson, J. F., Choma, N. N., Xu, H., Miller, R. A., Bastarache, L., & Peterson, N. B. (2010) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2010.004804 · Cited by 76
Self-citationAccelerating the Use of Electronic Health Records in Physician Practices
Shea, S., & Hripcsak, G. (2010) · New England Journal of Medicine · doi:10.1056/nejmp0910140 · Cited by 74
Acute diverticulitis of the colon ? current medical therapeutic management
Tursi, A. (2004) · Expert Opinion on Pharmacotherapy · doi:10.1517/14656566.5.1.55 · Cited by 51
Measuring the Quality of Medication Use in Older Adults
Roth, M. T., Weinberger, M., & Campbell, W. H. (2009) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.2009.02243.x · Cited by 44
Ghitza, U. E., Sparenborg, S., & Tai, B. (2011) · Substance Abuse and Rehabilitation · doi:10.2147/sar.s23030 · Cited by 42
Wei, W.-Q., Leibson, C. L., Ransom, J. E., Kho, A. N., & Chute, C. G. (2013) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2012.05.015 · Cited by 38
Self-citationIdentifying UMLS concepts from ECG Impressions using KnowledgeMap.
Denny, J. C., Spickard, A., Miller, R. A., Schildcrout, J. S., Darbar, D., Rosenbloom, S. T., & Peterson, J. F. (2005) · Europe PMC (PubMed Central) · Cited by 33
Self-citationMedication and indication linkage: A practical therapy for the problem list?
Burton, M. M., Simonaitis, L., & Schadow, G. (2008) · PubMed · Cited by 31
Tracking medical students’ clinical experiences using natural language processing
Denny, J. C., Bastarache, L. A., Sastre, E. A., & Spickard, A. (2009) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2009.02.004 · Cited by 28
Self-citationFDA Guidance on Off-Label Promotion and the State of the Literature From Sponsors
Psaty, B. M. (2008) · JAMA · doi:10.1001/jama.299.16.1949 · Cited by 25
Denny, J. C., & Peterson, J. F. (2007) · PubMed · Cited by 15
Self-citationThe Many Sides of Off-Label Prescribing
Epstein, R. S., & Sm, H. (2012) · Clinical Pharmacology & Therapeutics · doi:10.1038/clpt.2012.37 · Cited by 14
A graph-based approach to auditing RxNorm
Bodenreider, O., & Peters, L. B. (2009) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2009.04.004 · Cited by 12
Warnekar, P., Bouhaddou, O., Parrish, F., Do, N., Kilbourne, J., Brown, S. H., & Lincoln, M. J. (2007) · PubMed · Cited by 11
RECENT CHANGES IN THE LIST OF DANISH BREEDING BIRDS
Løppenthin, B. (1948) · Ibis · doi:10.1111/j.1474-919x.1948.tb01404.x · Cited by 5
Cited by
Systematic integration of biomedical knowledge prioritizes drugs for repurposing
Himmelstein, D. S., Lizee, A., Hessler, C., Brueggeman, L., Chen, S. L., Hadley, D., Green, A., Khankhanian, P., & Baranzini, S. E. (2017) · eLife · doi:10.7554/elife.26726 · Cited by 666
Network-based in silico drug efficacy screening
Guney, E., Menche, J., Vidal, M., & Barábasi, A.-L. (2016) · Nature Communications · doi:10.1038/ncomms10331 · Cited by 625
“We gather the drug-target information on FDA approved drugs from DrugBank 16 and the indication information (the diseases the drug is used for) from the medication-indication resource high-precision subset (MEDI-HPS) 17 , which is then filtered by strong literature evidence using Metab2MeSH (ref.”
InfluentialLEAP: Learning to Prescribe Effective and Safe Treatment Combinations for Multimorbidity
Zhang, Y., Chen, R., Tang, J., Stewart, W. F., & Sun, J. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098109 · Cited by 224
“There have been previous e orts to create a medication-indication database by integrating resources from medical knowledge bases such as RxNorm, SIDER, and Wikipedia [36].”
MethodInfluentialExtracting research-quality phenotypes from electronic health records to support precision medicine
Wei, W.-Q., & Denny, J. C. (2015) · Genome Medicine · doi:10.1186/s13073-015-0166-y · Cited by 242
“This approach has led to several previously unavailable resources, such as SIDER [137] and MEDI [138-140].”
MethodSelf-citationPhenome-Wide Association Studies as a Tool to Advance Precision Medicine
Denny, J. C., Bastarache, L., & Roden, D. M. (2016) · Annual Review of Genomics and Human Genetics · doi:10.1146/annurev-genom-090314-024956 · Cited by 232
“For example, a highly accurate algorithm for type 2 diabetes includes billing codes, laboratory results, and medication data (35), and resources have been created that link medications to their diseases (78).”
BackgroundSelf-citation
Metadata
- Authors
- Wei, W.-Q., Cronin, R. M., Xu, H., Lasko, T. A., Bastarache, L., & Denny, J. C.
- Affiliations
- Vanderbilt University (US)
- The University of Texas Health Science Center at Houston (US)
- Corresponding author
- Denny, Joshua C
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2013-09
- Volume
- 20
- Issue
- 5
- Pages
- 954-961
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC3756263
- OpenAlex
- W2121111666
- Cited by
- 106
- References
- 43
- Citations by year
- 2026: 3 · 2025: 6 · 2024: 5 · 2023: 4 · 2022: 7 · 2021: 9 · 2020: 7 · 2019: 8 · 2018: 15 · 2017: 11 · 2016: 14 · 2015: 7 · 2014: 8 · 2013: 2
- FWCI
- 4.63
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by-nc-nd
- Locations
- Journal of the American Medical Informatics Association (publishedVersion, cc-by-nc-nd)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- Funders
- National Institutes of Health
- National Heart, Lung, and Blood Institute (U19HL065962)
- National Human Genome Research Institute (U01HG006378)
- National Institute of General Medical Sciences (R01GM105688)
- U.S. National Library of Medicine (R01LM010685, T15LM007450)
- Topics
- Health Sciences › Medicine › Health Informatics › Biomedical Text Mining and Ontologies
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
- Keywords
- RxNorm, MedlinePlus, Wikipedia, natural language processing, ontology relationships, UMLS concepts, ICD-9 codes, electronic health records
- MeSH terms
- Dictionaries as Topic, Drug Therapy, Pharmaceutical Preparations, Natural Language Processing, Internet, MedlinePlus, Electronic Health Records, RxNorm
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.