Building the graph of medicine from millions of clinical narratives
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
Electronic health records (EHR) represent a rich and relatively untapped resource for characterizing the true nature of clinical practice and for quantifying the degree of inter-relatedness of medical entities such as drugs, diseases, procedures and devices. We provide a unique set of co-occurrence matrices, quantifying the pairwise mentions of 3 million terms mapped onto 1 million clinical concepts, calculated from the raw text of 20 million clinical notes spanning 19 years of data. Co-frequencies were computed by means of a parallelized annotation, hashing, and counting pipeline that was applied over clinical notes from Stanford Hospitals and Clinics. The co-occurrence matrix quantifies the relatedness among medical concepts which can serve as the basis for many statistical tests, and can be used to directly compute Bayesian conditional probabilities, association rules, as well as a range of test statistics such as relative risks and odds ratios. This dataset can be leveraged to quantitatively assess comorbidity, drug-drug, and drug-disease patterns for a range of clinical, epidemiological, and financial applications.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Sorror, M. L., Maris, M. B., Storb, R., Baron, F., Sandmaier, B. M., Maloney, D. G., & Storer, B. (2005) · Blood · doi:10.1182/blood-2005-05-2004 · Cited by 2,969
How to measure comorbiditya critical review of available methods
DEGROOT, V, BECKERMAN, H., LANKHORST, G., & BOUTER, L. (2003) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(02)00585-1 · Cited by 1,757
Mining electronic health records: towards better research applications and clinical care
Jensen, P. B., Jensen, L. J., & Brunak, S. (2012) · Nature Reviews Genetics · doi:10.1038/nrg3208 · Cited by 1,680
Simon, N., Friedman, J., Hastie, T., & Tibshirani, R. (2013) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.2012.681250 · Cited by 1,380 · cited 1×
“Similar to using lift, one might leverage co-frequency counts as a component of a group LASSO penalty 47 in building better phenotyping models.”
MethodSchneeweiss, S., Rassen, J. A., Glynn, R. J., Avorn, J., Mogun, H., & Brookhart, M. A. (2009) · Epidemiology · doi:10.1097/ede.0b013e3181a663cc · Cited by 1,128 · cited 2×
“The advent of larger datasets, including claims data, has given rise to high dimension propensity score methods that incorporate large numbers of variables for improved performance 31 .”
BackgroundMethodClassen, D. C., Resar, R., Griffin, F., Federico, F., Frankel, T., Kimmel, N., Whittington, J. C., Frankel, A., Seger, A., & James, B. C. (2011) · Health Affairs · doi:10.1377/hlthaff.2011.0190 · Cited by 1,027
Stang, P. E., Ryan, P. B., Racoosin, J. A., Overhage, J. M., Hartzema, A. G., Reich, C., Welebob, E., Scarnecchia, T., & Woodcock, J. (2010) · Annals of Internal Medicine · doi:10.7326/0003-4819-153-9-201011020-00010 · Cited by 441
Probing genetic overlap among complex human phenotypes
Rzhetsky, A., Wajngurt, D., Park, N., & Zheng, T. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0704820104 · Cited by 298
Electronic health records-driven phenotyping: challenges, recent advances, and perspectives
Pathak, J., Kho, A. N., & Denny, J. C. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2013-002428 · Cited by 274 · cited 1×
“Knowledge of such inter-relatedness can be readily leveraged for improving fundamental methods underlying a wide range of use cases, such as patient clustering 2 and outcome prediction 3 , analysing comorbidity patterns 4,5 , and cohort querying for clinical trial design 6 .”
MethodA Nondegenerate Code of Deleterious Variants in Mendelian Loci Contributes to Complex Disease Risk
Blair, D. R., Lyttle, C. S., Mortensen, J. M., Bearden, C. F., Jensen, A. B., Khiabanian, H., Melamed, R., Rabadan, R., Bernstam, E. V., Brunak, S., et al. (2013) · Cell · doi:10.1016/j.cell.2013.08.030 · Cited by 215 · cited 3×
“Knowledge of such inter-relatedness can be readily leveraged for improving fundamental methods underlying a wide range of use cases, such as patient clustering 2 and outcome prediction 3 , analysing comorbidity patterns 4,5 , and cohort querying for clinical trial design 6 .”
BackgroundMethodSelf-citationThe twin questions of personalized medicine: who are you and whom do you most resemble?
Kohane, I. S. (2009) · Genome Medicine · doi:10.1186/gm4 · Cited by 38 · cited 1×
“Unsupervised learning methods applied to population-wide, comprehensive clinical datasets can rede fi ne subtyping of existing diseases, and discover unrecognized phenotypes 28 – 30 .”
Method
Cited by
Learning a Health Knowledge Graph from Electronic Medical Records
Rotmensch, M., Halpern, Y., Tlimat, A., Horng, S., & Sontag, D. (2017) · Scientific Reports · doi:10.1038/s41598-017-05778-z · Cited by 423
Graph embedding on biomedical networks: methods, applications and evaluations
Yue, X., Wang, Z., Huang, J., Parthasarathy, S., Moosavinasab, S., Huang, Y., Lin, S. M., Zhang, W., Zhang, P., & Sun, H. (2020) · Bioinformatics · doi:10.1093/bioinformatics/btz718 · Cited by 386
Real-world data medical knowledge graph: construction and applications
Li, L., Wang, P., Yan, J., Wang, Y., Li, S., Jiang, J., Sun, Z., Tang, B., Chang, T.-H., Wang, S., et al. (2020) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2020.101817 · Cited by 272
PIC, a paediatric-specific intensive care database
Zeng, X., Yu, G., Lu, Y., Tan, L., Wu, X., Shi, S., Duan, H., Shu, Q., & Li, H. (2020) · Scientific Data · doi:10.1038/s41597-020-0355-4 · Cited by 138
SECNLP: A survey of embeddings in clinical natural language processing
Kalyan, K. S., & Sangeetha, S. (2020) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2019.103323 · Cited by 111
Metadata
- Authors
- Finlayson, S. G., LePendu, P., & Shah, N. H.
- Venue
- Scientific Data
- Published
- 2014-09-16
- Volume
- 1
- Issue
- 1
- Pages
- 140032-140032
- ISSN
- 2052-4463 (ISSN-L)
- OpenAlex
- W2327091741
- Cited by
- 91
- References
- 11
- Type
- data paper
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.