The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Learning from Longitudinal Data in Electronic Health Record and Genetic Data to Improve Cardiovascular Event Prediction
Open accessPublished version of a preprint
Abstract
Current approaches to predicting a cardiovascular disease (CVD) event rely on conventional risk factors and cross-sectional data. In this study, we applied machine learning and deep learning models to 10-year CVD event prediction by using longitudinal electronic health record (EHR) and genetic data. Our study cohort included 109, 490 individuals. In the first experiment, we extracted aggregated and longitudinal features from EHR. We applied logistic regression, random forests, gradient boosting trees, convolutional neural networks (CNN) and recurrent neural networks with long short-term memory (LSTM) units. In the second experiment, we applied a late-fusion approach to incorporate genetic features. We compared the performance with approaches currently utilized in routine clinical practice – American College of Cardiology and the American Heart Association (ACC/AHA) Pooled Cohort Risk Equation. Our results indicated that incorporating longitudinal feature lead to better event prediction. Combining genetic features through a late-fusion approach can further improve CVD prediction, underscoring the importance of integrating relevant genetic data whenever available.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
General Cardiovascular Risk Profile for Use in Primary Care: The Framingham Heart Study
D’Agostino, R. B., Vasan, R. S., Pencina, M. J., Wolf, P. A., Cobain, M., Massaro, J. M., & Kannel, W. B. (2008) · Circulation · doi:10.1161/circulationaha.107.699579 · Cited by 7,491
Saito, T., & Rehmsmeier, M. (2015) · PLOS ONE · doi:10.1371/journal.pone.0118432 · Cited by 5,309
2013 ACC/AHA Guideline on the Assessment of Cardiovascular Risk
Goff, D. C., Lloyd-Jones, D. M., Bennett, G., Coady, S., D’Agostino, R. B., Gibbons, R., Greenland, P., Lackland, D. T., Levy, D., O’Donnell, C. J., et al. (2014) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2013.11.005 · Cited by 4,945
Genetic Risk, Adherence to a Healthy Lifestyle, and Coronary Disease
Khera, A. V., Emdin, C. A., Drake, I., Natarajan, P., Bick, A. G., Cook, N. R., Chasman, D. I., Baber, U., Mehran, R., Rader, D. J., et al. (2016) · New England Journal of Medicine · doi:10.1056/nejmoa1605086 · Cited by 1,460
Predicting cardiovascular risk in England and Wales: prospective derivation and validation of QRISK2
Hippisley-Cox, J., Coupland, C., Vinogradova, Y., Robson, J., Minhas, R., Sheikh, A., & Brindle, P. (2008) · BMJ · doi:10.1136/bmj.39609.449676.25 · Cited by 1,459
Can machine-learning improve cardiovascular risk prediction using routine clinical data?
Weng, S. F., Reps, J., Kai, J., Garibaldi, J. M., & Qureshi, N. (2017) · PLOS ONE · doi:10.1371/journal.pone.0174944 · Cited by 1,346
Pipkins, H. R., Bradshaw, J. L., Keller, L. E., Swiatlo, E., & McDaniel, L. S. (2017) · PLOS ONE · doi:10.1371/journal.pone.0179159 · Cited by 1,338
Khan, S. S., Ning, H., Wilkins, J. T., Allen, N., Carnethon, M., Berry, J. D., Sweis, R. N., & Lloyd-Jones, D. M. (2018) · JAMA Cardiology · doi:10.1001/jamacardio.2018.0022 · Cited by 1,072
Research works printed but not linked: 28
- Benjamin, E. J. et al. Heart Disease and Stroke Statistics—2017 Update: A Report From the American Heart Association. Circulation 135, e146–e603 (2017). · DOI · Paper page
- Kannel, W. B. & Vasan, R. S. Adverse consequences of the 50% misconception. Am J Cardiol 103, 426–7 (2009). · DOI
- Khot, U. N. Prevalence of Conventional Risk Factors in Patients With Coronary Heart Disease. JAMA 290, 898 (2003). · DOI · Paper page
- Wei, W. -Q. & Denny, J. C. Extracting research-quality phenotypes from electronic health records to support precision medicine. Genome Med 7 (2015). · DOI · Paper page
- Choi, E., Schuetz, A., Stewart, W. F. & Sun, J. Using recurrent neural network models for early detection of heart failure onset. Journal of the American Medical Informatics Association 24, 361–370 (2017). · DOI · Paper page
- Singh, A. et al. Incorporating temporal EHR data in predictive models for risk stratification of renal function deterioration. Journal of Biomedical Informatics 53, 220–228 (2015). · DOI · Paper page
- Ansari, W. M. et al. Effect of Coronary Artery Disease risk SNPs on serum cytokine levels and cytokine imbalance in Premature Coronary Artery Disease. Cytokine https://doi.org/10.1016/j.cyto.2017.05.013 (2017). · DOI
- Wei, W. -Q. et al. LPA Variants are Associated with Residual Cardiovascular Risk in Patients Receiving Statins. Circulation, https://doi.org/10.1161/CIRCULATIONAHA.117.031356 (2018). · DOI
- Tang, X.-Y. et al. The association between GGCX, miR-133 genetic polymorphisms and warfarin stable dosage in Han Chinese patients with mechanical heart valve replacement. J Clin Pharm Ther 42, 438–445 (2017). · doi:10.1111/jcpt.12527
- Tillin, T. et al. Ethnicity and prediction of cardiovascular disease: performance of QRISK2 and Framingham scores in a U.K. tri-ethnic prospective cohort study (SABRE–Southall And Brent REvisited). Heart 100, 60–67 (2014). · DOI · Paper page
- Wannamethee, S. G., Shaper, A. G. & Perry, I. J. Serum Creatinine Concentration and Risk of Cardiovascular Disease. Stroke (1997). · DOI · Paper page
- Reusch, J. E. B. & Wang, C. C. L. Cardiovascular Disease in Diabetes: Where Does Glucose Fit In? J Clin Endocrinol Metab 96, 2367–2376 (2011). · DOI
- Khan, U. I., Rieder, J., Cohen, H. W., Coupey, S. M. & Wildman, R. P. Effect of modest changes in BMI on cardiovascular disease risk markers in severely obese, minority adolescents. Obes Res Clin Pract 4, e163–246 (2010). · DOI
- Vidal-Petiot, E. et al. Visit-to-visit variability of blood pressure and cardiovascular outcomes in patients with stable coronary heart disease. Insights from the STABILITY trial. Eur. Heart J. 38, 2813–2822 (2017). · DOI
- Gaulton, K. J. et al. Genetic fine mapping and genomic annotation defines causal mechanisms at type 2 diabetes susceptibility loci. Nat. Genet. 47, 1415–1425 (2015). · DOI · Paper page
- Paquette, M. et al. Polygenic risk score predicts prevalence of cardiovascular disease in patients with familial hypercholesterolemia. Journal of Clinical Lipidology 11, 725–732.e5 (2017). · DOI · Paper page
- Knowles, J. W. & Ashley, E. A. Cardiovascular disease: The rise of the genetic risk score. PLOS Medicine 15, e1002546 (2018). · DOI · Paper page
- Müller, B. et al. Improved prediction of complex diseases by common genetic markers: state of the art and further perspectives. Hum Genet 135, 259–272 (2016). · DOI
- Schildcrout, J. S. et al. Optimizing drug outcomes through pharmacogenetics: A case for preemptive genotyping. Clin Pharmacol Ther 92, 235–242 (2012). · DOI · Paper page
- Wei, W.-Q. et al. Impact of data fragmentation across healthcare centers on the accuracy of a high-throughput clinical phenotyping algorithm for specifying subjects with type 2 diabetes mellitus. Journal of the American Medical Informatics Association 19, 219–224 (2012). · DOI · Paper page
- Wei, W.-Q., Leibson, C. L., Ransom, J. E., Kho, A. N. & Chute, C. G. The absence of longitudinal data limits the accuracy of high-throughput clinical phenotyping for identifying type 2 diabetes mellitus subjects. Int J Med Inform 82, 239–247 (2013). · DOI
- Liu, H. & Setiono, R. Chi2: feature selection and discretization of numeric attributes. in Proceedings of 7th IEEE International Conference on Tools with Artificial Intelligence 388–391, https://doi.org/10.1109/TAI.1995.479783 (1995). · DOI · Paper page
- Yackel, T. R. & Embi, P. J. Unintended errors with EHR-based result management: a case series. J Am Med Inform Assoc 17, 104–107 (2010). · DOI · Paper page
- Batista, G. E. A. P. A. & Monard, M. C. An analysis of four missing data treatment methods for supervised learning. Applied Artificial Intelligence 17, 519–533 (2003). · DOI · Paper page
- Wei, W.-Q. et al. Evaluating phecodes, clinical classification software, and ICD-9-CM codes for phenome-wide association studies in the electronic health record. PLOS ONE 12, 1–16 (2017).
- Normalized names for clinical drugs: RxNorm at 6 years. Available at, https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3128404/ (Accessed: 18th May 2018)
- Pedregosa, F. et al. Scikit-learn: Machine Learning in Python. J. Mach. Learn. Res. 12, 2825–2830 (2011).
- Lai, K. T., Liu, D., Chang, S. F. & Chen, M. S. Learning Sample Specific Weights for Late Fusion. IEEE Transactions on Image Processing 24, 2772–2783 (2015). · DOI
Cited by
Precision medicine, AI, and the future of personalized health care
Johnson, K. B., Wei, W., Weeraratne, D., Frisse, M. E., Misulis, K., Rhee, K., Zhao, J., & Snowdon, J. L. (2021) · Clinical and Translational Science · doi:10.1111/cts.12884 · Cited by 1,854
Self-citationMultimodal deep learning models for early detection of Alzheimer’s disease stage
Venugopalan, J., Tong, L., Hassanzadeh, H. R., & Wang, M. D. (2021) · Scientific Reports · doi:10.1038/s41598-020-74399-w · Cited by 732
Armoundas, A. A., Narayan, S. M., Arnett, D. K., Spector-Bagdady, K., Bennett, D. A., Celi, L. A., Friedman, P. A., Gollob, M. H., Hall, J. L., Kwitek, A. E., et al. (2024) · Circulation · doi:10.1161/cir.0000000000001201 · Cited by 347
Predictive analytics with gradient boosting in clinical medicine
written on behalf of AME Big-Data Clinical Trial Collaborative Group, Zhang, Z., Zhao, Y., Canes, A., Steinberg, D., & Lyashevska, O. (2019) · Annals of Translational Medicine · doi:10.21037/atm.2019.03.29 · Cited by 312
Zihni, E., Madai, V. I., Livne, M., Galinovic, I., Khalil, A. A., Fiebach, J. B., & Frey, D. (2020) · PLOS ONE · doi:10.1371/journal.pone.0231166 · Cited by 187
Metadata
- Authors
- Zhao, J., Feng, Q., Wu, P., Lupu, R. A., Wilke, R. A., Wells, Q. S., Denny, J. C., & Wei, W.-Q.
- Venue
- Scientific Reports
- Published
- 2019-01-24
- Volume
- 9
- Issue
- 1
- Pages
- 717-717
- ISSN
- 2045-2322 (ISSN-L)
- OpenAlex
- W2952312197
- Cited by
- 209
- References
- 11
- FWCI
- 11.97
- Type
- journal article
- Language
- en
- Open access
- gold
- Licence
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Funders
- U.S. Department of Health & Human Services | NIH | National Institute of General Medical Sciences (GM120523, GM109145)
- U.S. Department of Health & Human Services | NIH | U.S. National Library of Medicine (T15 LM007450, LM010685)
- U.S. Department of Health & Human Services | NIH | National Heart, Lung, and Blood Institute (HL133786)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Learning from Longitudinal Data in Electronic Health Record and Genetic Data to Improve Cardiovascular Event Prediction. https://app.cochat.ai/papers/10.1038/s41598-018-36745-x
- The paper
- Zhao, J., Feng, Q., Wu, P., Lupu, R. A., Wilke, R. A., Wells, Q. S., Denny, J. C., & Wei, W.-Q. (2019). Learning from Longitudinal Data in Electronic Health Record and Genetic Data to Improve Cardiovascular Event Prediction. Scientific Reports. https://doi.org/10.1038/s41598-018-36745-x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
