Development and Validation of a Protein-Based Risk Score for Cardiovascular Outcomes Among Patients With Stable Coronary Heart Disease
Abstract
IMPORTANCE: Precise stratification of cardiovascular risk in patients with coronary heart disease (CHD) is needed to inform treatment decisions. OBJECTIVE: To derive and validate a score to predict risk of cardiovascular outcomes among patients with CHD, using large-scale analysis of circulating proteins. DESIGN, SETTING, AND PARTICIPANTS: Prospective cohort study of participants with stable CHD. For the derivation cohort (Heart and Soul study), outpatients from San Francisco were enrolled from 2000 through 2002 and followed up through November 2011 (≤11.1 years). For the validation cohort (HUNT3, a Norwegian population-based study), participants were enrolled from 2006 through 2008 and followed up through April 2012 (5.6 years). EXPOSURES: Using modified aptamers, 1130 proteins were measured in plasma samples. MAIN OUTCOMES AND MEASURES: A 9-protein risk score was derived and validated for 4-year probability of myocardial infarction, stroke, heart failure, and all-cause death. Tests, including the C statistic, were used to assess performance of the 9-protein risk score, which was compared with the Framingham secondary event model, refit to the cohorts in this study. Within-person change in the 9-protein risk score was evaluated in the Heart and Soul study from paired samples collected 4.8 years apart. RESULTS: From the derivation cohort, 938 samples were analyzed, participants' median age at enrollment was 67.0 years, and 82% were men. From the validation cohort, 971 samples were analyzed, participants' median age at enrollment was 70.2 years, and 72% were men. In the derivation cohort, C statistics were 0.66 for refit Framingham, 0.74 for 9-protein, and 0.75 for refit Framingham plus 9-protein models. In the validation cohort, C statistics were 0.64 for refit Framingham, 0.70 for 9-protein, and 0.71 for refit Framingham plus 9-protein models. Adding the 9-protein risk score to the refit Framingham model increased the C statistic by 0.09 (95% CI, 0.06-0.12) in the derivation cohort, and in the validation cohort, the C statistic was increased by 0.05 (95% CI, 0.02-0.09). Compared with the refit Framingham model, the integrated discrimination index for the 9-protein model was 0.12 (95% CI, 0.08-0.16) in the derivation cohort and 0.08 (95% CI, 0.05-0.10) in the validation cohort. In analysis of paired samples among 139 participants with cardiovascular events after the second sample, absolute within-person annualized risk increased more for the 9-protein model (median, 1.86% [95% CI, 1.15%-2.54%]) than for the refit Framingham model (median, 1.00% [95% CI, 0.87%-1.19%]) (P = .002), while among 375 participants without cardiovascular events, both scores changed less and similarly (P = .30). CONCLUSIONS AND RELEVANCE: Among patients with stable CHD, a risk score based on 9 proteins performed better than the refit Framingham secondary event risk score in predicting cardiovascular events, but still provided only modest discriminative accuracy. Further research is needed to assess whether the score is more accurate in a lower-risk population.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Proteins have shown great clinical utility and promise as prognostic biomarkers in many settings relevant to ageing, prominently in heart, kidney, liver, metabolic, inflammatory and neurodegenerative disease risk.
“Additionally, they have shown great clinical utility and promise as prognostic biomarkers in many settings relevant to ageing, prominently in heart, kidney, liver, metabolic, inflammatory and neurodegenerative disease risk101,161,162.”
From Measuring biological age using omics data (2022) · cites this paper as [161]
Cites
HEART DISEASE AND STROKE STATISTICS–2014 UPDATE: A REPORT FROM THE AMERICAN HEART ASSOCIATION
Tarver, T. (2014) · Journal of Consumer Health on the Internet · doi:10.1080/15398285.2014.902284 · Cited by 5,595 · see citing works
Heart Disease and Stroke Statistics—2014 Update
Go, A. S., Mozaffarian, D., Roger, V. L., Benjamin, E. J., Berry, J. D., Blaha, M. J., Dai, S., Ford, E. S., Fox, C. S., Franco, S., et al. (2013) · Circulation · doi:10.1161/01.cir.0000441139.02102.80 · Cited by 5,207 · see citing works
Assessing the Performance of Prediction Models: A Framework for Traditional and Novel Measures
Steyerberg, E. W., Vickers, A. J., Cook, N. R., Gerds, T., Gonen, M., Obuchowski, N., Pencina, M. J., & Kattan, M. W. (2010) · Epidemiology · doi:10.1097/ede.0b013e3181c30fb2 · Cited by 5,170 · see citing works
2013 ACC/AHA Guideline on the Assessment of Cardiovascular Risk
Goff, D. C., Lloyd-Jones, D. M., Bennett, G., Coady, S., D’Agostino, R. B., Gibbons, R., Greenland, P., Lackland, D. T., Levy, D., O’Donnell, C. J., et al. (2014) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2013.11.005 · Cited by 4,945 · see citing works
Goff, D. C., Lloyd-Jones, D. M., Bennett, G., Coady, S., D’Agostino, R. B., Gibbons, R., Greenland, P., Lackland, D. T., Levy, D., O’Donnell, C. J., et al. (2014) · Circulation · doi:10.1161/01.cir.0000437741.48606.98 · Cited by 3,697 · see citing works
Regression Shrinkage and Selection via The Lasso: A Retrospective
Tibshirani, R. J. (2011) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.1467-9868.2011.00771.x · Cited by 3,601 · see citing works
Heart disease and stroke statistics--2013 update: a report from the American Heart Association.
Go, A. S., Mozaffarian, D., Roger, V. L., Benjamin, E. J., Berry, J. D., Blaha, M. J., Dai, S., Ford, E. S., Fox, C. S., Franco, S., et al. (2013) · eScholarship (California Digital Library) · Cited by 2,601 · see citing works
Extensions of net reclassification improvement calculations to measure usefulness of new biomarkers
Pencina, M. J., D’Agostino, R. B., & Steyerberg, E. W. (2010) · Statistics in Medicine · doi:10.1002/sim.4085 · Cited by 2,478 · see citing works
Aptamer-Based Multiplexed Proteomic Technology for Biomarker Discovery
Gold, L., Ayers, D., Bertino, J., Bock, C., Bock, A., Brody, E. N., Carter, J., Dalby, A. B., Eaton, B. E., Fitzwater, T., et al. (2010) · PLoS ONE · doi:10.1371/journal.pone.0015004 · Cited by 1,754 · see citing works
Survival Model Predictive Accuracy and ROC Curves
Heagerty, P. J., & Zheng, Y. (2005) · Biometrics · doi:10.1111/j.0006-341x.2005.030814.x · Cited by 1,471 · see citing works
Statin Therapy, LDL Cholesterol, C-Reactive Protein, and Coronary Artery Disease
Nissen, S. E., Tuzcu, E. M., Schoenhagen, P., Crowe, T., Sasiela, W. J., Tsai, J., Orazem, J., Magorien, R. D., O'Shaughnessy, C., & Ganz, P. (2005) · New England Journal of Medicine · doi:10.1056/nejmoa042000 · Cited by 1,325 · see citing works
Self-citationHiggins (2002) · doi:10.1002/(issn)1097-0258 · Cited by 1,248 · see citing works
Cohort Profile: The HUNT Study, Norway
Krokstad, S., Langhammer, A., Hveem, K., Holmen, T., Midthjell, K., Stene, T., Bratberg, G., Heggland, J., & Holmen, J. (2013) · International Journal of Epidemiology · doi:10.1093/ije/dys095 · Cited by 1,127 · see citing works
Self-citationRidker, P. M., Danielson, E., Fonseca, F. A., Genest, J., Gotto, A. M., Kastelein, J. J., Koenig, W., Libby, P., Lorenzatti, A. J., MacFadyen, J. G., et al. (2009) · The Lancet · doi:10.1016/s0140-6736(09)60447-5 · Cited by 1,010 · see citing works
Whooley, M. A. (2008) · JAMA · doi:10.1001/jama.2008.711 · Cited by 887 · see citing works
Mega, J. L., Stitziel, N. O., Smith, J. G., Chasman, D. I., Caulfield, M. J., Devlin, J. J., Nordio, F., Hyde, C. L., Cannon, C. P., Sacks, F. M., et al. (2015) · The Lancet · doi:10.1016/s0140-6736(14)61730-x · Cited by 704 · see citing works
McClelland, R. L., Jorgensen, N. W., Budoff, M. J., Blaha, M. J., Post, W. S., Kronmal, R. A., Bild, D. E., Shea, S., Liu, K., Watson, K. E., et al. (2015) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2015.08.035 · Cited by 685 · see citing works
Primary and subsequent coronary risk appraisal: New results from the Framingham study
D’Agostino, R. B., Russell, M. W., Huse, D. M., Ellison, R. C., Silbershatz, H., Wilson, P. W. F., & Hartz, S. C. (2000) · American Heart Journal · doi:10.1016/s0002-8703(00)90236-9 · Cited by 588 · see citing works
Ripatti, S., Tikkanen, E., Orho-Melander, M., Havulinna, A. S., Silander, K., Sharma, A., Guiducci, C., Perola, M., Jula, A., Sinisalo, J., et al. (2010) · The Lancet · doi:10.1016/s0140-6736(10)61267-6 · Cited by 562 · see citing works
Interpreting Incremental Value of Markers Added to Risk Prediction Models
Pencina, M. J., D'Agostino, R. B., Pencina, K. M., Janssens, A. C. J. W., & Greenland, P. (2012) · American Journal of Epidemiology · doi:10.1093/aje/kws207 · Cited by 506 · see citing works
Statins: new American guidelines for prevention of cardiovascular disease
Ridker, P. M., & Cook, N. R. (2013) · The Lancet · doi:10.1016/s0140-6736(13)62388-0 · Cited by 477 · see citing works
Association between a literature-based genetic risk score and cardiovascular events in women
Paynter, N. P. (2010) · JAMA · doi:10.1001/jama.2010.119 · Cited by 361 · see citing works
Expanding the Chemistry of DNA for in Vitro Selection
Vaught, J. D., Bock, C., Carter, J., Fitzwater, T., Otis, M., Schneider, D., Rolando, J. C., Waugh, S. M., Wilcox, S. K., & Eaton, B. E. (2010) · Journal of the American Chemical Society · doi:10.1021/ja908035g · Cited by 314 · see citing works
Kraemer, S., Vaught, J. D., Bock, C., Gold, L., Katilius, E., Keeney, T. R., Kim, N., Saccomano, N. A., Wilcox, S. K., Zichi, D., et al. (2011) · PLoS ONE · doi:10.1371/journal.pone.0026332 · Cited by 310 · see citing works
Criteria for the use of omics-based predictors in clinical trials
McShane, L. M., Cavenagh, M. M., Lively, T., Eberhard, D. A., Bigbee, W. L., Williams, P. M., Mesirov, J. P., Polley, M. C., Kim, K. Y., Tricoli, J. V., et al. (2013) · Nature · doi:10.1038/nature12564 · Cited by 245 · see citing works
An International Model to Predict Recurrent Cardiovascular Disease
Wilson, P. W. F., D’Agostino, R. B., Bhatt, D. L., Eagle, K. A., Pencina, M. J., Smith, S. C., Alberts, M. J., Dallongeville, J., Goto, S., Hirsch, A. T., et al. (2012) · The American Journal of Medicine · doi:10.1016/j.amjmed.2012.01.014 · Cited by 238 · see citing works
Lipid lowering with PCSK9 inhibitors
Dadu, R. T., & Ballantyne, C. M. (2014) · Nature Reviews Cardiology · doi:10.1038/nrcardio.2014.84 · Cited by 232 · see citing works
Transformative Impact of Proteomics on Cardiovascular Health and Disease
Lindsey, M. L., Mayr, M., Gomes, A. V., Delles, C., Arrell, D. K., Murphy, A. M., Lange, R. A., Costello, C. E., Jin, Y.-F., Laskowitz, D. T., et al. (2015) · Circulation · doi:10.1161/cir.0000000000000226 · Cited by 174 · see citing works
Olson, K. A., Beatty, A. L., Heidecker, B., Regan, M. C., Brody, E. N., Foreman, T. M., Kato, S., Mehler, R. E., Singer, B. S., Hveem, K., et al. (2015) · European Heart Journal · doi:10.1093/eurheartj/ehv385 · Cited by 117 · see citing works
Self-citationRacial Differences in Atrial Fibrillation Prevalence and Left Atrial Size
Marcus, G. M., Olgin, J. E., Whooley, M. A., Vittinghoff, E., Stone, K. L., Mehra, R., Hulley, S. B., & Schiller, N. B. (2010) · The American Journal of Medicine · doi:10.1016/j.amjmed.2009.05.019 · Cited by 105 · see citing works
Quantifying discrimination of Framingham risk functions with different survival C statistics
Pencina, M. J., D’Agostino, R. B., & Song, L. (2012) · Statistics in Medicine · doi:10.1002/sim.4508 · Cited by 95 · see citing works
Identifying Patients at High Risk of a Cardiovascular Event in the Near Future
Eagle, K. A., Ginsburg, G. S., Musunuru, K., Aird, W. C., Balaban, R. S., Bennett, S. K., Blumenthal, R. S., Coughlin, S. R., Davidson, K. W., Frohlich, E. D., et al. (2010) · Circulation · doi:10.1161/circulationaha.109.904029 · Cited by 85 · see citing works
Highly Multiplexed Proteomic Platform for Biomarker Discovery, Diagnostics, and Therapeutics
Mehan, M. R., Ostroff, R. M., Wilcox, S. K., Steele, F. R., Schneider, D. J., Jarvis, T. C., Baird, G. S., Gold, L., & Janjić, N. (2012) · Advances in experimental medicine and biology · doi:10.1007/978-1-4614-4118-2_20 · Cited by 69 · see citing works
Beatty, A. L., Ku, I. A., Bibbins-Domingo, K. B., Christenson, R. H., deFilippi, C. R., Ganz, P., Ix, J. H., Lloyd‐Jones, D. M., Omland, T., Sabatine, M. S., et al. (2015) · Journal of the American Heart Association · doi:10.1161/jaha.114.001646 · Cited by 57 · see citing works
Self-citationLife's Simple Measures: Unlocking the Proteome
Brody, E., Gold, L., Mehan, M., Ostroff, R., Rohloff, J., Walker, J., & Zichi, D. (2012) · Journal of Molecular Biology · doi:10.1016/j.jmb.2012.06.021 · Cited by 54 · see citing works
Lambris, J. D., Holers, V. M., & Ricklin, D. (2012) · Advances in experimental medicine and biology · doi:10.1007/978-1-4614-4118-2 · Cited by 13 · see citing works
Tibshirani (1997) · doi:10.1002/(sici)1097-0258(19970228)16:4
Flagged first, then by citations
Cited by
Sorted by citations
Genomic atlas of the human plasma proteome
Sun, B. B., Maranville, J. C., Peters, J. E., Stacey, D., Staley, J. R., Blackshaw, J., Burgess, S., Jiang, T., Paige, E., Surendran, P., et al. (2018) · Nature · doi:10.1038/s41586-018-0175-2 · Cited by 2,268 · see citing works
Undulating changes in human plasma proteome profiles across the lifespan
Lehallier, B., Gate, D., Schaum, N., Nanasi, T., Lee, S. E., Yousef, H., Moran Losada, P., Berdnik, D., Keller, A., Verghese, J., et al. (2019) · Nature Medicine · doi:10.1038/s41591-019-0673-2 · Cited by 981 · see citing works
Mendelian randomization in cardiometabolic disease: challenges in evaluating causality
Holmes, M. V., Ala-Korpela, M., & Smith, G. D. (2017) · Nature Reviews Cardiology · doi:10.1038/nrcardio.2017.78 · Cited by 679 · see citing works
Organ aging signatures in the plasma proteome track health and disease
Oh, H. S.-H., Rutledge, J., Nachun, D., Pálovics, R., Abiose, O., Moran-Losada, P., Channappa, D., Urey, D. Y., Kim, K., Sung, Y. J., et al. (2023) · Nature · doi:10.1038/s41586-023-06802-1 · Cited by 634 · see citing works
Measuring biological age using omics data
Rutledge, J., Oh, H., & Wyss-Coray, T. (2022) · Nature Reviews Genetics · doi:10.1038/s41576-022-00511-7 · Cited by 570 · see citing works
Plasma protein patterns as comprehensive indicators of health
Williams, S. A., Kivimaki, M., Langenberg, C., Hingorani, A. D., Casas, J. P., Bouchard, C., Jonasson, C., Sarzynski, M. A., Shipley, M. J., Alexander, L., et al. (2019) · Nature Medicine · doi:10.1038/s41591-019-0665-2 · Cited by 506 · see citing works
Self-citationGenetics meets proteomics: perspectives for large population-based studies
Suhre, K., McCarthy, M. I., & Schwenk, J. M. (2021) · Nature Reviews Genetics · doi:10.1038/s41576-020-0268-2 · Cited by 478 · see citing works
Niewczas, M. A., Pavkov, M. E., Skupien, J., Smiles, A., Md Dom, Z. I., Wilson, J. M., Park, J., Nair, V., Schlafly, A., Saulnier, P.-J., et al. (2019) · Nature Medicine · doi:10.1038/s41591-019-0415-5 · Cited by 432 · see citing works
Cohort profile update: The HUNT study, Norway
Åsvold, B. O., Langhammer, A., Rehn, T. A., Kjelvik, G., Grøntvedt, T. V., Sørgjerd, E. P., Fenstad, J. S., Heggland, J., Holmen, O., Stuifbergen, M. C., et al. (2023) · International Journal of Epidemiology · doi:10.1093/ije/dyac095 · Cited by 409 · see citing works
Self-citationLarge-scale plasma proteomic analysis identifies proteins and pathways associated with dementia risk
Walker, K. A., Chen, J., Zhang, J., Fornage, M., Yang, Y., Zhou, L., Grams, M. E., Tin, A., Daya, N., Hoogeveen, R. C., et al. (2021) · Nature Aging · doi:10.1038/s43587-021-00064-0 · Cited by 212 · see citing works
Self-citationStability and reproducibility of proteomic profiles measured with an aptamer-based platform
Kim, C. H., Tworoger, S. S., Stampfer, M. J., Dillon, S. T., Gu, X., Sawyer, S. J., Chan, A. T., Libermann, T. A., & Eliassen, A. H. (2018) · Scientific Reports · doi:10.1038/s41598-018-26640-w · Cited by 170 · see citing works
SOMAscan Proteomics Identifies Serum Biomarkers Associated With Liver Fibrosis in Patients With NASH
Luo, Y., Wadhawan, S., Greenfield, A., Decato, B. E., Oseini, A. M., Collen, R., Shevell, D. E., Thompson, J., Jarai, G., Charles, E. D., et al. (2021) · Hepatology Communications · doi:10.1002/hep4.1670 · Cited by 87 · see citing works
“769 The analytical robustness of the SOMAscan platform has been previously established, and it has been used for proteomics-based studies in large cohorts.(20) The current study identified multiple proteins that are linked to biological processes that are related to cell stress/injury (i.”
MethodSchuermans, A., Pournamdari, A. B., Lee, J., Bhukar, R., Ganesh, S., Darosa, N., Small, A. M., Yu, Z., Hornsby, W., Koyama, S., et al. (2024) · Nature Cardiovascular Research · doi:10.1038/s44161-024-00567-0 · Cited by 71 · see citing works
Jiang, Y., Uhm, H., Ip, F. C., Ouyang, L., Lo, R. M. N., Cheng, E. Y. L., Cao, X., Tan, C. M. C., Law, B. C. H., Ortiz‐Romero, P., et al. (2024) · Alzheimer's & Dementia · doi:10.1002/alz.13676 · Cited by 36 · see citing works
Aptamer-based proteomics of serum and plasma in acquired aplastic anemia
Giudice, V., Biancotto, A., Wu, Z., Cheung, F., Candia, J., Fantoni, G., Kajigaya, S., Rios, O., Townsley, D., Feng, X., et al. (2018) · Experimental Hematology · doi:10.1016/j.exphem.2018.09.008 · Cited by 25 · see citing works
Activated GDF11/8 subforms predict cardiovascular events and mortality in humans
Walker, R. G., Kato, T., Ben Driss, L., Williams, S. A., Hinterberg, M. A., Janjic, N., Gelinas, A. D., Carpenter, M. A., Kattamuri, C., Walter, J. E., et al. (2025) · Nature Communications · doi:10.1038/s41467-025-61815-w · Cited by 4 · see citing works
Self-citation
- Authors
- Ganz, P., Heidecker, B., Hveem, K., Jonasson, C., Kato, S., Segal, M. R., Sterling, D. G., & Williams, S. A.
- Affiliations
- San Francisco General Hospital (US)
- University of California, San Francisco (US)
- Norwegian University of Science and Technology (NO)
- NEC (United States) (US)
- SomaLogic (United States) (US)
- Corresponding author
- Ganz, Peter
- ORCID
- Venue
- JAMA
- Publisher
- American Medical Association (AMA)
- Published
- 2016-06-21
- Volume
- 315
- Issue
- 23
- Pages
- 2532
- ISSN
- 0002-9955 (ISSN-L)
- 0098-7484
- OpenAlex
- W2462540433
- Cited by
- 364
- References
- 37
- Citations by year
- 2026: 32 · 2025: 29 · 2024: 40 · 2023: 44 · 2022: 35 · 2021: 39 · 2020: 49 · 2019: 31 · 2018: 31 · 2017: 26 · 2016: 7
- FWCI
- 35.43
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- JAMA (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Heart, Lung, and Blood Institute (R01HL079235)
- Topics
- Health Sciences › Medicine › Surgery › Lipoproteins and Cardiovascular Health
- Health Sciences › Medicine › Cardiology and Cardiovascular Medicine › Acute Myocardial Infarction Research
- Health Sciences › Medicine › Cardiology and Cardiovascular Medicine › Cardiovascular Health and Risk Factors
- Keywords
- stable coronary artery disease, cardiovascular risk stratification, circulating proteins, plasma proteomics, myocardial infarction, stroke, heart failure, all-cause mortality, Framingham risk equation, risk prediction model, Heart and Soul Study, HUNT3
- MeSH terms
- Aged, Blood Proteins, Cause of Death, Coronary Artery Disease, Female, Heart Failure, Humans, Male, Myocardial Infarction, Norway, Prospective Studies, San Francisco, Risk Assessment, Stroke, Proteomics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
