Cited by 38COVID-19 diagnosis using AIArtificial Intelligence in Healthcare and EducationArtificial Intelligence in Healthcare

Deep learning to detect left ventricular structural abnormalities in chest X-rays

Open access
Bhave, Shreyas, Rodriguez, Victor, Poterucha, Timothy, Mutasa, Simukayi, Aberle, Dwight, Capaccione, Kathleen M, Chen, Yibo, Dsouza, Belinda +22 more·2024·European Heart Journal

Abstract

Background and Aims: Early identification of cardiac structural abnormalities indicative of heart failure is crucial to improving patient outcomes. Chest X-rays (CXRs) are routinely conducted on a broad population of patients, presenting an opportunity to build scalable screening tools for structural abnormalities indicative of Stage B or worse heart failure with deep learning methods. In this study, a model was developed to identify severe left ventricular hypertrophy (SLVH) and dilated left ventricle (DLV) using CXRs. Methods: A total of 71 589 unique CXRs from 24 689 different patients completed within 1 year of echocardiograms were identified. Labels for SLVH, DLV, and a composite label indicating the presence of either were extracted from echocardiograms. A deep learning model was developed and evaluated using area under the receiver operating characteristic curve (AUROC). Performance was additionally validated on 8003 CXRs from an external site and compared against visual assessment by 15 board-certified radiologists. Results: The model yielded an AUROC of 0.79 (0.76–0.81) for SLVH, 0.80 (0.77–0.84) for DLV, and 0.80 (0.78–0.83) for the composite label, with similar performance on an external data set. The model outperformed all 15 individual radiologists for predicting the composite label and achieved a sensitivity of 71% vs. 66% against the consensus vote across all radiologists at a fixed specificity of 73%. Conclusions: Deep learning analysis of CXRs can accurately detect the presence of certain structural abnormalities and may be useful in early identification of patients with LV hypertrophy and dilation. As a resource to promote further innovation, 71 589 CXRs with adjoining echocardiographic labels have been made publicly available.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1093/eurheartj/ehad782

Cites

6 of 6 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 30

  1. [1]D’Arcy JL, Coffey S, Loudon MA, Kennedy A, Pearson-Stuttard J, Birks J, et al Large-scale community echocardiographic screening reveals a major burden of undiagnosed valvular heart disease in older people: the OxVALVE Population Cohort Study. Eur Heart J 2016; 37: 3515– 22. 10.1093/eurheartj/ehw229 27354049 PMC5216199 · DOI · Paper page
  2. [2]Maron MS, Hellawell JL, Lucove JC, Farzaneh-Far R, Olivotto I. Occurrence of clinically diagnosed hypertrophic cardiomyopathy in the United States. Am J Cardiol 2016; 117: 1651– 4. 10.1016/j.amjcard.2016.02.044 27006153 · DOI
  3. [3]Alexander KM, Orav J, Singh A, Jacob SA, Menon A, Padera RF, et al Geographic disparities in reported US amyloidosis mortality from 1979 to 2015: potential underdetection of cardiac amyloidosis. JAMA Cardiol 2018; 3: 865– 70. 10.1001/jamacardio.2018.2093 30046835 PMC6233639 · DOI
  4. [4]Heidenreich PA, Bozkurt B, Aguilar D, Allen LA, Byun JJ, Colvin MM, et al 2022 AHA/ACC/HFSA guideline for the management of heart failure: a report of the American College of Cardiology/American Heart Association Joint Committee on Clinical Practice Guidelines. J Am Coll Cardiol 2022; 79: e263– 421. 10.1016/j.jacc.2021.12.012 35379503 · DOI · Paper page
  5. [6]Cheitlin MD, Alpert JS, Armstrong WF, Aurigemma GP, Beller GA, Bierman FZ, et al ACC/AHA guidelines for the clinical application of echocardiography: a report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines (Committee on Clinical Application of Echocardiography) developed in collaboration with the American Society of Echocardiography. Circulation 1997; 95: 1686– 744. https://www.ahajournals.org/doi/10.1161/01.CIR.95.6.1686 9118558 · DOI
  6. [7]Curtis JP, Sokol SI, Wang Y, Rathore SS, Ko DT, Jadbabaie F, et al The association of left ventricular ejection fraction, mortality, and cause of death in stable outpatients with heart failure. J Am Coll Cardiol 2003; 42: 736– 42. 10.1016/S0735-1097(03)00789-7 12932612 · DOI
  7. [8]Lang RM, Badano LP, Mor-Avi V, Afilalo J, Armstrong A, Ernande L, et al Recommendations for cardiac chamber quantification by echocardiography in adults: an update from the American Society of Echocardiography and the European Association of Cardiovascular Imaging. J Am Soc Echocardiogr 2015; 28: 1– 39.e14. 10.1016/j.echo.2014.10.003 25559473 · DOI
  8. [9]Cook CH, Praba AC, Beery PR, Martin LC. Transthoracic echocardiography is not cost-effective in critically ill surgical patients. J Trauma Acute Care Surg 2002; 52: 280– 4. 10.1097/00005373-200202000-00013 11834988 · DOI
  9. [11]Raoof S, Feigin D, Sung A, Raoof S, Irugulpati L, Rosenow EC. Interpretation of plain chest roentgenogram. Chest 2012; 141: 545– 58. 10.1378/chest.10-1302 22315122 · DOI
  10. [12]Gurney J. Why chest radiography became routine. Radiology 1995; 195: 245– 6. 10.1148/radiology.195.1.7892479 7892479 · DOI
  11. [14]Cho J, Lee B, Kwon J-M, Lee Y, Park H, Oh B-H, et al Artificial intelligence algorithm for screening heart failure with reduced ejection fraction using electrocardiography. ASAIO J 2021; 67: 314– 21. 10.1097/MAT.0000000000001218 33627606 · DOI
  12. [15]Elias P, Poterucha TJ, Rajaram V, Moller LM, Rodriguez V, Bhave S, et al Deep learning electrocardiographic analysis for detection of left-sided valvular heart disease. J Am Coll Cardiol 2022; 80: 613– 26. 10.1016/j.jacc.2022.05.029 35926935 · DOI · Paper page
  13. [16]Ulloa-Cerna AE, Jing L, Pfeifer JM, Raghunath S, Ruhl JA, Rocha DB, et al rECHOmmend: an ECG-based machine learning approach for identifying patients at increased risk of undiagnosed structural heart disease detectable by echocardiography. Circulation 2022; 146: 36– 47. 10.1161/circulationaha.121.057869 35533093 PMC9241668 · DOI · Paper page
  14. [17]Cohen-Shelly M, Attia ZI, Friedman PA, Ito S, Essayagh BA, Ko W-Y, et al Electrocardiogram screening for aortic valve stenosis using artificial intelligence. Eur Heart J 2021; 42: 2885– 96. 10.1093/eurheartj/ehab153 33748852 · DOI · Paper page
  15. [18]Kwon J-M, Jeon K-H, Kim HM, Kim MJ, Lim SM, Kim K-H, et al Comparing the performance of artificial intelligence and conventional diagnosis criteria for detecting left ventricular hypertrophy using electrocardiography. EP Europace 2020; 22: 412– 9. 10.1093/europace/euz324 31800031 · DOI
  16. [19]Rajpurkar P, Irvin J, Zhu K, Yang B, Mehta H, Duan T, et al Chexnet: radiologist-level pneumonia detection on chest X-rays with deep learning. arXiv preprint arXiv:1711.05225, 2017. · arXiv
  17. [20]Zhou L, Yin X, Zhang T, Feng Y, Zhao Y, Jin M, et al Detection and semiquantitative analysis of cardiomegaly, pneumothorax, and pleural effusion on chest radiographs. Radiol Artif Intell 2021; 3: e200172. 10.1148/ryai.2021200172 34350406 PMC8328111 · DOI
  18. [21]Knudsen CW, Omland T, Clopton P, Westheim A, Abraham WT, Storrow AB, et al Diagnostic value of B-type natriuretic peptide and chest radiographic findings in patients with acute dyspnea. Am J Med 2004; 116: 363– 8. 10.1016/j.amjmed.2003.10.028 15006584 · DOI
  19. [22]Mant J, Doust J, Roalfe A, Barton P, Cowie M, Glasziou P, et al Systematic review and individual patient data meta-analysis of diagnosis of heart failure, with modelling of implications of different diagnostic strategies in primary care. Health Technol Assess 2009; 13: 1– 207, iii. 10.3310/hta13320 19586584 · DOI · Paper page
  20. [23]Pizer SM, Amburn EP, Austin JD, Cromartie R, Geselowitz A, Greer T, et al Adaptive histogram equalization and its variations. Comput Vis Graph Image Process 1987; 39: 355– 68. 10.1016/S0734-189X(87)80186-X · DOI
  21. [24]Huang G, Liu Z, Van Der Maaten L, Weinberger KQ. Densely connected convolutional networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017, 4700–8.
  22. [25]El Omary S, Lahrache S, El Ouazzani R. Detecting heart failure from chest X-ray images using deep learning algorithms. In: 2021 3rd IEEE Middle East and North Africa COMMunications Conference (MENACOMM), 2021, 13–8. IEEE.
  23. [26]Jabbour S, Fouhey D, Kazerooni E, Sjoding MW, Wiens J. Deep learning applied to chest X-rays: Exploiting and preventing shortcuts. In: Machine Learning for Healthcare Conference, 2020, 750–82. PMLR.
  24. [28]Zhou B, Khosla A, Lapedriza A, Oliva A, Torralba A. Learning deep features for discriminative localization. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2016, 2921–9.
  25. [29]Jiang P-T, Zhang C-B, Hou Q, Cheng M-M, Wei Y. Layercam: exploring hierarchical class activation maps for localization. IEEE Trans Image Process 2021; 30: 5875– 88. 10.1109/TIP.2021.3089943 34156941 · DOI
  26. [30]Glynn P, Lloyd-Jones DM, Feinstein MJ, Carnethon M, Khan SS. Disparities in cardiovascular mortality related to heart failure in the United States. J Am Coll Cardiol 2019; 73: 2354– 5. 10.1016/j.jacc.2019.02.042 31072580 · DOI
  27. [33]Moreno-Torres JG, Raeder T, Alaiz-Rodríguez R, Chawla NV, Herrera F. A unifying view on dataset shift in classification. Pattern Recognit 2012; 45: 521– 30. 10.1016/j.patcog.2011.06.019 · DOI · Paper page
  28. [34]Taori R, Dave A, Shankar V, Carlini N, Recht B, Schmidt L. Measuring robustness to natural distribution shifts in image classification. Adv Neural Inf Process Syst 2020; 33: 18583– 99. https://proceedings.neurips.cc/paper/2020/file/d8330f857a17c53d217014ee776bfd50-Paper.pdf
  29. [36]McDonagh TA, Metra M, Adamo M, Gardner RS, Baumbach A, Böhm M, et al 2021 ESC guidelines for the diagnosis and treatment of acute and chronic heart failure: developed by the task force for the diagnosis and treatment of acute and chronic heart failure of the European Society of Cardiology (ESC) With the special contribution of the Heart Failure Association (HFA) of the ESC. Eur Heart J 2021; 42: 3599– 726. 10.1093/eurheartj/ehab368 34447992 · DOI · Paper page
  30. [37]Heidenreich PA, Bozkurt B, Aguilar D, Allen LA, Byun JJ, Colvin MM, et al 2022 AHA/ACC/HFSA guideline for the management of heart failure: executive summary: a report of the American College of Cardiology/American Heart Association Joint Committee on Clinical Practice Guidelines. J Am Coll Cardiol 2022; 79: 1757– 80. 10.1016/j.jacc.2021.12.011 35379504 · DOI · Paper page

Cited by

Sorted by citations

Authors
Bhave, S., Rodriguez, V., Poterucha, T., Mutasa, S., Aberle, D., Capaccione, K. M., Chen, Y., Dsouza, B., Dumeer, S., Goldstein, J., Hodes, A., Leb, J., Lungren, M., Miller, M., Monoky, D., Navot, B., Wattamwar, K., Wattamwar, A., Clerkin, K., Ouyang, D., Ashley, E., Topkara, V. K., Maurer, M., Einstein, A. J., Uriel, N., Homma, S., Schwartz, A., Jaramillo, D., Perotte, A. J., & Elias, P.
Affiliations
  • Columbia University Irving Medical Center (US)
  • NewYork–Presbyterian Hospital (US)
  • Inova Fairfax Hospital (US)
  • Department of Radiology, Columbia University Irving Medical Center , NewYork, NY , USA
  • Hackensack Meridian School of Medicine (US)
  • University of California, San Francisco (US)
  • Montefiore Medical Center (US)
  • Cedars-Sinai Medical Center (US)
  • Stanford Medicine (US)
Corresponding author
Elias, Pierre
Venue
European Heart Journal
Published
2024-03-20
Volume
45
Issue
22
Pages
2002-2012
ISSN
  • 0195-668X (ISSN-L)
  • 1522-9645
OpenAlex
W4394741028
Cited by
38
References
6
Citations by year
2026: 13 · 2025: 17 · 2024: 8
FWCI
9.68
Type
journal article
Language
en
Open access
Locations
  • European Heart Journal (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
Funders
  • National Institutes of Health
  • National Heart, Lung, and Blood Institute
Topics
  • Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › COVID-19 diagnosis using AI
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
Keywords
left ventricular hypertrophy, left ventricular dilatation, heart failure, chest radiography, deep learning, cardiac structural abnormalities, echocardiography, radiologist comparison, early detection, public datasets
MeSH terms
Deep Learning, Aged, Echocardiography, Female, Heart Failure, Heart Ventricles, Humans, Male, Middle Aged, ROC Curve, Radiography, Thoracic, Hypertrophy, Left Ventricular

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review