Accuracy of Physicians’ Electrocardiogram Interpretations: A Systematic Review and Meta-analysis
Open accessThe DOI matches its Crossref record; 79 of the 79 references it cites were found in a registry or an index.
Abstract
Importance: The electrocardiogram (ECG) is the most common cardiovascular diagnostic test. Physicians' skill in ECG interpretation is incompletely understood. Objectives: To identify and summarize published research on the accuracy of physicians' ECG interpretations. Data Sources: A search of PubMed/MEDLINE, Embase, Cochrane CENTRAL (Central Register of Controlled Trials), PsycINFO, CINAHL (Cumulative Index to Nursing and Allied Health), ERIC (Education Resources Information Center), and Web of Science was conducted for articles published from database inception to February 21, 2020. Study Selection: Of 1138 articles initially identified, 78 studies that assessed the accuracy of physicians' or medical students' ECG interpretations in a test setting were selected. Data Extraction and Synthesis: Data on study purpose, participants, assessment features, and outcomes were abstracted, and methodological quality was appraised with the Medical Education Research Study Quality Instrument. Results were pooled using random-effects meta-analysis. Main Outcomes and Measures: Accuracy of ECG interpretation. Results: Of 1138 studies initially identified, 78 assessed the accuracy of ECG interpretation. Across all training levels, the median accuracy was 54% (interquartile range [IQR], 40%-66%; n = 62 studies) on pretraining assessments and 67% (IQR, 55%-77%; n = 47 studies) on posttraining assessments. Accuracy varied widely across studies. The pooled accuracy for pretraining assessments was 42.0% (95% CI, 34.3%-49.6%; n = 24 studies; I2 = 99%) for medical students, 55.8% (95% CI, 48.1%-63.6%; n = 37 studies; I2 = 96%) for residents, 68.5% (95% CI, 57.6%-79.5%; n = 10 studies; I2 = 86%) for practicing physicians, and 74.9% (95% CI, 63.2%-86.7%; n = 8 studies; I2 = 22%) for cardiologists. Conclusions and Relevance: Physicians at all training levels had deficiencies in ECG interpretation, even after educational interventions. Improved education across the practice continuum appears warranted. Wide variation in outcomes could reflect real differences in training or skill or differences in assessment design.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225
AHA/ACCF/HRS Recommendations for the Standardization and Interpretation of the Electrocardiogram
Surawicz, B., Childers, R., Deal, B. J., & Gettes, L. S. (2009) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2008.12.013 · Cited by 2,032
American Academy of Family Physicians
(1966) · New England Journal of Medicine · doi:10.1056/nejm196611172752014 · Cited by 1,948
Current Concepts in Validity and Reliability for Psychometric Instruments: Theory and Application
Cook, D. A., & Beckman, T. J. (2006) · The American Journal of Medicine · doi:10.1016/j.amjmed.2005.10.036 · Cited by 1,745
Self-citationAssociation Between Funding and Quality of Published Medical Education Research
Reed, D. A., Cook, D. A., Beckman, T. J., Levine, R. B., Kern, D. E., & Wright, S. M. (2007) · JAMA · doi:10.1001/jama.298.9.1002 · Cited by 958
Self-citationEffectiveness of Intelligent Tutoring Systems: A Meta-Analytic Review
Kulik, J. A., & Fletcher, J. D. (2016) · Review of Educational Research · doi:10.3102/0034654315581420 · Cited by 930
Kligfield (2007) · doi:10.1161/circulationaha.106.180200 · Cited by 802
Cook, D. A., Hamstra, S. J., Brydges, R., Zendejas, B., Szostek, J. H., Wang, A. T., Erwin, P. J., & Hatala, R. (2013) · Medical Teacher · doi:10.3109/0142159x.2012.714886 · Cited by 709
Self-citationKogan, J. R., Holmboe, E. S., & Hauer, K. E. (2009) · JAMA · doi:10.1001/jama.2009.1365 · Cited by 598
Advances in Medical Education and Practice
(2020) · Advances in Medical Education and Practice · doi:10.2147/amep · Cited by 554
Computer-Interpreted Electrocardiograms
Schläpfer, J., & Wellens, H. J. (2017) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2017.07.723 · Cited by 377
Cook, D. A., Zendejas, B., Hamstra, S. J., Hatala, R., & Brydges, R. (2014) · Advances in Health Sciences Education · doi:10.1007/s10459-013-9458-4 · Cited by 317
Self-citationSalerno, S. M., Alguire, P. C., & Waxman, H. S. (2003) · Annals of Internal Medicine · doi:10.7326/0003-4819-138-9-200305060-00013 · Cited by 261
Kadish, A. H., Buxton, A. E., Kennedy, H. L., Knight, B. P., Mason, J. W., Schuger, C. D., Tracy, C. M., Winters, W. L., Boone, A. W., Elnicki, M., et al. (2001) · Journal of the American College of Cardiology · doi:10.1016/s0735-1097(01)01680-1 · Cited by 244
Committee Members, Kadish, A. H., Buxton, A. E., Kennedy, H. L., Knight, B. P., Mason, J. W., Schuger, C. D., Tracy, C. M., Winters, W. L., Boone, A. W., et al. (2001) · Circulation · doi:10.1161/circ.104.25.3169 · Cited by 192
Hatala, R. M., Brooks, L. R., & Norman, G. R. (2003) · Advances in Health Sciences Education · doi:10.1023/a:1022687404380 · Cited by 168
Impact of a clinical scenario on accuracy of electrocardiogram interpretation
Hatala, R., Norman, G. R., & Brooks, L. R. (1999) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.1999.00298.x · Cited by 164
Recommendations for the Standardization and Interpretation of the Electrocardiogram
Mason, J. W., Hancock, E. W., Gettes, L. S., Bailey, J. J., Childers, R., Deal, B. J., Josephson, M., Kligfield, P., Kors, J. A., Macfarlane, P., et al. (2007) · Circulation · doi:10.1161/circulationaha.106.180201 · Cited by 155
Rui, Z., Lian-rui, X., Rong-zheng, Y., Jing, Z., Xue-hong, W., & Chuan, Z. (2017) · BMC Medical Education · doi:10.1186/s12909-017-0881-8 · Cited by 134
Raupach, T., Brown, J., Anders, S., Hasenfuss, G., & Harendza, S. (2013) · BMC Medicine · doi:10.1186/1741-7015-11-61 · Cited by 128
Salerno, S. M., Alguire, P. C., & Waxman, H. S. (2003) · Annals of Internal Medicine · doi:10.7326/0003-4819-138-9-200305060-00012 · Cited by 109
The Computerized ECG: Friend and Foe
Smulyan, H. (2018) · The American Journal of Medicine · doi:10.1016/j.amjmed.2018.08.025 · Cited by 108
Teaching the interpretation of electrocardiograms: Which method is best?
Fent, G. J., Gosai, J. N., & Purva, M. (2014) · Journal of Electrocardiology · doi:10.1016/j.jelectrocard.2014.12.014 · Cited by 107
Smith, S. W., Walsh, B., Grauer, K., Wang, K., Rapin, J., Li, J., Fennell, W., & Taboulet, P. (2019) · Journal of Electrocardiology · doi:10.1016/j.jelectrocard.2018.11.013 · Cited by 106
Mahler, S. A., Wolcott, C., Swoboda, T. K., Wang, H., & Arnold, T. (2011) · Medical Education · doi:10.1111/j.1365-2923.2010.03891.x · Cited by 100
Evaluation of a web-based ECG-interpretation programme for undergraduate medical students
Nilsson, M., Bolinder, G., Held, C., Johansson, B., Fors, U., & Östergren, J. (2008) · BMC Medical Education · doi:10.1186/1472-6920-8-25 · Cited by 100
Berger, J. S., Eisen, L. A., Nozad, V., D’Angelo, J., Calderon, Y., Brown, D., & Schweitzer, P. (2005) · The American Journal of Medicine · doi:10.1016/j.amjmed.2004.12.004 · Cited by 98
(1997) · Springer eBooks · doi:10.1007/978-94-011-4886-3 · Cited by 85
Both preparing to teach and teaching positively impact learning outcomes for peer teachers
Gregory, A. J., Walker, I. O., McLaughlin, K., & Peets, A. D. (2011) · Medical Teacher · doi:10.3109/0142159x.2011.586747 · Cited by 84
Impact of teaching and assessment format on electrocardiogram interpretation skills
Raupach, T., Hanneforth, N., Anders, S., Pukrop, T., Th J ten Cate, O., & Harendza, S. (2010) · Medical Education · doi:10.1111/j.1365-2923.2010.03687.x · Cited by 78
Bojsen, S. R., Räder, S. B. E. W., Holst, A. G., Kayser, L., Ringsted, C. V., Svendsen, J. H., & Konge, L. (2015) · BMC Medical Education · doi:10.1186/s12909-015-0319-0 · Cited by 78
Interpretation of electrocardiograms by first-year residents: the need for change
Eslava, D. J., Dhillon, S. K., Berger, J. S., Homel, P., & Bergmann, S. R. (2009) · Journal of Electrocardiology · doi:10.1016/j.jelectrocard.2009.07.020 · Cited by 78
Western Journal of Emergency Medicine
(2023) · Western Journal of Emergency Medicine · doi:10.5811/westjem · Cited by 77
Ratanawongsa, N., Thomas, P. A., Marinopoulos, S. S., Dorman, T., Wilson, L. M., Ashar, B. H., Magaziner, J. L., Miller, R. G., Prokopowicz, G. P., Qayyum, R., et al. (2008) · Academic Medicine · doi:10.1097/acm.0b013e3181637925 · Cited by 77
ECG interpretation skills of South African Emergency Medicine residents
de Jager, J., Wallis, L. A., & Maritz, D. (2010) · International Journal of Emergency Medicine · doi:10.1007/s12245-010-0227-3 · Cited by 71
Rubinstein, J., Dhoble, A., & Ferenchick, G. S. (2009) · BMC Medical Education · doi:10.1186/1472-6920-9-4 · Cited by 68
Competency in ECG Interpretation Among Medical Students
Kopeć, G., Magoń, W., Holda, M. K., & Podolec, P. S. (2015) · Medical Science Monitor · doi:10.12659/msm.895129 · Cited by 65
Clinical Competence in Electrocardiography
Fisch, C., Ryan, T. J., Williams, S. V., Achord, J. L., Akhtar, M., Crawford, M. H., Friesinger, G. C., Holzinger, E. J., Klocke, F. J., Kowey, P. R., et al. (1995) · Circulation · doi:10.1161/01.cir.91.10.2683 · Cited by 61
Antiperovitch, P., Zaręba, W., Steinberg, J. S., Bachárová, L., Tereshchenko, L. G., Farré, J., Nikus, K. C., Ikeda, T., Baranchuk, A. M., & International Society of Electrocardiology and the International Society of Holter and Noninvasive Electrocardiology (2017) · Journal of Hospital Medicine · doi:10.12788/jhm.2876 · Cited by 61
Accelerating expertise: Perceptual and adaptive learning technology in medical learning
Kellman, P. J., & Krasne, S. (2018) · Medical Teacher · doi:10.1080/0142159x.2018.1484897 · Cited by 52
Hatala, R. A., Gutman, J., Lineberry, M. C., Triola, M. M., & Pusic, M. V. (2018) · Advances in Health Sciences Education · doi:10.1007/s10459-018-9846-x · Cited by 51
Self-citationGoodacre, S. W., Webster, A. P., & Morris, F. (2001) · Postgraduate Medical Journal · doi:10.1136/pmj.77.909.455 · Cited by 45
Debiasing versus knowledge retrieval checklists to reduce diagnostic error in ECG interpretation
Sibbald, M., Sherbino, J., Ilgen, J. S., Zwaan, L., Blissett, S., Monteiro, S., & Norman, G. R. (2019) · Advances in Health Sciences Education · doi:10.1007/s10459-019-09875-8 · Cited by 42
E‐learning and near‐peer teaching in electrocardiogram education: a randomised trial
Davies, A., MacLeod, R., Bennett-Britton, I., McElnay, P., Bakhbakhi, D., & Sansom, J. (2015) · The Clinical Teacher · doi:10.1111/tct.12421 · Cited by 42
Feasibility of self-reflection as a tool to balance clinical reasoning strategies
Sibbald, M., & de Bruin, A. B. H. (2011) · Advances in Health Sciences Education · doi:10.1007/s10459-011-9320-5 · Cited by 41
Balady, G. J., Bufalino, V. J., Gulati, M., Kuvin, J. T., Mendes, L. A., & Schuller, J. L. (2015) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2015.03.021 · Cited by 40
Barthelemy, F. X., Segard, J., Fradin, P., Hourdin, N., Batard, É., Pottier, P., Potel, G., & Montassier, E. (2015) · European Journal of Emergency Medicine · doi:10.1097/mej.0000000000000312 · Cited by 39
Electrocardiographic Interpretation Skills of Cardiology Residents: Are They Competent?
Sibbald, M., Davies, E. G., Dorian, P., & Yu, E. (2014) · Canadian Journal of Cardiology · doi:10.1016/j.cjca.2014.08.026 · Cited by 39
Pourmand, A., Tanski, M., Davis, S., Shokoohi, H., Lucas, R. H., & Zaver, F. (2015) · Western Journal of Emergency Medicine · doi:10.5811/westjem.2014.12.23706 · Cited by 37
Boulouffe, C., Doucet, B., Muschart, X., Charlin, B., & Vanpee, D. (2013) · Emergency Medicine Journal · doi:10.1136/emermed-2012-201737 · Cited by 36
Fent, G. J., Gosai, J. N., & Purva, M. (2015) · Journal of Electrocardiology · doi:10.1016/j.jelectrocard.2015.11.005 · Cited by 35
Electrocardiographic Training in Primary Care Residency Programs
Pinkerton, R. E. (1981) · JAMA · doi:10.1001/jama.1981.03320020040021 · Cited by 34
The effect of clinical history on physiciansʼ ECG interpretation skills
Hatala, R. A., Norman, G. R., & Brooks, L. R. (1996) · Academic Medicine · doi:10.1097/00001888-199610000-00047 · Cited by 32
Educational Software Applied in Teaching Electrocardiogram: A Systematic Review
Pontes, P. A. I., Chaves, R. O., Castro, R. C., de Souza, É. F., Seruffo, M. C. D. R., & Francês, C. R. L. (2018) · BioMed Research International · doi:10.1155/2018/8203875 · Cited by 31
Novotný, T., Bond, R., Andršová, I., Koc, L., Šišáková, M., Finlay, D., Guldenring, D., Špinar, J., & Malík, M. (2015) · Journal of Electrocardiology · doi:10.1016/j.jelectrocard.2015.08.023 · Cited by 31
Burke, J. F., Gnall, E., Umrudden, Z., Kyaw, M., & Schick, P. K. (2008) · Medical Teacher · doi:10.1080/01421590801972471 · Cited by 30
Electrocardiogram interpretation skills in pediatric residents
Crocetti, M. T., & Thompson, R. (2010) · Annals of Pediatric Cardiology · doi:10.4103/0974-2069.64356 · Cited by 30
The Effect of Erroneous Computer Interpretation of ECGs on Resident Decision Making
Southern, W. N., & Arnsten, J. H. (2009) · Medical Decision Making · doi:10.1177/0272989x09333125 · Cited by 28
ECG rhythm analysis with expert and learner-generated schemas in novice learners
Blissett, S., Cavalcanti, R. B., & Sibbald, M. (2014) · Advances in Health Sciences Education · doi:10.1007/s10459-014-9572-y · Cited by 26
Dong, R., Yang, X., Xing, B., Zou, Z., Zheng, Z., Xie, X., Zhu, J., Chen, L., & Zhou, H.-J. (2015) · Europe PMC (PubMed Central) · Cited by 26
Monteiro, S., Melvin, L., Manolakos, J. J., Patel, A., & Norman, G. R. (2017) · Perspectives on Medical Education · doi:10.1007/s40037-017-0365-x · Cited by 25
Performance of the BMJ learning training modules for ECG interpretation in athletes
Riding, N. R., & Drezner, J. A. (2018) · Heart · doi:10.1136/heartjnl-2018-313066 · Cited by 20
Worked examples for teaching electrocardiogram interpretation: Salient or discriminatory features?
Thach, T. H., Blissett, S., & Sibbald, M. (2020) · Medical Education · doi:10.1111/medu.14066 · Cited by 19
Electrocardiogram training for residents: A curriculum based on Facebook and Twitter
Liu, S. S., Zakaria, S., Vaidya, D. M., & Srivastava, M. C. (2017) · Journal of Electrocardiology · doi:10.1016/j.jelectrocard.2017.04.010 · Cited by 18
Hartman, N. D., Wheaton, N. B., Williamson, K., Quattromani, E. N., Branzetti, J. B., & Aldeen, A. Z. (2016) · Journal of Emergency Medicine · doi:10.1016/j.jemermed.2016.06.054 · Cited by 18
Accuracy Screening for ST Elevation Myocardial Infarction in a Task-switching Simulation
Soares, W. E., Price, L. L., Prast, B., Tarbox, E., Mader, T. J., & Blanchard, R. D. (2018) · Western Journal of Emergency Medicine · doi:10.5811/westjem.2018.10.39962 · Cited by 18
Novice interpretation of screening electrocardiograms and impact of online training
Porras, L., Drezner, J. A., Dotson, A. B., Stafford, H. C., Berkoff, D. J., Agnihotri, K., & Chung, E. H. (2016) · Journal of Electrocardiology · doi:10.1016/j.jelectrocard.2016.02.004 · Cited by 15
Knoery, C., Bond, R., Iftikhar, A., Rjoob, K. W. Y., McGilligan, V., Peace, A. J., Heaton, J., & Leslie, S. J. (2019) · Journal of Electrocardiology · doi:10.1016/j.jelectrocard.2019.08.006 · Cited by 14
Kewcharoen, J., Charoenpoonsiri, N., Thangjui, S., Panthong, S., & Hongkan, W. (2020) · Europe PMC (PubMed Central) · doi:10.30476/jamp.2019.81458.1006 · Cited by 13
Rourke, L., Leong, J., & Chatterly, P. (2018) · Teaching and Learning in Medicine · doi:10.1080/10401334.2018.1428611 · Cited by 13
Smith, M. W., & Rondero, D. A. (2019) · PeerJ · doi:10.7717/peerj.6632 · Cited by 9
Electrocardiogram interpretation skills in psychiatry trainees
Yadav, R., & Vidyarthi, A. (2013) · The Psychiatrist · doi:10.1192/pb.bp.112.038992 · Cited by 7
Mohyuddin, G. R., Jobe, A., & Thomas, L. (2020) · Cureus · doi:10.7759/cureus.6872 · Cited by 6
Randomized study to compare two ECG e-learning methods among medical students
Kopeć, G., Waligóra, M., Pacia, M., Chmielak, W., Stępień, A., Janiec, S., Magoń, W., Jonas, K., & Podolec, P. S. (2017) · Polskie Archiwum Medycyny Wewnętrznej · doi:10.20452/pamw.4146 · Cited by 6
EVALUATION ON ECG TRAINING PROGRAM FOR INTERNS AND POSTGRADUATES
Suresh, K., Badrinath, A., Babu, S., & Eswarawaha, M. (2018) · Journal of Evolution of Medical and Dental Sciences · doi:10.14260/jemds/2018/91 · Cited by 4
Asteroids® and Electrocardiograms: Proof of Concept of a Simulation for Task-Switching Training
Aziz, F., Yeh, B., Emerson, G., Way, D. P., Miguel, C. S., & King, A. M. (2018) · Western Journal of Emergency Medicine · doi:10.5811/westjem.2018.10.39722 · Cited by 2
Cited by
Machine learning for ECG diagnosis and risk stratification of occlusion myocardial infarction
Al-Zaiti, S. S., Martin-Gill, C., Zègre-Hemsey, J. K., Bouzid, Z., Faramand, Z., Alrawashdeh, M. O., Gregg, R. E., Helman, S., Riek, N. T., Kraevsky-Phillips, K., et al. (2023) · Nature Medicine · doi:10.1038/s41591-023-02396-3 · Cited by 309
Diagnosis of cardiac conditions from 12-lead electrocardiogram through natural language supervision
Zhou, X., Li, T., Hayama, H., Nakamura, K., Liu, S.-H., Chen, W., & Zhu, X. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-02074-3 · Cited by 8
Metadata
- Authors
- Cook, D. A., Oh, S.-Y., & Pusic, M. V.
- Venue
- JAMA Internal Medicine
- Publisher
- American Medical Association (AMA)
- Published
- 2020-11-01
- Volume
- 180
- Issue
- 11
- Pages
- 1461
- ISSN
- 2168-6106 (ISSN-L)
- OpenAlex
- W3088459955
- Cited by
- 203
- References
- 79
- FWCI
- 17.34
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.