The relationship of academic measures in medical school to performance after graduation.
Abstract
This study examined the relationship between academic variables in medical school and outcome measures in the first year of postgraduate training, using data from 947 graduates of Wright State University School of Medicine from 1980 through 1991. The medical school variables were preclinical grade-point averages (GPAs), clerkship GPAs, scores on the National Board of Medical Examiners (NBME) Part I examination, and NBME Part II scores. The outcome measures were NBME Part III scores and physician supervisors' ratings of clinical competence in residency. The medical school academic variables correlated between .46 and .71 with NBME Part III scores and between .20 and .30 with the physician supervisors' ratings. R2 values for NBME Part III scores and physician supervisors' ratings were .51 and .10. Chi-square analysis using factor-analysis-derived variables showed that top-quarter and bottom-quarter achievers in medical school were highly unlikely to change positions whether the graduate outcome measure was physician supervisors' ratings or NBME Part III scores.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Cognitive factors can account for up to 51% of the variance in NBME part III grade.
“These studies show that cognitive factors can account for up to 51% of the variance in NBME part III grade.26”
From Factors associated with success in medical school: systematic review of the literature (2002) · cites this paper as [26]
Cited by
Sorted by citations
Factors associated with success in medical school: systematic review of the literature
Ferguson, E., James, D., & Madeley, L. (2002) · BMJ · doi:10.1136/bmj.324.7343.952 · Cited by 811 · see citing works
Hamdy, H., Prasad, K., Anderson, M. B., Scherpbier, A. J. J. A., Williams, R. G., Zwierstra, R. P., & Cuddihy, H. L. (2006) · Medical Teacher · doi:10.1080/01421590600622723 · Cited by 185 · see citing works
Selection Criteria for Emergency Medicine Residency Applicants
Crane, J. T., & Ferraro, C. (2000) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2000.tb01892.x · Cited by 141 · see citing works
Durning, S. J., Artino, A. R., Pangaro, L. N., van der Vleuten, C. P. M., & Schuwirth, L. (2010) · Academic Medicine · doi:10.1097/acm.0b013e3181d7427c · Cited by 141 · see citing works
Durning, S. J., Cleary, T. J., Sandars, J. E., Hemmer, P. A., Kokotailo, P. K., & Artino, A. R. (2011) · Academic Medicine · doi:10.1097/acm.0b013e31820dc384 · Cited by 119 · see citing works
Comprehensive undergraduate medical assessments improve prediction of clinical performance
WILKINSON, T. J., & FRAMPTON, C. M. A. (2004) · Medical Education · doi:10.1111/j.1365-2929.2004.01962.x · Cited by 110 · see citing works
Does Residency Selection Criteria Predict Performance in Orthopaedic Surgery Residency?
Raman, T., Alrabaa, R. G., Sood, A., Maloof, P., Benevenia, J., & Berberian, W. S. (2015) · Clinical Orthopaedics and Related Research · doi:10.1007/s11999-015-4317-7 · Cited by 108 · see citing works
“The assessment of preresidency selection criteria and success as a resident has been investigated within several specialties, generating many different results and conclusions as will be discussed [1–3, 6, 8, 10, 12, 15, 18–24, 27, 28, 30, 31].”
BackgroundInformation Collected During the Residency Match Process Does Not Predict Clinical Performance
Borowitz, S. M., Saulsbury, F. T., & Wilson, W. G. (2000) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/archpedi.154.3.256 · Cited by 103 · see citing works
The relationship between criteria used to select residents and performance during residency
Papp, K. K., Polk, H. C., & David Richardson, J. (1997) · The American Journal of Surgery · doi:10.1016/s0002-9610(96)00389-3 · Cited by 78 · see citing works
Selection of obstetrics and gynecology residents on the basis of medical school performance
Bell, J. G., Kanellitsas, I., & Shaffer, L. (2002) · American Journal of Obstetrics and Gynecology · doi:10.1067/mob.2002.121622 · Cited by 69 · see citing works
Gonnella, J. S., Erdmann, J. B., & Hojat, M. (2004) · Medical Education · doi:10.1111/j.1365-2923.2004.01774.x · Cited by 64 · see citing works
What predicts surgical internship performance?
Andriole, D. A., Jeffe, D. B., & Whelan, A. J. (2004) · The American Journal of Surgery · doi:10.1016/j.amjsurg.2004.03.003 · Cited by 61 · see citing works
“[3] Markert RJ.”
BackgroundDamage control orthopedic surgery (DOC): Is there an Influence on outcome?
Amin, O. A., Mustafa, K., & Hussein, H. (2011) · PubMed · Cited by 49 · see citing works
Taylor, M. L., Blue, A. V., Mainous, A. G., et al. (2005) · Academic Medicine · doi:10.1097/00001888-200505000-00019 · Cited by 40 · see citing works
Cullen, M. W., Reed, D. A., Halvorsen, A. J., Wittich, C. M., Kreuziger, L. B., Keddis, M. T., McDonald, F. S., & Beckman, T. J. (2011) · Mayo Clinic Proceedings · doi:10.4065/mcp.2010.0655 · Cited by 40 · see citing works
Evaluating applicants to emergency medicine residency programs
Balentine, J., Gaeta, T. J., & Spevack, T. A. (1999) · Journal of Emergency Medicine · doi:10.1016/s0736-4679(98)00138-3 · Cited by 38 · see citing works
Untying the Gordian knot: remediation problems in medical schools that need remediation
Bennion, L. D., Durning, S. J., LaRochelle, J. S., Yoon, M. H., Schreiber-Gregory, D. N., Reamy, B. V., & Torre, D. M. (2018) · BMC Medical Education · doi:10.1186/s12909-018-1219-x · Cited by 34 · see citing works
Development of a Tool to Measure Clinical Competence in Occupational Therapy: A Pilot Study?
Salvatori, P. S., Baptiste, S., & Ward, M. (2000) · Canadian Journal of Occupational Therapy · doi:10.1177/000841740006700108 · Cited by 36 · see citing works
Outcomes in Medical Education: What is the Standard and Outcome of Care Delivered by our Graduates?
Tamblyn, R. M. (1999) · Advances in Health Sciences Education · doi:10.1023/a:1009893715930 · Cited by 34 · see citing works
“... to an assessment of intermediate markers ‐ the clinical competence of graduates (Swanson et al., 1993; Case et al., 1995; Elam and Johnson, 1994; Swanson et al., 1996; Case et al., 1996; Mennin et al., 1993; Elam and Johnson, 1994; Veloski et al., 1979; Catalano and Jenkins, 1989; George et al., 1989; Gonnella and…”
BackgroundComparative values of medical school assessments in the prediction of internship performance
Lee, M. J., & Vermillion, M. (2018) · Medical Teacher · doi:10.1080/0142159x.2018.1430353 · Cited by 33 · see citing works
What Predicts USMLE Step 3 Performance?
Andriole, D. A., Jeffe, D. B., Hageman, H. L., et al. (2005) · Academic Medicine · doi:10.1097/00001888-200510001-00009 · Cited by 33 · see citing works
Predictors of Undergraduate and Postgraduate Clinical Performance: A Longitudinal Cohort Study
Kim, T., Chang, J.-Y., Myung, S. J., Chang, Y., Park, K. D., Park, W. B., & Shin, C. S. (2016) · Journal of surgical education · doi:10.1016/j.jsurg.2016.03.006 · Cited by 29 · see citing works
Ayers, W. R., & Boulet, J. R. (2001) · Teaching and Learning in Medicine · doi:10.1207/s15328015tlm1304_01 · Cited by 27 · see citing works
Characteristics of internal medicine residents who successfully match into cardiology fellowships
Cullen, M. W., Klarich, K. W., Oxentenko, A. S., et al. (2020) · BMC Medical Education · doi:10.1186/s12909-020-02154-w · Cited by 25 · see citing works
Emergency Medicine Standardized Letter of Recommendation: Predictors of Guaranteed Match
Girzadas, D. V., Harwood, R. C., Delis, S., et al. (2001) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2001.tb00179.x · Cited by 25 · see citing works
Fagan, R. J., Harkin, E., Wu, K., et al. (2019) · Journal of surgical education · doi:10.1016/j.jsurg.2019.06.016 · Cited by 20 · see citing works
Otolaryngology Resident Selection
Bent, J. P., Colley, P. M., Zahtz, G. D., Smith, R. V., Parikh, S. R., Schiff, B. A., & Fried, M. P. (2011) · Otolaryngology · doi:10.1177/0194599810396604 · Cited by 19 · see citing works
Is Undergraduate Performance Predictive of Postgraduate Performance?
Woloschuk, W., McLaughlin, K., & Wright, B. J. (2010) · Teaching and Learning in Medicine · doi:10.1080/10401334.2010.488205 · Cited by 19 · see citing works
ALTMAIER, E. M., From, R. P., Pearson, K. S., et al. (1997) · Journal of Clinical Anesthesia · doi:10.1016/s0952-8180(97)00195-5 · Cited by 17 · see citing works
Predicting residents' performance: A prospective study
Ozuah, P. O. (2002) · BMC Medical Education · doi:10.1186/1472-6920-2-7 · Cited by 13 · see citing works
“The observed degrees of correlation between ISC ratings and future clinical performance compare quite favorably with those reported for objective measures of medical school performance and even exceed those reported for objective criteria such as National Board of Medical Examination scores, medical school grade point…”
ResultPearson, S., Rolfe, I. E., & Henry, R. L. (1998) · Medical Education · doi:10.1046/j.1365-2923.1998.00161.x · Cited by 14 · see citing works
Cavalieri, T. A., Shen, L., & Slick, G. L. (2003) · PubMed · Cited by 11 · see citing works
Clinical Competence: A Review of the Health Care Literature with a Focus on Occupational Therapy
Salvatori, P. S. (1996) · Canadian Journal of Occupational Therapy · doi:10.1177/000841749606300407 · Cited by 11 · see citing works
Study of Selected Outcomes of Medical Students Who Fail USMLE Step 1
Biskobing, D. M., Lawson, S. R., Messmer, J. M., et al. (2006) · Medical Education Online · doi:10.3402/meo.v11i.4589 · Cited by 10 · see citing works
Board scores and resident performance: Is there a link?
Blanchard, J. (2000) · Annals of Emergency Medicine · doi:10.1067/mem.2000.107577 · Cited by 10 · see citing works
Minorities and the Orthopaedic Profession
Ayers, C. E.-E. (1999) · Clinical Orthopaedics and Related Research · doi:10.1097/00003086-199905000-00010 · Cited by 10 · see citing works
Grade Inflation in Medical Student Radiation Oncology Clerkships: Missed Opportunities for Feedback?
Grover, S., Swisher-McClure, S. D., Sosnowicz, S., et al. (2015) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2015.03.039 · Cited by 8 · see citing works
Were today's professors good students? Case study of the Zagreb University School of Medicine.
Kuzman, T., Bergovec, M., & Rojnić, M. (2004) · PubMed · Cited by 7 · see citing works
Teaching Newborn Medicine to Third-Year Medical Students
McCurdy, F. A. (1995) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/archpedi.1995.02170130051011 · Cited by 6 · see citing works
Chung, E., Yun, H., Yang, J.-H., Shin, M., & Han, E. (2024) · PLoS ONE · doi:10.1371/journal.pone.0296682 · Cited by 5 · see citing works
Predicting Quality of Clinical Performance From Cardiology Fellowship Applications
Cullen, M. W., Beckman, T. J., Baldwin, K. M., Engstler, G. J., Mandrekar, J. N., Scott, C. G., & Klarich, K. W. (2020) · Texas Heart Institute Journal · doi:10.14503/thij-18-6851 · Cited by 4 · see citing works
“Medical school grades have predicted internship performance in various specialties.(6,7) Among internal medicine residency candidates, positive statements in recommendation letters comparing applicants with their peers are associated with professionalism during internship.”
BackgroundWhy the Delay? Factors Predicting Step 1 Delay
Manger, J., Benedik, L., Matott, M. P., et al. (2025) · Medical Science Educator · doi:10.1007/s40670-025-02349-0 · Cited by 3 · see citing works
“Because evidence indicates that success on National Board of Medical Examiners (NBME) exams and questions correlates with future success, our assessments include many of these elements [9–11].”
Álvarez, I. C. M., Montalvo, A. O., & Ma. Eugenia Ponce De León, C. (2009) · Cited by 2 · see citing works
van Luijk, S. J. (1994) · doi:10.26481/dis.19941021sl · Cited by 2 · see citing works
An opportunity for professionalism in the Match
McAlister, R. P. (2003) · Obstetrics and Gynecology · doi:10.1016/j.obstetgynecol.2003.09.036 · Cited by 1 · see citing works
Caracterización por promedio de los grupos de internado de la Facultad de Medicina de la UNAM
Carmona, C. R., Rojas, A. M. M., Martínez, A. N., et al. (2015) · Investigación en Educación Médica · doi:10.1016/s2007-5057(15)72163-0 · Cited by 1 · see citing works
Best evidence on medical school assessment: can it predict future performance?
Hamdy, H., & Khalek, N. A. (2008) · The Clinical Teacher · doi:10.1111/j.1743-498x.2008.00220.x
Can We More Wisely Choose Residents?
Pittman, T. A. (2014) · World Neurosurgery · doi:10.1016/j.wneu.2014.06.028
Rezaee, M. E., Roshani, D., Iranfar, S., et al. (2005) · Majallah-i dānishgāh-i ̒ulūm-i pizishkī-i Kirmānshāh
An Opportunity for Professionalism in the Match
McAlister, R. P. (2003) · Obstetrics and Gynecology · doi:10.1097/00006250-200312000-00002
- Authors
- Markert, R. J.
- Corresponding author
- Markert, R J
- Venue
- Academic Medicine
- Publisher
- Oxford University Press (OUP)
- Published
- 1993-02
- Volume
- 68
- Issue
- 2
- Pages
- S31-4
- ISSN
- 1040-2446 (ISSN-L)
- OpenAlex
- W2043082206
- Cited by
- 51
- References
- 0
- Citations by year
- 2025: 1 · 2024: 1 · 2020: 2 · 2019: 1 · 2018: 2 · 2016: 1 · 2015: 3 · 2014: 2
- FWCI
- 1.58
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Academic Medicine (publishedVersion)
- PubMed (publishedVersion)
- Journal of Bioresource Management (submittedVersion)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Innovations in Medical Education
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Medical Education and Admissions
- Social Sciences › Gender Studies › Diversity and Career in Medicine
- Keywords
- graduate medical education, clinical competence, grade point average, clerkship grades, medical graduates
- MeSH terms
- Achievement, Clinical Competence, Data Interpretation, Statistical, Education, Medical, Humans, Internship and Residency, Longitudinal Studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
