Resident and program characteristics that impact performance on the Ophthalmic Knowledge Assessment Program (OKAP)
Open accessAbstract
BACKGROUND: To determine which resident and program characteristics correlate with ophthalmic knowledge, as assessed by resident Ophthalmic Knowledge Assessment Program (OKAP) performance. METHODS: An online survey was sent in June 2017 to all US ophthalmology residents who took the OKAP in April 2017. RESULTS: The survey response rate was 13.8% (192/1387 residents). The mean respondent age was 30.4 years, and 57.3% were male. The mean [SD] self-reported 2017 OKAP percentile was 61.9 [26.7]. OKAP performance was found to have a significant positive correlation with greater number of hours spent/week studying for the OKAPs (p = 0.007), with use of online question banks (p < 0.001), with review sessions and/or lectures arranged by residency programs (p < 0.001), and with OKAP-specific didactics (p = 0.002). On multivariable analysis, factors most predictive of residents scoring ≥75th percentile were, higher step 1 scores (OR = 2.48, [95% CI: 1.68-3.64, p < 0.001]), presence of incentives (OR = 2.75, [95% CI: 1.16-6.56, p = 0.022]), greater number of hours/week spent studying (OR = 1.09, [95% CI:1.01-1.17, p = 0.026]) and fewer hours spent in research 3 months prior to examination (OR = 1.08, [95% CI: 1.01-1.15, p = 0.020]. Lastly, residents less likely to depend on group study sessions as a learning method tended to score higher (OR = 3.40, [95% CI: 1.16-9.94, p = 0.026]). CONCLUSIONS: Programs wishing to improve resident OKAP scores might consider offering incentives, providing effective access to learning content e.g. online question banks, and adjusting the curriculum to highlight OKAP material. Step 1 scores may help educators identify residents who might be at risk of not performing as well on the OKAP.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The BCSC and OphthoQuestions resources have been shown to be effective in studying for board examinations and linked to improved performance on OKAP.
“These resources have been shown to be effective in studying for board examinations and have been linked to improved performance on the standardized Ophthalmic Knowledge Assessment Program (OKAP) examination, which is taken annually by ophthalmology residents in the United States and Canada.12,13”
From Evaluating the Performance of ChatGPT in Ophthalmology (2023) · cites this paper as [12]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Internet-Based Learning in the Health Professions
Cook, D., Levinson, A. J., Garside, S., Dupras, D. M., Erwin, P. J., & Montori, V. M. (2008) · JAMA · doi:10.1001/jama.300.10.1181 · Cited by 1,552 · see citing works
Quality of Life, Burnout, Educational Debt, and Medical Knowledge Among Internal Medicine Residents
West, C. P., Shanafelt, T. D., & Kolars, J. C. (2011) · JAMA · doi:10.1001/jama.2011.1247 · Cited by 720 · see citing works
Association between licensure examination scores and practice in primary care.
Tamblyn, R., Abrahamowicz, M., Dauphinee, W. D., Hanley, J., Norcini, J., Girard, N., Grand'Maison, P., & Brailovsky, C. (2002) · Journal of the American Medical Association (JAMA) · doi:10.1001/jama.288.23.3019 · Cited by 266 · see citing works
Physician and Hospital Factors Associated With Mortality of Surgical Patients
Kelly, J. V., & Hellinger, F. J. (1986) · Medical Care · doi:10.1097/00005650-198609000-00001 · Cited by 196 · see citing works
Predictive Validity of Certification by the American Board of Internal Medicine
Ramsey, P. G., Carline, J. D., Inui, T. S., Larson, E. B., LoGerfo, J. P., & Wenrich, M. D. (1989) · Annals of Internal Medicine · doi:10.7326/0003-4819-110-9-719 · Cited by 173 · see citing works
Tamblyn, R. M. (1998) · JAMA · doi:10.1001/jama.280.11.989 · Cited by 169 · see citing works
Anesthesiologist Board Certification and Patient Outcomes
Silber, J. H., Kennedy, S. K., Even‐Shoshan, O., Chen, W., Mosher, R. E., Showan, A. M., & Longnecker, D. E. (2002) · Anesthesiology · doi:10.1097/00000542-200205000-00004 · Cited by 151 · see citing works
Scott, D. J., Valentine, R. J., Bergen, P. C., et al. (2000) · Surgery · doi:10.1067/msy.2000.108115 · Cited by 134 · see citing works
E-learning in graduate medical education: survey of residency program directors
Wittich, C. M., Agrawal, A., Cook, D. A., et al. (2017) · BMC Medical Education · doi:10.1186/s12909-017-0953-9 · Cited by 123 · see citing works
Factors Influencing Career Choices among Graduating Ophthalmology Residents
Gedde, S. J., Budenz, D. L., Haft, P., et al. (2005) · Ophthalmology · doi:10.1016/j.ophtha.2005.01.038 · Cited by 98 · see citing works
Chiang, M. F., Boland, M. V., Margolis, J. W., et al. (2008) · Ophthalmology · doi:10.1016/j.ophtha.2008.03.024 · Cited by 81 · see citing works
Self-citationErrors in Health Care: A Leading Cause of Death and Injury
Kohn, L. T., Corrigan, J. M., & Donaldson, M. S. (2000) · Cited by 80 · see citing works
The New competencies and their impact on resident training in ophthalmology
Lee, A. G. (2003) · Survey of Ophthalmology · doi:10.1016/j.survophthal.2003.08.009 · Cited by 69 · see citing works
Miyamoto, R. G., Klein, G. R., Walsh, M., et al. (2007) · PubMed · Cited by 64 · see citing works
Smeds, M. R., Thrush, C. R., McDaniel, F. K., Gill, R., Kimbrough, M. K., Shames, B. D., Sussman, J. J., Galante, J. M., Wittgen, C. M., Ansari, P., et al. (2017) · Journal of Surgical Research · doi:10.1016/j.jss.2017.05.034 · Cited by 62 · see citing works
Factors Affecting Improvement on the American Board of Surgery In-Training Exam (ABSITE)
Godellas, C. V., Hauge, L. S., & Huang, R. (2000) · Journal of Surgical Research · doi:10.1006/jsre.2000.5852 · Cited by 53 · see citing works
Are study strategies related to medical licensing exam performance?
West, C. A., Kurz, T., Smith, S., & Graham, L. (2014) · International Journal of Medical Education · doi:10.5116/ijme.5439.6491 · Cited by 46 · see citing works
Kim, J. J., Kim, D. Y., Kaji, A. H., et al. (2015) · JAMA Surgery · doi:10.1001/jamasurg.2015.1698 · Cited by 41 · see citing works
First-Year Report Cards From the Merit-Based Incentive Payment System (MIPS)
Rathi, V. K., & McWilliams, J. M. (2019) · JAMA · doi:10.1001/jama.2019.1295 · Cited by 40 · see citing works
Johnson, G. A., Bloom, J. N., Szczotka‐Flynn, L. B., Zauner, D., & Tomsak, R. L. (2010) · Ophthalmology · doi:10.1016/j.ophtha.2010.03.056 · Cited by 37 · see citing works
Lee, A. G., Oetting, T. A., Blomquist, P. H., Bradford, G., Culican, S. M., Kloek, C., Krishnan, C., Lauer, A. K., Levi, L., Naseri, A., et al. (2012) · Ophthalmology · doi:10.1016/j.ophtha.2012.06.010 · Cited by 27 · see citing works
Richardson, D., Porter, G. A., & Johnson, P. M. (2012) · Annals of Surgery · doi:10.1097/sla.0b013e31825ffdca · Cited by 24 · see citing works
Comparative Evaluation of Educational Methods in Surgical Resident Education
Wade, T. P. (1995) · Archives of Surgery · doi:10.1001/archsurg.1995.01430010085017 · Cited by 23 · see citing works
Kempton, J. E., Shields, M. B., Afshari, N. A., et al. (2009) · Ophthalmology · doi:10.1016/j.ophtha.2008.12.047 · Cited by 23 · see citing works
Correlating Factors to Resident Performance in an Ophthalmology Program
Catalano, R. A., & Jenkins, P. (1989) · Ophthalmology · doi:10.1016/s0161-6420(89)32858-2 · Cited by 19 · see citing works
Validity Evidence for USMLE Examination Cut Scores: Results of a Large-Scale Survey
Margolis, M. J., Clauser, B. E., Winward, M. L., et al. (2010) · Academic Medicine · doi:10.1097/acm.0b013e3181ed4028 · Cited by 13 · see citing works
Successful Resident Engagement in Quality Improvement: The Detroit Medical Center Story
Hussain, S. A., Arsene, C., Hamstra, C., et al. (2016) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-15-00316.1 · Cited by 13 · see citing works
New Directions for the Ophthalmic Knowledge Assessment Program (OKAP) Examination
Liesegang, T. J. (1994) · Ophthalmology · doi:10.1016/s0161-6420(94)31365-0 · Cited by 11 · see citing works
Strategies for Residency Programs that Improve Medicine Departments and Teaching Hospitals
Rahim, A., & Anderson, R. A. (2008) · The American Journal of Medicine · doi:10.1016/j.amjmed.2007.12.010 · Cited by 7 · see citing works
Assessment of ophthalmology residents' contact lens training.
Macaluso, D. C., Andre, M., Caroline, P. J., et al. (2000) · PubMed · Cited by 5 · see citing works
Characteristics that Predict Ophthalmic Knowledge among Ophthalmology Residents
van Landingham, S. W., Srikumaran, D. S., Siddiqui, A. A., et al. (2015) · Ophthalmology · doi:10.1016/j.ophtha.2014.12.008 · Cited by 3 · see citing works
Self-citationExaminations and Ophthalmic Education
O’Day, D. M. (2012) · Ophthalmology · doi:10.1016/j.ophtha.2012.07.060 · Cited by 2 · see citing works
Comparative Evaluation of Educational Methods in Surgical Resident Education
Coe, N. P. W. (1995) · Archives of Surgery · doi:10.1001/archsurg.1995.01430090108032 · Cited by 1 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Evaluating the Performance of ChatGPT in Ophthalmology
Antaki, F., Touma, S., Milad, D., El-Khoury, J., & Duval, R. (2023) · Ophthalmology Science · doi:10.1016/j.xops.2023.100324 · Cited by 563 · see citing works
Antaki, F., Touma, S., Milad, D., El-Khoury, J., & Duval, R. (2023) · doi:10.1101/2023.01.22.23284882 · Cited by 563 · see citing works
- Authors
- Zafar, S., Wang, X., Srikumaran, D., Sikder, S., Ramulu, P., Boland, M. V., Singman, E., & Woreta, F. A.
- Affiliations
- Johns Hopkins University (US)
- Corresponding author
- Woreta, Fasika A.
- ORCID
- Venue
- BMC Medical Education
- Published
- 2019-06-07
- Volume
- 19
- Issue
- 1
- Pages
- 190-190
- ISSN
- 1472-6920 (ISSN-L)
- PMC
- PMC6555746
- OpenAlex
- W2948641588
- Cited by
- 13
- References
- 33
- Citations by year
- 2026: 1 · 2025: 2 · 2024: 1 · 2023: 4 · 2022: 1 · 2021: 1 · 2020: 2 · 2019: 1
- FWCI
- 1.23
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- BMC Medical Education (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Johns Hopkins University
- Topics
- Health Sciences › Medicine › Ophthalmology › Ophthalmology and Visual Health Research
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Innovations in Medical Education
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Medical Education and Admissions
- Keywords
- ophthalmology residency, residency program characteristics, online question bank, study habits, USMLE Step 1 scores, curriculum development, ophthalmology education, didactic sessions
- MeSH terms
- Adult, Educational Measurement, Female, Humans, Internship and Residency, Male, Ophthalmology, Surveys and Questionnaires
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
