The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
A Core Components Framework for Evaluating Implementation of Competency-Based Medical Education Programs
Open accessAbstract
Purpose: The rapid adoption of competency-based medical education (CBME) provides an unprecedented opportunity to study implementation. Examining “fidelity of implementation”—that is, whether CBME is being implemented as intended—is hampered, however, by the lack of a common framework. This article details the development of such a framework. Method: A two-step method was used. First, a perspective indicating how CBME is intended to bring about change was described. Accordingly, core components were identified. Drawing from the literature, the core components were organized into a draft framework. Using a modified Delphi approach, the second step examined consensus amongst an international group of experts in CBME. Results: Two different viewpoints describing how a CBME program can bring about change were found: production and reform. Because the reform model was most consistent with the characterization of CBME as a transformative innovation, this perspective was used to create a draft framework. Following the Delphi process, five core components of CBME curricula were identified: outcome competencies, sequenced progression, tailored learning experiences, competency-focused instruction, and programmatic assessment. With some modification in wording, consensus emerged amongst the panel of international experts. Conclusions: Typically, implementation evaluation relies on the creation of a specific checklist of practices. Given the ongoing evolution and complexity of CBME, this work, however, focused on identifying core components. Consistent with recent developments in program evaluation, where implementation is described as a developmental trajectory toward fidelity, identifying core components is presented as a fundamental first step toward gaining a more sophisticated understanding of implementation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496
The Delphi Technique: Making Sense of Consensus
Hsu, C.-C., & Sandford, B. A. (2007) · University of Massachusetts Amherst · doi:10.7275/pdz9-th90 · Cited by 4,500
Realist review - a new method of systematic review designed for complex policy interventions
Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2005) · Journal of Health Services Research & Policy · doi:10.1258/1355819054308530 · Cited by 3,190
Petersdorf, R. G. (1993) · Academic Medicine · doi:10.1097/00001888-199301000-00012 · Cited by 2,497
Consensus measurement in Delphi studies
von der Gracht, H. A. (2012) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2012.04.013 · Cited by 1,831
Does problem-based learning work? A meta-analysis of evaluative research
Vernon, D. T., & Blake, R. L. (1993) · Academic Medicine · doi:10.1097/00001888-199307000-00015 · Cited by 1,456
Complex interventions: how “out of control” can a randomised controlled trial be?
Hawe, P., Shiell, A., & Riley, T. (2004) · BMJ · doi:10.1136/bmj.328.7455.1561 · Cited by 1,244
Shifting Paradigms: From Flexner to Competencies
Carraccio, C., Wolfsthal, S. D., Englander, R., Ferentz, K., & Martin, C. (2002) · Academic Medicine · doi:10.1097/00001888-200205000-00003 · Cited by 975
Fidelity Criteria: Development, Measurement, and Validation
MOWBRAY, C. (2003) · The American Journal of Evaluation · doi:10.1016/s1098-2140(03)00057-2 · Cited by 884
Frank, J. R., Mungroo, R., Ahmad, Y., Wang, M., De Rossi, S., & Horsley, T. (2010) · Medical Teacher · doi:10.3109/0142159x.2010.500898 · Cited by 781
Self-citation
Cited by
Revisiting the Core Entrustable Professional Activities for Entering Residency
Amiel, J. M., Andriole, D. A., Biskobing, D. M., Brown, D. R., Cutrer, W. B., Emery, M. T., Mejicano, G. C., Ryan, M. S., Swails, J. L., & Wagner, D. P. (2021) · Academic Medicine · doi:10.1097/acm.0000000000004088 · Cited by 107
Triola, M. M., & Burk-Rafel, J. (2023) · Academic Medicine · doi:10.1097/acm.0000000000005227 · Cited by 111
Hall, A. K., Rich, J., Dagnone, J. D., Weersink, K., Caudle, J., Sherbino, J., Frank, J. R., Bandiera, G., & Van Melle, E. (2020) · Academic Medicine · doi:10.1097/acm.0000000000003040 · Cited by 104
Self-citationEvaluating competency-based medical education: a systematized review of current practices
Alharbi, N. S. (2024) · BMC Medical Education · doi:10.1186/s12909-024-05609-6 · Cited by 83
Artificial Intelligence in Health Professions Education assessment: AMEE Guide No. 178
Masters, K., MacNeil, H., Benjamin, J., Carver, T., Nemethy, K., Valanci-Aroesty, S., Taylor, D. C. M., Thoma, B., & Thesen, T. (2025) · Medical Teacher · doi:10.1080/0142159x.2024.2445037 · Cited by 80
Metadata
- Authors
- Van Melle, E., Frank, J. R., Holmboe, E. S., Dagnone, D., Stockley, D., & Sherbino, J.
- Venue
- Academic Medicine
- Publisher
- Oxford University Press (OUP)
- Published
- 2019-07
- Volume
- 94
- Issue
- 7
- Pages
- 1002-1009
- ISSN
- 1040-2446 (ISSN-L)
- OpenAlex
- W2936924489
- Cited by
- 451
- References
- 46
- FWCI
- 25.38
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Core Components Framework for Evaluating Implementation of Competency-Based Medical Education Programs. https://app.cochat.ai/papers/10.1097/acm.0000000000002743
- The paper
- Van Melle, E., Frank, J. R., Holmboe, E. S., Dagnone, D., Stockley, D., & Sherbino, J. (2019). A Core Components Framework for Evaluating Implementation of Competency-Based Medical Education Programs. Academic Medicine. https://doi.org/10.1097/acm.0000000000002743
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.