Cited by 38Innovations in Medical EducationHospital Admissions and OutcomesElectronic Health Records Systems

TRainee Attributable & Automatable Care Evaluations in Real-time (TRACERs): A Scalable Approach for Linking Education to Patient Care

Open access
Burk-Rafel, Jesse, Sebok-Syer, Stefanie S., Santen, Sally A., Jiang, Joshua, Caretta-Weyer, Holly A., Iturrate, Eduardo, Kelleher, Matthew, Warm, Eric J. +2 more·2023·Perspectives on Medical Education

Abstract

Competency-based medical education (CBME) is an outcomes-based approach to education and assessment that focuses on what competencies trainees need to learn in order to provide effective patient care. Despite this goal of providing quality patient care, trainees rarely receive measures of their clinical performance. This is problematic because defining a trainee’s learning progression requires measuring their clinical performance. Traditional clinical performance measures (CPMs) are often met with skepticism from trainees given their poor individual-level attribution. Resident-sensitive quality measures (RSQMs) are attributable to individuals, but lack the expeditiousness needed to deliver timely feedback and can be difficult to automate at scale across programs. In this eye opener, the authors present a conceptual framework for a new type of measure – TRainee Attributable & Automatable Care Evaluations in Real-time (TRACERs) – attuned to both automation and trainee attribution as the next evolutionary step in linking education to patient care. TRACERs have five defining characteristics: meaningful (for patient care and trainees), attributable (sufficiently to the trainee of interest), automatable (minimal human input once fully implemented), scalable (across electronic health records [EHRs] and training environments), and real-time (amenable to formative educational feedback loops). Ideally, TRACERs optimize all five characteristics to the greatest degree possible. TRACERs are uniquely focused on measures of clinical performance that are captured in the EHR, whether routinely collected or generated using sophisticated analytics, and are intended to complement (not replace) other sources of assessment data. TRACERs have the potential to contribute to a national system of high-density, trainee-attributable, patient-centered outcome measures.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.5334/pme.1013

Cites

51 of 52 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 1

  1. [21]Weaver SJ, Feitosa J, Salas E. The science of teams: the theoretical drivers, models, and competencies of team performance for patient safety. In: Salas E, Frush K (Eds.), Improving patient safety through teamwork and team training. 2013; 3– 26. Oxford University Press.

Cited by

Sorted by citations

Authors
Burk-Rafel, J., Sebok-Syer, S. S., Santen, S. A., Jiang, J., Caretta-Weyer, H. A., Iturrate, E., Kelleher, M., Warm, E. J., Schumacher, D. J., & Kinnear, B.
Affiliations
  • University of Cincinnati (US)
  • University of California, Los Angeles (US)
  • NYU Langone Health (US)
  • Cincinnati Children's Hospital Medical Center (US)
Corresponding author
  • Santen, Sally A.
  • Jiang, Joshua
  • Iturrate, Eduardo
  • Warm, Eric J.
  • Schumacher, Daniel J.
  • Kinnear, Benjamin
Venue
Perspectives on Medical Education
Published
2023
Volume
12
Issue
1
Pages
149-159
ISSN
  • 2212-2761 (ISSN-L)
  • 2212-277X
OpenAlex
W4377084984
Cited by
38
References
51
Citations by year
2026: 7 · 2025: 9 · 2024: 10 · 2023: 12
FWCI
9.73
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Perspectives on Medical Education (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
  • University of Cincinnati
  • Santen
  • College of Medicine, University of Cincinnati
Topics
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Innovations in Medical Education
  • Health Sciences › Medicine › Emergency Medicine › Hospital Admissions and Outcomes
  • Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
Keywords
competency-based medical education, clinical performance measures, automated performance evaluation, real-time feedback, electronic health records, formative feedback, patient-centered outcome measures, medical residents
MeSH terms
Education, Medical, Graduate, Educational Measurement, Feedback, Humans, Internship and Residency, Learning

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review