The R2C2 Model in Residency Education: How Does It Foster Coaching and Promote Feedback Use?
Open accessAbstract
Purpose: The authors previously developed and tested a reflective model for facilitating performance feedback for practice improvement, the R2C2 model. It consists of four phases: r elationship building, exploring r eactions, exploring c ontent, and c oaching. This research studied the use and effectiveness of the model across different residency programs and the factors that influenced its effectiveness and use. Method: From July 2014–October 2016, case study methodology was used to study R2C2 model use and the influence of context on use within and across five cases. Five residency programs (family medicine, psychiatry, internal medicine, surgery, and anesthesia) from three countries (Canada, the United States, and the Netherlands) were recruited. Data collection included audiotaped site assessment interviews, feedback sessions, and debriefing interviews with residents and supervisors, and completed learning change plans (LCPs). Content, thematic, template, and cross-case analysis were conducted. Results: An average of nine resident–supervisor dyads per site were recruited. The R2C2 feedback model, used with an LCP, was reported to be effective in engaging residents in a reflective, goal-oriented discussion about performance data, supporting coaching, and enabling collaborative development of a change plan. Use varied across cases, influenced by six general factors: supervisor characteristics, resident characteristics, qualities of the resident–supervisor relationship, assessment approaches, program culture and context, and supports provided by the authors. Conclusions: The R2C2 model was reported to be effective in fostering a productive, reflective feedback conversation focused on resident development and in facilitating collaborative development of a change plan. Factors contributing to successful use were identified.
AI snapshot
Written from the paper’s full text.
TL;DR
The R2C2 feedback model plus a learning change plan (LCP) was reported to be effective across five residency programs in three countries in fostering reflective feedback conversations, coaching, and collaborative change plans. Use varied by six general factors, and supervisors/residents returned to the LCP in only about half of second feedback sessions.
Key findings
- Across five residency programs (family medicine, psychiatry, internal medicine, surgery, anesthesia) in Canada, the United States, and the Netherlands, almost all supervisors and residents reported that R2C2 facilitated resident engagement in reflective discussion about assessment data and planning improvement.
- The coaching phase and LCP were especially valued: participants reported they helped create concrete plans and shifted feedback from “assessment and judgment” toward “development.”
- Use varied across cases and was influenced by six general factors: supervisor characteristics, resident characteristics, qualities of the resident–supervisor relationship, program assessment approaches, program culture and context, and supports provided by the authors.
- Supervisors and residents reported returning to the goals and LCPs from the first session in only about half of second-session feedback interviews; among three dyads with a struggling resident, development of a specific improvement plan appeared to depend on supervisor coaching skill.
Methods
- Case study methodology within a UK Medical Research Council complex-interventions/realist evaluation framing, conducted July 2014–October 2016 across five residency programs in three countries.
- Recruited 45 residents (3–14 per site) and 21 supervisors (2–8 per site), averaging 9 resident–supervisor dyads per site; data included audiotaped site assessment interviews, feedback sessions, debrief interviews, and completed LCPs.
- Analysis used content, thematic, template, and cross-case analysis; template analysis used the four R2C2 phases as an a priori coding structure.
Limitations
- Stated by the paper: sites, residents, and supervisors volunteered; both resident and current supervisor had to agree to participate, which in some cases delayed or limited recruitment; the quality of site-specific assessment reports and data could not be ascertained.
- Evident in the text: LCP use was variable, written completion was less consistent across sites, and return to the original LCP in the second session occurred in only about half of interviews; the paper attributes this partly to omitted instructions in the R2C2 brochure and limited preparatory instruction.
- Evident in the text: only three dyads involved a resident who appeared to be struggling, limiting the basis for conclusions about R2C2/LCP use across the performance spectrum.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
0 of 44 cited sources checked · 0 supported · 0 flagged
- Findingown data
In each of the three dyads with a struggling resident, both the resident and supervisor reported on the usefulness of the R2C2 model and LCP in enabling the resident to gain insight into their progress and ways to improve.
“In each instance, both the resident and supervisor reported on the usefulness of the R2C2 model and LCP in enabling the resident to gain insight into their progress and ways to improve.”
Quote in the paperSubstantial claim - Findingown data
The R2C2 feedback model, used with an LCP, was reported to support coaching.
“The R2C2 feedback model, used with an LCP, was reported to be effective in engaging residents in a reflective, goal-oriented discussion about performance data, supporting coaching, and enabling collaborative development of a change plan.”
- Also stated in: § Identification of opportunities for improvement and development of an LCP · plain
“All participants particularly valued the coaching phase and observed that it was the most unique feature compared with traditional feedback models.”
Quote in the paperSubstantial claim - Also stated in: § Identification of opportunities for improvement and development of an LCP · plain
- Findingown data
Many supervisors reported that it was beneficial to use the R2C2 and LCP with residents who were excelling, as they provided substance and structure for the feedback conversation.
“Many supervisors reported that it was beneficial to use the R2C2 and LCP with those who were excelling, as they provided substance and structure for the feedback conversation.”
Quote in the paperNot a substantial claim - Findingown data
Almost all participants noted that the R2C2 sample coaching questions and items on the LCP helped create a concrete plan.
“Almost all participants noted that the R2C2 sample coaching questions and items on the LCP helped create a concrete plan and changed the orientation of the feedback conversation from”
Quote in the paperSubstantial claim - Findingown data
Where progress was not made, supervisors engaged the resident in a discussion about the barriers to progress.
“Most residents whose supervisor did return to the LCP reported progress related to their plan, and where progress was not made, supervisors engaged the resident in a discussion about the barriers to progress.”
Quote in the paperNot a substantial claim
- Findingown data
The majority of residents and supervisors reported that the R2C2's focus on getting better created collaboration in developing an action plan.
“The majority of residents and supervisors also reported that the R2C2's focus on getting better created collaboration in developing an action plan, and that they valued this collaboration.”
Quote in the paperSubstantial claim - Findingnone given
The R2C2 model was reported to be effective in fostering a productive, reflective feedback conversation focused on resident development.
“The R2C2 model was reported to be effective in fostering a productive, reflective feedback conversation focused on resident development and in facilitating collaborative development of a change plan.”
Quote in the paperSubstantial claim - Findingown data
The R2C2 feedback model, used with an LCP, was reported to be effective in engaging residents in a reflective, goal-oriented discussion about performance data.
“The R2C2 feedback model, used with an LCP, was reported to be effective in engaging residents in a reflective, goal-oriented discussion about performance data, supporting coaching, and enabling collaborative development of a change plan.”
- Also stated in: § Residents' reflection on and engagement with their assessment data · plain
“Across all sites, almost all supervisors and residents reported that the R2C2 model facilitated resident engagement in a reflective feedback conversation about their assessment data and in using the data to plan improvement.”
Quote in the paperSubstantial claim - Also stated in: § Residents' reflection on and engagement with their assessment data · plain
- Findingown data
Topics identified as goals in the written LCPs varied widely.
“Topics identified as goals in the written LCPs varied widely, including participating in research, improving differential diagnoses, being more assertive, communicating more clearly with patients, better managing work-life balance, and improving knowledge of common diagnoses.”
Quote in the paperNot a substantial claim - Findingown data
Most residents whose supervisor did return to the LCP reported progress related to their plan.
“Most residents whose supervisor did return to the LCP reported progress related to their plan, and where progress was not made, supervisors engaged the resident in a discussion about the barriers to progress.”
Quote in the paperNot a substantial claim - Findingown data
Supervisors across the five sites used the LCP variably to support coaching.
“Supervisors across the five sites, however, used the LCP variably to support coaching.”
Quote in the paperNot a substantial claim - Findingown data
In both situations, supervisors reported that the LCP helped structure coaching and development of an action plan.
“In both situations, the supervisors reported that it helped structure coaching and development of an action plan.”
Quote in the paperSubstantial claim - Findingown data
Focusing on using assessment data to improve through setting and achieving goals was reported as most helpful.
“Focusing on using assessment data to improve through setting and achieving goals was reported as most helpful.”
Quote in the paperSubstantial claim - Findingown data
Supervisors and residents reported returning to the goals and LCPs from the first session in only about half of the second session feedback interviews.
“However, supervisors and residents reported returning to the goals and LCPs from the first session in only about half of the second session feedback interviews.”
Quote in the paperSubstantial claim - Findingown data
The majority of residents and supervisors valued the collaboration in developing an action plan.
“The majority of residents and supervisors also reported that the R2C2's focus on getting better created collaboration in developing an action plan, and that they valued this collaboration.”
Quote in the paperNot a substantial claim - Findingown data
All supervisors observed that the R2C2 model and open-ended questions fostered residents' active engagement in the feedback discussion, particularly in planning for their improvement.
“In addition, all supervisors observed that the model and open-ended questions fostered residents' active engagement in the feedback discussion, particularly in planning for their improvement:”
Quote in the paperSubstantial claim - Findingown data
Supervisors who did not return to the goals and LCPs in the second session reported forgetting to do so because it was not identified as a specific step on the R2C2 brochure.
“In debrief interviews, supervisors who did not return to the goals and LCPs in the second session reported forgetting to do so because it was not identified as a specific step on the R2C2 brochure.”
Quote in the paperNot a substantial claim - Findingown data
The R2C2 feedback model, used with an LCP, was reported to enable collaborative development of a change plan.
“The R2C2 feedback model, used with an LCP, was reported to be effective in engaging residents in a reflective, goal-oriented discussion about performance data, supporting coaching, and enabling collaborative development of a change plan.”
- Also stated in: § Identification of opportunities for improvement and development of an LCP · plain
“The majority of residents and supervisors also reported that the R2C2's focus on getting better created collaboration in developing an action plan, and that they valued this collaboration.”
- Also stated in: § Abstract · plain
“The R2C2 model was reported to be effective in fostering a productive, reflective feedback conversation focused on resident development and in facilitating collaborative development of a change plan.”
Quote in the paperSubstantial claim - Also stated in: § Identification of opportunities for improvement and development of an LCP · plain
- Findingnone given
Even when plans were not recorded on the LCP, using the LCP still appeared to aid coaching and discussion of a change plan.
“Even when plans were not recorded on the LCP, using the LCP still appeared to aid coaching and discussion of a change plan.”
Quote in the paperNot a substantial claim - Findingown data
The foci on coaching and improvement and on collaborative codevelopment of a change plan in response to the data were especially valued by both residents and supervisors.
“Especially valued by both residents and supervisors were the foci on coaching and improvement and on collaborative codevelopment of a change plan in response to the data.”
Quote in the paperSubstantial claim - Findingown data
At the site using direct observation, supervisors and residents appeared to be able to use the R2C2 model effectively to enhance reflection and development.
“they appeared to be able to use the model effectively to enhance reflection and development.”
Quote in the paperSubstantial claim - Findingown data
The degree of fit between the learner-centered facilitative approach of the R2C2 model and the supervisor's natural feedback approach and style was a beneficial supervisor factor.
“one beneficial supervisor factor was the degree of fit between the learner-centered facilitative approach of the R2C2 model and the supervisor's natural feedback approach and style.”
Quote in the paperSubstantial claim - Findingown data
Of the three criteria used to evaluate effectiveness, the first two (residents' reflection on and engagement with their assessment data, and identification of opportunities for improvement and development of an LCP) were the most consistently reported across sites.
“Of the three criteria used to evaluate effectiveness (residents' reflection on and engagement with their assessment data, identification of opportunities for improvement and development of an LCP, and outcomes of the LCP), the first two were the most consistently reported across sites.”
Quote in the paperNot a substantial claim - Findingown data
The subsequent development of a specific plan for improvement appeared to depend on the skill of the supervisor in coaching the resident and in using the LCP.
“However, the subsequent development of a specific plan for improvement appeared to depend on the skill of the supervisor in coaching the resident and in using the LCP; two supervisors appeared to be skilled and one less so.”
Quote in the paperSubstantial claim - Findingown data
Supervisors who did not know the resident beforehand appeared to be able to readily build a constructive relationship through the phases of the R2C2 model.
“those supervisors who did not know the resident beforehand appeared to be able to readily build a constructive relationship.”
Quote in the paperNot a substantial claim - Findingreasoning
The written completion of the LCP and assessment of outcomes of the plan during the second interview session were less consistent across sites.
“Less consistent across sites were the written completion of the LCP and assessment of outcomes of the plan during the second interview session.”
Quote in the paperNot a substantial claim - Findingown data
The familiarity of the resident and supervisor dyad was a beneficial factor.
“A third beneficial factor was the familiarity of the resident and supervisor dyad.”
Quote in the paperNot a substantial claim - Findingown data
The extent to which the R2C2 model and LCP were integrated into the program's assessment and feedback approaches and implementation of CBME was a beneficial factor.
“Another beneficial factor was the extent to which the R2C2 model and LCP were integrated into the program's assessment and feedback approaches and implementation of CBME.”
Quote in the paperSubstantial claim - Findingown data
Supervisors reported the educational intervention prior to using the R2C2 model and having copies of the R2C2 brochure and LCP at hand during their feedback interviews as positive supports for using the model.
“supervisors reported the educational intervention prior to using the R2C2 model and having copies of the R2C2 brochure and LCP at hand during their feedback interviews as positive supports for using the model.”
Quote in the paperNot a substantial claim - Findingown data
Coaching on nonmedical expert roles (communication and professional skills) appeared novel and challenging at the site using multisource feedback.
“Coaching on these nonmedical expert roles appeared novel and challenging.”
Quote in the paperNot a substantial claim - Findingnone given
The use of open-ended questions promoted a respectful supervisor-resident relationship focused on residents' development.
“The use of open-ended questions, which promoted a respectful supervisor-resident relationship focused on residents' development”
Quote in the paperNot a substantial claim - Findingown data
Using the R2C2 model to facilitate oral feedback on an observed performance (mock oral) instead of written assessment reports required reorganization and rethinking on the part of supervisors and residents.
“This approach required using the R2C2 model to facilitate oral feedback on an observed performance, instead of written assessment reports, which required reorganization and rethinking on the part of supervisors and residents.”
Quote in the paperNot a substantial claim - Findingnone given
At one site where CBME had just been implemented with a novel and extensive progress report and no formal strategy for enabling residents to interpret it, the R2C2 feedback discussion was welcomed as a collaborative process for understanding reports and developing action plans.
“the R2C2 feedback discussion was welcomed as a collaborative process for understanding their reports and developing action plans.”
Quote in the paperNot a substantial claim - Premisecitation
CBME and programmatic assessment have the potential to improve the practice of feedback by promoting frequent observation of learners, feedback conversations, and coaching for improvement.
“Two recently implemented initiatives in medical education, competencybased medical education (CBME) [9][10][11] and programmatic assessment of learners, 12 have the potential to improve the practice of feedback by promoting frequent observation of learners, feedback conversations, and coaching for improvement.”
Quote in the paperSubstantial claim0 of 3 sources checked - Premisecitation
The pilot study was limited because it occurred at one residency site with only a few residents and supervisors.
“A small pilot study identified implementation challenges and demonstrated positive reactions to the use of the R2C2 model, but was limited because it occurred at one residency site with only a few residents and supervisors.22”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [22] source
Not checked in the free run.
- Premisecitation
Feedback in medical education is a complex social interaction, influenced by the feedback provider, feedback receiver, and context.
“The number of studies addressing the provision of feedback in medical education continues to increase, 1 and their results support viewing feedback as a complex social interaction, influenced by the feedback provider, feedback receiver, and context.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [1] source
Not checked in the free run.
- Premisecitation
The R2C2 feedback model was founded on three theoretical perspectives: humanism, informed self-assessment, and the science of behavior change.
“It was founded on three theoretical perspectives: humanism, informed self-assessment, and the science of behavior change.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [20] source
Not checked in the free run.
- Interpretationown data
Foremost among factors influencing successful use of the R2C2 model appeared to be the resident-supervisor relationship, which the first phase of the model focuses on building.
“foremost appeared to be the resident-supervisor relationship (as reflected in our findings on residents' reflection upon and engagement with their assessment data and identification of opportunities for improvement), which the first phase of the model focuses on building.”
Quote in the paperSubstantial claim - Interpretationcitation
Effective implementation of the R2C2 and LCP requires specific supportive strategies.
“we learned that effective implementation requires specific supportive strategies 40,41”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [40]
Not checked in the free run.
- cites [41]
Not checked in the free run.
- Interpretationreasoning
Use of the R2C2 model and LCP seemed to contribute to the engagement of residents in their performance data and feedback discussions.
“use of the R2C2 model and LCP seemed to contribute to the engagement of residents in their performance data and feedback discussions.”
Quote in the paperSubstantial claim
- The quote only partly states this claim. 2
- May combine two claims. 35
- Classified as probably not a substantial claim. 27
The quote only partly states this claim.
Findingown dataUse of the R2C2 model varied across cases.
“Supervisors across the five sites, however, used the LCP variably to support coaching.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataAlmost all residents reported that the facilitative format increased their comfort and ability to honestly share concerns and needs for improvement.
“Almost all residents reported that the facilitative format increased their comfort and ability to honestly share concerns and needs for improvement:”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Findingown dataWe identified three dyads in which a resident appeared to be struggling.
“We identified three dyads in which a resident appeared to be struggling.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataAt three sites, supervisors required residents to complete a written LCP, while in two, they only used it to guide the coaching discussion.
“At three sites, they required residents to complete a written LCP, while in two, they only used it to guide the coaching discussion.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataAlmost all participants noted that the R2C2 sample coaching questions and items on the LCP changed the orientation of the feedback conversation from assessment and judgment to development.
“Almost all participants noted that the R2C2 sample coaching questions and items on the LCP helped create a concrete plan and changed the orientation of the feedback conversation from”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataAll participants particularly valued the coaching phase and observed that it was the most unique feature compared with traditional feedback models.
“All participants particularly valued the coaching phase and observed that it was the most unique feature compared with traditional feedback models.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe open-ended questions in each of the four R2C2 model phases encouraged residents' critical reflection and self-assessment.
“The openended questions in each of the four model phases encouraged residents' critical reflection and self-assessment.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThose who returned to the goals and LCPs spoke of the benefits of doing so; it provided a way to evaluate the planned activity and a longitudinal view of progress.
“Those who did spoke of the benefits of doing so; it provided a way to evaluate the planned activity and a longitudinal view of progress.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataAlthough all residents appeared to be meeting their program expectations, some appeared to be excelling and some struggling.
“Although all residents appeared to be meeting their program expectations, some appeared to be excelling and some struggling.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataSome supervisors noted that there was inadequate guidance regarding the need to return to the original LCP in the second feedback session and how to do this.
“some noted that there was inadequate guidance regarding the need to return to the original LCP in the second feedback session and how to do this.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataTwo supervisors appeared to be skilled and one less so in coaching and using the LCP.
“However, the subsequent development of a specific plan for improvement appeared to depend on the skill of the supervisor in coaching the resident and in using the LCP; two supervisors appeared to be skilled and one less so.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataContributing factors to not returning to the plan during the second interview were omission of instructions for using the LCP in the R2C2 brochure and limited instruction in the preparatory interventions about returning to the original LCP in the second feedback session.
“Contributing factors to not returning to the plan during the second interview were omission of instructions for using the LCP in the R2C2 brochure and limited instruction in the preparatory interventions about returning to the original LCP in the second feedback session.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataPrograms varied in assessment and feedback approaches and in the extent to which they had formally implemented CBME.
“Programs varied in assessment and feedback approaches and in the extent to which they had formally implemented CBME (Table 1).”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataFactors contributing to success were, at each site, the presence of an author and/or a research associate, preparatory supervisor workshop or session, and specific resource materials (R2C2 brochure and LCP), as well as how well the model aligned with the supervisor's natural feedback style and the program's culture and context.
“Factors contributing to success were, at each site, the presence of an author and/or a research associate, preparatory supervisor workshop or session, and specific resource materials (R2C2 brochure and LCP), as well as how well the model aligned with the supervisor's natural feedback style and the program's culture and context.”
Quote in the paperSubstantial claimMay combine two claims.
FindingreasoningResidents appeared to be active, reflective participants in the feedback conversation and in using their assessment data.
“Residents appeared to be active, reflective participants in the feedback conversation and in using their assessment data”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataAlthough the R2C2 model was generally perceived positively, there was variability in supervisor and resident reactions and use across sites and programs.
“Although the model was generally perceived positively, there was variability in supervisor and resident reactions and use across sites and programs.”
Quote in the paperSubstantial claimMay combine two claims.
Findingnone givenBy asking open-ended questions, supervisors seemed to be able to create a safe learning environment and express commitment to residents and their development.
“By asking open-ended questions, supervisors seemed to be able to create a safe learning environment and express commitment to residents and their development.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe R2C2 model, combined with the LCP, was reported to be effective in enabling a rich discussion about performance data, fostering reflection, and supporting coaching and collaborative development of a change plan across five residency programs in three countries, with each program using different assessment and feedback approaches.
“The R2C2 model, combined with the LCP, was reported to be effective in enabling a rich discussion about performance data, fostering reflection, and supporting coaching and collaborative development of a change plan across five residency programs in three countries, with each program using different assessment and feedback approaches.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataMost resident-supervisor dyads appeared to have prior work experience and knew each other, but a few did not.
“Although most dyads appeared to have prior work experience and knew each other, a few did not.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe variability in reactions and use did not appear to arise from differences in specialty per se but from six more general factors: supervisor characteristics, resident characteristics, qualities of the resident-supervisor relationship, program assessment approaches, program culture and context, and the supports provided.
“However, this variability did not appear to arise from differences in specialty per se but from six more general factors: supervisor characteristics, resident characteristics, qualities of the resident-supervisor relationship, program assessment approaches, program culture and context, and the supports we provided (Table 3).”
Quote in the paperSubstantial claimMay combine two claims.
Findingnone givenThe R2C2 model oriented the feedback conversation toward coaching and residents' use of assessment data.
“The way it oriented the feedback conversation toward coaching and residents' use of assessment data”
Quote in the paperSubstantial claimThe quote only partly states this claim.
Findingnone givenThe presence of an open, supportive relationship was a quality of the resident-supervisor relationship influencing use and effectiveness.
“Presence of an open, supportive relationship.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingnone givenReflection on oral feedback and using the oral feedback to plan change was found to be effective.
“reflection on oral feedback and using the oral feedback to plan change was found to be effective.”
Quote in the paperNot a substantial claimMay combine two claims.
FindingreasoningThe R2C2 model encouraged supervisor-resident collaboration and codevelopment of residents' goals and change plans.
“The way it encouraged supervisorresident collaboration and codevelopment of residents' goals and change plans.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenAt each level of analysis, differences were identified and resolved by discussion and by returning to the data as required.
“At each level of analysis, differences were identified and resolved by discussion and by returning to the data as required.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataTo conduct comparisons across cases and confirm overall findings, the authors held a face-to-face analysis meeting in April 2016, with those unable to attend participating by web conferencing.
“To conduct comparisons across cases and confirm overall findings, we held a faceto-face analysis meeting in April 2016, with those unable to attend participating by web conferencing.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThe principles of programmatic assessment and CBME direct attention to actively engaging learners in their assessment, feedback, and development activities.
“Foundationally, the principles of programmatic assessment and CBME direct our attention to actively engaging learners in their assessment, feedback, and development activities.9,13,15”
Quote in the paperNot a substantial claim0 of 3 sources checkedClassified as probably not a substantial claim.
PremisecitationRealist evaluation studies the social system and context in which an intervention occurs as well as the intervention itself.
“Realist evaluation studies the social system and context in which an intervention occurs as well as the intervention itself.20,24”
Quote in the paperSubstantial claim0 of 2 sources checkedProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenThe goal was to recruit 10 dyads per site to enable saturation of themes.
“Our goal was to recruit 10 dyads per site to enable saturation of themes.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationA small pilot study identified implementation challenges and demonstrated positive reactions to the use of the R2C2 model.
“A small pilot study identified implementation challenges and demonstrated positive reactions to the use of the R2C2 model, but was limited because it occurred at one residency site with only a few residents and supervisors.22”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [22] source
Not checked in the free run.
May combine two claims.
PremisecitationCBME and programmatic assessment promote the longitudinal compilation of performance data to coach the learner's continuing development and to make evidence-based decisions about the learner's progress.
“Finally, they promote the longitudinal compilation of performance data to coach the learner's continuing development (assessment for learning) and to make evidence-based decisions about the learner's progress (assessment of learning).[11][12][13][14][15]”
Quote in the paperSubstantial claim0 of 3 sources checkedClassified as probably not a substantial claim. May combine two claims.
PremisecitationWithin education, coaching is learner centered and has dual goals: to achieve immediate improvement in the specific activity at hand, and to build skills for longitudinal self-monitoring and self-directed learning.
“Within education, coaching is also learner centered and has dual goals: to achieve immediate improvement in the specific activity at hand, and to build skills for longitudinal self-monitoring and selfdirected learning.19”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [19] source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationDevelopmental learning perspectives, such as Dreyfus's five-stage model and Ericsson's model of deliberate practice, ground approaches to assessment and feedback.
“Such approaches are grounded in developmental learning perspectives, such as Dreyfus's 37 five-stage model (novice, advanced beginner, competent, proficient, expert) and Ericsson's 38,39 model of deliberate practice.”
Quote in the paperNot a substantial claim0 of 3 sources checked- cites [37]
Not checked in the free run.
- cites [38]
Not checked in the free run.
- cites [39]
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductcitationThe authors endeavored to be reflective and reflexive by being attentive to and disclosing personal involvement in and opinions about the R2C2 model and about assessment and feedback.
“We also endeavored to be reflective and reflexive by being attentive to and disclosing personal involvement in and opinions about the R2C2 model and about assessment and feedback, which may have influenced our analysis.31,32”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [31] source
Not checked in the free run.
- cites [32]
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductnone givenSummaries prepared by the pairs were shared with the whole team, and critical discussions of findings were encouraged.
“Summaries prepared by the pairs were shared with the whole team, and critical discussions of findings were encouraged.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationEach R2C2 phase, informed by theory and research, guides the feedback conversation and includes specific open-ended questions to promote self-reflection and self-direction.
“Each phase, informed by theory and research, guides the feedback conversation and includes specific open-ended questions to promote self-reflection and selfdirection (see Supplemental Digital Appendix 1 at http://links.lww.com/ ACADMED/A522).20,21”
Quote in the paperSubstantial claim0 of 2 sources checkedProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.
PremisecitationCoaching's intent is to help individuals develop both effectively and efficiently and to perform at their best.
“Drawing from the sports world, its intent is to help individuals develop both effectively and efficiently and to perform at their best.17,18”
Quote in the paperNot a substantial claim0 of 2 sources checkedProbably not a substantial claim: may not pass S2 (checkable). May combine two claims.
PremisecitationCoaching is developmental and moves feedback away from its historic tie to assessment and closer to learning.
“Coaching is developmental, and philosophically it moves feedback away from its historic tie to assessment and moves it closer to learning.9,15,16”
Quote in the paperNot a substantial claim0 of 3 sources checked- cites [9] source
Not checked in the free run.
- cites [15]
Not checked in the free run.
- cites [16]
Not checked in the free run.
Classified as probably not a substantial claim.
PremisecitationThe R2C2 feedback model consists of four phases: relationship building, exploring reactions to the feedback, exploring understanding of feedback content, and coaching for performance change.
“This model consists of four phases: relationship building, exploring reactions to the feedback, exploring understanding of feedback content, and coaching for performance change.20”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [20] source
Not checked in the free run.
May combine two claims.
PremisecitationInvested, credible supervisors and a supportive, open culture are integral to positive learning and coaching in medicine and education.
“Invested, credible supervisors 2,4-7 and a supportive, open culture [33][34][35][36] are integral to positive learning and coaching in medicine 8 and education.16,19”
Quote in the paperSubstantial claim0 of 7 sources checked- cites [2] source
Not checked in the free run.
- cites [4] source
Not checked in the free run.
- cites [5] source
Not checked in the free run.
- cites [6] source
Not checked in the free run.
- cites [7] source
Not checked in the free run.
- cites [33][34][35][36]
Not checked in the free run.
- cites [8] source
Not checked in the free run.
Classified as probably not a substantial claim.
PremisecitationThe Medical Research Council framework recommends undertaking exploratory studies to ensure understanding and accounting for factors that influence the outcomes of an intervention before conducting comparative effectiveness studies.
“The Medical Research Council framework recommends undertaking exploratory studies to ensure understanding and accounting for factors that influence the outcomes of an intervention (e.g., the R2C2 model) before conducting comparative effectiveness studies.”
Quote in the paperSubstantial claim0 of 2 sources checkedClassified as probably not a substantial claim.
Study design and conductown dataTo minimize bias, the authors did not analyze transcripts from their own site.
“To minimize bias, we did not analyze transcripts from our own site.”
Quote in the paperSubstantial claimMay combine two claims.
PremisecitationFeatures important to the provision of feedback include actively engaging providers and recipients in the feedback interaction and addressing factors that influence feedback credibility and use, such as relationships, context, and culture.
“Features seen to be especially important to the provision of feedback include actively engaging providers and recipients in the feedback interaction and addressing factors that influence feedback credibility and use, such as relationships, context, and culture.[2][3][4][5][6][7][8]”
Quote in the paperSubstantial claim0 of 3 sources checkedProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductown dataThe study used author pairs to analyze each transcript and discuss interpretations and findings with each other and then with the larger team.
“These included the use of author pairs to analyze each transcript and discuss their interpretations and findings with each other and then with the larger team.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.
Premisenone givenThe R2C2 is a learner-centered approach designed to engage the resident, facilitate reflection, and guide informed self-assessment.
“The R2C2 is a learner-centered approach designed to engage the resident, facilitate reflection, and guide informed self-assessment.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenThe sites, residents, and supervisors volunteered to participate.
“The sites, residents, and supervisors volunteered to participate.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Study design and conductnone givenThe quality of the site-specific assessment reports and data could not be ascertained.
“The quality of the site-specific assessment reports and data could not be ascertained.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable). May combine two claims.
InterpretationreasoningCoaching is not just a new skill for supervisors but also a new way of thinking, requiring an educational partnership with residents and collaboratively enabling their development and self-directed learning.
“coaching is not just a new skill for supervisors but also a new way of thinking, requiring an educational partnership with residents and collaboratively enabling their development and self-directed learning.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisereasoningIn both Dreyfus's and Ericsson's models, assessment for learning, instruction, feedback, and subsequent practice are integral to developing competence.
“In both, assessment for learning, instruction, feedback, and subsequent practice are integral to developing competence.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenBoth residents and their current supervisor had to agree to participate, which in some cases delayed or limited recruitment.
“Both residents and their current supervisor had to agree to participate, which in some cases delayed or limited recruitment.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
InterpretationreasoningThe R2C2 may be more easily taken on by supervisors who naturally use a facilitative approach and more challenging for those who naturally use a more directive approach.
“It may be more easily taken on by supervisors who naturally use such a facilitative approach and more challenging for those who naturally use a more directive approach.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationMedical education is gradually adopting a system in which ongoing, longitudinal formative assessment and coaching, combined with summative assessment at sentinel progress points, are integral.
“Medical education is gradually adopting a system in which ongoing, longitudinal formative assessment and coaching, combined with summative assessment at sentinel progress points, are integral.15”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [15]
Not checked in the free run.
Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.
InterpretationreasoningThe R2C2 model for feedback and coaching, and a format such as the LCP to guide development plans, may be helpful in the transition to a system of ongoing formative assessment and coaching.
“The R2C2 model for feedback and coaching, and a format such as the LCP to guide development plans, may be helpful in this transition.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningUse of the R2C2 model and LCP also seemed to contribute to the development of a trusting, collaborative supervisor-resident relationship that facilitated residents' critical reflection, identification of areas for improvement, and codevelopment of LCPs.
“It also seemed to contribute to the development of a trusting, collaborative supervisorresident relationship that facilitated residents' critical reflection, identification of areas for improvement, and codevelopment of LCPs.”
Quote in the paperSubstantial claim
The paper relies on this without support.
The quality of assessment data and reports influences the quality of feedback and coaching conversations.
“This is a concern because the quality of assessment data and reports influences the quality of feedback and coaching conversations.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Coach access to data is a program success factor.
“| Coaching success factors | Program | Coach access to data | [106,129,131] |”
From Coaching in undergraduate and graduate medical education: a scoping review of success factors, barriers, and outcomes (2026) · cites this paper as [131]
The Procedures and data collection section says supervisors used program performance reports in R2C2 feedback sessions, and the Discussion reports effective coaching conversations about those data (pages unavailable). However, the paper does not identify coach access to data itself as a program-level success factor; its listed factors include program assessment approaches and culture and context. (LLM, conf=0.77)
Experimental — accuracy not yet measuredCoach characteristics are a program barrier.
“| Coaching barriers | Program | Coach characteristics | [97,116,131] |”
From Coaching in undergraduate and graduate medical education: a scoping review of success factors, barriers, and outcomes (2026) · cites this paper as [131]
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414 · see citing works
Developing and evaluating complex interventions: the new Medical Research Council guidance
Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, M. (2008) · BMJ · doi:10.1136/bmj.a1655 · Cited by 10,995 · see citing works
Making psychological theory useful for implementing evidence based practice: a consensus approach
Michie, S. (2005) · Quality and Safety in Health Care · doi:10.1136/qshc.2004.011155 · Cited by 3,440 · see citing works
Competency-based medical education: Theory to practice.
Frank, J. R., Snell, L. S., Cate, O. T., Holmboe, E. S., Carraccio, C., Swing, S. R., Harris, P., Glasgow, N. J., Campbell, C., Dath, D., et al. (2010) · Medical Teacher · doi:10.3109/0142159x.2010.501190 · Cited by 2,883 · see citing works
Self-citationDeliberate practice and acquisition of expert performance: a general overview
Anders Ericsson, K. (2008) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2008.00227.x · Cited by 1,827 · see citing works
Harvey, G., & Kitson, A. (2015) · Implementation Science · doi:10.1186/s13012-016-0398-2 · Cited by 1,271 · see citing works
The Five-Stage model of adult skill acquisition
Dreyfus, S. E. (2004) · Bulletin of Science, Technology & Society · doi:10.1177/0270467604264992 · Cited by 1,261 · see citing works
A model for programmatic assessment fit for purpose.
van der Vleuten, C. P. M., Schuwirth, L. W. T., Driessen, E. W., Dijkstra, J., Tigelaar, D., Baartman, L. K. J., & van Tartwijk, J. (2012) · Medical Teacher · doi:10.3109/0142159x.2012.652239 · Cited by 892 · see citing works
Critically appraising qualitative research
Kuper, A., Lingard, L., & Levinson, W. (2008) · BMJ · doi:10.1136/bmj.a1035 · Cited by 784 · see citing works
The “educational alliance” as a framework for reconceptualizing feedback in medical education.
Telio, S., Ajjawi, R., & Regehr, G. (2015) · Academic Medicine · doi:10.1097/acm.0000000000000560 · Cited by 572 · see citing works
Ericsson, K. A. (2015) · Academic Medicine · doi:10.1097/acm.0000000000000939 · Cited by 542 · see citing works
Core principles of assessment in competency-based medical education.
Lockyer, J., Carraccio, C., Chan, M.-K., Hart, D., Smee, S., Touchie, C., Holmboe, E. S., Frank, J. R., & Collaborators, O. B. O. T. I. (2017) · Medical Teacher · doi:10.1080/0142159x.2017.1315082 · Cited by 493 · see citing works
Eva, K. W., Armson, H., Holmboe, E., Lockyer, J., Loney, E., Mann, K., & Sargeant, J. (2012) · Advances in Health Sciences Education · doi:10.1007/s10459-011-9290-7 · Cited by 402 · see citing works
Self-citationAdvancing competency-based medical education: A charter for clinician–educators.
Carraccio, C., Englander, R., Van Melle, E., ten Cate, O., Lockyer, J., Chan, M.-K., Frank, J. R., & Snell, L. S. (2016) · Academic Medicine · doi:10.1097/acm.0000000000001048 · Cited by 372 · see citing works
Guidelines: The do’s, don’ts and don’t knows of feedback for clinical education.
Lefroy, J., Watling, C., Teunissen, P. W., & Brand, P. (2015) · Perspectives on Medical Education · doi:10.1007/s40037-015-0231-7 · Cited by 347 · see citing works
Twelve Tips for programmatic assessment
Van Der Vleuten, C. P. M., Schuwirth, L. W. T., Driessen, E. W., Govaerts, M. J. B., & Heeneman, S. (2015) · Medical Teacher · doi:10.3109/0142159x.2014.973388 · Cited by 333 · see citing works
Sargeant, J., Lockyer, J., Mann, K., Holmboe, E., Silver, I., Armson, H., Driessen, E., MacLeod, T., Yen, W., Ross, K., et al. (2015) · Academic Medicine · doi:10.1097/acm.0000000000000809 · Cited by 306 · see citing works
Self-citationLearning from clinical work: the roles of learning cues and credibility judgements
Watling, C., Driessen, E., van der Vleuten, C. P. M., & Lingard, L. (2012) · Medical Education · doi:10.1111/j.1365-2923.2011.04126.x · Cited by 261 · see citing works
Feedback for learners in medical education: What is known? A scoping review.
Bing-You, R., Hayes, V., Varaklis, K., Trowbridge, R., Kemp, H., & McKelvy, D. (2017) · Academic Medicine · doi:10.1097/acm.0000000000001578 · Cited by 256 · see citing works
Feedback and the educational alliance: Examining credibility judgements and their consequences.
Telio, S., Regehr, G., & Ajjawi, R. (2016) · Medical Education · doi:10.1111/medu.13063 · Cited by 231 · see citing works
Features of assessment learners use to make informed self-assessments of clinical performance.
Sargeant, J., Eva, K. W., Armson, H., Chesluk, B., Dornan, T., Holmboe, E., Lockyer, J. M., Loney, E., Mann, K. V., & van der Vleuten, C. P. M. (2011) · Medical Education · doi:10.1111/j.1365-2923.2010.03888.x · Cited by 154 · see citing works
Self-citationMapping the dark matter of context: A conceptual scoping review.
Bates, J., & Ellaway, R. H. (2016) · Medical Education · doi:10.1111/medu.13034 · Cited by 144 · see citing works
Commitment to change statements can predict actual change in practice.
Wakefield, J., Herbert, C. P., Maclure, M., Dormuth, C., Wright, J. M., Legare, J., Brett-MacLean, P., & Premi, J. (2003) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.1340230205 · Cited by 141 · see citing works
Ramani, S., Post, S. E., Könings, K., Mann, K., Katz, J. T., & van der Vleuten, C. (2017) · Teaching and Learning in Medicine · doi:10.1080/10401334.2016.1244014 · Cited by 138 · see citing works
Self-citationFocusing on the Formative: Building an Assessment System Aimed at Student Growth and Development
Konopasek, L., Norcini, J. J., & Krupat, E. (2016) · Academic Medicine · doi:10.1097/acm.0000000000001171 · Cited by 126 · see citing works
Bowen, L., Marshall, M., & Murdoch-Eaton, D. (2017) · Academic Medicine · doi:10.1097/acm.0000000000001632 · Cited by 99 · see citing works
R2C2 in action: Testing an evidence-based model to facilitate feedback and coaching in residency.
Sargeant, J., Mann, K., Manos, S., Epstein, I., Warren, A., Shearer, C., & Boudreau, M. (2017) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-16-00398.1 · Cited by 98 · see citing works
Self-citationCultivating student–staff partnerships through research and practice.
Bovill, C., & Felten, P. (2016) · International Journal for Academic Development · doi:10.1080/1360144x.2016.1124965 · Cited by 95 · see citing works
Proposing a Model of Co-Regulated Learning for Graduate Medical Education
Rich, J. V. (2017) · Academic Medicine · doi:10.1097/acm.0000000000001583 · Cited by 64 · see citing works
Evidence-Informed Facilitated Feedback: The R2C2 Feedback Model
Sargeant, J. M., Armson, H., Driessen, E. W., Holmboe, E. S., Könings, K. D., Lockyer, J., Lynn, L. A., Mann, K. V., Ross, K., Silver, I., et al. (2016) · MedEdPORTAL · doi:10.15766/mep_2374-8265.10387 · Cited by 39 · see citing works
Self-citationFind the Coaching in Criticism
Traficanti, H. K. (2014) · CFA Digest · doi:10.2469/dig.v44.n3.10 · Cited by 12 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- Gawande, Personal best: Top athletes and singers have coaches. Should you?, New Yorker
Cited by
Sorted by citations
Identifying coaching skills to improve feedback use in postgraduate medical education
Armson, H., Lockyer, J. M., Zetkulic, M., Könings, K. D., & Sargeant, J. (2019) · Medical Education · doi:10.1111/medu.13818 · Cited by 115 · see citing works
Self-citationGonzalo, J. D., Wolpaw, D. R., Krok, K. L., Pfeiffer, M. P., & McCall-Hosenfeld, J. S. (2019) · Medical Education Online · doi:10.1080/10872981.2019.1591256 · Cited by 39 · see citing works
Coaching to improve self‐directed learning
Wolff, M., Stojan, J., Buckler, S., Cranford, J., Whitman, L., Gruppen, L., & Santen, S. (2020) · The Clinical Teacher · doi:10.1111/tct.13109 · Cited by 29 · see citing works
Svendsen, B. T., Petersen, L. F., Skjelsager, A., Lippert, A., & Østergaard, D. (2024) · Advances in Simulation · doi:10.1186/s41077-024-00303-5 · Cited by 27 · see citing works
“In residency training, the R2C2 (relationship, reaction, content and coaching) model has been successfully used [8].”
MethodSelling, S. K., Rooholamini, S. N., Grow, H. M., McPhillips, H., Hoang, K., Blankenburg, R., & Rassbach, C. (2023) · Academic Medicine · doi:10.1097/acm.0000000000005011 · Cited by 15 · see citing works
Bringing meaning to coaching in medical education
Lovell, B. (2019) · Medical Education · doi:10.1111/medu.13833 · Cited by 12 · see citing works
Twelve tips for designing and implementing an academic coaching program
King, S. M., Anas, S., Carnicer Hijazo, R., Jordaan, J., Potter, J. D. F., & Low-Beer, N. (2024) · Medical Teacher · doi:10.1080/0142159x.2024.2308058 · Cited by 8 · see citing works
Jain, P. G., McBride, M. E., Caliendo, A., & Eppich, W. (2022) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-21-00936.1 · Cited by 8 · see citing works
Mukherjee, B., Pfleeger, J., Custodio, H., Roca, M. R., Khalsa, G., & Clanton, C. (2026) · Medical Education Online · doi:10.1080/10872981.2026.2687304 · Cited by 1 · see citing works
- Authors
- Sargeant, J., Lockyer, J. M., Mann, K., Armson, H., Warren, A., Zetkulic, M., Soklaridis, S., Könings, K. D., Ross, K., Silver, I., Holmboe, E., Shearer, C., & Boudreau, M.
- Affiliations
- Dalhousie University (CA)
- Maastricht University (NL)
- American Board of Internal Medicine (US)
- Uniformed Services University of the Health Sciences (US)
- Corresponding author
- Sargeant, Joan
- ORCID
- Venue
- Academic Medicine
- Publisher
- Oxford University Press (OUP)
- Published
- 2018-07
- Volume
- 93
- Issue
- 7
- Pages
- 1055-1063
- ISSN
- 1040-2446 (ISSN-L)
- OpenAlex
- W2794418754
- Cited by
- 148
- References
- 31
- Citations by year
- 2026: 11 · 2025: 15 · 2024: 18 · 2023: 16 · 2022: 20 · 2021: 27 · 2020: 14 · 2019: 22 · 2018: 5
- FWCI
- 16.18
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Academic Medicine (publishedVersion)
- PubMed (publishedVersion)
- Research Publications (Maastricht University) (publishedVersion, other-oa)
- UEA Digital Repository (University of East Anglia) (submittedVersion)
- Research Publications (Maastricht University) (submittedVersion, other-oa)
- Funders
- Universiteit Maastricht
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Innovations in Medical Education
- Social Sciences › Education › Student Assessment and Feedback
- Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
- Keywords
- performance feedback, coaching, resident education, reflective practice, performance improvement, supervisor characteristics, program culture, family medicine residency, psychiatry residency, internal medicine residency, surgical residency, anesthesiology residency
- MeSH terms
- Mentoring, Educational Measurement, Feedback, United Kingdom, Humans, Internal Medicine, Internship and Residency, Interviews as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-10.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-10.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review