Factors influencing responsiveness to feedback: On the interplay between fear, confidence, and reasoning processes.

May combine two claims.

Each of confidence, experience, and fear of not appearing knowledgeable could have a paradoxical effect of both increasing and decreasing receptivity to feedback.

“Importantly, however, each could have a paradoxical effect of both increasing and decreasing receptivity.”

May combine two claims.

Participants' interpretations of external feedback, both formal and informal, fell into several categories: (1) the interplay between experience, confidence, and fear of not appearing knowledgeable; (2) influences upon accessing, interpreting and using feedback; and (3) mechanisms guiding (and potentially biasing) interpretation of external feedback.

“The ways in which participants interpreted external feedback, both formal and informal, fell into several categories. We discuss these as (1) the interplay between experience, confidence, and fear of not appearing knowledgeable; (2) influences upon accessing, interpreting and using feedback; and (3) mechanisms guiding (and potentially biasing) interpretation of external feedback.”

Probably not a substantial claim: may not pass S1 (asserted), S3 (load-bearing).

Some participants argued that lack of humility (the willingness to disclose one's limitations) is a fundamental problem with some individuals' practice.

“Some argued that lack of humility (i.e., the willingness to disclose one’s limitations) is a fundamental problem with some individuals’ practice.”

May combine two claims.

Experience alone seemed to contribute to confidence and a sense of comfort.

“That is, experience alone seemed to contribute to confidence and a sense of comfort.”

May combine two claims.

Confidence, experience, and fear of not appearing knowledgeable are influences on the interpretation and uptake of feedback.

“These include confidence, experience, and fear of not appearing knowledgeable.”

Classified as probably not a substantial claim.

There remain fundamental differences of opinion across all groups with respect to how much learners and physicians should disclose to their patients, their colleagues, or themselves about their limitations.

“there remain fundamental differences of opinion across all groups with respect to how much learners and physicians should disclose to their patients, their colleagues, or themselves about their limitations.”

Classified as probably not a substantial claim. May combine two claims.

Both the absolute number of cases one has seen and the occurrence of specific experiences were thought to play a guiding role.

“Both the absolute number of cases one has seen and the occurrence of specific experiences were thought to play a guiding role.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Little was mentioned in terms of the quality of either the experience or of the information gained from these experiences.

“However, little was mentioned in terms of the quality of either the experience or of the information gained from these experiences.”

May combine two claims.

For learners, experience was generally viewed positively, was desired, and generally led to increased confidence.

“For learners, experience was generally viewed positively, was desired, and generally led to increased confidence.”

Probably not a substantial claim: may not pass S1 (asserted).

Other participants argued that one should not disclose lack of knowledge to patients because desirable features of practice include independence and the projection of confidence.

“Others argued that one should not disclose this lack of knowledge to patients as desirable features of practice to be strived for include independence and the projection of confidence.”

May combine two claims.

Physicians were susceptible to fear of not appearing knowledgeable and suggested that the fear of appearing not to know is a motivational factor.

“physicians too were susceptible to fear of not appearing knowledgeable and suggested that the fear of appearing not to know is a motivational factor”

May combine two claims.

Participants did not value confidence at all costs; many spoke of the risk of becoming over-confident and described how one's confidence needs to be informed by honest and humble self-appraisals.

“That is not to say that participants valued confidence at all costs as many did speak of the risk of becoming over-confident and described how one’s confidence needs to be informed by honest and humble self-appraisals of how they are doing”

May combine two claims.

Some noted that the lack of opportunity to readily engage in collegial interactions creates difficulty in solo practice and limits access to external feedback.

“Some noted that the lack of opportunity to readily engage in collegial interactions creates difficulty “when you are in … solo practice” [Physician K7] and limits access to external feedback.”

May combine two claims.

A number of physicians spoke of the need to be shaken out of a prior belief and used emotionally-tied words like "shock" to express the feeling that first arises when discovering that there was a weakness in their performance.

“A number of physicians spoke of the need to be shaken out of a prior belief and used emotionally-tied words like “shock” to express the feeling that first arises when discovering that there was a weakness in their performance.”

May combine two claims.

Confidence and experience appeared to work in two ways: by enabling participants to ask for and accept feedback and, for some, guarding them against feedback that might be critical in nature.

“That is, confidence and experience appeared to work in two ways: By enabling participants to ask for and accept feedback and, for some, guarding them against feedback that might be critical in nature.”

Classified as probably not a substantial claim.

Some participants expressed views suggesting a tendency to trust positive outcomes/feedback while discounting negative ones.

“some expressed views that suggested a tendency to trust positive outcomes/feedback while discounting negative ones”

May combine two claims.

Confidence appeared tenuous, and loss of confidence in response to particular events is something that needs to be overcome.

“Yet, confidence appeared tenuous and participants’ comments also made it clear that loss of confidence in response to particular events is something that needs to be overcome.”

May combine two claims.

'Shock' is a common initial response to feedback that one must try deliberately to overcome to avoid shrinking away from tasks or situations in which performance was sub-optimal.

“(3) the “shock” described as a common initial response that one must try deliberately to overcome to avoid shrinking away from tasks or situations in which performance was sub-optimal.”

May combine two claims.

Family physicians commented on critical consultants who did not understand the family physician's role and patients who lacked the medical knowledge or insight required to objectively judge care.

“Family physicians likewise commented on critical consultants who did not understand the family physician’s role and patients who lacked the medical knowledge or insight required to objectively judge care.”

May combine two claims.

The need to believe that feedback was delivered from a position of beneficence and non-maleficence was equally important, and that belief often developed as a result of strong relationships between the feedback deliverer and recipient.

“Equally important was the need to believe that the feedback was delivered from a position of beneficence and non-maleficence, that belief often developing as a result of strong relationships being established between the feedback deliverer and recipient.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Noticeable by its absence was indication of the quality of those experiences in terms of what information was provided or what was actually learned.

“That would seem appropriate, but noticeable by its absence was indication of the quality of those experiences in terms of what information was provided or what was actually learned.”

May combine two claims.

The problem is often that feedback is simply unavailable or truly of insufficient quality.

“and that the problem is often that feedback is simply unavailable or truly of insufficient quality.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

At least five team members analyzed each transcript and participated in continually informing the coding structure and its revision.

“At least five team members analyzed each transcript and participated in this process, continually informing the coding structure and its revision.”

Classified as probably not a substantial claim.

Accurate external feedback is crucial if one hopes to facilitate improvement.

“The general conclusion from all of this effort is that accurate external feedback is crucial if one hopes to facilitate improvement (Sargeant et al. 2010).”

• cites Sargeant et al. 2010Not checked yet

  Not checked in the free run.

Probably not a substantial claim: may not pass S3 (load-bearing).

High levels of team member engagement and interaction through all stages of analysis enhanced the rigour of the analysis.

“High levels of team member engagement and interaction through all stages of analysis enhanced its rigour (Liamputtong and Ezzy 2005) as did the collaboration of team members from a variety of backgrounds.”

• cites Liamputtong and Ezzy 2005Not checked yet

  Not checked in the free run.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Themes were initially determined independently by open-coding transcripts and then comparing interpretations through group discussions.

“We determined themes initially independently by open-coding transcripts and then comparing interpretations through group discussions conducted by teleconference and email.”

May combine two claims.

Performance gains often occur without altering individuals' self-perceptions; the two become aligned because performance increases to meet perceptions.

“performance gains often occur without altering individuals’ self-perceptions, the two becoming aligned because performance increases to meet perceptions.”

• cites Kruger and Dunning’s (1999) sourceNot checked yet

  Not checked in the free run.

Probably not a substantial claim: may not pass S3 (load-bearing).

Differences in interpretation were resolved through discussion and re-examining transcripts and coded data.

“We resolved differences in interpretation through discussion and re-examining transcripts and coded data.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The analysis was conducted iteratively as a team.

“We conducted the analysis iteratively as a team.”

Classified as probably not a substantial claim.

The methodology used in this study does not allow a statement to be made regarding the accuracy of the participants' interpretations or the prevalence of actual 'bias.'

“The methodology used in this study does not allow a statement to be made regarding the accuracy of the participants’ interpretations or the prevalence of actual “bias.””

Probably not a substantial claim: may not pass S2 (checkable).

It is equally if not more important to consider how feedback is received and data are interpreted.

“it is equally if not more important to consider how feedback is received and data are interpreted.”

Classified as probably not a substantial claim.

Trusting positive feedback while discounting negative feedback can potentially increase confidence by not accounting for the fact that positive outcomes can arise by chance just as readily as negative outcomes.

“thereby potentially increasing confidence by not accounting for the fact that positive outcomes can arise by chance just as readily as can negative outcomes.”

• AssumptionRests on an assumption: Positive outcomes can arise by chance just as readily as negative outcomes.

Probably not a substantial claim: may not pass S3 (load-bearing).

Researchers in social psychology have identified two broad classes of influences sometimes described as 'hot cognition' and 'cold cognition.'

“Growing out of the classic work of Tversky and Kahneman (1974), researchers in this field have identified two broad classes of influences sometimes described as “hot cognition” and “cold cognition” (Gilovich 1991).”

• cites Tversky and Kahneman (1974) sourceNot checked yet

  Not checked in the free run.

• cites Gilovich 1991Not checked yet

  Not checked in the free run.

Probably not a substantial claim: may not pass S2 (checkable).

Educators may be best served by separating the goal of performance improvement from the goal of accurate self-assessment.

“This further suggests that we, as educators, may be best served by separating the goal of performance improvement from the goal of accurate self-assessment”

Probably not a substantial claim: may not pass S2 (checkable).

Any effort to improve performance and overcome reliance on often flawed personal judgments must be considered in the context of what receivers believe provides important guidance regarding the credibility of that feedback.

“As such, any effort to improve performance and overcome reliance on often flawed personal judgments must be considered in the context of what receivers believe provides important guidance regarding the credibility of that feedback.”

• AssumptionRests on an assumption: Feedback is never provided in a vacuum.

Probably not a substantial claim: may not pass S2 (checkable).

If one hopes to convey feedback that is perceived as credible, an effort must be made to tailor feedback in a manner that will be interpretable and palatable through the lens of the recipient's perceptions.

“If one hopes to convey feedback that is perceived as credible an effort must be made to tailor feedback in a manner that will be interpretable and palatable through the lens of the recipient’s perceptions.”

Probably not a substantial claim: may not pass S2 (checkable).

The adaptive nature of positive self-efficacy makes it such that in many circumstances we are better off maintaining a positive outlook regarding our own abilities.

“The argument laid out above, however, is meant to highlight that the adaptive nature of positive self-efficacy (Dweck 1999) makes it such that in many circumstances we are better off maintaining a positive outlook regarding our own abilities.”

• cites Dweck 1999Not checked yet

  Not checked in the free run.

May combine two claims.

Experience determines confidence, which becomes a double-edged sword.

“That experience determines confidence, therefore, becomes a double-edged sword.”

Probably not a substantial claim: may not pass S2 (checkable).

Feedback providers must learn to take into account the self-perceptions of the individual being assessed.

“While most teaching around feedback focuses on delivery, feedback providers must learn to take into account the self-perceptions of the individual being assessed.”

Probably not a substantial claim: may not pass S2 (checkable).

The results of this study reinforce the need to study these issues in this way.

“The results of this study, however, reinforce the need to study these issues in this way.”

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

A variety of methodologies have yielded similar conclusions across disparate domains, providing evidence of triangulation.

“That a variety of methodologies have yielded similar conclusions across disparate domains can be seen as providing evidence of triangulation”

Probably not a substantial claim: may not pass S2 (checkable).

The triangulation strengthens claims that the results are meaningful and add to our understanding of how some basic psychological issues may impact upon professional self-regulation.

“thus strengthening claims that the results are meaningful and add to our understanding of how some basic psychological issues may impact upon professional self-regulation.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The researchers themselves are prone to biases in their interpretation of participant responses, with the tendency to confirm one's preconceptions being an obvious concern.

“A greater limitation of the research reported here is that the researchers themselves are prone to biases in their interpretation of participant responses, the tendency to confirm one’s preconceptions providing one obvious concern.”

May combine two claims.

As experience accumulates, one gains both confidence and a greater capacity to discount corrective feedback as a result of having a greater personal database of cases on which to draw as 'evidence' that the skill has been achieved and that the source of the feedback must be biased or misinformed.

“As experience accumulates, however, one gains both confidence and a greater capacity to discount corrective feedback as a result of having a greater personal database of cases on which to draw as “evidence” that the skill has been achieved and that the source of the feedback (be it a person or a test or some other dataset) must be biased in some way or misinformed about the receiver’s abilities.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The researchers aimed to minimize this problem by having multiple team members read the transcripts and independently generate themes/ideas rather than relying on the perceptions of one individual.

“We aimed to minimize this problem by having multiple team members read the transcripts and independently generate themes/ideas rather than relying on the perceptions of one individual.”

Probably not a substantial claim: may not pass S2 (checkable).

The interviews and theoretical perspective help us understand the complex variety of ways in which feedback, when received, can be interpreted in ways that can lead to it falling on deaf ears despite the best intentions of all involved.

“Rather, the interviews and this theoretical perspective merely help us to understand the complex variety of ways in which feedback, when received, can be interpreted in ways that can lead to it falling on deaf ears despite the best intentions of all involved.”

Classified as probably not a substantial claim.

Previous work in both clinical and lay domains has suggested that, when left to our own devices, we judge ourselves to have achieved proficiency when the rate at which we are learning from additional experiences declines rather than judging proficiency based on the actual level of performance achieved.

“Previous work in both clinical and lay domains has suggested that, when left to our own devices, we judge ourselves to have achieved proficiency when the rate at which we are learning from additional experiences declines (i.e., rather than judging proficiency based on the actual level of performance achieved; Eva 2009).”

• cites Eva 2009 sourceNot checked yet

  Not checked in the free run.

Probably not a substantial claim: may not pass S3 (load-bearing).

Many of the themes identified were not anticipated to present themselves in this dataset.

“At the same time, we draw confidence from the fact that many of the themes identified were not anticipated to present themselves in this dataset.”