The Work-life Check-ins randomized controlled trial: a leader-based adaptive, semi-structured burnout intervention in primary care clinics

May combine two claims.

Individual-level interventions significantly reduce emotional exhaustion and depersonalization but are less effective for personal accomplishment, which may be tied to the workplace environment.

“Another meta-analysis among clinical nurses concluded that while individual-level interventions can significantly reduce emotional exhaustion and depersonalization, they are less effective in enhancing personal accomplishment, which may be more closely tied to the workplace environment [7].”

• cites [7] sourcePartly supported

  The Results > Meta-analysis section reports significant reductions in emotional exhaustion and depersonalization, but no statistically significant improvement in low personal accomplishment. The Discussion suggests that nurses’ personal accomplishment may be more closely tied to the workplace system. The paper reports these findings for pooled interventions, however, rather than a separately analyzed category of individual-level interventions. (LLM, conf=0.84)

  Experimental — accuracy not yet measured

May combine two claims.

Dyadic leader-member interaction influences job satisfaction, employee retention, and workplace morale.

“This dyadic interaction forms the backbone of organizational culture and significantly influences job satisfaction, employee retention, and overall workplace morale [15].”

• cites [15] sourcePartly supported

  In “Foundations of WCL,” Element 2 (page unavailable), the paper says leaders should cultivate relationships with individuals and teams, and links team relationships to well-being, fulfillment, and team culture. Element 1 also links leadership behaviors to team members’ professional fulfillment. Our copy does not establish the claimed effect on employee retention or explicitly link dyadic interactions to workplace morale. (LLM, conf=0.83)

  Experimental — accuracy not yet measured

May combine two claims.

For primary care providers, burnout drivers include difficulty providing timely access and coordinated care, administrative task pressures, and EHR pressures.

“In primary care clinics, burnout drivers for providers revolve around the difficulty in offering patients timely healthcare access and coordinated care, as well as pressures related to administrative tasks and Electronic Health Records (EHR) [4].”

• cites [4] sourcePartly supported

  The Results and Conclusions identify administrative work overload as a stressor for primary health care employees, and the Results also mention limited time to examine patients. The paper does not identify difficulty providing timely access or coordinated care, or EHR pressures, as stressors. No page numbers were available in the indexed passages. (LLM, conf=0.88)

  Experimental — accuracy not yet measured

May combine two claims.

Burnout harms mental health, staff retention, and patient safety.

“Burnout, characterized by emotional exhaustion, depersonalization, and a diminished sense of personal accomplishment, deteriorates mental health, staff retention [2], and patient safety [3].”

• cites [2] sourcePartly supported

  The Conclusion reports that burnout was associated with poorer patient safety in the majority of studies reviewed. That supports the patient-safety portion attributed to citation [3], but the claim that burnout deteriorates patient safety states a causal effect the review does not establish. Mental health and staff retention are attached to citation [2], not this source. (LLM, conf=0.87)

  Experimental — accuracy not yet measured
• cites [3] sourcePartly supported

  For citation [3], the relevant claim is about patient safety; the mental-health and retention claims are attached to [2]. The Results report a significant negative relationship between burnout and safety, but the Discussion says burnout *may* contribute to errors and cautions that the predominantly cross-sectional studies cannot establish its direction or cause. “Deteriorates” states the effect more definitively than the source supports. (LLM, conf=0.88)

  Experimental — accuracy not yet measured

May combine two claims.

Adaptive design flexibility can improve trial efficiency, save time and resources, and lead to more ethical studies by minimizing exposure to less effective treatments.

“This flexibility can improve the efficiency of trials, potentially saving time and resources, and can lead to more ethical studies by minimizing patient exposure to less effective treatments [23].”

• cites [23] sourceSupported

Classified as probably not a substantial claim.

Relational leadership frameworks emphasize the quality of leader-team member relationships.

“Emerging frameworks in academic medicine based on relational leadership theory [10] emphasize the quality of the relationship between leaders and team members [11].”

• cites [10] sourceNot checked — no full text of the source
• cites [11] sourceSupported

May combine two claims.

The FSSB model holds that supervisor support for work-life balance enhances work-family positive spillover and job satisfaction, attenuating burnout risk.

“In addition, the Family Supportive Supervisor Behaviors (FSSB) model underscores how supervisor support for employees’ work-life balance can enhance positive attitudes such as work-family positive spillover and job satisfaction [16] to attenuate the risk of burnout.”

• cites [16] sourcePartly supported

  The Results (FSSB Validity; page unavailable) report positive associations between FSSB and both work-family positive spillover and job satisfaction. The paper does not establish that supervisor support causes those outcomes or that they attenuate burnout risk; burnout is not assessed in the cited results. (LLM, conf=0.86)

  Experimental — accuracy not yet measured

Classified as probably not a substantial claim.

Adaptive clinical trial designs allow adjustments to trial parameters based on interim data analysis.

“Adaptive clinical trial designs allow for adjustments to trial parameters based on interim data analysis [22].”

• cites [22] sourceSupported

Probably not a substantial claim: may not pass S3 (load-bearing).

Clinician survey response rates are typically low, between 20% and 60%.

“Though clinicians usually have low survey response rates (20% to 60%) [37]”

• cites [37] sourcePartly supported

  The Introduction says response rates in GP studies have been falling and reports a mean of 61% in published GP studies. This supports concern about low response rates, but not a typical range of 20%–60% for clinicians generally; the paper's own survey had a 67.6% response rate (Results). (LLM, conf=0.88)

  Experimental — accuracy not yet measured

Probably not a substantial claim: may not pass S3 (load-bearing).

Of 348 initiated surveys, 339 had at least four items completed on every Maslach Burnout Inventory subscale.

“A total of 348 surveys were initiated, but 339 had at least four items from each subscale of the Maslach Burnout Inventory completed.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The baseline survey achieved a 64% response rate, yielding 348 completed surveys from 540 possible.

“the response rate for the baseline survey was 64%, collecting 348 surveys out of a possible 540.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Clinic leaders learned their condition assignment only after completing the baseline interview.

“condition assignment was revealed at the end of the baseline interviews with clinic leaders.”

Classified as probably not a substantial claim.

JD-R theory posits that burnout results from an imbalance between available resources and job demands.

“The job demand-resource (JD-R) posits that burnout results from an imbalance between the resources available to meet job demands [9].”

• cites [9] sourceNot checked — no full text of the source

Classified as probably not a substantial claim.

Within each pair, one clinic was randomized to intervention or waitlist control in a 1:1 ratio.

“The trial had a parallel design wherein one clinic was randomized to either the intervention or the waitlist-control condition in a 1:1 ratio per pair.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The randomization system was accessible only to one designated researcher.

“This system was accessible only to one designated researcher.”

Probably not a substantial claim: may not pass S3 (load-bearing).

All clinics had identical data collection procedures involving surveys with all eligible employees and key informant interviews with selected clinic leaders.

“All clinics had identical data collection procedures, which involved surveys with all eligible employees and key informant interviews with selected clinic leaders (i.e., medical director and practice manager).”

May combine two claims.

Workplace semi-structured interventions have been applied to improve employee well-being and safety, enhance productivity, and foster positive organizational culture.

“Such designs have been applied to improve employee well-being and safety [19], enhance productivity, or foster a positive organizational culture [20].”

• cites [19] sourceNot checked — no full text of the source
• cites [20] sourceNot checked — no full text of the source

Probably not a substantial claim: may not pass S3 (load-bearing).

Six pairs of clinics were created using ABFM size classification: one small, three medium, and two large.

“Following the American Board of Family Medicine’s clinic size classification based on provider counts, six pairs of clinics were created, where one pair was considered small (< 5 providers) practices, three pairs of medium (5 to 20 providers) practices, and two pairs large (>20 providers) practices.”

Probably not a substantial claim: may not pass S2 (checkable).

Tailored interventions are needed to address the specific sources of burnout within each professional group.

“These differences highlight the need for tailored interventions that address the specific sources of burnout within each professional group.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Data collection occurred within the same period for each clinic pair.

“However, data collection occurred within the same period for each clinic pair.”

May combine two claims.

Adopting organically created practices from primary care clinics into RCTs increases ecological validity, generalizability, and applicability.

“Such an approach increases the ecological validity of the study, as the interventions are tested in environments where they are intended to be applied, thereby enhancing the trial’s generalizability and applicability.”

May combine two claims.

Organizational interventions targeting root causes of occupational stress are less explored but may be more long-term beneficial for worker well-being.

“Systematic reviews thus underscore the fact that organizational interventions aimed at the root causes of occupational stress are less explored, though they may be more long-term beneficial for worker well-being [8].”

• cites [8]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

The check-ins practice was independently and organically developed at a primary care clinic, then deconstructed and scaled for other clinics.

“The check-ins were first -identified at a primary care clinic that developed this practice, which was then deconstructed and then scaled for implementation at other clinics [17].”

• cites [17] sourceNot checked — no full text of the source

Classified as probably not a substantial claim.

Baseline survey and interview procedures did not differ between the control and intervention arms.

“Procedures for baseline surveys and interviews were identical between control and intervention”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The baseline survey was voluntary, anonymous, and confidential.

“The practice manager or medical director sent an email to all eligible workers (N=540) inviting them to participate in a voluntary, anonymous, and confidential survey.”

Classified as probably not a substantial claim.

Clinics were matched on provider counts before randomization to ensure comparability.

“Prior to randomization, clinics were matched based on provider counts to ensure comparability.”

• AssumptionRests on an assumption: Provider count is a sufficient basis for matching clinics to ensure comparability on burnout and intervention outcomes.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The study was single-blinded; baseline participants were blinded to clinic intervention status, which was revealed to clinic leaders at the end of the baseline interview.

“The study was single-blinded; baseline data was collected, with participants blinded to their clinic intervention status, which was revealed to clinic leaders at the end of the baseline interview.”

Probably not a substantial claim: may not pass S3 (load-bearing).

A computer-based random number generator was used for random allocation.

“A computer-based random number generator was used for random allocation of conditions.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Clinic leaders' baseline interview questions and process were identical except for intervention status disclosure at the end.

“That said, the questions and process of the clinic leaders’ baseline interviews were identical except at the end, where intervention status was disclosed.”

Classified as probably not a substantial claim.

Semi-structured interventions allow anticipated adaptability in execution, unlike fully structured rigid interventions.

“Unlike fully structured interventions, which are rigid and follow a strict protocol, semi-structured interventions allow for anticipated adaptability in their execution [18].”

• cites [18] sourceNot checked — no full text of the source

Probably not a substantial claim: may not pass S3 (load-bearing).

Confidentiality and data anonymization measures were used to prevent participant identification.

“Confidentiality measures were rigorously applied to safeguard information, with data anonymization protocols in place to prevent the identification of participants.”

Classified as probably not a substantial claim.

To reduce the impact of varying intervention processes, the intervention's core components and stages were standardized across groups while allowing documented variability.

“To mitigate the impact of different intervention processes, the core components and stages of the intervention were standardized across groups while still allowing for variability to be documented by the process evaluation.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

No direct identifiers were collected; an anonymous survey ID based on birth month and the last four phone digits was used to link baseline and follow-up surveys.

“No identifiers were collected, and an anonymous survey I.D. variable was created based on the month of birth and last four digits of their cellular phone numbers to match baseline and follow-up surveys.”

May combine two claims.

Using whole clinics as the randomization unit risks inter-clinic variability affecting results, although the paired-matched design reduces this limitation.

“Moreover, the use of entire clinics as the unit of randomization introduces the risk of inter-clinic variability affecting the results, though this limitation is reduced by the paired-matched design.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Pair-matching and randomization were intended to balance key group characteristics and reduce confounding related to clinic size.

“The pair-matching and randomization process aimed to balance key characteristics between groups, thereby minimizing potential confounding factors related to clinic size.”

Classified as probably not a substantial claim.

The models will control for baseline burnout, clinic size, and healthcare worker demographics as potential confounders.

“The models will also adjust for potential confounders such as baseline burnout levels, clinic size, and demographic characteristics of the healthcare workers.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The event log was used to monitor trial progress, identify and resolve unexpected problems, and support adherence to the intervention protocol.

“The log of events served as a crucial tool for monitoring the trial’s progress, facilitating the identification and resolution of unforeseen challenges, and ensuring adherence to the planned intervention protocols.”

Classified as probably not a substantial claim.

The effectiveness analysis will use both intention-to-treat and per-protocol approaches.

“The analysis will include intention-to-treat (ITT) and per-protocol analyses to assess the intervention’s effectiveness.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The trial received institutional review board approval before it began.

“Prior to the trial’s commencement, approval from an institutional review board (IRB) was obtained.”

Probably not a substantial claim: may not pass S3 (load-bearing).

All participants provided informed consent after being told about the trial's nature, risks, benefits, and voluntary participation.

“Informed consent was meticulously obtained from all participants, ensuring they were fully aware of the trial’s nature, potential risks, and benefits and that their participation was voluntary.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Participants did not know which clinics were assigned to intervention or control.

“Though participants ignore which clinics have been assigned to the intervention or control conditions”

Probably not a substantial claim: may not pass S3 (load-bearing).

Several study team members will code each interview to improve reliability.

“with multiple study members coding each interview to enhance reliability.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Member checking and peer debriefing will be used to support the credibility of the qualitative findings.

“Validation techniques such as member checking and peer debriefing ensure the credibility of the findings.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Attrition mitigation included collecting data without identifiers, explaining the study at staff meetings, and offering participation incentives.

“Strategies to mitigate attrition were implemented, such as collecting data without identifiers, explaining the study at staff meetings, and offering participation incentives.”