The DOI matches its Crossref record; 99 of the 102 references it cites were found in a registry or an index; 41 of the 95 sources its claims cite were checked for support.
Individual and organizational interventions to reduce burnout in resident physicians: a systematic review and meta-analysis
Open accessAbstract
BACKGROUND: Burnout among resident physicians during training has been prevalent, prompting training centers to introduce interventions at the individual or organizational level. However, empirical evidence is crucial before implementing such programs in practice. METHODS: A systematic review and meta-analysis was carried out to evaluate the effectiveness of individual and organizational interventions in reducing burnout among resident physicians. Searching was done across five databases-PubMed, Scopus, ScienceDirect, Embase, and Cochrane Library from 1 December 2023 to 26 August 2024. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement was used for our reporting of study selection process. Eligibility criteria were randomized or non-randomized designs, with prospective intervention, with a comparator group focused on individual or organizational interventions reducing burnout, in any language and publication date. The Maslach Burnout Inventory scores for emotional exhaustion (EE), depersonalization (DP), and personal accomplishment (PA) were the three outcome measures. Two investigators independently extracted the data. The risk of bias was evaluated using Cochrane risk-of-bias tool for randomized trials (RoB2) and non-randomized studies of interventions (ROBINS-I). Cohen's d and heterogeneity was estimated using a random-effects DerSimonian-Laird model and visualized by forest plots. Sensitivity analyses were carried out by leave-one-out meta-analysis. RESULTS: = 50.0%). The organizational intervention showed no significant association with any domain. Sensitivity analyses were robust in all outcomes, with differences in intervention description and design identified as potential contributors to heterogeneity. CONCLUSIONS: Various interventions, including individual coaching, meditation, and organization interventions, have been implemented to improve resident burnout. The effectiveness of intervention demonstrated none to small practical significance in improving burnout. Data inconsistency and high risk of bias across studies limited the validity of the pooled results. Further studies should focus on a combined approach. REGISTRATION: The study was registered on PROSPERO, under PROSPERO registration number CRD42022349698.
Overview
CoChat Summary
TL;DR
This systematic review and meta-analysis found that individual interventions for resident physicians had small but statistically significant effects on emotional exhaustion and depersonalization, while organizational interventions showed no significant overall effects. The authors concluded that the evidence is limited by very low certainty, high risk of bias, and heterogeneity, so combined approaches and better-designed studies are needed.
Key findings
- The review included 33 studies with n = 2536 resident physicians; 25 studies (75.8%) evaluated individual interventions and 8 (24.2%) evaluated organizational interventions.
- For individual interventions, pooled effects were significant for emotional exhaustion (Cohen’s d = -0.25, 95% CI -0.40 to -0.11, p < 0.01) and depersonalization (-0.17, 95% CI -0.32 to -0.03, p = 0.02), but not for personal accomplishment (0.18, 95% CI 0.00 to 0.35, p = 0.05).
- For organizational interventions, no overall burnout domain showed a significant association: EE -0.22 (95% CI -0.47 to 0.04, p = 0.10), DP -0.15 (95% CI -0.38 to 0.08, p = 0.21), PA 0.12 (95% CI -0.01 to 0.25, p = 0.07).
- Subgroup findings differed by intervention type: coaching was significant for EE (-0.24, 95% CI -0.40 to -0.07, p = 0.04), while meditation was significant for PA (0.22, 95% CI 0.03 to 0.40, p = 0.02); among organizational interventions, improved learning environment was significant for PA (0.28, 95% CI 0.05 to 0.50, p = 0.02).
Methods
- Systematic review and meta-analysis of interventions to reduce burnout in resident physicians during training, including randomized and non-randomized prospective interventions with comparator groups; any language and publication year were eligible if full text was available.
- Searched PubMed, Scopus, ScienceDirect, Embase, and Cochrane Library from 1 Dec 2023 to 26 Aug 2024; outcomes were MBI emotional exhaustion, depersonalization, and personal accomplishment.
- Meta-analysis used Cohen’s d with a DerSimonian-Laird random-effects model; bias was assessed with RoB2 and ROBINS-I, and certainty with GRADE.
Limitations
- The paper states that the evidence was limited by data inconsistency, high risk of bias, and overall very low quality of evidence.
- The authors note they only included the Maslach Burnout Inventory (MBI) as the burnout measure, even though other tools exist; they also say pairwise meta-analysis required assuming comparability across interventions and controls, contributing to significant heterogeneity.
- Evident from the text: many included studies were non-randomized, and the authors report all randomized studies and all non-randomized studies as high risk of bias, which likely weakens causal interpretation.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
13 Valid · 4 Not valid · 2 Not checked · 21 Own results and interpretations
Some cited sources support this claim and some don’t — read each source’s verdict below.
In the paper
“In organizational intervention studies [44, 45, 47–49, 73, 76], pooling of post-intervention intervention Cohen’s d SMD yielded non-statistically significant resulted in all outcomes, EE (-0.22, 95% CI -0.47 to 0.04, p = 0.10, I2 = 62.6%) (Fig. 3A), DP (-0.15, 95% CI -0.38 to 0.08, p = 0.21, I2 = 53.0%) (Fig. 3B), and PA (0.12, 95% CI -0.01 to 0.25, p = 0.07; I2 = 0%) (Fig. 3C).”
§ Individual and organizational interventions to reduce burnout in resident physicians: a systematic review and meta-analysis > Results > Meta-analysis of organizational intervention studies
What the sources say
- Disputedcites [44] Burgos L, Battioni L, Costabel J, Alves de Lima A. Evaluation of Burnout Syndrome in Medical residents following a Rest after Shift intervention. Revista Argentina De Cardiologia. 2018;86:123–6. sourceExperimental — accuracy not yet measured
Our copy reports the opposite for one domain: the RESULTS (p. 3, Tabla 2) state a statistically significant reduction in high depersonalization scores after the rest-after-shift (DPG) intervention (78.9% vs. 52.2%, median 19 [11-21] vs. 10 [1-17], p = 0.023), and the CONCLUSION (p. 4) and RESUMEN (p. 1) headline this as the intervention's association with reduced depersonalization. Only emotional exhaustion (p = 0.45) and personal realization (p = 0.58), plus overall burnout prevalence (47.4% vs. 26.1%, p = 0.152), were non-significant. So this source cannot support 'no statistically significant association with ANY burnout domain (EE, DP, PA)'; it is a contrary finding for DP. (LLM, conf=0.85)
Checked by a reasoning model — may be wrong.
- Supportedcites [45] Parshuram CS, Amaral AC, Ferguson ND, Baker GR, Etchells EE, Flintoft V, et al. Patient safety, resident well-being and continuity of care with different resident duty schedules in the intensive care unit: a randomized trial. CMAJ. 2015;187(5):321–9. source
Our copy is a randomized trial of an organizational intervention (three resident duty-schedule models) that measured all three Maslach Burnout Inventory domains; the Results (section 'ICU admissions n = 971') state that for EE, DP and PA end-rotation scores 'There was no significant effect of schedule (all p > 0.5),' with only baseline score significantly associated. The Conclusion repeats this: 'No schedule protected against overnight fatigue or burnout,' and the Interpretation notes 'burnout, as assessed by the Maslach Burnout Inventory, was independent of schedule.' The cited work therefore is one of the organizational-intervention studies pooled in the citing meta-analysis and contributes non-significant EE, DP and PA results; the pooled Cohen's d values themselves are the citing authors' computation, not this paper's. (The paper's only significant burnout finding is a post hoc within-rotation decline in personal accomplishment over time, not an effect of the schedule.) (LLM, conf=0.85)
- Disputedcites [47] Stevens K, Davey C, Lassig AA. Association of Weekly Protected Nonclinical Time with Resident Physician Burnout and Well-being. JAMA otolaryngology– head neck Surg. 2020;146(2):168–75. sourceExperimental — accuracy not yet measured
Our copy confirms this is an organizational/departmental-level burnout intervention (Introduction, p. 'B': 'we designed an intervention focused at the departmental level'), but it contradicts the claim's substance that no burnout domain was significantly affected. The Burnout results and Table 1 report a baseline-to-week-32 mean decrease of 0.63 points in MBI EE with 95% CI -1.03 to -0.22 (interval excluding zero), described as a 'clinically meaningful decrease,' whereas only DP (-0.24; 95% CI, -0.69 to 0.21) and PA (0.05; 95% CI, -0.17 to 0.26) showed no meaningful change. The Discussion repeats this: '2 hours of nonclinical time were associated with a clinically meaningful decrease in MBI EE scores.' So this source cannot stand for 'no statistically significant association with any burnout domain (EE, DP, PA)'; it supports the DP and PA portion only. (LLM, conf=0.75)
Checked by a reasoning model — may be wrong.
- Not checked — no full text of the sourcecites [48] Bisgaard E, Clark A, Hester C, Napier R, Grant J, Scielzo S, et al. Resident Engagement in a Wellness Program in a large academic residency: a Follow-Up after two years of Wellness. J Surg Educ. 2021;78(5):1430–7. source
- Supportedcites [49] Ogunyemi D, Darwish AG, Young G, Cyr E, Lee C, Arabian S, et al. Graduate medical education-led continuous assessment of burnout and learning environments to improve residents’ wellbeing. BMC Med Educ. 2022;22(1):292. source
The cited paper is an organizational-intervention study eligible to be identified among the studies pooled in the citing sentence. Its Abstract > Results reports organization-directed interventions and outcomes for all three MBI factors. The nonsignificant pooled estimates are the citing paper’s analysis, not a result attributed to this individual study. (LLM, conf=0.88)
- Not checked — no full text of the sourcecites [73] Schuh LA, Khan MA, Harle H, Southerland AM, Hicks WJ, Falchook A, et al. Pilot trial of IOM duty hour recommendations in neurology residency programs: unintended consequences. Neurology. 2011;77(9):883–7. source
- Supportedcites [76] Heppe D, Baduashvili A, Limes JE, et al. Resident Burnout, Wellness, Professional Development, and Engagement before and after new training schedule implementation. JAMA Netw Open. 2024;7(2):e240037. https://doi.org/10.1001/jamanetworkopen.2024.0037. Published 2024 Feb 5. source
The citation identifies this paper as one of the organizational intervention studies pooled by the citing authors. Its Introduction describes a change from a 4 + 1 to a 4 + 4 training schedule, and its Results report EE, DP, and PA outcomes. The nonsignificant pooled estimates are the citing authors’ analysis, not a finding attributed to this individual study; this study found significant improvements in EE and DP. (LLM, conf=0.85)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on 3 assumptions not shown here.
- Disputed
Some cited sources support this claim and some don’t — read each source’s verdict below.
In the paper
“Subgroup analyses of coaching intervention [59–72, 74, 75] demonstrated a post-intervention Cohen’s d SMD in EE (-0.24, 95% CI -0.40 to -0.07, p = 0.04, I2 = 41.6%).”
§ Individual and organizational interventions to reduce burnout in resident physicians: a systematic review and meta-analysis > Results > Meta-analysis of individual intervention studies
What the sources say
- Not checked — no full text of the sourcecites [59] Ares WJ, Maroon JC, Jankowitz BT. Pursuit of balance: the UPMC Neurosurgery Wellness Initiative. World Neurosurg. 2019;132:e704–9. source
- Supportedcites [60] Fainstad T, Mann A, Suresh K, Shah P, Dieujuste N, Thurmon K, et al. Effect of a Novel Online Group-Coaching Program to Reduce Burnout in Female Resident Physicians: a Randomized Clinical Trial. JAMA Netw open. 2022;5(5):e2210752. source
The citation identifies one coaching trial included in the citing authors’ subgroup analysis; the pooled Cohen’s d, confidence interval, p value, and I² are results of that analysis, not figures attributed to this individual trial. The source’s Results, under “Primary Outcome: Burnout,” report a significant reduction in emotional exhaustion with coaching compared with control (P = .01). (LLM, conf=0.90)
- Disputedcites [61] Hart D, Paetow G, Zarzar R. Does implementation of a corporate wellness initiative improve burnout? West J Emerg Med. 2019;20(1):138–44. sourceExperimental — accuracy not yet measured
The Results section (page unavailable) reports a slight trend toward increased emotional exhaustion after this study’s intervention, not a significant reduction. This paper also does not report the cited pooled subgroup effect size, confidence interval, p-value, or heterogeneity statistic. (LLM, conf=0.86)
Checked by a reasoning model — may be wrong.
- Supportedcites [62] Huang L, Harsh J, Cui H, Wu J, Thai J, Zhang X, et al. A Randomized Controlled Trial of Balint Groups to prevent burnout among residents in China. Front Psychiatry. 2019;10:957. source
The Methods (Procedure and Intervention; page unavailable) describe a randomized trial of facilitated Balint group sessions, and the Results (Effectiveness of Balint Groups; page unavailable) report emotional exhaustion as an outcome. In the citing sentence, this paper is one of several intervention studies cited for the subgroup analysis; the pooled SMD and its statistics are the citing authors’ analysis, not a result attributed to this individual trial. (LLM, conf=0.85)
- Not checked — no full text of the sourcecites [63] Martins AE, Davenport MC, Del Valle MP, Di Lalla S, Domínguez P, Ormando L, et al. Impact of a brief intervention on the burnout levels of pediatric residents. J Pediatr (Rio J). 2011;87(6):493–8. source
- Not checked — no full text of the sourcecites [64] Milstein JM, Raingruber BJ, Bennett SH, Kon AA, Winn CA, Paterniti DA. Burnout assessment in house officers: evaluation of an intervention to reduce stress. Med Teach. 2009;31(4):338–41. source
- Supportedcites [65] Palamara K, Chu JT, Chang Y, Yu L, Cosco D, Higgins S, et al. Who benefits most? A Multisite Study of Coaching and Resident Well-being. J Gen Intern Med. 2022;37(3):539–47. source
The Intervention section describes a faculty-coaching program for residents, and the Results section reports a decline in emotional exhaustion from baseline to follow-up. This paper is one of the coaching studies cited for the subgroup analysis; the Cohen’s d estimate is presented as the citing authors’ pooled result, not as a statistic calculated by this paper (pages unavailable in our copy). (LLM, conf=0.88)
- Not checked — no full text of the sourcecites [66] Riall TS, Teiman J, Chang M, Cole D, Leighn T, McClafferty H, et al. Maintaining the fire but avoiding burnout: implementation and evaluation of a Resident Well-Being Program. J Am Coll Surg. 2018;226(4):369–79. source
- Partly supportedcites [67] Sheer A, Estores I, Nickels R, Radhakrishnan N, Goede D, Mramba L et al. Improving burnout and well-being among medicine residents: impact of a grassroots intervention compared to a formal program curriculum. J Edu Health Promotion. 2021;10(1). sourceExperimental — accuracy not yet measured
The Results (Table 1; page unavailable) report emotional-exhaustion measurements before and after the paper’s wellness interventions, so the paper could supply study-level data for a pooled analysis. It does not report the cited subgroup’s Cohen’s d, confidence interval, p-value, or I²; its own pre–post emotional-exhaustion comparisons were not statistically significant. The quoted pooled result is therefore not a finding of this source. (LLM, conf=0.84)
- Not checked — no full text of the sourcecites [68] Slavin S, Shoss M, Broom MA. A program to prevent burnout, Depression, and anxiety in First-Year Pediatric residents. Acad Pediatr. 2017;17(4):456–8. source
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on 3 assumptions not shown here.
Every source the paper cites for this claim was checked and supports it.
In the paper
“All non-randomized studies were evaluated to be at high risk of bias using Cochrane ROBINS-I [34] (See Supplementary Appendix 5.2, Additional File 1), primarily due to inadequate confounder control, with historical control studies in particular.”
§ Individual and organizational interventions to reduce burnout in resident physicians: a systematic review and meta-analysis > Results > Risk of bias in studies
What the sources say
- Supportedcites [34] Sterne JA, Hernán MA, Reeves BC, Savović J, Berkman ND, Viswanathan M, et al. ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. BMJ. 2016;355:i4919. source
The Abstract identifies ROBINS-I as a tool for evaluating risk of bias in non-randomised studies of interventions. The citation identifies the tool used; the high-risk ratings are the citing authors’ own assessment, not a finding attributed to this source. (LLM, conf=0.93)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“In the subgroup of meditation intervention studies [50–58], the Cohen’s d SMD was found to be non-statistically significant in EE (-0.30, 95% CI -0.61 to 0.02, p = 0.25, I2 = 63.1%) and DP (-0.10, 95% CI -0.28 to 0.07, p = 0.25, I2 = 0%), but statistically significant in PA (0.22, 95% CI 0.03 to 0.40, p = 0.02, I2 = 0%).”
§ Individual and organizational interventions to reduce burnout in resident physicians: a systematic review and meta-analysis > Results > Meta-analysis of individual intervention studies
What the sources say
- Not checked — no full text of the sourcecites [50] Carullo PC, Ungerman EA, Metro DG, Adams PS. The impact of a smartphone meditation application on anesthesia trainee well-being. J Clin Anesth. 2021;75. source
- Not checked — no full text of the sourcecites [51] Dunne PJ, Lynch J, Prihodova L, O’Leary C, Ghoreyshi A, Basdeo SA, et al. Burnout in the emergency department: Randomized controlled trial of an attention-based training program. J Integr Med. 2019;17(3):173–80. source
- Supportedcites [52] Loewenthal J, Dyer NL, Lipsyc-Sharf M, Borden S, Mehta DH, Dusek JA et al. Evaluation of a yoga-based mind-body intervention for Resident Physicians: a Randomized Clinical Trial. Global Adv Health Med. 2021;10. source
The citation in the sentence identifies studies in the intervention subgroup; it does not present the pooled DP estimate as a result calculated by this individual trial. The Methods (Intervention and Outcome Measures; pages unavailable) describe a yoga-based mind-body intervention for resident physicians and a burnout measure. The pooled SMD, confidence interval, and heterogeneity statistic are the citing paper’s subgroup analysis, not figures reported in this trial. (LLM, conf=0.82)
- Not checked — no full text of the sourcecites [53] Pandit AS, Reka A, Layard Horsfall H, Marcus HJ. Mindfulness Training for Young neurosurgeons: a virtual multicenter prospective pilot study. World Neurosurg. 2022;164:e446–57. source
- Not checked — no full text of the sourcecites [54] Peterson B, Fitzmaurice L, Boehm JK, Bendix B. Pilot study evaluating a 12-h mindfulness-based curriculum for OB/GYN residents. Complement Ther Clin Pract. 2022;48:101620. source
- Partly supportedcites [55] Purdie DR, Federman M, Chin A, Winston D, Bursch B, Olmstead R, et al. Hybrid delivery of mindfulness meditation and perceived stress in Pediatric Resident Physicians: a Randomized Clinical Trial of In-Person and Digital Mindfulness Meditation. J Clin Psychol Med Settings. 2023;30(2):425–34. sourceExperimental — accuracy not yet measured
The Results (Secondary Outcomes) report no statistically significant difference in burnout outcomes between the meditation and control groups. Table 2 reports a depersonalization effect size of 0.23 (95% CI −0.48 to 0.94), not the cited subgroup estimate of −0.10; this trial does not itself report a pooled estimate or I². (LLM, conf=0.88)
- Could not verifycites [56] Schmeusser B, Gauthier Z, Nagy K. Assessment of Resident Burnout After Formalization of Wellness Program. Military medicine. 2022. sourceExperimental — accuracy not yet measured
Our copy of Schmeusser et al. (2023, Military Medicine) is a single-site survey study of 24 WSU OB/GYN residents at 0/6/12 months; the Statistical Analysis and Results sections report only MBI raw-score means, category frequencies and burnout percentages with ANOVA/t-test/chi-square p-values (Table III), with no meta-analysis, no pooled effect sizes, and no Cohen's d SMD, 95% CI or I2 anywhere. Searched for 'meditation intervention subgroup Cohen's d SMD', 'mindfulness meditation meta-analysis effect size', 'standardized mean difference 95% CI I2 subgroup', and 'meditation personal accomplishment' — no passage addresses a meditation subgroup or the DP SMD of -0.10 (-0.28 to 0.07, p = 0.25). The only meta-analysis discussed is Rodrigues et al. 2018 (Maslach Burnout Inventory section, reference 9), cited solely for the method of calculating burnout from high DP and/or EE, not for intervention subgroup effect sizes, so the cited numbers belong to a work our copy does not report. (LLM, conf=0.70)
- Supportedcites [57] Verweij H, van Ravesteijn H, van Hooff MLM, Lagro-Janssen ALM, Speckens AEM. Mindfulness-based stress reduction for residents: a Randomized Controlled Trial. J Gen Intern Med. 2018;33(4):429–36. source
The citation is attached to the identification of meditation-intervention studies. The Methods (Intervention) describes this trial’s mindfulness program as including sitting and walking meditation, and the Results (Outcome of the Intervention) report a nonsignificant depersonalization difference (p = 0.71). The pooled SMD and heterogeneity figures are the citing paper’s subgroup results, not figures attributed to this individual trial. (LLM, conf=0.88)
- Not checked — no full text of the sourcecites [58] Weitzman RE, Wong K, Worrall DM, Park C, McKee S, Tufts RE, et al. Incorporating virtual reality to improve Otolaryngology Resident Wellness: one Institution’s experience. Laryngoscope. 2021;131(9):1972–6. source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on 3 assumptions not shown here.
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“In the subgroup of meditation intervention studies [50–58], the Cohen’s d SMD was found to be non-statistically significant in EE (-0.30, 95% CI -0.61 to 0.02, p = 0.25, I2 = 63.1%) and DP (-0.10, 95% CI -0.28 to 0.07, p = 0.25, I2 = 0%), but statistically significant in PA (0.22, 95% CI 0.03 to 0.40, p = 0.02, I2 = 0%).”
§ Individual and organizational interventions to reduce burnout in resident physicians: a systematic review and meta-analysis > Results > Meta-analysis of individual intervention studies
What the sources say
- Not checked — no full text of the sourcecites [50] Carullo PC, Ungerman EA, Metro DG, Adams PS. The impact of a smartphone meditation application on anesthesia trainee well-being. J Clin Anesth. 2021;75. source
- Not checked — no full text of the sourcecites [51] Dunne PJ, Lynch J, Prihodova L, O’Leary C, Ghoreyshi A, Basdeo SA, et al. Burnout in the emergency department: Randomized controlled trial of an attention-based training program. J Integr Med. 2019;17(3):173–80. source
- Supportedcites [52] Loewenthal J, Dyer NL, Lipsyc-Sharf M, Borden S, Mehta DH, Dusek JA et al. Evaluation of a yoga-based mind-body intervention for Resident Physicians: a Randomized Clinical Trial. Global Adv Health Med. 2021;10. source
The Introduction (page unavailable) describes yoga as incorporating formal meditation, and Methods > Intervention identifies this paper as a trial of a yoga-based program. The bracketed citation identifies studies in the citing authors’ subgroup; the pooled PA estimate is the citing authors’ result, not a result attributed to this individual trial. (LLM, conf=0.85)
- Not checked — no full text of the sourcecites [53] Pandit AS, Reka A, Layard Horsfall H, Marcus HJ. Mindfulness Training for Young neurosurgeons: a virtual multicenter prospective pilot study. World Neurosurg. 2022;164:e446–57. source
- Not checked — no full text of the sourcecites [54] Peterson B, Fitzmaurice L, Boehm JK, Bendix B. Pilot study evaluating a 12-h mindfulness-based curriculum for OB/GYN residents. Complement Ther Clin Pract. 2022;48:101620. source
- Supportedcites [55] Purdie DR, Federman M, Chin A, Winston D, Bursch B, Olmstead R, et al. Hybrid delivery of mindfulness meditation and perceived stress in Pediatric Resident Physicians: a Randomized Clinical Trial of In-Person and Digital Mindfulness Meditation. J Clin Psychol Med Settings. 2023;30(2):425–34. source
The Results table (page not provided) identifies this as a mindfulness-intervention trial that measured personal accomplishment, so it supports citing the paper as one of the meditation studies in the subgroup. The pooled SMD, confidence interval, p value, and I² are the citing paper’s subgroup-analysis results, not results attributed to this individual trial. (LLM, conf=0.86)
- Could not verifycites [56] Schmeusser B, Gauthier Z, Nagy K. Assessment of Resident Burnout After Formalization of Wellness Program. Military medicine. 2022. sourceExperimental — accuracy not yet measured
Our copy of Schmeusser et al. (Military Medicine 2023) is a single-site, three-time-point survey of 24 OBGYN residents before/after a formalized Wellness Program; it performs no meta-analysis, no intervention-type subgroup pooling, and reports no Cohen's d / SMD, 95% CI or I² anywhere (searched: 'meditation intervention subgroup', 'personal accomplishment improvement effect size Cohen's d'). Meditation appears only as one event within the program ('meditation sessions, and guided reflections', Implementation of a Wellness Program), and the study's own PA data are raw MBI means — 37.7 (5.7) at 0M, 34.5 (8.5) at 6M, 39.1 (5.2) at 12M, p = .14 (Table III, DISCUSSION) — with the authors stating 'No significant difference was found among the three time periods' (RESULTS). Thus the pooled statistic attributed (SMD 0.22, 95% CI 0.03–0.40, p = 0.02, I² = 0%) is neither stated nor contradicted by our copy; it evidently comes from the citing paper's own meta-analysis of references 50–58, but our copy names no such meditation meta-analysis, so misattribution cannot be established from it either. (LLM, conf=0.72)
- Supportedcites [57] Verweij H, van Ravesteijn H, van Hooff MLM, Lagro-Janssen ALM, Speckens AEM. Mindfulness-based stress reduction for residents: a Randomized Controlled Trial. J Gen Intern Med. 2018;33(4):429–36. source
The Methods (Intervention; page unavailable) describe an MBSR program that included meditation, and the Results (Outcome of the Intervention, Table 2; page unavailable) report significantly improved personal accomplishment in this trial (p = 0.03, d = 0.24). The citation identifies a study in the citing authors’ meditation-intervention subgroup; the subgroup’s pooled estimate of 0.22 is the citing authors’ result, not a statistic attributed to this individual trial. (LLM, conf=0.88)
- Not checked — no full text of the sourcecites [58] Weitzman RE, Wong K, Worrall DM, Park C, McKee S, Tufts RE, et al. Incorporating virtual reality to improve Otolaryngology Resident Wellness: one Institution’s experience. Laryngoscope. 2021;131(9):1972–6. source
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on 3 assumptions not shown here.
26 more claims · 7 with their cited sources checked
Create a free account to see all 40 claims and to verify the 12 references still open.
- Probably not a substantial claim. 2
- It may state two separate claims as one. 8
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ Individual and organizational interventions to reduce burnout in resident physicians: a systematic review and meta-analysis > Conclusions
“Organizational intervention, primarily focused on improved learning environment, resulted in small but significant enhancements in PA.”
§ Individual and organizational interventions to reduce burnout in resident physicians: a systematic review and meta-analysis > Abstract > Results
“The organizational intervention showed no significant association with any domain.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Individual and organizational interventions to reduce burnout in resident physicians: a systematic review and meta-analysis > Abstract > Results
“Cohen’s d for individual intervention versus control were as follows: EE -0.25 (95% CI -0.40 to -0.11, p < 0.01, I2 = 49.3%), and DP -0.17 (95% CI -0.32 to -0.03, p = 0.02, I2 = 50.0%).”
§ Individual and organizational interventions to reduce burnout in resident physicians: a systematic review and meta-analysis > Results > Meta-analysis of individual intervention studies
“Comparison of the intervention group with the control group in individual intervention studies revealed a significant post-intervention Cohen’s d SMD in EE (-0.25, 95% CI -0.40 to -0.11, p < 0.001, I2 = 49.3%) (Fig. 2A) and DP (-0.18, 95% CI -0.32 to -0.03, p = 0.02, I2 = 50.0%) (Fig. 2B).”
Citations
Cites
The PRISMA 2020 statement: An updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n71 · Cited by 108,283
RoB 2: a revised tool for assessing risk of bias in randomised trials
Sterne, J. A. C., Savović, J., Page, M. J., Elbers, R. G., Blencowe, N. S., Boutron, I., Cates, C. J., Cheng, H.-Y., Corbett, M. S., Eldridge, S. M., et al. (2019) · BMJ · doi:10.1136/bmj.l4898 · Cited by 34,787 · cited 3×
“Eight domains were assessed: inconsistency [40], indirectness [41], imprecision [42], risk of bias [33], publication bias, dose-response gradient, magnitude of association, and presence of residual confounding [43].”
MethodInfluentialROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions
Sterne, J. A., Hernán, M. A., Reeves, B. C., Savović, J., Berkman, N. D., Viswanathan, M., Henry, D., Altman, D. G., Ansari, M. T., Boutron, I., et al. (2016) · BMJ · doi:10.1136/bmj.i4919 · Cited by 20,329 · cited 3×
“All non-randomized studies were evaluated to be at high risk of bias using Cochrane ROBINS-I [34] (See Supplementary Appendix 5.2, Additional File 1), primarily due to inadequate confounder control, with historical control studies in particular.”
BackgroundMethodInfluentialMaslach, C., Schaufeli, W. B., & Leiter, M. P. (2001) · Annual Review of Psychology · doi:10.1146/annurev.psych.52.1.397 · Cited by 12,852 · cited 1×
“Its framework, largely influenced by Maslach [8–10], encompasses three domains.”
BackgroundAustin, P. C. (2011) · Multivariate Behavioral Research · doi:10.1080/00273171.2011.568786 · Cited by 12,242 · cited 1×
“Randomized studies, such as preference-based trials [99], and non-randomized studies with targeted trial frameworks, incorporating adequate baseline and time-varying confounder control methods like regression and inverse probability weighting can enhance the effectiveness of outcomes [34, 100, 101].”
BackgroundUnderstanding the burnout experience: Recent research and its implications for psychiatry
Maslach, C., & Leiter, M. P. (2016) · World Psychiatry · doi:10.1002/wps.20311 · Cited by 4,200 · cited 2×
“Measurement criteria for evaluation of interventions should utilized the Maslach Burnout Inventory (MBI) [10], with reporting on total scores of each dimension: EE, DP, and PA. Modification to the PROSPERO protocol was made to cover MBI scale other than the 22-item standard version in order to…”
BackgroundMethodThe Copenhagen Burnout Inventory: A new tool for the assessment of burnout
Kristensen, T. S., Borritz, M., Villadsen, E., & Christensen, K. B. (2005) · Work & Stress · doi:10.1080/02678370500297720 · Cited by 3,136
Interrupted time series regression for the evaluation of public health interventions: a tutorial
Lopez Bernal, J., Cummins, S., & Gasparrini, A. (2016) · International Journal of Epidemiology · doi:10.1093/ije/dyw098 · Cited by 3,049 · cited 1×
“Alternatively, time-series designs may be suitable for organizational interventions [104] in institutes with active surveillance and consistent data collection of burnout, allowing for the assessment of long-term population-level changes in MBI scores [105, 106].”
BackgroundPhysician burnout: contributors, consequences and solutions
West, C. P., Dyrbye, L. N., & Shanafelt, T. D. (2018) · Journal of Internal Medicine · doi:10.1111/joim.12752 · Cited by 2,768
GRADE guidelines 6. Rating the quality of evidence—imprecision
Guyatt, G. H., Oxman, A. D., Kunz, R., Brozek, J., Alonso-Coello, P., Rind, D., Devereaux, P. J., Montori, V. M., Freyschuss, B., Vist, G., et al. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2011.01.012 · Cited by 2,693 · cited 1×
“Eight domains were assessed: inconsistency [40], indirectness [41], imprecision [42], risk of bias [33], publication bias, dose-response gradient, magnitude of association, and presence of residual confounding [43].”
Research works printed but not linked: 3
- Library C. MeSH browser 2022. https://www.cochranelibrary.com/advanced-search/mesh
- Stevens K, Davey C, Lassig AA. Association of Weekly Protected Nonclinical Time with Resident Physician Burnout and Well-being. JAMA otolaryngology– head neck Surg. 2020;146(2):168–75. · DOI · Paper page
- Fainstad T, Mann A, Suresh K, Shah P, Dieujuste N, Thurmon K, et al. Effect of a Novel Online Group-Coaching Program to Reduce Burnout in Female Resident Physicians: a Randomized Clinical Trial. JAMA Netw Open. 2022;5(5):e2210752–e. · DOI · Paper page
Cited by
Surawattanasakul, V., Siviroj, P., Kiratipaisarl, W., Sirikul, W., Phetsayanavin, V., Pholvivat, C., Auernaruemonsuk, N., & Lamlert, C. (2025) · BMC Public Health · doi:10.1186/s12889-025-23172-7 · Cited by 16
“…highlight the importance of proactive mental health surveillance, Employee Assistance Programs (EAP), regular assessments, personalized communication, and targeted interventions to support at-risk individuals and enhance their ability to manage professional responsibilities effectively [37].”
Self-citationLiu, H., Li, X., Zhao, L., Zhang, Y., Huang, D., Li, T. X., Xie, K., & Shen, Y. (2025) · BMJ Open · doi:10.1136/bmjopen-2025-099192 · Cited by 13
“Improving the well-being of these frontline workers is crucial for maintaining the operational integrity of the healthcare system during crises.”
Yehia, A. C., Moreira, J. M., & Premaor, M. O. (2025) · PLoS ONE · doi:10.1371/journal.pone.0321443 · Cited by 7
Fit2Perform: European society of thoracic surgery survey on member well-being
Minervini, F., Bertoglio, P., Steup, W. H., Vanstraelen, S., Rathinam, S., Novoa, N. M., & Schreurs, H. (2025) · Interdisciplinary CardioVascular and Thoracic Surgery · doi:10.1093/icvts/ivaf140 · Cited by 2
“However, studies with data inconsistency and high risk of bias limited the strength of the conclusions [19].”
Privitera, G. J., Gillespie, J. J., Pamula, A., & Piper, B. J. (2025) · Population Health Management · doi:10.1089/pop.2025.0080 · Cited by 2
Metadata
- Authors
- Kiratipaisarl, W., Surawattanasakul, V., & Sirikul, W.
- Affiliations
- Chiang Mai University (TH)
- Corresponding author
- Kiratipaisarl, Wuttipat
- Surawattanasakul, Vithawat
- Sirikul, Wachiranun
- Venue
- BMC Medical Education
- Published
- 2024-10-30
- Volume
- 24
- Issue
- 1
- Pages
- 1234-1234
- ISSN
- 1472-6920 (ISSN-L)
- PMC
- PMC11523819
- OpenAlex
- W4403894026
- Semantic Scholar
- 3184b2fb828bfa30ab8b0ee98fa0632248c50fad
- Cited by
- 37
- References
- 102
- Citations by year
- 2026: 25 · 2025: 12
- FWCI
- 3.32
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- BMC Medical Education (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Chiang Mai University
- Faculty of Medicine, Chiang Mai University
- Topics
- Health Sciences › Health Professions › General Health Professions › Healthcare professionals’ stress and burnout
- Social Sciences › Psychology › Social Psychology › Stress and Burnout Research
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Occupational Health and Burnout
- Keywords
- burnout, medical residents, organizational interventions, individual interventions, emotional exhaustion, depersonalization, personal accomplishment, Maslach Burnout Inventory, coaching, meditation, medical education
- MeSH terms
- Burnout, Professional, Humans, Internship and Residency, Physicians
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Individual and organizational interventions to reduce burnout in resident physicians: a systematic review and meta-analysis. https://app.cochat.ai/papers/10.1186/s12909-024-06195-3
- The paper
- Kiratipaisarl, W., Surawattanasakul, V., & Sirikul, W. (2024). Individual and organizational interventions to reduce burnout in resident physicians: a systematic review and meta-analysis. BMC Medical Education. https://doi.org/10.1186/s12909-024-06195-3
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.