Resident Burnout, Wellness, Professional Development, and Engagement Before and After New Training Schedule Implementation
Open accessAbstract
Importance: Burnout is a work-related syndrome of depersonalization (DP), emotional exhaustion (EE), and low personal achievement (PA) that is prevalent among internal medicine resident trainees. Prior interventions have had modest effects on resident burnout. The association of a new 4 + 4 block schedule (4 inpatient weeks plus 4 outpatient weeks) with resident burnout has not previously been evaluated. Objective: To evaluate the association of a 4 + 4 block schedule, compared with a 4 + 1 schedule, with burnout, wellness, and self-reported professional engagement and clinical preparedness among resident physicians. Design, Setting, and Participants: This nonrandomized preintervention and postintervention survey study was conducted in a single academic-based internal medicine residency program from June 2019 to June 2021. The study included residents in the categorical, hospitalist, and primary care tracks in postgraduate years 1 and 2 (PGY1 and PGY2). Data analysis was conducted from October to December 2022. Intervention: In the 4 + 4 structure, resident schedules alternated between 4-week inpatient call-based rotations and 4-week ambulatory non–call-based rotations. Main Outcomes and Measures: The primary outcome was burnout, assessed using the Maslach Burnout Inventory subcategories of EE (range, 0-54), DP (range, 0-30), and PA (range, 0-48), adjusted for sex and PGY. Secondary outcomes included In-Training Examination (ITE) scores and a questionnaire on professional, educational, and health outcomes. Multivariable logistic regression was used to assess the primary outcome, 1-way analysis of variance was used to compare ITE percentiles, and a Bonferroni-adjusted Kruskal Wallis test was used for the remaining secondary outcomes. The findings were reexamined with several sensitivity analyses, and Cohen’s D was used to estimate standardized mean differences (SMDs). Results: Of the 313 eligible residents, 216 completed the surveys. A total of 107 respondents (49.5%) were women and 109 (50.5%) were men; 119 (55.1%) were PGY1 residents. The survey response rates were 78.0% (85 of 109) in the preintervention cohort and 60.6% (63 of 104) and 68.0% (68 of 100) in the 2 postintervention cohorts. The PGY1 residents had higher response rates than the PGY2 residents (119 of 152 [78.2%] vs 97 of 161 [60.2%]; P < .001). Adjusted EE scores (mean difference [MD], −6.78 [95% CI, −9.24 to −4.32]) and adjusted DP scores (MD, −3.81 [95% CI, −5.29 to −2.34]) were lower in the combined postintervention cohort. The change in PA scores was not statistically significant (MD, 1.4 [95% CI, −0.49 to 3.29]). Of the 15 items exploring professional, educational, and health outcomes, a large positive association was observed for 11 items (SMDs >1.0). No statistically significant change in ITE percentile ranks was noted. Conclusions and Relevance: In this survey study of internal medicine resident physicians, a positive association was observed between a 4 + 4 block training schedule and internal medicine resident burnout scores and improved self-reported professional, educational, and health outcomes. These results suggest that specific 4 + 4 block combinations may better improve resident burnout than a 4 + 1 combination used previously.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the organizational work-hour intervention subgroup, there was no significant post-intervention effect across all outcome domains: EE -0.20 (95% CI -0.58 to 0.17, p = 0.29, I2 = 67.1%), DP -0.16 (95% CI -0.48 to 0.16, p = 0.33, I2 = 55.8%), and PA 0.04 (95% CI -0.12 to 0.20, p = 0.60, I2 = 0%).
“Subgroup analyses revealed no post-intervention Cohen’s d SMD in work-hour interventions [44, 45, 47, 73, 76] across all outcome domains: EE (-0.20, 95% CI -0.58 to 0.17, p = 0.29, I2 = 67.1%), DP (-0.16, 95% CI -0.48 to 0.16, p = 0.33, I2 = 55.8%), and PA (0.04, 95% CI -0.12 to 0.20, p = 0.60, I2 = 0%).”
From Individual and organizational interventions to reduce burnout in resident physicians: a systematic review and meta-analysis (2024) · cites this paper as [76]
Organizational interventions showed no statistically significant association with any burnout domain (EE, DP, PA).
“In organizational intervention studies [44, 45, 47–49, 73, 76], pooling of post-intervention intervention Cohen’s d SMD yielded non-statistically significant resulted in all outcomes, EE (-0.22, 95% CI -0.47 to 0.04, p = 0.10, I2 = 62.6%) (Fig. 3A), DP (-0.15, 95% CI -0.38 to 0.08, p = 0.21, I2 = 53.0%) (Fig. 3B), and PA (0.12, 95% CI -0.01 to 0.25, p = 0.07; I2 = 0%) (Fig. 3C).”
From Individual and organizational interventions to reduce burnout in resident physicians: a systematic review and meta-analysis (2024) · cites this paper as [76]
The majority of studies employed non-randomized, non-concurrent designs, with 9 using historical controls, 13 utilizing self-control studies, and 11 randomized controlled concurrent trials.
“The majority of studies employed non-randomized, non-concurrent designs, with 9 (27.2%) using historical controls [44, 48, 49, 56, 59, 68, 71, 75, 76] and 13 (39.4%) utilizing self-control studies [47, 50, 53, 54, 58, 61, 65–67, 69, 70, 72, 73]. Eleven (33.3%) studies were randomized, controlled, concurrent trials [45, 51, 52, 55, 57, 60–64, 74].”
From Individual and organizational interventions to reduce burnout in resident physicians: a systematic review and meta-analysis (2024) · cites this paper as [76]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Statistical Power Analysis for the Behavioral Sciences
Cohen, J. (2013) · doi:10.4324/9780203771587 · Cited by 25,373 · see citing works
Use of Ranks in One-Criterion Variance Analysis
Kruskal, W. H., & Wallis, W. A. (1952) · Journal of the American Statistical Association · doi:10.1080/01621459.1952.10483441 · Cited by 13,912 · see citing works
(1996) · Consulting Psychologists Press eBooks · Cited by 7,863 · see citing works
Multiple comparisons among means
Dunn, O. J. (1961) · Journal of the American Statistical Association · doi:10.1080/01621459.1961.10482090 · Cited by 5,006 · see citing works
Burnout and self-reported patient care in an internal medicine residency program
Shanafelt, T. D., Bradley, K. A., Wipf, J. E., & Back, A. L. (2002) · Annals of Internal Medicine · doi:10.7326/0003-4819-136-5-200203050-00008 · Cited by 2,165 · see citing works
A narrative review on burnout experienced by medical students and residents
Dyrbye, L., & Shanafelt, T. (2016) · Medical Education · doi:10.1111/medu.12927 · Cited by 1,134 · see citing works
Association of resident fatigue and distress with perceived medical errors
West, C. P. (2009) · JAMA · doi:10.1001/jama.2009.1389 · Cited by 999 · see citing works
Shanafelt, T. D. (2011) · Archives of Surgery · doi:10.1001/archsurg.2010.292 · Cited by 869 · see citing works
Hodkinson, A., Zhou, Johnson, J., Geraghty, K., Riley, R., Zhou, A., Panagopoulou, E., Chew-Graham, C. A., Peters, D., Esmail, A., et al. (2022) · BMJ · doi:10.1136/bmj-2022-070442 · Cited by 618 · see citing works
Interpreting estimates of treatment effects: implications for managed care.
(2008) · PubMed Central · Cited by 511 · see citing works
Hendra, R., & Hill, A. (2018) · Evaluation Review · doi:10.1177/0193841x18807719 · Cited by 323 · see citing works
Efficacy of Interventions to Reduce Resident Physician Burnout: A Systematic Review
Busireddy, K. R., Miller, J. A., Ellison, K., Ren, V., Qayyum, R., & Panda, M. (2017) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-16-00372.1 · Cited by 283 · see citing works
Scott, A., Jeon, S.-H., Joyce, C. M., Humphreys, J. S., Kalb, G., Witt, J., & Leahy, A. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-126 · Cited by 244 · see citing works
Desai, S. V., Feldman, L., Brown, L., Dezube, R., Yeh, H.-C., Punjabi, N., Afshar, K., Grunwald, M. R., Harrington, C., Naik, R., et al. (2013) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2013.2973 · Cited by 235 · see citing works
Education Outcomes in a Duty-Hour Flexibility Trial in Internal Medicine
Desai, S. V., Asch, D. A., Bellini, L. M., Chaiyachati, K. H., Liu, M., Sternberg, A. L., Tonascia, J. A., Yeager, A. M., Asch, J. M., Katz, J. T., et al. (2018) · New England Journal of Medicine · doi:10.1056/nejmoa1800965 · Cited by 174 · see citing works
Fainstad, T., Mann, A., Suresh, K., Shah, P., Dieujuste, N., Thurmon, K., & Jones, C. D. (2022) · JAMA Network Open · doi:10.1001/jamanetworkopen.2022.10752 · Cited by 148 · see citing works
Self-citationRipp, J., Babyatsky, M., Fallar, R., Bazari, H., Bellini, L., Kapadia, C., Katz, J. T., Pecker, M., & Korenstein, D. (2011) · Academic Medicine · doi:10.1097/acm.0b013e31822c1236 · Cited by 128 · see citing works
Mendelsohn, D. A., Despot, I., Gooderham, P. A., Singhal, A., Redekop, G., & Toyota, B. D. (2018) · Medical Education · doi:10.1111/medu.13757 · Cited by 125 · see citing works
Kanna, B., Deng, C., Erickson, S. N., Valerio, J. A., Dimitrov, V., & Soni, A. (2006) · BMC Medical Education · doi:10.1186/1472-6920-6-52 · Cited by 110 · see citing works
Lim, W. Y., Ong, J., Ong, S. G. K., Hao, Y., Abdullah, H. R., Koh, D. L., & Mok, U. S. (2019) · Journal of Clinical Medicine · doi:10.3390/jcm9010061 · Cited by 98 · see citing works
Residency schedule, burnout and patient care among first-year residents
Block, L., Wu, A. W., Feldman, L. S., Yeh, H., & Desai, S. V. (2013) · Postgraduate Medical Journal · doi:10.1136/postgradmedj-2012-131743 · Cited by 95 · see citing works
Moral distress and burnout in internal medicine residents
Sajjadi, S., Norena, M., Wong, H., & Dodek, P. (2017) · Canadian Medical Education Journal · doi:10.36834/cmej.36639 · Cited by 94 · see citing works
Residency as a Social Network: Burnout, Loneliness, and Social Network Centrality
Shapiro, J., Zhang, B., & Warm, E. J. (2015) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-15-00038.1 · Cited by 87 · see citing works
The 4∶1 Schedule: A Novel Template for Internal Medicine Residencies
Mariotti, J. L., Shalaby, M., & Fitzgibbons, J. P. (2010) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-10-00044.1 · Cited by 61 · see citing works
Reframing professional identity through navigating tensions during residency: A qualitative study
Santivasi, W. L., Nordhues, H. C., Hafferty, F. W., Stelling, B. E. V., Ratelle, J. T., Beckman, T. J., & Sawatsky, A. P. (2022) · Perspectives on Medical Education · doi:10.1007/s40037-022-00709-9 · Cited by 50 · see citing works
X + Y Scheduling Models for Internal Medicine Residency Programs—A Look Back and a Look Forward
Shalaby, M., Yaich, S., Donnelly, J., Chippendale, R. Z., DeOliveira, M. C., & Noronha, C. F. (2014) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-14-00034.1 · Cited by 44 · see citing works
Resident and Faculty Perspectives on Prevention of Resident Burnout: A Focus Group Study
Ironside, K., Becker, D., Chen, I. L., Daniyan, A., Kian, A., Saheba, N., & Hollander, R. (2019) · The Permanente Journal · doi:10.7812/tpp/18-185 · Cited by 42 · see citing works
Response Rate and Nonresponse Bias in Oncology Survey Studies
Parekh, A. D., Bates, J. E., & Amdur, R. J. (2020) · American Journal of Clinical Oncology · doi:10.1097/coc.0000000000000665 · Cited by 39 · see citing works
Carter, A. E., Anderson, T. S., Rodriguez, K. L., Hruska, K. L., Zimmer, S. M., Spagnoletti, C. L., Morris, A., Kapoor, W. N., & Fine, M. J. (2019) · Teaching and Learning in Medicine · doi:10.1080/10401334.2019.1604355 · Cited by 28 · see citing works
Thriving in Residency: a Qualitative Study
Hyman, J., & Doolittle, B. R. (2022) · Journal of General Internal Medicine · doi:10.1007/s11606-022-07504-6 · Cited by 21 · see citing works
Mode of delivery affected questionnaire response rates in a birth cohort study
Bray, I., Noble, S., Robinson, R., Molloy, L., & Tilling, K. M. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.09.004 · Cited by 21 · see citing works
The Impact of Block Ambulatory Scheduling on Internal Medicine Residencies: a Systematic Review
DeWaters, A. L., Loria, H. M., Mayo, H., Chisty, A., & Nguyen, O. K. (2019) · Journal of General Internal Medicine · doi:10.1007/s11606-019-04887-x · Cited by 19 · see citing works
Noronha, C. F., Chaudhry, S. I., Chacko, K. M., McGarry, K., Agrawal, A., Yadavalli, G., & Shalaby, M. (2017) · The American Journal of Medicine · doi:10.1016/j.amjmed.2017.09.012 · Cited by 18 · see citing works
Self-citationPinho, R. D. N. L., Costa, T. F., Silva, N. M., Areal, A. F. B., Salles, A. D. M., Oliveira, A. P. R. A., Rassi, C. H. R. E., Gomes, C. M., da Silva, D. L. M., de Oliveira, F. A. R., et al. (2022) · PLoS ONE · doi:10.1371/journal.pone.0267530 · Cited by 16 · see citing works
The Distance Between Us: the COVID-19 Pandemic’s Effects on Burnout Among Resident Physicians
Natsuhara, K. H., & Borno, H. T. (2021) · Medical Science Educator · doi:10.1007/s40670-021-01431-7 · Cited by 15 · see citing works
Restoration of resident sleep and wellness with block scheduling
Bordley, J., Agustin, A. G., Ahmed, M. A. H., Khalid, R., Paluso, A. M., Kobza, B. S., Spaugy, A. W., Emens, J. S., Desai, S. S., & Khan, A. (2017) · Medical Education · doi:10.1111/medu.13392 · Cited by 14 · see citing works
Avoiding burnout in new doctors: sleep, supervision and teams
PAICE, E. W., & Hamilton‐Fairley, D. (2013) · Postgraduate Medical Journal · doi:10.1136/postgradmedj-2013-132214 · Cited by 13 · see citing works
Understanding the Relationship between Situational Strength and Burnout: A Multi-Sample Analysis
Arroyo, J., Moncayo, I. M. C., Gómez-García, A. R., & Segovia, A. O. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18010162 · Cited by 12 · see citing works
Ofei‐Dodoo, S., Irwin, G. M., Wright, B., Krohn, K., Williams, K., Dooley, P. T., & Duggins, M. L. (2022) · Kansas Journal of Medicine · doi:10.17161/kjm.vol15.18420 · Cited by 8 · see citing works
St‐Pierre, F., Petrosyan, R., Gupta, A., Hughes, S., Trickett, J., Read, S., Doren, V. V., Zeveney, A. S., & Shoushtari, C. S. (2023) · BMC Health Services Research · doi:10.1186/s12913-023-10237-9 · Cited by 8 · see citing works
Flagged first, then by citations
5 of the 45 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Kiratipaisarl, W., Surawattanasakul, V., & Sirikul, W. (2024) · BMC Medical Education · doi:10.1186/s12909-024-06195-3 · Cited by 37 · see citing works
“Subgroup analyses revealed no post-intervention Cohen’s d SMD in work-hour interventions [44, 45, 47, 73, 76] across all outcome domains: EE (-0.20, 95% CI -0.58 to 0.17, p = 0.29, I 2 = 67.1%), DP (-0.16, 95% CI -0.48 to 0.16, p = 0.33, I 2 = 55.8%), and PA (0.04, 95% CI -0.12 to 0.20, p = 0.60, I…”
BackgroundMethodInfluentialThe association between burnout and medical professionalism in medical trainees: a systematic review
Bordbar, S., Mousavi, S. M., & Samadi, S. (2025) · BMC Medical Education · doi:10.1186/s12909-025-07687-6 · Cited by 15 · see citing works
Ma, L., Chee, C. S., Amri, S., Gao, X., Wang, Q., Wang, N., & Liu, P. (2025) · PeerJ · doi:10.7717/peerj.18952 · Cited by 21 · see citing works
Wykowski, J. H., & Starks, H. E. (2024) · Journal of General Internal Medicine · doi:10.1007/s11606-024-09176-w · Cited by 8 · see citing works
Hausner, C. J., Yi, M., Patel, M., Franchino, J. T., & Day, C. S. (2026) · PLoS ONE · doi:10.1371/journal.pone.0343160 · Cited by 6 · see citing works
Prevention of burnout syndrome in physicians: a systematic review and meta-analysis
Krebs, L., Jung, L., & Arrich, J. (2026) · Wiener Klinische Wochenschrift · doi:10.1007/s00508-025-02601-y · Cited by 5 · see citing works
The Secularization of Medicine
Carlin, N. (2025) · doi:10.1093/med/9780197574003.001.0001 · Cited by 2 · see citing works
Promoting Well‐Being Among Gastroenterologists – A Call for Systemic Action
Zimmermann, K., Rodríguez–Lago, I., Sidhu, R., Heinrich, H. S., Sousa, P., Dieninytė, E., Duijvestein, M., Hann, A., Gemilyan, M., Knüttel, H., et al. (2025) · United European Gastroenterology Journal · doi:10.1002/ueg2.70149 · Cited by 3 · see citing works
Ma, L., Chee, C. S., Liu, P., & Amri, S. (2026) · BMC Psychology · doi:10.1186/s40359-026-04528-z · Cited by 2 · see citing works
Enfrentamento do burnout em preceptores e residentes de medicina: explorando estratégias
Grünewald, S. T. F. (2024) · Espaço para a Saúde - Revista de Saúde Pública do Paraná · doi:10.22421/1517-7130/es.2024v25.e996 · Cited by 1 · see citing works
Reimagining Block Scheduling to Address Resident Well-Being
Waymel, C., Norcott, C., & Andrews, B. (2024) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.0017
Ambulatory Blocks in Pulmonary and Critical Care Fellowship Reprioritize Outpatient Medicine
Witt, L. J., & Heath, J. K. (2024) · ATS Scholar · doi:10.34197/ats-scholar.2024-0058ed
Read These Hot Non-JGME Articles From 2024!
Yarris, L. M., SIMPSON, D. E., Deiorio, N. M., Artino, A. R., & Sullivan, G. M. (2025) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-25-00033.1
Carlin, N. S. (2025) · doi:10.1093/med/9780197574003.002.0009
Carlin, N. S. (2025) · doi:10.1093/med/9780197574003.003.0003
Carlin, N. S. (2025) · doi:10.1093/med/9780197574003.002.0004
Carlin, N. S. (2025) · doi:10.1093/med/9780197574003.002.0005
Carlin, N. S. (2025) · doi:10.1093/med/9780197574003.003.0002
Carlin, N. S. (2025) · doi:10.1093/med/9780197574003.003.0001
Carlin, N. S. (2025) · doi:10.1093/med/9780197574003.003.0005
Carlin, N. S. (2025) · doi:10.1093/med/9780197574003.002.0003
Carlin, N. S. (2025) · doi:10.1093/med/9780197574003.003.0004
Fujikawa, H., Tamune, H., Nishizaki, Y., Nagasaki, K., Kobayashi, H., Nojima, M., Sekine, M., Shimizu, T., Yamamoto, Y., Shikino, K., et al. (2026) · Scientific Reports · doi:10.1038/s41598-026-40301-3
Shifted Week Resident Rotations in Neuroradiology
Robinson, A., Wojdyla, L. M., Yen, A., Liau, J., Brown, D., & Bykowski, J. (2026) · American Journal of Neuroradiology · doi:10.3174/ajnr.a9293
Pal, P., Bodhi, R., & Yadav, S. (2026) · Journal of Health Organization and Management · doi:10.1108/jhom-03-2025-0153
Dhali, A., Mandal, S., Aithal, G., & Sanders, D. S. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1833862
Verastegui, A., González-Urquijo, M., Maldonado, D., Leyva‐Alvizo, A., & Rodarte‐Shade, M. (2026) · Global Surgical Education - Journal of the Association for Surgical Education · doi:10.1007/s44186-026-00557-9
Arias, J. L. R., Weber, F. L. R., & Fajardo-Dolci, G. (2026) · Acta Médica Grupo Ángeles · doi:10.35366/123524
The importance of mentorship programs during residency: the Big Brother Project
Gimeno-Castillo, M., Fernández‐Montero, A., Garrido, I. C., Chaverri, C., Ibarzabal, M., & Moreno‐Galarraga, L. (2026) · Mentoring & Tutoring Partnership in Learning · doi:10.1080/13611267.2026.2714009
A decade of evaluating burnout among American medical students using the OLBI-MS
Rosen, L. T., & Friedman, R. (2026) · Scientific Reports · doi:10.1038/s41598-025-22054-7
Prapanpot, T., Saengruang-Orn, S., Limpaiboon, C., & Wiriyanukhroh, T. (2026) · Journal of Southeast Asian Medical Research · doi:10.55374/jseamed.v10.277
Indraprasta, B. R., Ernawati, E., & Joewono, H. T. (2026) · Al-Rafidain Journal of Medical Sciences · doi:10.54133/ajms.v11i2.3176
Na, S.-J., Park, J., Choi, H., Yeo, S., & 권효진 (2026) · Research Square · doi:10.21203/rs.3.rs-10733670/v1
- Authors
- Heppe, D., Baduashvili, A., Limes, J. E., Suddarth, K., Mann, A., Gottenborg, E., Sacro, Y., Davis, L., Chacko, K., & Connors, G.
- Affiliations
- University of Colorado Anschutz (US)
- Denver Health Medical Center (US)
- Corresponding author
- Heppe, Daniel
- Venue
- JAMA Network Open
- Publisher
- American Medical Association (AMA)
- Published
- 2024-02-28
- Volume
- 7
- Issue
- 2
- Pages
- e240037
- ISSN
- 2574-3805 (ISSN-L)
- PMC
- PMC10902722
- OpenAlex
- W4392242475
- Cited by
- 33
- References
- 45
- Citations by year
- 2026: 13 · 2025: 15 · 2024: 5
- FWCI
- 19.38
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JAMA Network Open (publishedVersion, cc-by)
- PubMed (publishedVersion)
- PubMed Central (publishedVersion, cc-by)
- Topics
- Health Sciences › Health Professions › General Health Professions › Healthcare professionals’ stress and burnout
- Social Sciences › Psychology › Social Psychology › Stress and Burnout Research
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Innovations in Medical Education
- Keywords
- resident burnout, internal medicine residency, resident well-being, professional engagement, professional development, clinical preparedness, emotional exhaustion, depersonalization, personal accomplishment, academic medicine workforce, physician well-being, Maslach Burnout Inventory
- MeSH terms
- Burnout, Psychological, Emotional Exhaustion, Female, Humans, Inservice Training, Male, Psychological Tests, Hospitalists, Self Report
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review