Effect of Reducing Interns' Work Hours on Serious Medical Errors in Intensive Care Units
The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Although sleep deprivation has been shown to impair neurobehavioral performance, few studies have measured its effects on medical errors. METHODS: We conducted a prospective, randomized study comparing the rates of serious medical errors made by interns while they were working according to a traditional schedule with extended (24 hours or more) work shifts every other shift (an "every third night" call schedule) and while they were working according to an intervention schedule that eliminated extended work shifts and reduced the number of hours worked per week. Incidents were identified by means of a multidisciplinary, four-pronged approach that included direct, continuous observation. Two physicians who were unaware of the interns' schedule assignments independently rated each incident. RESULTS: During a total of 2203 patient-days involving 634 admissions, interns made 35.9 percent more serious medical errors during the traditional schedule than during the intervention schedule (136.0 vs. 100.1 per 1000 patient-days, P<0.001), including 56.6 percent more nonintercepted serious errors (P<0.001). The total rate of serious errors on the critical care units was 22.0 percent higher during the traditional schedule than during the intervention schedule (193.2 vs. 158.4 per 1000 patient-days, P<0.001). Interns made 20.8 percent more serious medication errors during the traditional schedule than during the intervention schedule (99.7 vs. 82.5 per 1000 patient-days, P=0.03). Interns also made 5.6 times as many serious diagnostic errors during the traditional schedule as during the intervention schedule (18.6 vs. 3.3 per 1000 patient-days, P<0.001). CONCLUSIONS: Interns made substantially more serious medical errors when they worked frequent shifts of 24 hours or more than when they worked shorter shifts. Eliminating extended work shifts and reducing the number of hours interns work per week can reduce serious medical errors in the intensive care unit.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Shift work is frequently associated with circadian misalignment and self‐reported poor or insufficient sleep, with adverse effects on occupational health and safety (Kecklund and Axelsson 2016; Landrigan 2004).”
From Adapting shift work schedules for sleep quality, sleep duration, and sleepiness in shift workers (2023) · cites this paper as Landrigan 2004
In the citing paper
“A randomised controlled trial found that limiting first-year resident physicians to 16 consecutive work hours significantly improved resident alertness and patient safety.”
In the citing paper
“Alternative detection methods, such as trigger tools and direct observation have been shown to detect higher rates of medical errors compared with self-report.6 38”
Citations
Cites
To Err Is Human: Building a Safer Health System
(2000) · National Academies Press eBooks · doi:10.17226/9728 · Cited by 14,044
Brennan, T. A., Leape, L. L., Laird, N. M., Hebert, L., Localio, A. R., Lawthers, A. G., Newhouse, J. P., Weiler, P. C., & Hiatt, H. H. (1991) · New England Journal of Medicine · doi:10.1056/nejm199102073240604 · Cited by 4,627
To Err Is Human : Building A Safer Health System
Kohn, L. T., Corrigan, J. M., & Donaldson, M. S. (2000) · Cited by 2,830
Bates, D. W. (1998) · JAMA · doi:10.1001/jama.280.15.1311 · Cited by 2,107
Self-citationMedication Errors and Adverse Drug Events in Pediatric Inpatients
Kaushal, R. (2001) · JAMA · doi:10.1001/jama.285.16.2114 · Cited by 1,917
Self-citationPharmacist Participation on Physician Rounds and Adverse Drug Events in the Intensive Care Unit
Leape, L. L. (1999) · JAMA · doi:10.1001/jama.282.3.267 · Cited by 1,599
Effects of Sleep Deprivation on Performance: A Meta-Analysis
Pilcher, J. J., & Huffcutt, A. I. (1996) · Sleep · doi:10.1093/sleep/19.4.318 · Cited by 1,549
Fatigue, alcohol and performance impairment
Dawson, D., & Reid, K. (1997) · Nature · doi:10.1038/40775 · Cited by 1,199
Relationship between medication errors and adverse drug events
Bates, D. W., Boyle, D. L., Vliet, M. B. V., Schneider, J., & Leape, L. (1995) · Journal of General Internal Medicine · doi:10.1007/bf02600255 · Cited by 981
Self-citationEffect of Reducing Interns' Weekly Work Hours on Sleep and Attentional Failures
Lockley, S. W., Cronin, J. W., Evans, E. E., Cade, B. E., Lee, C. J., Landrigan, C. P., Rothschild, J. M., Katz, J. T., Lilly, C. M., Stone, P. H., et al. (2004) · New England Journal of Medicine · doi:10.1056/nejmoa041404 · Cited by 913
Self-citation
Research works printed but not linked: 2
- Richardson GS, 1996, Sleep, 19, 718
- Wyatt JK, 1999, Am J Physiol, 277, R1152
Cited by
Items 1,501–1,600 of 1,760
Shift Scheduling for Residents in Medical Critical Care: Benefits and Limitations
Ohleyer, V., Fried, E. D., & Shapiro, J. M. (2012)
The impaired anesthesiologist – sleep deprivation
Howard, S. K. (2010) · Cambridge University Press eBooks · doi:10.1017/cbo9780511841361.039
Managing the Stress and Problems of Others
MSc, P. J. F.-C., & Dr. Jamie Harrison MA, F. (2010) · doi:10.1002/9781444318432.ch13
Improving Diagnostic Safety in Hospital Medicine: Can Clinical Care Conundrums Help?
Etchells, E. E., Shojania, K. G., & Redelmeier, D. A. (2013) · Wiley eBooks · doi:10.1002/9781118483206.ch2
Human error and latent risk in incidents in anaesthesia in New Zealand
Belbin, E. J. (2015) · Research Commons (University of Waikato)
Physiological recovery from night-call duty - a field study of physicians
Malmberg, B. (2011) · Lund University Publications (Lund University)
Sleep Quality Among First-Year Internal Medicine Residents in Siriraj Hospital
Chierakul, N. (2014) · DOAJ (DOAJ: Directory of Open Access Journals)
Pediatric Residents' Perspectives on Reducing Work Hours and Lengthening Residency
Gordon, M. B., Sectish, T. C., Elliott, M. N., Klein, D. J., Landrigan, C. P., Bogart, L. M., Amrock, S. M., Burke, A. E., Chiang, V. W., & Schuster, M. A. (2012)
Self-citationResident Training and the Medical Emergency Team
Lighthall, G. K. (2006) · Springer eBooks · doi:10.1007/0-387-27921-0_20
“Observational studies in the intensive care unit as well as in a simulated environment have demonstrated that physicians make errors without even realizing that they occur (7, 22 ); in the case of real patients, it is difficult to imagine how any educational benefit could result from such mistakes if the physician is…”
BackgroundMaking Better Cents of Future Teaching Hospital Costs—Reply
Mitchell, C. C. (2007) · Archives of Surgery · doi:10.1001/archsurg.142.12.1226-b
Peacock, B. (2009) · Ergonomics in Design The Quarterly of Human Factors Applications · doi:10.1518/106480409x12487282100454
“The archaic requirement of medical residents to spend 24 hours on duty has fortunately changed in recent years to a more physiologically appropriate and safe schedule (Landrigan et al., 2004).”
BackgroundStrategic learning: Linking resident training to outcomes for patients*
Corriveau, C. O., & BERGER, J. T. (2005) · Critical Care Medicine · doi:10.1097/01.ccm.0000170748.43947.24
Resident Hours in the Pursuit of Better Health Care—Reply
Goitein, L., Shanafelt, T. D., & Wipf, J. E. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.13.1424-a
News & Perspective Piece Fails to Acknowledge Evidence for Resident Work Hours Limits
Madsen, T. E. (2010) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2009.11.016
Evidence-Based Evaluation of Physician Work Hour Regulations—Reply
Landrigan, C. P. (2009) · JAMA · doi:10.1001/jama.2009.44
Self-citationLes procédures de sécurisation structurelles et managériales
Guidet, B., Mc-Aree, C., & Marty, J. (2008) · Réanimation · doi:10.1016/j.reaurg.2008.06.011
Lizotte, M.-H., Lamy, M.-C., & Carrière, B. (2014) · Pédagogie médicale · doi:10.1051/pmed/2014006
“De nombreux travaux rapportent des effets néfastes d’horaires prolongés de travail, à la fois pour les patients[1] (par exemple un accroissement des erreurs médicales[2]) et pour les médecins résidents (augmentation des blessures par aiguilles[3] et des accidents de la route[4]).”
BackgroundCan we use our time more wisely?*
Hamilton, M. F. (2008) · Pediatric Critical Care Medicine · doi:10.1097/01.pcc.0000298646.01886.59
The effect of work hours on adverse events and errors in health care
Middel, B. (2010) · Nederlands Tijdschrift voor Evidence Based Practice · doi:10.1007/bf03089995 · Cited by 16
Healing with an eye on the clock
Frisch, S. (2013) · BMJ · doi:10.1136/bmj.f5436
Resident Hours in the Pursuit of Better Health Care—Reply
Gopal, R. K., Glasheen, J. J., Miyoshi, T. J., et al. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.13.1423-b
Organisation und Versorgungsqualität
Kockert, S., & Schott, T. (2014) · Public Health Forum · doi:10.1016/j.phf.2014.03.002
“…Behandlungs-/ Diagnosefehlern und letztlich auch die risikoadjustierte Mortalität der Patienten zunehmen, während die Patientenzufriedenheit und diewahrgenommeneVersorgungsqualität abnehmen (Aiken et al., 2002; Tucker et al., 2002; Landrigan et al., 2004; Vahey et al., 2004; Aiken et al., 2012).”
BackgroundVerkeersongelukken bij arts-assistenten door lange werktijden
Pal, T. M. (2005) · Tijdschrift voor bedrijfs- en verzekeringsgeneeskunde · doi:10.1007/bf03074176
Aportaciones de la medicina preventiva y salud pública a la seguridad del paciente
Andrés, J. M. A. (2011)
Are 80 Hours Per Week Enough or Too Little for Residents and Fellows?
Lang, L. (2005) · Gastroenterology · doi:10.1053/j.gastro.2005.07.050
Programas de Especialización y limitación horaria, una necesidad con alcances aún no dimensionados
Delfino, A. E., & Guillermo Lema, F. (2010) · Revista médica de Chile · doi:10.4067/s0034-98872010000100022 · Cited by 1
Sixteen Hours, Education, Error, and Cost—Is Enforcing Continuity the Answer?
Fagan, H. A. (2013) · SLEEP · doi:10.5665/sleep.2362
Loddé, B., Gourhannic, P.-Y., Ferrec, G., et al. (2010) · Archives des maladies professionnelles et de médecine du travail/Archives des maladies professionnelles et de l'environnement · doi:10.1016/j.admp.2010.02.008
Green, F. M., & Taveira, A. D. (2012) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1071181312561166
Fatigue in Anesthesia—the Impact on Patient and Provider Safety: Update on Work-Hour Limitations
Nevarez, M. D., & Howard, S. K. (2006) · Advances in Anesthesia · doi:10.1016/j.aan.2006.06.003 · Cited by 1
Manthous, C. A., & Amoateng‐Adjepong, Y. (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-149-10-200811180-00020
Sleep Medicine and Public Health
Chung, Y. (2009) · Korean Journal of Otorhinolaryngology - Head and Neck Surgery · doi:10.3342/kjorl-hns.2009.52.9.713
Sicurezza delle cure in medicina di urgenza
Leveau, P. (2015) · EMC - Urgenze · doi:10.1016/s1286-9341(15)72246-5
Soma‐Pillay, P. (2013) · UpSpace Institutional Repository (University of Pretoria)
Sleep Status of Residents in Neurology Department
Kim, W. (2013) · Journal of Korean Sleep Research Society · doi:10.13078/jksrs.13004
Gould, K. S. (2009) · NORA - Norwegian Open Research Archives · Cited by 2
L'élimination des gardes de 24 heures, est-ce la bonne décision?: NON
Cools‐Lartigue, J. (2013) · Europe PMC (PubMed Central)
Literatuurstudie naar factoren die de patientveiligheid in ANW beinvloeden
Kramer, J. C., Simons, R., & Rijnders, M. (2009) · TNO Repository
Intuitive Decisions as a Means of Preventing Medical Errors
Savage, L. M. (2009) · ScholarWorks (Walden University)
O'Neill, A. T. (2010) · BMJ · doi:10.1136/bmj.c5320
“The logic behind this conclusion is hard to follow. Evidence shows that serious medical errors increase with prolonged shifts versus restricted hours.”
BackgroundInconclusive Findings on Effects of Duty Hour Reduction
Moonesinghe, R., & Beard, J. (2011) · Mayo Clinic Proceedings · doi:10.4065/mcp.2011.0222
Perception and acceptable risks – the union of decision-theory, behaviour and the brain
Ricci, P. F. (2010) · International Journal of Environment and Health · doi:10.1504/ijenvh.2010.033036
Wilson, I. H. (2005) · British Journal of Hospital Medicine · doi:10.12968/hmed.2005.66.3.17678
Occupational Stress and Physical Symptoms among Family Medicine Residents Original Article
Choi, S.-M., Park, Y. S., Yoo, J., & Kim, G.-Y. (2013)
Guidelines for safety and quality in anaesthesia practice in the
Mellin‐Olsen, J., Balogh, D., Drobnik, L., Knape, J. T. A., & Vimláti, L. (2007)
to "wake enhancement" Sleep better than medicine? Ethical issues related
Ravelingien, A., & Sandberg, A. (2009)
OP-ED The Pharmacologically Enhanced Physician
Cheshire, W. P. (2008)
Morrow, G., Carter, M., & Illing, J. C. (2013)
Fontenelle, J. (2015) · Aquila Digital Community (University of Southern Mississippi) · Cited by 1
To sleep, perchance to dream: continuity of care, handover and sleep in the intensive care unit
Warrillow, S. J. (2012) · Critical Care and Resuscitation · doi:10.1016/s1441-2772(23)01808-2
Schleder, B. J. (2013) · Digital Commons - Olivet Distinctive Heritage, Scholarship, & Creativity (Olivet Nazarene University)
Limiting Errors and Avoiding Litigation
Marik, P. E. (2010) · Springer eBooks · doi:10.1007/978-1-4419-5923-2_67
Gallagher, A. G., & O’Sullivan, G. C. (2011) · Springer eBooks · doi:10.1007/978-0-85729-763-1_1
Reducing Resident Work Hours -- Does It Make a Difference?
Bauchner, H. (2004) · Journal watch · doi:10.1056/pa200411290000001
Preventing deaths from methotrexate overdose.
Etchells, E. E. (2005) · PubMed
The Psychological Role of Pay Systems in Undertaking Discretionary Work HoursPreprint
Merriman, K. K. (2012) · SSRN Electronic Journal
Disorders of Sleep and Cardiovascular Disease
Naughton, M. T. (2016) · Springer eBooks · doi:10.1007/978-981-287-206-7_20
Analysing Nursing Workload in Intensive Care Unit by Using a Novel Objective Tracking System
Guo, P. (2015) · UC Research Repository (University of Canterbury) · doi:10.26021/2784
Limitations of survey-based assessments on duty-hour work standards.
McDonald, R. (2007) · PubMed
Ethische Aspekte einer Begrenzung der ärztlichen Arbeitszeit
Wiesing, U. (2005) · Ethik in der Medizin · doi:10.1007/s00481-005-0379-5
Stockman, J. A. (2009) · Yearbook of Pediatrics · doi:10.1016/s0084-3954(08)79174-7
Effect of Reducing Interns' Work Hours on Serious Medical Errors in Intensive Care Units
Bekes, C. (2006) · Yearbook of Critical Care Medicine · doi:10.1016/s0734-3299(08)70200-4
Diurnal variation of salivary amylase activity in fatigue state
Nakajima, Y., Takahashi, T., & Yamaguchi, M. (2011) · Nihon Kyukyu Igakukai Zasshi Journal of Japanese Association for Acute Medicine · doi:10.3893/jjaam.22.117
Effets de la privation de sommeil chez les internes en anesthésie au Brésil
Neto, E. S., Brogiatto, C. N., Bassani, R., et al. (2013) · Annales Françaises d Anesthésie et de Réanimation · doi:10.1016/j.annfar.2013.07.490
Program Directors’ View of Duty Hours: Where Do We Go From Here?
(2014) · AAP Grand Rounds · doi:10.1542/gr.31-3-32
American medical education: the evolution of excellence
Gelber, S. E., Taubel, D. A., & Chervenak, F. A. (2015) · Journal of Perinatal Medicine · doi:10.1515/jpm-2014-0368
Reform of national university to the educational corporation and management of intensive care unit
Goto, F. (2005) · Journal of the Japanese Society of Intensive Care Medicine · doi:10.3918/jsicm.12.155
Damewood, R. B., Morris, J. B., Mellinger, J. D., Friedell, M. L., Borman, K. R., Dent, D. L., Schenarts, P. J., & Jarman, B. T. (2016) · Journal of surgical education · doi:10.1016/j.jsurg.2016.03.002
Frequency of Recovered Orders at the Cardiac Care Unit
Esmaeili, R., Bagheri‐Nesami, M., Nadighara, A., & Taghizadeh, A. (2016) · Critical Care Nursing · doi:10.17795/ccn-5100
“Studies have shown that other factors such as the number of admissions, prescriber’s work-load and their knowledge, are also effective factors on the occurrence of wrong orders (20-22).”
BackgroundFrom the Editor The Importance of Paying Attention to Sleep 541
Broderick, M. J., Frénette, É., & Sullivan, S. S. (2008)
FATIGUE Text Button L ADDITIONAL REFERENCES OF INTEREST
Buysse, D. (2004)
Effect of 16-Hour Duty Periods on Patient Care and Resident Education ORIGINAL ARTICLE
McCoy, C. P., Halvorsen, A. J., Loftus, C. G., McDonald, F. S., & Oxentenko, A. S. (2011)
Towards safer care in Sweden? : Studies of influences on patient safety
Ridelberg, M. (2016) · Linköping University Electronic Press eBooks · doi:10.3384/diss.diva-127307
“Several previous studies have proved that fatigue impairs clinical work (Fletcher et al. 2005; Landrigan et al. 2004) and that issues related to workload, the physical environment and nursing shortages are of importance to the patient safety status (Nicklin and McVeety 2002; Blendon et al.”
Backgroundda Cruz, E. M., Tabbutt, S., Eisenhaur, M. C., et al. (2015) · World Journal for Pediatric and Congenital Heart Surgery · doi:10.1177/2150135115596440
Following Hip Fracture Resident Duty-Hour Reform Associated with Increased Morbidity
Browne, J. A., Cook, C. E., Olson, S. A., & Bolognesi, M. P. (2009)
Graf, J., & Janssens, U. (2009) · Wiener klinische Wochenschrift · doi:10.1007/s00508-008-1067-5
Chertoff, J. (2016) · Internal Medicine Journal · doi:10.1111/imj.12950
Duties and Conduct of Medical Students
Molavi, B., Mir, A., Shojaiefard, A., et al. (2016) · MedEdPublish · doi:10.15694/mep.2016.000015
“Although working hours are always discussed in light of the patients’ wellness (Fletcher et al., 2004; Landrigan et al., 2004; Lockley et al., 2004) versus the physicians’ fatigue, there is no study about effect of working hours on medical education.”
BackgroundSurgical Training and Duty-Hour Limits: An Oxymoron or an Idea whose Time has Come?
Silber, C. G. (2005) · Ear Nose & Throat Journal · doi:10.1177/014556130508401201
Report from the Junior Doctors Network on the WMA Council Session and JDN Meeting, Oslo 2015.
Hayashi, S. (2015) · PubMed
Le syndrome de fatigue chronique : une pathologie difficile à cerner
Delliaux, S., & Nord, H. (2013)
Reconstruction to Investigate the Sources of an Event in a Medical System
Donchin, Y. (2013) · Human factors and ergonomics · doi:10.1201/b15557-18
White (Coat) Lies: Bending the Truth to Stay Faithful to Patients
Bennett, C., Finch, A., & Rennie, S. (2016) · The American Journal of Bioethics · doi:10.1080/15265161.2016.1197342
Patient Safety and Team Training
Birnbach, D. J., & Salas, E. (2009) · Elsevier eBooks · doi:10.1016/b978-0-323-05541-3.00011-9
Diagnosis and Treatment of Shift Work Disorder
Harris, S. F., & Thorpy, M. J. (2015) · Elsevier eBooks · doi:10.1016/b978-0-12-420168-2.00003-x
1 Veiligheid en kwaliteit rondom operaties
Boermeester, M. A., & Lange, J. F. (2012) · Bohn Stafleu van Loghum eBooks · doi:10.1007/978-90-313-8735-9_1
Lieh-Lai, M. W., Goodman, D. M., Hamilton, M. F., & Valentine, K. M. (2011) · Elsevier eBooks · doi:10.1016/b978-0-323-07307-3.10017-5
Reduced Resident Work Hours in Urology: The History and Impact of Duty Hour Restrictions
Kirby, E. W., & Carson, C. C. (2016) · Urology Practice · doi:10.1016/j.urpr.2015.09.005
Saudek, K., & Treat, R. W. (2016) · Medical Science Educator · doi:10.1007/s40670-016-0327-7
Sellke, F. W., Nussmeier, N. A., Thourani, V. H., Eghtesady, P., Ikonomidis, J. S., England, M. R., Sánchez, J. A., Shappell, S. A., Culig, M. H., Lazzara, E. H., et al. (2013) · Cited by 1
Rush, R. P. (2016) · Medical Education · doi:10.1111/medu.13076
Phantom Menace Prompts Education Reform to Strike Back
Chakraborti, C. (2011)
Moens, M., & van den Nieuwenhof, J. (2008)
Quality of Care and Patient Safety
Wachter, R. M. (2009) · Elsevier eBooks · doi:10.1016/b978-141604220-4.50017-1
He, Y. (2015) · STARS (University of Central Florida)
Metadata
- Authors
- Landrigan, C. P., Rothschild, J. M., Cronin, J. W., Kaushal, R., Burdick, E., Katz, J. T., Lilly, C. M., Stone, P. H., Lockley, S. W., Bates, D. W., & Czeisler, C. A.
- Affiliations
- Brigham and Women's Hospital (US)
- ORCID
- Venue
- New England Journal of Medicine
- Publisher
- Massachusetts Medical Society
- Published
- 2004-10-28
- Volume
- 351
- Issue
- 18
- Pages
- 1838-1848
- ISSN
- 0028-4793 (ISSN-L)
- 1533-4406
- OpenAlex
- W2111497168
- Semantic Scholar
- 4897b11c36e79c760b7621fa6691aa285330015d
- Cited by
- 1,760
- References
- 42
- Citations by year
- 2026: 35 · 2025: 40 · 2024: 44 · 2023: 48 · 2022: 55 · 2021: 56 · 2020: 76 · 2019: 87 · 2018: 71 · 2017: 72 · 2016: 74 · 2015: 95 · 2014: 107 · 2013: 103 · 2012: 88
- FWCI
- 123.83
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- New England Journal of Medicine (publishedVersion)
- PubMed (publishedVersion)
- Digital Access to Scholarship at Harvard (DASH) (Harvard University) (submittedVersion)
- Surrey Research Insight Open Access (The University of Surrey) (submittedVersion)
- Funders
- Agency for Healthcare Research and Quality (F32 HS14130, K08 HS13333, R01 HS 12032)
- National Heart, Lung, and Blood Institute (T32 HL079010)
- National Center for Research Resources (M01RR002635)
- National Institute for Occupational Safety and Health (R01 OH07567)
- Topics
- Health Sciences › Nursing › Leadership and Management › Hospital Admissions and Outcomes
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Patient Safety and Medication Errors
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Sleep and Work-Related Fatigue
- Keywords
- medical errors, interns, working hours, sleep deprivation, intensive care unit, intensive care, medication errors, diagnostic errors, shift scheduling, resident fatigue
- MeSH terms
- Humans, Intensive Care Units, Internal Medicine, Internship and Residency, Personnel Staffing and Scheduling, Prospective Studies, Sleep Deprivation, Work Schedule Tolerance, Workload, Medical Errors
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.