Cited by 317Workplace Health and Well-beingSubstance Abuse Treatment and OutcomesAlcohol Consumption and Health Effects

Long working hours and alcohol use: systematic review and meta-analysis of published studies and unpublished individual participant data

Open access
Virtanen, M., Jokela, M., Nyberg, S. T., Madsen, I. E. H., Lallukka, T., Ahola, K., Alfredsson, L., Batty, G. D. +36 more·2015·BMJ

Abstract

OBJECTIVE: To quantify the association between long working hours and alcohol use. DESIGN: Systematic review and meta-analysis of published studies and unpublished individual participant data. DATA SOURCES: A systematic search of PubMed and Embase databases in April 2014 for published studies, supplemented with manual searches. Unpublished individual participant data were obtained from 27 additional studies. REVIEW METHODS: The search strategy was designed to retrieve cross sectional and prospective studies of the association between long working hours and alcohol use. Summary estimates were obtained with random effects meta-analysis. Sources of heterogeneity were examined with meta-regression. RESULTS: Cross sectional analysis was based on 61 studies representing 333,693 participants from 14 countries. Prospective analysis was based on 20 studies representing 100,602 participants from nine countries. The pooled maximum adjusted odds ratio for the association between long working hours and alcohol use was 1.11 (95% confidence interval 1.05 to 1.18) in the cross sectional analysis of published and unpublished data. Odds ratio of new onset risky alcohol use was 1.12 (1.04 to 1.20) in the analysis of prospective published and unpublished data. In the 18 studies with individual participant data it was possible to assess the European Union Working Time Directive, which recommends an upper limit of 48 hours a week. Odds ratios of new onset risky alcohol use for those working 49-54 hours and ≥ 55 hours a week were 1.13 (1.02 to 1.26; adjusted difference in incidence 0.8 percentage points) and 1.12 (1.01 to 1.25; adjusted difference in incidence 0.7 percentage points), respectively, compared with working standard 35-40 hours (incidence of new onset risky alcohol use 6.2%). There was no difference in these associations between men and women or by age or socioeconomic groups, geographical regions, sample type (population based v occupational cohort), prevalence of risky alcohol use in the cohort, or sample attrition rate. CONCLUSIONS: Individuals whose working hours exceed standard recommendations are more likely to increase their alcohol use to levels that pose a health risk.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1136/bmj.g7772

Cites

11 of 11 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 75

  1. [2]Friedmann PD. Clinical practice. Alcohol use in adults. N Engl J Med 2013; 368: 365-73. 23343065
  2. [8]Stockwell T, Gruenewald PJ, Toumbourou JW, Loxley W. Preventing risky drug use and related harms: the need for a synthesis of new knowledge. In: Stockwell T, Gruenewald PJ, Toumbourou JW, Loxley W, eds. Preventing harmful substance use The evidence for policy and practice. John Wiley, 2005.
  3. [9]Heikkila K, Nyberg ST, Fransson EI, Alfredsson L, De Bacquer D, Bjorner JB, et al. Job strain and alcohol intake: a collaborative meta-analysis of individual-participant data from 140,000 men and women. PloS One 2012; 7: e40101. 22792218 PMC3391232
  4. [10]Virtanen M, Heikkilä K, Jokela M, Ferrie JE, Batty GD, Vahtera J, et al. Long working hours and coronary heart disease: a systematic review and meta-analysis. Am J Epidemiol 2012; 176: 586-96. 22952309 PMC3458589
  5. [11]Van der Hulst M. Long workhours and health. Scand J Work Environ Health 2003; 29: 171-88. 12828387
  6. [12]Harma M. Are long workhours a health risk? Scand J Work Environ Health 2003; 29: 167-9. 12828386
  7. [13]Kawakami N, Haratani T. Epidemiology of job stress and health in Japan: review of current evidence and future direction. Ind Health 1999; 37: 174-86. 10319566
  8. [14]Sparks K, Cooper C, Fried Y, Shirom A. The effects of hours of work on health: a meta-analytic review. J Occup Organ Psychol 1997; 70: 391-408.
  9. [16]Bannai A, Tamakoshi A. The association between long working hours and health: a systematic review of epidemiological evidence. Scand J Work Environ Health 2014; 40: 5-18. 24100465
  10. [17]Wagstaff AS, Sigstad Lie JA. Shift and night work and long working hours—a systematic review of safety implications. Scand J Work Environ Health 2011; 37: 173-85. 21290083
  11. [18]Caruso CC. Possible broad impacts of long work hours. Ind Health 2006; 44: 531-6. 17085913
  12. [19]Abo-Zaid G, Sauerbrei W, Riley RD. Individual participant data meta-analysis of prognostic factor studies: state of the art? BMC Med Res Methodol 2012; 12: 56. 22530717 PMC3413577
  13. [21]Stroup DF, Berlin JA, Morton SC, Olkin I, Williamsson GD, Rennie D, et al. Meta-analysis of observational studies in epidemiology: a proposal for reporting. Meta-analysis Of Observational Studies in Epidemiology (MOOSE) group. JAMA 2000; 283: 2008-12. 10789670
  14. [22]Nielsen M, Kristensen T, Smith-Hansen L. The intervention project on absence and well-being (IPAW): design and results from the baseline of a 5-year study. Work Stress 2002; 16: 191-206.
  15. [24]Lahelma E, Aittomaki A, Laaksonen M, Lallukka T, Martikainen P, Piha K, et al. Cohort profile: the Helsinki Health Study. Int J Epidemiol 2013; 42: 722-30. 22467288
  16. [25]Schupp J. [The socioeconomic panel (SOEP)]. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz 2012; 55: 767-74. 22736154
  17. [28]Marchand A, Blanc ME. Occupation, work organization conditions, and alcohol misuse in Canada: an 8-year longitudinal study. Subst Use Misuse 2011; 46: 1003-14. 21210722
  18. [29]Marchand A, Parent-Lamarche A, Blanc ME. Work and high-risk alcohol consumption in the Canadian workforce. Int J Environ Res Public Health 2011; 8: 2692-705. 21845153 PMC3155324
  19. [30]Bildt C, Michelsen H. Gender differences in the effects from working conditions on mental health: a 4-year follow-up. Int Arch Occup Environ Health 2002; 75: 252-8. 11981659
  20. [31]Kawakami N, Araki S, Haratani T, Hemmi T. Relations of work stress to alcohol use and drinking problems in male and female employees of a computer factory in Japan. Environ Res 1993; 62: 314-24. 8344238
  21. [32]Ezoe S, Morimoto K. Behavioral lifestyle and mental health status of Japanese factory workers. Prev Med 1994; 23: 98-105. 8016040
  22. [33]Maruyama S, Kohno K, Morimoto K. [A study of preventive medicine in relation to mental health among middle-management employees (Part 2)—effects of long working hours on lifestyles, perceived stress and working-life satisfaction among white-collar middle-management employees]. Nihon Eiseigaku Zasshi 1995; 50: 849-60. 8538058
  23. [34]Nakanishi N, Nakamura K, Ichikawa S, Suzuki K, Tatara K. Lifestyle and the development of hypertension: a 3-year follow-up study of middle-aged Japanese male office workers. Occup Med (Lond) 1999; 49: 109-14. 10436563
  24. [35]Uchiyama S, Kurasawa T, Sekizawa T, Nakatsuka H. Job strain and risk of cardiovascular events in treated hypertensive Japanese workers: hypertension follow-up group study. J Occup Health 2005; 47: 102-11. 15824474
  25. [36]Liu Y, Tanaka H. Overtime work, insufficient sleep, and risk of non-fatal acute myocardial infarction in Japanese men. Occup Environ Med 2002; 59: 447-51. 12107292 PMC1740308
  26. [37]Tarumi K, Hagihara A, Morimoto K. A prospective observation of onsets of health defects associated with working hours. Ind Health 2003; 41: 101-8. 12725470
  27. [38]Lallukka T, Lahelma E, Rahkonen O, Roos E, Laaksonen M, Martikainen P, et al. Associations of job strain and working overtime with adverse health behaviors and obesity: evidence from the Whitehall II Study, Helsinki Health Study, and the Japanese Civil Servants Study. Soc Sci Med 2008; 66: 1681-98. 18261833
  28. [39]Nishikitani M, Nakao M, Karita K, Nomura K, Yano E. Influence of overtime work, sleep duration, and perceived job characteristics on the physical and mental status of software engineers. Ind Health 2005; 43: 623-9. 16294916
  29. [41]Kobayashi T, Suzuki E, Takao S, Doi H. Long working hours and metabolic syndrome among Japanese men: a cross-sectional study. BMC Public Health 2012; 12: 395. 22651100 PMC3419617
  30. [42]Nakata A, Takahashi M, Irie M. Association of overtime work with cellular immune markers among healthy daytime white-collar employees. Scand J Work Environ Health 2012; 38: 56-64. 21766158
  31. [43]Hasegawa T, Murata C, Ninomiya T, Takabayashi T, Noda T, Hayasaka S, et al. Occupational factors and problem drinking among a Japanese working population. Ind Health 2013; 51: 490-500. 23912205 PMC4202734
  32. [44]Seaman FJ. The etiology of problem drinking in the workplace. Drug Alcohol Dep 1981; 7: 285-93. 7261903
  33. [45]Proctor SP, White RF, Robins TG, Echeverria D, Rocskay AZ. Effect of overtime work on cognitive function in automotive workers. Scand J Work Environ Health 1996; 22: 124-32. 8738891
  34. [46]Trinkoff AM, Storr CL. Work schedule characteristics and substance use in nurses. Am J Ind Med 1998; 34: 266-71. 9698996
  35. [47]Baldwin DC, Jr., Daugherty SR, Tsai R, Scotti MJ, Jr. A national survey of residents’ self-reported work hours: thinking beyond specialty. Acad Med 2003; 78: 1154-63. 14604880
  36. [51]Marchand A, Demers A, Durand P, Simard M. Occupational variations in drinking and psychosocial distress: a multilevel analysis. Work 2003; 21: 153-63. 14501093
  37. [52]Shields M. Long working hours and health. Health Rep 1999; 11: 33-48. 10618741
  38. [53]Raggatt P. Work stress among long-distance coach drivers: a survey and correlational study. J Organ Behav 1991; 12: 565-79.
  39. [54]Nash LM, Daly MG, Kelly PJ, van Ekert EH, Walter G, Walton M, et al. Factors associated with psychiatric morbidity and hazardous alcohol use in Australian doctors. Med J Aust 2010; 193: 161-6. 20678045
  40. [55]Au N, Hauck K, Hollingsworth B. Employment, work hours and weight gain among middle-aged women. Int J Obes (Lond) 2013; 37: 718-24. 22710930
  41. [56]Baldwin PJ, Dodd M, Wrate RW. Young doctors’ health. I. How do working conditions affect attitudes, health and performance? Soc Sci Med 1997; 45: 35-40. 9203268
  42. [57]Jones F, O’Connor DB, Conner M, McMillan B, Ferguson E. Impact of daily mood, work hours, and iso-strain variables on self-reported health behaviors. J Appl Psychol 2007; 92: 1731-40. 18020809
  43. [58]Gibb SJ, Fergusson DM, Horwood LJ. Working hours and alcohol problems in early adulthood. Addiction 2012; 107: 81-8. 21692889
  44. [59]Holtermann A, Mortensen OS, Burr H, Sogaard K, Gyntelberg F, Suadicani P. Long work hours and physical fitness: 30-year risk of ischaemic heart disease and all-cause mortality among middle-aged Caucasian men. Heart 2010; 96: 1638-44. 20820054
  45. [60]Cheng WJ, Cheng Y, Huang MC, Chen CJ. Alcohol dependence, consumption of alcoholic energy drinks and associated work characteristics in the Taiwan working population. Alcohol Alcohol 2012; 47: 372-9. 22493045
  46. [61]Speicher C, Khodabux N, Lacerre F, Hiar S, Schmitt L, Bui E. Alcohol use in French medical residents. European Psychiatry Conference: 18th European Congress of Psychiatry Munich, Germany. Elsevier Masson SAS, 2010.
  47. [62]Pimenta AM, Beunza JJ, Bes-Rastrollo M, Alonso A, Lopez CN, Velasquez_Melendez G, et al. Work hours and incidence of hypertension among Spanish university graduates: the Seguimiento Universidad de Navarra prospective cohort. J Hypertens 2009; 27: 34-40. 19050449
  48. [63]Schluter PJ, Turner C, Benefer C. Long working hours and alcohol risk among Australian and New Zealand nurses and midwives: a cross-sectional study. Int J Nurs Stud 2012; 49: 701-9. 22307024
  49. [64]Berkman L, Breslow L. Health and ways of living: the Alameda County Study. Oxford University Press, 1983.
  50. [65]Madans JH, Kleinman JC, Cox CS, Barbano HE, Feldman JJ, Cohen B, et al. 10 years after NHANES I: report of initial followup, 1982-84. Public Health Rep 1986; 101: 465-73. 3094075 PMC1477775
  51. [66]House JS, Lantz PM, Herd P. Continuity and change in the social stratification of aging and health over the life course: evidence from a nationally representative longitudinal study from 1986 to 2001/2002 (Americans’ Changing Lives Study). J Gerontol B Psychol Sci Soc Sci 2005; 60: 15-26. 16251586
  52. [70]Holle R, Happich M, Lowel H, Wichmann HE. KORA—a research platform for population-based health research. Gesundheitswesen 2005; 67: S19-25. 16032513
  53. [71]Schmermund A, Mohlenkamp S, Stang A, Grönemeyer D, Seibel R, Hirche H, et al. Assessment of clinically silent atherosclerotic disease and established and novel risk factors for predicting myocardial infarction and cardiac death in healthy middle-aged subjects: rationale and design of the Heinz Nixdorf RECALL Study. Risk Factors, Evaluation of Coronary Calcium and Lifestyle. Am Heart J 2002; 144: 212-8. 12177636
  54. [72]Feveile H, Olsen O, Burr H, Bach E. Danish Work Environment Cohort Study 2005: from idea to sampling design. Stat Transit 2007; 8: 441-58.
  55. [74]Poulsen OM, Persson R, Kristiansen J, Andersen LL, Villadsen E, Orbaek P. Distribution of subjective health complaints, and their association with register based sickness absence in the Danish working population. Scand J Public Health 2013; 41: 150-7. 23287396
  56. [75]Borritz M, Rugulies R, Bjorner JB, Villadsen E, Mikkelsen OA, Kristensen TS. Burnout among employees in human service work: design and baseline findings of the PUMA study. Scand J Public Health 2006; 34: 49-58. 16449044
  57. [76]Elliott J, Shepherd P. Cohort profile: 1970 British birth cohort (BCS70). Int J Epidemiol 2006; 35: 836-43. 16931528
  58. [77]Power C, Elliott J. Cohort profile: 1958 British birth cohort (National Child Development Study). Int J Epidemiol 2006; 35: 34-41. 16155052
  59. [78]Marmot M, Brunner E. Cohort profile: the Whitehall II study. Int J Epidemiol 2005; 34: 251-6. 15576467
  60. [79]Korkeila K, Suominen S, Ahvenainen J, Ojanlatva A, Rautava P, Helenius H, et al. Non-response and related factors in a nation-wide health survey. Eur J Epidemiol 2001; 17: 991-9. 12380710
  61. [80]Vahtera J, Poikolainen K, Kivimäki M, Ala-Mursula L, Pentti J. Alcohol intake and sickness absence: a curvilinear relation. Am J Epidemiol 2002; 156: 969-76. 12419770
  62. [81]Peter R, Alfredsson L, Hammar N, Siegrist J, Theorell T, Westerholm P. High effort, low reward, and cardiovascular risk factors in employed Swedish men and women: baseline results from the WOLF Study. J Epidemiol Community Health 1998; 52: 540-7. 10320854 PMC1756758
  63. [82]Alfredsson L, Hammar N, Fransson E, de Faire U, Hallqvist J, Knutsson A, et al. Job strain and major risk factors for coronary heart disease among employed males and females in a Swedish study on work, lipids and fibrinogen. Scand J Work Environ Health 2002; 28: 238-48. 12199425
  64. [84]De Bacquer D, Pelfrene E, Clays E, Mak R, Moreau M, De Smet O, et al. Perceived job stress and incidence of coronary events: 3-year follow-up of the Belgian Job Stress Project cohort. Am J Epidemiol 2005; 161: 434-41. 15718479
  65. [85]Krause N, Brand RJ, Kauhanen J, Kaplan GA, Syme SL, Wong CC, et al. Work time and 11-year progression of carotid atherosclerosis in middle-aged Finnish men. Prev Chronic Dis 2009; 6: A13. 19080019 PMC2644586
  66. [86]Reis JP, Dubose KD, Ainsworth BE, Macera CA, Yore MM. Reliability and validity of the occupational physical activity questionnaire. Med Sci Sports Exerc 2005; 37: 2075-83. 16331132
  67. [87]Stockwell T, Donath S, Cooper-Stanbury M, Chikritzhs T, Catalano P, Mateo C. Under-reporting of alcohol consumption in household surveys: a comparison of quantity-frequency, graduated-frequency and recent recall. Addiction 2004; 99: 1024-33. 15265099
  68. [90]Frone MR. Work stress and alcohol use. Alcohol Res Health 1999; 23: 284-91. 10890825 PMC6760381
  69. [92]Kivimäki M, Nyberg ST, Batty GD, Fransson E, Heikkilä K, Alfredsson L, et al. Job strain as a risk factor for coronary heart disease: a collaborative meta-analysis of individual participant data. Lancet 2012; 380: 1491-7. 22981903 PMC3486012
  70. [93]Virtanen M, Ferrie JE, Singh-Manoux A, Shipley MJ, Vahtera J, Marmot MG, et al. Overtime work and incident coronary heart disease: the Whitehall II prospective cohort study. Eur Heart J 2010; 31: 1737-44. 20460389 PMC2903713
  71. [94]Friedman M, Rosenman RH. Type A behavior pattern: its association with coronary heart disease. Ann Clin Res 1971; 3: 300-12. 5156890
  72. [95]Midford R, Welander F, Allsop S. Preventing alcohol and other drug problems in the workplace. In: Stockwell T, Gruenewald PJ, Toumbourou JW, Loxley W, eds. Preventing harmful substance use. The evidence base for policy and practice. John Wiley, 2005.
  73. [96]Frone MR, Brown AL. Workplace substance-use norms as predictors of employee substance use and impairment: a survey of U.S. workers. J Stud Alcohol Drugs 2010; 71: 526-34. 20553660 PMC2887922
  74. [97]Mulder RT. Alcoholism and personality. Aust N Z J Psychiatry 2002; 36: 44-52. 11929437
  75. [98]Drago R, Wooden M, Black D. Long work hours: volunteers and conscripts. Br J Ind Relations 2009; 47: 571-600.

Cited by

Sorted by citations

Authors
Virtanen, M., Jokela, M., Nyberg, S. T., Madsen, I. E. H., Lallukka, T., Ahola, K., Alfredsson, L., Batty, G. D., Bjorner, J. B., Borritz, M., Burr, H., Casini, A., Clays, E., De Bacquer, D., Dragano, N., Erbel, R., Ferrie, J. E., Fransson, E. I., Hamer, M., Heikkila, K., Jockel, K.-H., Kittel, F., Knutsson, A., Koskenvuo, M., Ladwig, K.-H., Lunau, T., Nielsen, M. L., Nordin, M., Oksanen, T., Pejtersen, J. H., Pentti, J., Rugulies, R., Salo, P., Schupp, J., Siegrist, J., Singh-Manoux, A., Steptoe, A., Suominen, S. B., Theorell, T., Vahtera, J., Wagner, G. G., Westerholm, P. J. M., Westerlund, H., & Kivimaki, M.
Affiliations
  • Finnish Institute of Occupational Health (FI)
  • University of Helsinki (FI)
  • National Research Centre for the Working Environment (DK)
  • Region Stockholm (SE)
  • Alzheimer Scotland (GB)
  • Federal Institute for Occupational Safety and Health (DE)
  • Université Libre de Bruxelles (BE)
  • Ghent University (BE)
  • Heinrich Heine University Düsseldorf (DE)
  • West German Heart and Vascular Center Essen (DE)
  • University of Bristol (GB)
  • Stockholm University (SE)
  • University College London (GB)
  • Mid Sweden University (SE)
  • Helmholtz Munich (DE)
  • Frederiksberg Hospital (DK)
  • Danish National Centre for Social Research (DK)
  • University of Copenhagen (DK)
  • University of Turku (FI)
  • German Institute for Economic Research (DE)
  • Uppsala University (SE)
Corresponding author
Virtanen, M.
Venue
BMJ
Publisher
BMJ
Published
2015-01-13
Volume
350
Issue
jan12 13
Pages
g7772-g7772
ISSN
1756-1833 (ISSN-L)
OpenAlex
W2167829053
Cited by
317
References
11
Citations by year
2026: 7 · 2025: 12 · 2024: 15 · 2023: 23 · 2022: 41 · 2021: 48 · 2020: 49 · 2019: 35 · 2018: 27 · 2017: 24 · 2016: 17 · 2015: 19
FWCI
5.26
Type
journal article
Language
en
Open access
Licence
cc-by-nc
Locations
  • BMJ (publishedVersion, cc-by-nc)
  • PubMed Central (publishedVersion, cc-by-nc)
  • PubMed (publishedVersion)
  • Research at the University of Copenhagen (University of Copenhagen) (publishedVersion, cc-by-nc)
  • Research at the University of Copenhagen (University of Copenhagen) (publishedVersion, other-oa)
  • LSHTM Research Online (London School of Hygiene and Tropical Medicine) (acceptedVersion)
  • Ghent University Academic Bibliography (Ghent University) (submittedVersion, cc-by)
  • Publications (Mid Sweden University) (submittedVersion, other-oa)
  • KTH Publication Database DiVA (KTH Royal Institute of Technology) (submittedVersion, other-oa)
  • Digital Access to Libraries (submittedVersion, other-oa)
  • Dépôt institutionnel de l'Université libre de Bruxelles (Université Libre de Bruxelles) (submittedVersion, other-oa)
  • Loughborough University Institutional Repository (Loughborough University) (submittedVersion, cc-by-nc)
  • Econstor (Econstor) (submittedVersion, cc-by-nc)
  • Max Planck Institute for Plasma Physics (submittedVersion)
  • Loughborough University Research Repository (Loughborough University) (submittedVersion, cc-by-nc)
  • Site cant be reached (submittedVersion, cc-by-nc)
  • Refubium (Universitätsbibliothek der Freien Universität Berlin) (submittedVersion, cc-by-nc)
  • Bristol Research (University of Bristol) (submittedVersion)
Funders
  • Ministerie van Sociale Zaken en Werkgelegenheid
  • British Heart Foundation (R01AG034454, K013351)
  • Bupa Foundation
  • Academy of Finland (K013351, R01 AG034454, #258598, 265174)
  • Työsuojelurahasto
  • Deutsche Gesetzliche Unfallversicherung
  • Vetenskapsrådet (K013351)
  • NordForsk (75021)
  • Forskningsrådet om Hälsa, Arbetsliv och Välfärd
  • National Institutes of Health
  • Medical Research Council (MR/K013351/1, K013351, R01AG034454)
  • Economic and Social Research Council (R01AG034454, ES/J023299/1, R01HL036310)
  • National Institute on Aging (R01AG034454, P01AG020166, U19AG051426)
  • National Heart, Lung, and Blood Institute (R01HL036310)
Topics
  • Health Sciences › Health Professions › General Health Professions › Workplace Health and Well-being
  • Health Sciences › Medicine › Epidemiology › Substance Abuse Treatment and Outcomes
  • Health Sciences › Medicine › Pathology and Forensic Medicine › Alcohol Consumption and Health Effects
Keywords
long working hours, alcohol consumption, risky alcohol use, working time regulation, occupational health, individual patient data
MeSH terms
Age Factors, Alcohol Drinking, Cross-Sectional Studies, Humans, Prospective Studies, Sex Factors, Socioeconomic Factors, Prevalence, Odds Ratio, Workload

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review