Attribution of global foodborne disease to specific foods: Findings from a World Health Organization structured expert elicitation
Open accessThe DOI matches its Crossref record; 38 of the 40 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Recently the World Health Organization, Foodborne Disease Burden Epidemiology Reference Group (FERG) estimated that 31 foodborne diseases (FBDs) resulted in over 600 million illnesses and 420,000 deaths worldwide in 2010. Knowing the relative role importance of different foods as exposure routes for key hazards is critical to preventing illness. This study reports the findings of a structured expert elicitation providing globally comparable food source attribution estimates for 11 major FBDs in each of 14 world subregions. METHODS AND FINDINGS: We used Cooke's Classical Model to elicit and aggregate judgments of 73 international experts. Judgments were elicited from each expert individually and aggregated using both equal and performance weights. Performance weighted results are reported as they increased the informativeness of estimates, while retaining accuracy. We report measures of central tendency and uncertainty bounds on food source attribution estimate. For some pathogens we see relatively consistent food source attribution estimates across subregions of the world; for others there is substantial regional variation. For example, for non-typhoidal salmonellosis, pork was of minor importance compared to eggs and poultry meat in the American and African subregions, whereas in the European and Western Pacific subregions the importance of these three food sources were quite similar. Our regional results broadly agree with estimates from earlier European and North American food source attribution research. As in prior food source attribution research, we find relatively wide uncertainty bounds around our median estimates. CONCLUSIONS: We present the first worldwide estimates of the proportion of specific foodborne diseases attributable to specific food exposure routes. While we find substantial uncertainty around central tendency estimates, we believe these estimates provide the best currently available basis on which to link FBDs and specific foods in many parts of the world, providing guidance for policy actions to control FBDs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
![Fig 1 Global subregions and number of expert panelists with more than 3 years of work experience in the subregion. Subregions are defined on the basis of child and adult mortality as described by Ezzati et al. (2002) [18]. Stratum A: very low child and adult mortality; Stratum B: low child mortality and very low adult mortality; Stratum C: low child mortality and high adult mortality; Stratum D: high child and adult mortality; and Stratum E: high child mortality and very high adult mortality. AFR = Africa Region; AMR = Region of the Americas; EMR = Eastern Mediterranean Region; EUR = European Region; SEAR = South-East Asia Region; WPR = Western Pacific Region. Havelaar et al. 2015 provides a list of countries in each subregion [1]. The use of the term ‘subregion’ here and throughout the text does not identify an official grouping of WHO Member States, and the ‘subregions’ are not related to the six official WHO regions [16]. Values in circles indicate the number of experts in panels in each region.](https://figures.cochat.ai/paper-figures/0924dddfd6e34eb2ae7b60cf49c55606/attribution-of-global-foodborne-disease-to-specific-foods-findings-from-a-world-figure-1.jpg)













Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, poultry products are among those most often implicated in foodborne disease (FBD) outbreaks resulting in severe disease burden and economic losses (Thung et al., 2016;Hoffmann et al., 2017;Li et al., 2019;Mezali et al., 2019;Mpundu et al., 2019;Sapp et al., 2022;van Wagenberg and Havelaar, 2023).”
From Food safety and hygiene knowledge, attitudes and practices in street restaurants selling chicken in Ouagadougou, Burkina Faso (2024) · cites this paper as Hoffmann et al., 2017
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Judgment under Uncertainty: Heuristics and Biases
Tversky, A., & Kahneman, D. (1975) · Utility, Probability, and Human Decision Making · doi:10.1007/978-94-010-1834-0_8 · Cited by 22,650
Foodborne illness acquired in the United States—Major pathogens
Scallan, E., Hoekstra, R. M., Angulo, F. J., Tauxe, R. V., Widdowson, M.-A., Roy, S. L., Jones, J. L., & Griffin, P. M. (2011) · Emerging Infectious Diseases · doi:10.3201/eid1701.p11101 · Cited by 7,657 · cited 1×
“Further, most foodborne campylobacteriosis is likely sporadic [39].”
Self-citationSelected major risk factors and global and regional burden of disease
Ezzati, M., Lopez, A. D., Rodgers, A., Vander Hoorn, S., & Murray, C. J. (2002) · The Lancet · doi:10.1016/s0140-6736(02)11403-6 · Cited by 3,594
Havelaar, A. H., Kirk, M. D., Torgerson, P. R., Gibb, H. J., Hald, T., Lake, R. J., Praet, N., Bellinger, D. C., de Silva, N. R., Gargouri, N., et al. (2015) · PLoS Medicine · doi:10.1371/journal.pmed.1001923 · Cited by 2,067
Self-citationThe SAGE Encyclopedia of Social Science Research Methods
Lewis-Beck, M., Bryman, A., & Futing Liao, T. (2004) · Sage eBooks · doi:10.4135/9781412950589 · Cited by 1,439
The Sage encyclopedia of social science research methods
(2004) · Choice Reviews Online · doi:10.5860/choice.42-0062 · Cited by 1,337
A literature review of the anchoring effect
Furnham, A., & Boo, H. C. (2011) · The Journal of Socio-Economics · doi:10.1016/j.socec.2010.10.008 · Cited by 1,179
Painter, J. A., Hoekstra, R. M., Ayers, T., Tauxe, R. V., Braden, C. R., Angulo, F. J., & Griffin, P. M. (2013) · Emerging Infectious Diseases · doi:10.3201/eid1903.111866 · Cited by 1,146 · cited 2×
“and Canada see additional foods as playing a minor role (Table 4) [36].”
Self-citationExperts in uncertainty: opinion and subjective probability in science
(1992) · Choice Reviews Online · doi:10.5860/choice.29-5666 · Cited by 1,129 · cited 4×
“Performance weights (PWs) for each expert jointly optimize the combined accuracy and information scores for the set of calibration questions.”
InfluentialBatz, M. B., Hoffmann, S., & Morris, J. G. (2012) · Journal of Food Protection · doi:10.4315/0362-028x.jfp-11-418 · Cited by 546
Self-citationFood safety risk analysis. A guide for national food safety authorities.
(2006) · PubMed · Cited by 344
TU Delft expert judgment data base
Cooke, R. M., & Goossens, L. L. H. J. (2008) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2007.03.005 · Cited by 317
Self-citationAttributing the Human Disease Burden of Foodborne Infections to Specific Sources
Pires, S. M., Evers, E. G., van Pelt, W., Ayers, T., Scallan, E., Angulo, F. J., Havelaar, A., & Hald, T. (2009) · Foodborne Pathogens and Disease · doi:10.1089/fpd.2008.0208 · Cited by 254
Self-citationHald, T., Aspinall, W., Devleesschauwer, B., Cooke, R., Corrigan, T., Havelaar, A. H., Gibb, H. J., Torgerson, P. R., Kirk, M. D., Angulo, F. J., et al. (2016) · PLOS ONE · doi:10.1371/journal.pone.0145839 · Cited by 242 · cited 3×
“2016 attributes illnesses to foodborne and other major exposure routes when the illness is caused by direct exposure through a given route, for example, ingested food or direct animal contact [16].”
InfluentialSelf-citationUtility, Probability, and Human Decision Making
(1975) · Springer eBooks · doi:10.1007/978-94-010-1834-0 · Cited by 219
Batz, M. B., Doyle, M. P., Morris, J. G., Painter, J., Singh, R., Tauxe, R. V., Taylor, M. R., Wong, D. M. A. L. F., & for the Food Attribution Working Group (2005) · Emerging Infectious Diseases · doi:10.3201/eid1107.040634 · Cited by 198 · cited 2×
“Foodborne disease source attribution is a relatively new and rapidly developing area of research [3, 4, 11].”
Using Outbreak Data for Source Attribution of Human Salmonellosis and Campylobacteriosis in Europe
Pires, S. M., Vigre, H., Makela, P., & Hald, T. (2010) · Foodborne Pathogens and Disease · doi:10.1089/fpd.2010.0564 · Cited by 154
Self-citationDevleesschauwer, B., Haagsma, J. A., Angulo, F. J., Bellinger, D. C., Cole, D., Döpfer, D., Fazil, A., Fèvre, E. M., Gibb, H. J., Hald, T., et al. (2015) · PLOS ONE · doi:10.1371/journal.pone.0142498 · Cited by 148 · cited 1×
“This research was commissioned by the FERG’s Source Attribution Task Force (SATF) as part of its effort to develop estimates of the global burden of major foodborne diseases [5].”
Self-citationAttribution of Foodborne Pathogens Using Structured Expert Elicitation
Havelaar, A. H., Galindo, Á. V., Kurowicka, D., & Cooke, R. M. (2008) · Foodborne Pathogens and Disease · doi:10.1089/fpd.2008.0115 · Cited by 145
Self-citationUsing Expert Elicitation To Link Foodborne Illnesses in the United States to Foods
Hoffmann, S., Fischbeck, P. S., Krupnick, A., & McWilliams, M. (2007) · Journal of Food Protection · doi:10.4315/0362-028x-70.5.1220 · Cited by 122
Self-citationDE KNEGT, L. V., PIRES, S. M., & HALD, T. (2015) · Epidemiology and Infection · doi:10.1017/s0950268814001903 · Cited by 118 · cited 1×
“Table 3–5 present results from studies that attribute illness to the point of exposure [8, 10, 11, 35].”
Self-citationRisk and Uncertainty Assessment for Natural Hazards
Rougier, J., Sparks, S., & Hill, L. J. (2013) · Cambridge University Press eBooks · doi:10.1017/cbo9781139047562 · Cited by 115
Trusting Judgements: How to Get the Best out of Experts
Burgman, M. A. (2015) · Cited by 104
Butler, A. J., Thomas, M. K., & Pintar, K. D. M. (2015) · Foodborne Pathogens and Disease · doi:10.1089/fpd.2014.1856 · Cited by 103 · cited 1×
“Expert elicitation has been used successfully in a wide range of applications where primary data is limited or absent, including foodborne disease source attribution [7, 8, 9, 10, 11, 12, 13].”
Recipes for Foodborne Outbreaks: A Scheme for Categorizing and Grouping Implicated Foods
Painter, J. A., Ayers, T., Woodruff, R., Blanton, E., Perez, N., Hoekstra, R. M., Griffin, P. M., & Braden, C. (2009) · Foodborne Pathogens and Disease · doi:10.1089/fpd.2009.0350 · Cited by 75
van der Fels‐Klerx, H. J., Cooke, R. M., Nauta, M. J., Goossens, L. H. J., & Havelaar, A. H. (2005) · Risk Analysis · doi:10.1111/j.0272-4332.2005.00571.x · Cited by 67
Self-citationFlandoli, F., Giorgi, E., Aspinall, W. P., & Neri, A. (2011) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2011.05.012 · Cited by 64
Self-citationDavidson, V., Ravel, A., Nguyen, T. N., Fazil, A., & Ruzante, J. M. (2011) · Foodborne Pathogens and Disease · doi:10.1089/fpd.2010.0786 · Cited by 60
Ebel, E. D., Williams, M. S., Cole, D. J., Travis, C. C., Klontz, K. C., Golden, N. J., & Hoekstra, R. M. (2016) · Emerging infectious diseases · doi:10.3201/eid2207.150833 · Cited by 56 · cited 1×
“For foodborne campylobacteriosis, past research indicates that outbreak data does not provide a good guide to exposures causing sporadic illnesses [21, 37, 38].”
Ravel, A., Davidson, V. J., Ruzante, J. M., & Fazil, A. (2010) · Foodborne Pathogens and Disease · doi:10.1089/fpd.2010.0582 · Cited by 37
Evaluation of a Performance-Based Expert Elicitation: WHO Global Attribution of Foodborne Diseases
Aspinall, W. P., Cooke, R. M., Havelaar, A. H., Hoffmann, S., & Hald, T. (2016) · PLoS ONE · doi:10.1371/journal.pone.0149817 · Cited by 34 · cited 7×
“Aspinall et al. (2016) provide detail on the expert elicitation analysis method used in this study and on the performance of alternative approaches of aggregating experts’ judgments [17].”
InfluentialSelf-citationAnchoring and Adjustment in Relevance Estimation
Shokouhi, M., White, R. W., & Yılmaz, E. (2015) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/2766462.2767841 · Cited by 32 · cited 1×
“Research on decision science and survey methodology has repeatedly shown that respondents, even expert respondents, tend to “anchor” on information provided in a survey or elicitation, biasing results [28, 29, 30, 31].”
Bamber, J. L., Aspinall, W. P., & Cooke, R. M. (2016) · Climatic Change · doi:10.1007/s10584-016-1672-7 · Cited by 28
Self-citationPires, S. M. (2013) · Foodborne Pathogens and Disease · doi:10.1089/fpd.2012.1134 · Cited by 26 · cited 2×
“consistent alternative to reliance on solely of model builders’ own judgments to ill in these gaps [6].”
Expert judgement and re-elicitation for prion disease risk uncertainties
Tyshenko, M. G., ElSaadany, S., Oraby, T. F., Darshan, S., Catford, A., Aspinall, W. P., Cooke, R. M., & Krewski, D. R. (2012) · International Journal of Risk Assessment and Management · doi:10.1504/ijram.2012.047552 · Cited by 25 · cited 1×
“The SATF chose to use Cooke’s Classical Model because of its reliance on transparent, quantitative performance measures which minimize the effects of individual expert biases, its successful use in prior food source attribution studies, its validation in numerous studies in many disciplines, and the feasibility of app…”
Self-citationAnchoring Bias in the Assessment of Subjective Probability
Bunn, D. W. (1975) · Journal of the Operational Research Society · doi:10.1057/jors.1975.94 · Cited by 12
World Health Organization, F. E. R. G. (2016) · Risk Analysis · doi:10.1111/risa.12385 · Cited by 9
Vally, H., Glass, K., Ford, L., HALL, G., Kirk, M., Shadbolt, C., Veitch, M., Fullerton, K. E., Musto, J., & Becker, N. G. (2015) · Epidemiology and Infection · doi:10.1017/s0950268815002435 · Cited by 7 · cited 1×
“Expert elicitation has been used successfully in a wide range of applications where primary data is limited or absent, including foodborne disease source attribution [7, 8, 9, 10, 11, 12, 13].”
Self-citation
Research works printed but not linked: 1
- PLOS collections. WHO estimates of the global burden of foodborne diseases. http://collections.plos.org/ferg2015. Accessed 28 Dec. 2016.
Cited by
Panel, E. B., Koutsoumanis, K., Allende, A., Alvarez‐Ordóñez, A., Bover‐Cid, S., Chemaly, M., Davies, R., De Cesare, A., Herman, L., Hilbert, F., et al. (2020) · EFSA Journal · doi:10.2903/j.efsa.2020.5967 · Cited by 280
“The STEC food-borne disease burden was attributed to six food categories plus the category ‘other foods’ and a proportion of disease attributable to unknown categories was not estimated (Hoffmann et al., 2017).”
BackgroundMethodSurveillance of foodborne disease outbreaks in China, 2003–2017
Li, W., Pires, S. M., Liu, Z., Ma, X., Liang, J., Jiang, Y., Chen, J., Liang, J., Wang, S., Wang, L., et al. (2020) · Food Control · doi:10.1016/j.foodcont.2020.107359 · Cited by 228
Public health risks associated with food‐borne parasites
(BIOHAZ), E. P. O. B. H., Koutsoumanis, K., Allende, A., Alvarez‐Ordóñez, A., Bolton, D., Bover‐Cid, S., Chemaly, M., Davies, R., De Cesare, A., Herman, L., et al. (2018) · EFSA Journal · doi:10.2903/j.efsa.2018.5495 · Cited by 171
“to 80% of cases of food-borne cryptosporidiosis (Hoffmann et al., 2017), indicating a high level of uncertainty.”
BackgroundInfluentialSelf-citationGlobal disease burden of pathogens in animal source foods, 2010
Li, M., Havelaar, A. H., Hoffmann, S., Hald, T., Kirk, M., Torgerson, P. R., & Devleesschauwer, B. (2019) · PLoS ONE · doi:10.1371/journal.pone.0216545 · Cited by 127
“Second, FBDALYi;k , was multiplied with pASFj;k;l , the proportion of FBD burden attributed to specific animal products l (l = beef, small ruminant meat, dairy, pork, poultry meat, eggs, finfish, shellfish) by subregion j for each hazard k again assuming that this proportion was constant for each country in any subreg…”
BackgroundMethodInfluentialSelf-citation
Metadata
- Authors
- Hoffmann, S., Devleesschauwer, B., Aspinall, W., Cooke, R., Corrigan, T., Havelaar, A., Angulo, F., Gibb, H., Kirk, M., Lake, R., Speybroeck, N., Torgerson, P., & Hald, T.
- Affiliations
- Economic Research Service (US)
- Institut Scientifique de Santé Publique (BE)
- University of Bristol (GB)
- Resources For The Future (US)
- World Health Organization (CH)
- Utrecht University (NL)
- Centers for Disease Control and Prevention (US)
- Australian National University (AU)
- New Zealand Institute for Public Health and Forensic Science (NZ)
- UCLouvain (BE)
- University of Zurich (CH)
- Technical University of Denmark (DK)
- Corresponding author
- Hoffmann, Sandra
- ORCID
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2017-09-14
- Volume
- 12
- Issue
- 9
- Pages
- e0183641
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC5598938
- OpenAlex
- W2754907550
- Cited by
- 218
- References
- 40
- Citations by year
- 2026: 11 · 2025: 31 · 2024: 32 · 2023: 22 · 2022: 10 · 2021: 33 · 2020: 39 · 2019: 23 · 2018: 13
- FWCI
- 23.08
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- public-domain
- creativecommons.org/publicdomain/zero/1.0/ (vor)
- Locations
- PLoS ONE (publishedVersion, public-domain)
- PubMed Central (publishedVersion, public-domain)
- PubMed (publishedVersion)
- Zurich Open Repository and Archive (University of Zurich) (acceptedVersion, public-domain)
- ANU Open Research (Australian National University) (submittedVersion, cc-by)
- Ghent University Academic Bibliography (Ghent University) (submittedVersion, other-oa)
- Figshare (submittedVersion, cc-by)
- Research Repository (Delft University of Technology) (submittedVersion, public-domain)
- DIAL (Catholic University of Leuven) (submittedVersion, other-oa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Utrecht University Repository (Utrecht University) (submittedVersion, other-oa)
- Technical University of Denmark, DTU Orbit (Technical University of Denmark, DTU) (submittedVersion, public-domain)
- Rivm Repository (Netherlands National Institute for Public Health and the Environment) (submittedVersion)
- Zurich Open Repository and Archive (University of Zurich) (submittedVersion, public-domain)
- Rivm (National Institute for Public Health and the Environment) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- ESR Data and information Repository (public-domain)
- Zurich Open Repository and Archive (University of Zurich)
- Funders
- World Health Organization
- UK Natural Environment Research Council (NE/J017450/1)
- Topics
- Life Sciences › Agricultural and Biological Sciences › Food Science › Salmonella and Campylobacter epidemiology
- Life Sciences › Agricultural and Biological Sciences › Food Science › Food Safety and Hygiene
- Life Sciences › Agricultural and Biological Sciences › Food Science › Listeria monocytogenes in Food Safety
- Keywords
- food poisoning, exposure routes, non-typhoidal salmonellosis, pork, poultry meat, eggs, regional variation, global burden of disease, structured expert elicitation, uncertainty bounds, food safety policy
- MeSH terms
- Animals, Food Microbiology, Foodborne Diseases, Humans, Global Health, World Health Organization, Prevalence, Food Parasitology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.