Improving the trustworthiness of findings from nutrition evidence syntheses: assessing risk of bias and rating the certainty of evidence
Open accessThe DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
Suboptimal diet is recognized as a leading modifiable risk factor for non-communicable diseases. Non-randomized studies (NRSs) with patient relevant outcomes provide many insights into diet–disease relationships. Dietary guidelines are based predominantly on findings from systematic reviews of NRSs—mostly prospective observational studies, despite that these have been repeatedly criticized for yielding potentially less trustworthy results than randomized controlled trials (RCTs). It is assumed that these are a result of bias due to prevalent-user designs, inappropriate comparators, residual confounding, and measurement error. In this article, we aim to highlight the importance of applying risk of bias (RoB) assessments in nutritional studies to improve the credibility of evidence of systematic reviews. First, we discuss the importance and challenges of dietary RCTs and NRSs, and provide reasons for potentially less trustworthy results of dietary studies. We describe currently used tools for RoB assessment (Cochrane RoB, and ROBINS-I), describe the importance of rigorous RoB assessment in dietary studies and provide examples that further the understanding of the key issues to overcome in nutrition research. We then illustrate, by comparing the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) approach with current approaches used by United States Department of Agriculture Dietary Guidelines for Americans, and the World Cancer Research Fund, how to establish trust in dietary recommendations. Our overview shows that the GRADE approach provides more transparency about the single domains for grading the certainty of the evidence and the strength of recommendations. Despite not increasing the certainty of evidence itself, we expect that the rigorous application of the Cochrane RoB and the ROBINS-I tools within systematic reviews of both RCTs and NRSs and their integration within the GRADE approach will strengthen the credibility of dietary recommendations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
RoB 2: a revised tool for assessing risk of bias in randomised trials
Sterne, J. A. C., Savović, J., Page, M. J., Elbers, R. G., Blencowe, N. S., Boutron, I., Cates, C. J., Cheng, H.-Y., Corbett, M. S., Eldridge, S. M., et al. (2019) · BMJ · doi:10.1136/bmj.l4898 · Cited by 34,787
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., Vandenbroucke, J. P., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040296 · Cited by 23,020
ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions
Sterne, J. A., Hernán, M. A., Reeves, B. C., Savović, J., Berkman, N. D., Viswanathan, M., Henry, D., Altman, D. G., Ansari, M. T., Boutron, I., et al. (2016) · BMJ · doi:10.1136/bmj.i4919 · Cited by 20,329
Self-citationRoth, G. A., Abate, D., Abate, K. H., Abay, S. M., Abbafati, C., Abbasi, N., Abbastabar, H., Abd-Allah, F., Abdela, J., Abdelalim, A., et al. (2018) · The Lancet · doi:10.1016/s0140-6736(18)32203-7 · Cited by 8,600
Afshin, A., Sur, P. J., Fay, K. A., Cornaby, L., Ferrara, G., Salama, J. S., Mullany, E. C., Abate, K. H., Abbafati, C., Abebe, Z., et al. (2019) · The Lancet · doi:10.1016/s0140-6736(19)30041-8 · Cited by 5,811 · cited 1×
“According to the Global Burden of Disease studies, suboptimal diet is the leading risk factor for ~ 50% of disabilities from cardiovascular diseases [2].”
MethodNaghavi, M., Abajobir, A. A., Abbafati, C., Abbas, K. M., Abd-Allah, F., Abera, S. F., Aboyans, V., Adetokunboh, O., Afshin, A., Agrawal, A., et al. (2017) · The Lancet · doi:10.1016/s0140-6736(17)32152-9 · Cited by 4,821
Comparison of Weight-Loss Diets with Different Compositions of Fat, Protein, and Carbohydrates
Sacks, F. M., Bray, G. A., Carey, V. J., Smith, S. R., Ryan, D. H., Anton, S. D., McManus, K., Champagne, C. M., Bishop, L. M., Laranjo, N., et al. (2009) · New England Journal of Medicine · doi:10.1056/nejmoa0804748 · Cited by 1,966 · cited 1×
“Dietary adherence is probably the most important limitation of dietary RCTs, mainly in long-term RCTs [46].”
BackgroundVitamin E Supplementation and Cardiovascular Events in High-Risk Patients
(2000) · New England Journal of Medicine · doi:10.1056/nejm200001203420302 · Cited by 1,957
Dansinger, M. L., Gleason, J. A., Griffith, J. L., Selker, H. P., & Schaefer, E. J. (2005) · JAMA · doi:10.1001/jama.293.1.43 · Cited by 1,726 · cited 1×
“Difficulty of attrition (in free living populations, a 40–50% dropout rate is fairly common [47]) is mainly observed in longer-term dietary RCTs [48].”
BackgroundSanderson, S., Tatt, I. D., & Higgins, J. P. (2007) · International Journal of Epidemiology · doi:10.1093/ije/dym018 · Cited by 1,531 · cited 1×
“Focusing on NRSs, a SR identified 86 tools to assess study quality in NRSs showing high inconsistency in selection/inclusion and weighting of domains across tools [32].”
Method
Cited by
Dybvik, J. S., Svendsen, M., & Aune, D. (2023) · European Journal of Nutrition · doi:10.1007/s00394-022-02942-8 · Cited by 150
Ultra‐Processed Food and Obesity: What Is the Evidence?
Dicken, S. J., & Batterham, R. L. (2024) · Current Nutrition Reports · doi:10.1007/s13668-024-00517-z · Cited by 133
Selinger, E., Neuenschwander, M., Koller, A., Gojda, J., Kühn, T., Schwingshackl, L., Barbaresko, J., & Schlesinger, S. (2023) · Critical Reviews in Food Science and Nutrition · doi:10.1080/10408398.2022.2075311 · Cited by 114
“Overall using GRADE will strengthen the credibility of potential dietary recommendations (Schwingshackl, Schunemann, and Meerpohl 2021).”
MethodSelf-citationLee, J. J., Khan, T. A., McGlynn, N., Malik, V. S., Hill, J. O., Leiter, L. A., Jeppesen, P. B., Rahelić, D., Kahleová, H., Salas-Salvadó, J., et al. (2022) · Diabetes Care · doi:10.2337/dc21-2130 · Cited by 73
A Scoping Review of Current Guidelines on Dietary Fat and Fat Quality
Schwingshackl, L., Zähringer, J., Beyerbach, J., Werner, S. S., Nagavci, B., Heseker, H., Koletzko, B., Meerpohl, J. J., & on behalf of the International Union of Nutritional Sciences (IUNS) Task force on Dietary Fat Quality (2021) · Annals of Nutrition and Metabolism · doi:10.1159/000515671 · Cited by 53
Self-citation
Metadata
- Authors
- Schwingshackl, L., Schünemann, H. J., & Meerpohl, J. J.
- Venue
- European Journal of Nutrition
- Published
- 2020-12-30
- Volume
- 60
- Issue
- 6
- Pages
- 2893-2903
- ISSN
- 1436-6207 (ISSN-L)
- 1436-6215
- OpenAlex
- W3114003436
- Cited by
- 71
- References
- 28
- FWCI
- 6.63
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Improving the trustworthiness of findings from nutrition evidence syntheses: assessing risk of bias and rating the certainty of evidence. https://app.cochat.ai/papers/10.1007/s00394-020-02464-1
- The paper
- Schwingshackl, L., Schünemann, H. J., & Meerpohl, J. J. (2021). Improving the trustworthiness of findings from nutrition evidence syntheses: assessing risk of bias and rating the certainty of evidence. European Journal of Nutrition. https://doi.org/10.1007/s00394-020-02464-1
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.