Common scientific and statistical errors in obesity research
Open accessThe DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
This review identifies 10 common errors and problems in the statistical analysis, design, interpretation, and reporting of obesity research and discuss how they can be avoided. The 10 topics are: 1) misinterpretation of statistical significance, 2) inappropriate testing against baseline values, 3) excessive and undisclosed multiple testing and “P‐value hacking,” 4) mishandling of clustering in cluster randomized trials, 5) misconceptions about nonparametric tests, 6) mishandling of missing data, 7) miscalculation of effect sizes, 8) ignoring regression to the mean, 9) ignoring confirmation bias, and 10) insufficient statistical reporting. It is hoped that discussion of these errors can improve the quality of obesity research by helping researchers to implement proper statistical practice and to know when to seek the help of a statistician.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Cohen, J. (2013) · doi:10.4324/9780203771587 · Cited by 25,373
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., Vandenbroucke, J. P., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040296 · Cited by 23,020
Multiple imputation using chained equations: Issues and guidance for practice
White, I. R., Royston, P., & Wood, A. M. (2011) · Statistics in Medicine · doi:10.1002/sim.4067 · Cited by 9,792 · cited 2×
“(2011) or Carpenter and Kenward (2013) for a summary of practical considerations in conducting analyses using multiple imputation, including implications for randomized trials (74,75).”
BackgroundBeyond Baron and Kenny: Statistical Mediation Analysis in the New Millennium
Hayes, A. F. (2009) · Communication Monographs · doi:10.1080/03637750903310360 · Cited by 9,757 · cited 1×
“Distinguishing effects of third-variables requires support from additional data that can elucidate the causal and temporal pathways between the variables (110).”
BackgroundSimmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Fisher, R. A. (1936) · BMJ · doi:10.1136/bmj.1.3923.554-a · Cited by 4,980
The Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553
Cohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
Morris, S. B., & DeShon, R. P. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.1.105 · Cited by 2,502
CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials
Schulz, K. F., Altman, D. G., Moher, D., & for the CONSORT Group (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000251 · Cited by 2,296
Cited by
Best (but oft-forgotten) practices: mediation analysis ,
Fairchild, A. J., & McDaniel, H. L. (2017) · The American Journal of Clinical Nutrition · doi:10.3945/ajcn.117.152546 · Cited by 503
High-Intensity Interval Training for Cognitive and Mental Health in Adolescents
(2016) · doi:10.1249/mss.0000000000000993 · Cited by 236
Issues with data and analyses: Errors, underlying themes, and potential solutions
Brown, A. W., Kaiser, K. A., & Allison, D. B. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1708279115 · Cited by 157
“While we are aware of no formal, long-standing catalog of errors, either in frequency or category, efforts have critiqued common errors in focused areas of the literature (31, 58), aiming to educate the particular community where these are observed.”
BackgroundSelf-citationGaia, J. W. P., Schuch, F. B., Ferreira, R. W., Souza, E. D. L., Ferreira, V. M. S., & Pires, D. A. (2024) · Scandinavian Journal of Medicine & Science in Sports · doi:10.1111/sms.14618 · Cited by 26
“61 These practices may be considered questionable statistical practices that researchers may employ to obtain the desired outcomes.”
Metadata
- Authors
- George, B. J., Beasley, T. M., Brown, A. W., Dawson, J., Dimova, R., Divers, J., Goldsby, T. U., Heo, M., Kaiser, K. A., Keith, S. W., Kim, M. Y., Li, P., Mehta, T., Oakes, J. M., Skinner, A., Stuart, E., & Allison, D. B.
- Venue
- Obesity
- Publisher
- Wiley
- Published
- 2016-03-30
- Volume
- 24
- Issue
- 4
- Pages
- 781-790
- ISSN
- 1930-7381 (ISSN-L)
- 1930-739X
- OpenAlex
- W2318114766
- Cited by
- 97
- References
- 32
- FWCI
- 14.28
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.