The evidence underpinning sports performance products: a systematic assessment
Open accessAbstract
Background: To assess the extent and nature of claims regarding improved sports performance made by advertisers for a broad range of sports-related products, and the quality of the evidence on which these claims are based. Methods: The authors analysed magazine adverts and associated websites of a broad range of sports products. The authors searched for references supporting the performance and/or recovery claims of these products. The authors critically appraised the methods in the retrieved references by assessing the level of evidence and the risk of bias. The authors also collected information on the included participants, adverse events, study limitations, the primary outcome of interest and whether the intervention had been retested. Results: The authors viewed 1035 web pages and identified 431 performance-enhancing claims for 104 different products. The authors found 146 references that underpinned these claims. More than half (52.8%) of the websites that made performance claims did not provide any references, and the authors were unable to perform critical appraisal for approximately half (72/146) of the identified references. None of the references referred to systematic reviews (level 1 evidence). Of the critically appraised studies, 84% were judged to be at high risk of bias. Randomisation was used in just over half of the studies (58.1%), allocation concealment was only clear in five (6.8%) studies; and blinding of the investigators, outcome assessors or participants was only clearly reported as used in 20 (27.0%) studies. Only three of the 74 (2.7%) studies were judged to be of high quality and at low risk of bias. Conclusions: The current evidence is not of sufficient quality to inform the public about the benefits and harms of sports products. There is a need to improve the quality and reporting of research, a move towards using systematic review evidence to inform decisions.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Current recommendations for refueling after exercise can be misleading, in particular for recreational athletes who are targeted by commercial marketing.
“Current recommendations for refueling after exercise can be misleading, in particular for recreational athletes who are targeted by commercial marketing (Heneghan et al. 2012; Zytnick et al. 2015).”
From Males and females exhibit similar muscle glycogen recovery with varied recovery food sources (2020) · cites this paper as Heneghan et al. 2012
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The Cochrane Collaboration's tool for assessing risk of bias in randomised trials
Higgins, J. P. T., Altman, D. G., Gotzsche, P. C., Juni, P., Moher, D., Oxman, A. D., Savovic, J., Schulz, K. F., Weeks, L., Sterne, J. A. C., et al. (2011) · BMJ · doi:10.1136/bmj.d5928 · Cited by 33,817 · see citing works
Allocation concealment in randomised trials: defending against deciphering
Schulz, K. F., & Grimes, D. A. (2002) · The Lancet · doi:10.1016/s0140-6736(02)07750-4 · Cited by 923 · see citing works
Subverting Randomization in Controlled Trials
Schulz, K. F. (1995) · JAMA · doi:10.1001/jama.1995.03530180050029 · Cited by 518 · see citing works
Physical activity: Health outcomes and importance for public health policy
Haskell, W. L., Blair, S. N., & Hill, J. O. (2009) · Preventive Medicine · doi:10.1016/j.ypmed.2009.05.002 · Cited by 365 · see citing works
Physical activity in relation to cognitive decline in elderly men: The FINE Study
van Gelder, B. M., Tijhuis, M. A. R., Kalmijn, S., Giampaoli, S., Nissinen, A., & Kromhout, D. (2004) · Neurology · doi:10.1212/01.wnl.0000147474.29994.35 · Cited by 311 · see citing works
The Landscape and Lexicon of Blinding in Randomized Trials
Schulz, K. F., Chalmers, I., & Altman, D. G. (2002) · Annals of Internal Medicine · doi:10.7326/0003-4819-136-3-200202050-00022 · Cited by 242 · see citing works
Placebo effect of carbohydrate feedings during a 40-km cycling time trial
CLARK, V. R., Hopkins, W. G., Hawley, J. A., & Burke, L. M. (2000) · Medicine & Science in Sports & Exercise · doi:10.1097/00005768-200009000-00019 · Cited by 190 · see citing works
Gaullier, J., Halse, J., Høivik, H. O., Høye, K., Syvertsen, C., Nurminiemi, M., Hassfeld, C., Einerhand, A. W. C., O’Shea, M., & Gudmundsen, O. (2007) · British Journal Of Nutrition · doi:10.1017/s0007114507381324 · Cited by 182 · see citing works
Effect of exercise-induced dehydration on time-trial exercise performance: a meta-analysis
Goulet, E. D. B. (2011) · British Journal of Sports Medicine · doi:10.1136/bjsm.2010.077966 · Cited by 142 · see citing works
The Effectiveness of Commercially Available Sports Drinks
Coombes, J. S., & Hamilton, K. L. (2000) · Sports Medicine · doi:10.2165/00007256-200029030-00004 · Cited by 141 · see citing works
Safety of conjugated linoleic acid (CLA) in overweight or obese human volunteers
Berven, G., Bye, A., Hals, O., Blankson, H., Fagertun, H., Thom, E., Wadstein, J., & Gudmundsen, O. (2000) · European Journal of Lipid Science and Technology · doi:10.1002/1438-9312(200008)102:7 · Cited by 134 · see citing works
Digestibility of Bovine Milk Whey Protein and β-Lactoglobulin in Vitro and in Vivo
Kitabatake, N., & Kinekawa, Y.-I. (1998) · Journal of Agricultural and Food Chemistry · doi:10.1021/jf9710903 · Cited by 125 · see citing works
The biological activity of undenatured dietary whey proteins: role of glutathione.
Bounous, G., & Gold, P. (1991) · PubMed · Cited by 122 · see citing works
Effects of Acute Carbohydrate Supplementation on Endurance Performance: A Meta-Analysis
Vandenbogaerde, T. J., & Hopkins, W. G. (2011) · Sports Medicine · doi:10.2165/11590520-000000000-00000 · Cited by 112 · see citing works
Flakoll, P. J., Judy, T., Flinn, K., Carr, C., & Flinn, S. D. (2004) · Journal of Applied Physiology · doi:10.1152/japplphysiol.00811.2003 · Cited by 104 · see citing works
Lukaski, H. C., & Nielsen, F. H. (2002) · Journal of Nutrition · doi:10.1093/jn/132.5.930 · Cited by 93 · see citing works
Sharma, V. K. (2009) · Scientia Pharmaceutica · doi:10.3797/scipharm.0808-14 · Cited by 82 · see citing works
Roffe, C., Sills, S., Crome, P., et al. (2002) · PubMed · Cited by 80 · see citing works
Carbohydrate-Supplement Form and Exercise Performance
Campbell, C., Prince, D., Braun, M. M., Applegate, E., & Casazza, G. A. (2008) · International Journal of Sport Nutrition and Exercise Metabolism · doi:10.1123/ijsnem.18.2.179 · Cited by 62 · see citing works
Jenkinson, D. M., & Harbert, A. J. (2008) · PubMed · Cited by 58 · see citing works
Differential response of rat skeletal muscle glycogen metabolism to testosterone and estradiol
Ramamani, A., Aruldhas, M. M., & Govindarajulu, P. (1999) · Canadian Journal of Physiology and Pharmacology · doi:10.1139/y99-016 · Cited by 50 · see citing works
Waterlogged: The Serious Problem of Overhydration in Endurance Sports
Noakes, T. D. (2011) · Medical Entomology and Zoology · Cited by 49 · see citing works
Soop, M., Nehra, V., Henderson, G. C., Boirie, Y., Ford, G. C., & Nair, K. S. (2012) · American Journal of Physiology-Endocrinology and Metabolism · doi:10.1152/ajpendo.00106.2012 · Cited by 49 · see citing works
Compression Sleeves Increase Tissue Oxygen Saturation But Not Running Performance
Ménétrier, A., Mourot, L., Bouhaddi, M., et al. (2011) · International Journal of Sports Medicine · doi:10.1055/s-0031-1283181 · Cited by 45 · see citing works
DAWSON, B., VLADICH, T., & BLANKSBY, B. A. (2002) · Journal of Strength and Conditioning Research · doi:10.1519/00124278-200211000-00001 · Cited by 41 · see citing works
Noakes, T. D. (2012) · Human Kinetics eBooks · doi:10.5040/9781492596028 · Cited by 35 · see citing works
Effects of petroleum ether extract of Anacyclus pyrethrum DC. on sexual behavior in male rats
Sharma, V. K. (2010) · Journal of Chinese Integrative Medicine · doi:10.3736/jcim20100807 · Cited by 33 · see citing works
Zabala‐Letona, A., Churruca, I., Fernández‐Quintela, A., Rodriguez, V. M., Macarulla, M. T., Martínez, J. A., & Portillo, M. P. (2006) · British Journal Of Nutrition · doi:10.1079/bjn20061774 · Cited by 32 · see citing works
Clinical and Biological Activity of Soy Protein Powder Supplementation in Healthy Male Volunteers
Goodin, S., Shen, F., Shih, W. J., Dave, N. J., Kane, M. P., Medina, P. J., Lambert, G. H., Aisner, J., Gallo, M. A., & DiPaola, R. S. (2007) · Cancer Epidemiology Biomarkers & Prevention · doi:10.1158/1055-9965.epi-06-0882 · Cited by 31 · see citing works
Forty years of sports performance research and little insight gained
Heneghan, C. J., Perera, R., Nunan, D., Mahtani, K., & Gill, P. J. (2012) · BMJ · doi:10.1136/bmj.e4797 · Cited by 28 · see citing works
Self-citationPowering Up With Sports and Energy Drinks
Meadows‐Oliver, M., & Ryan‐Krause, P. (2007) · Journal of Pediatric Health Care · doi:10.1016/j.pedhc.2007.08.005 · Cited by 27 · see citing works
Double blind carbohydrate ingestion does not improve exercise duration in warm humid conditions
Nassif, C., Ferreira, A. P. A., Gomes, A. R., et al. (2007) · Journal of science and medicine in sport · doi:10.1016/j.jsams.2007.08.015 · Cited by 16 · see citing works
The history, ingredients and effects of energy drinks
Grósz, A., & Szatmári, Á. (2008) · Orvosi Hetilap · doi:10.1556/oh.2008.28491 · Cited by 12 · see citing works
Effect of Long-Term Feeding of Soy-Based Diets on the Pancreas of Cebus Monkeys
Harwood, J. P., Ausman, L. M., King, N. W., et al. (1986) · Advances in experimental medicine and biology · doi:10.1007/978-1-4757-0022-0_15 · Cited by 10 · see citing works
Differential response of rat skeletal muscle glycogen metabolism to testosterone and estradiol
Ramamani, A., Aruldhas, M. M., & Govindarajulu, P. (1999) · Canadian Journal of Physiology and Pharmacology · doi:10.1139/cjpp-77-4-300 · Cited by 10 · see citing works
SAMUEL, E. L. (1930) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/archpedi.1930.01930160005002 · Cited by 5 · see citing works
Flagged first, then by citations
Research works printed but not linked: 2
- [10]Jeremy Howick IC Paul G Greenhalgh T; OCEBM Levels of Evidence Working Group The Oxford 2011 Levels of Evidence 2011 30th May 2012. http://www.cebm.net/index.aspx?o=5653
- [37]Hopkins W Research designs: choosing and fine-tuning a design for your study. Sport Science 2008; 12: 12– 21
Cited by
Sorted by citations
Males and females exhibit similar muscle glycogen recovery with varied recovery food sources
Flynn, S., Rosales, A., Hailes, W., & Ruby, B. (2020) · European Journal of Applied Physiology · doi:10.1007/s00421-020-04352-2 · Cited by 17 · see citing works
- Authors
- Heneghan, C., Howick, J., O'Neill, B., Gill, P. J., Lasserson, D. S., Cohen, D., Davis, R., Ward, A., Smith, A., Jones, G., & Thompson, M.
- Affiliations
- University of Oxford (GB)
- Centre for Evidence-Based Medicine, Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
- BMJ Group (United Kingdom) (GB)
- Corresponding author
- Heneghan, Carl
- Venue
- BMJ Open
- Publisher
- BMJ
- Published
- 2012
- Volume
- 2
- Issue
- 4
- Pages
- e001702
- ISSN
- 2044-6055 (ISSN-L)
- PMC
- PMC3401829
- OpenAlex
- W2167412854
- Cited by
- 48
- References
- 36
- Citations by year
- 2026: 4 · 2025: 1 · 2024: 2 · 2023: 1 · 2022: 1 · 2021: 3 · 2020: 14 · 2019: 3 · 2018: 1 · 2017: 3 · 2016: 1 · 2015: 4 · 2014: 4 · 2013: 2 · 2012: 4
- FWCI
- 5.09
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by-nc
- Locations
- BMJ Open (publishedVersion, cc-by-nc)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- HighWire Press Open Archive (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Pharmacology › Pharmaceutical industry and healthcare
- Social Sciences › Sociology and Political Science › Doping in Sports
- Keywords
- quality of evidence, risk of bias, reporting quality, systematic reviews, critical appraisal
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review