Strengthening the Practice of Exercise and Sport-Science Research
Open accessThe DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
Exercise and sport sciences continue to grow as a collective set of disciplines investigating a broad array of basic and applied research questions. Despite the progress, there is room for improvement. A number of problems pertaining to reliability and validity of research practices hinder advancement and the potential impact of the field. These problems include inadequate validation of surrogate outcomes, too few longitudinal and replication studies, limited reporting of null or trivial results, and insufficient scientific transparency. The purpose of this review is to discuss these problems as they pertain to exercise and sport sciences based on their treatment in other disciplines, namely psychology and medicine, and to propose a number of solutions and recommendations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Progressive Statistics for Studies in Sports Medicine and Exercise Science
HOPKINS, W. G., MARSHALL, S. W., BATTERHAM, A. M., & HANIN, J. (2009) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0b013e31818cb278 · Cited by 9,128
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515 · cited 7×
“54 Whereas 97% of the original studies reported statistically signi fi cant results, only 36% of the replications had the same outcome.”
BackgroundResultInfluentialSimmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
HARKing: Hypothesizing after the results are known
Kerr, N. L. (1998) · Personality and Social Psychology Review · doi:10.1207/s15327957pspr0203_4 · Cited by 1,989
Fanelli, D. (2009) · PLoS ONE · doi:10.1371/journal.pone.0005738 · Cited by 1,911 · cited 2×
“In more-extreme circumstances, some scientists may be tempted to manipulate their data to fi nd a positive effect 33,39 or, alternatively, change their original hypotheses (aim or research question) according to their fi ndings in an attempt to present the results as positive (also known as HARKing…”
BackgroundPublication bias in the social sciences: Unlocking the file drawer
Franco, A., Malhotra, N., & Simonovits, G. (2014) · Science · doi:10.1126/science.1255484 · Cited by 1,542 · cited 3×
“38,41 Authors may also decide against attempting to publish nonsigni fi cant results because leading journals have a high rejection rate of negative results.”
BackgroundPashler, H., & Wagenmakers, E. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612465253 · Cited by 1,321
Nosek (2012) · doi:10.1177/1745691612459058 · Cited by 1,301 · cited 7×
“Problem: Generally, the term open science refers to activities designed to make the scientific processes transparent and accessible.(57,58) This approach includes sharing research materials, data, exact analysis, workflow, and more.”
BackgroundMethodInfluentialNegative results are disappearing from most disciplines and countries
Fanelli, D. (2012) · Scientometrics · doi:10.1007/s11192-011-0494-7 · Cited by 1,248 · cited 6×
“35 This practice results in a disproportionately high ratio of positive to negative outcomes published in scienti fi c journals, and this ratio is apparently increasing with each passing year.”
BackgroundResultInfluentialShall we Really do it Again? The Powerful Concept of Replication is Neglected in the Social Sciences
Schmidt, S. (2009) · Review of General Psychology · doi:10.1037/a0015108 · Cited by 1,125 · cited 8×
“8,50 With direct replication, researchers repeat the methods of the original study as closely as possible.”
BackgroundMethodResultInfluentialIndividual differences in response to regular physical activity
BOUCHARD, C., & RANKINEN, T. (2001) · Medicine and Science in Sports and Exercise · doi:10.1097/00005768-200106001-00013 · Cited by 939
“Positive” results increase down the Hierarchy of the Sciences
Fanelli, D. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010068 · Cited by 734 · cited 3×
“35,37 In addition to a cultural shift, implementing registered reports and/or blinded results to peer reviews will be helpful in reducing the frequency of these negative occurrences.”
BackgroundRegistered Reports: A Method to Increase the Credibility of Published Results
Nosek, B. A., & Lakens, D. (2014) · Social Psychology · doi:10.1027/1864-9335/a000192 · Cited by 716
Kidwell, M. C., Lazarević, L. B., Baranski, E., Hardwicke, T. E., Piechowski, S., Falkenberg, L.-S., Kennett, C., Slowik, A., Sonnleitner, C., Hess-Holden, C., et al. (2016) · PLOS Biology · doi:10.1371/journal.pbio.1002456 · Cited by 700 · cited 3×
“10 For example, since 2014, when Psychological Science announced it would award badges for data-sharing behaviors, the average data-sharing rate increased tenfold to 38% from 2013 to 2015.”
BackgroundInfluentialThe Value of Direct Replication
Simons, D. J. (2014) · Perspectives on Psychological Science · doi:10.1177/1745691613514755 · Cited by 630
The alleged crisis and the illusion of exact replication
Stroebe, W., & Strack, F. (2014) · Perspectives on Psychological Science · doi:10.1177/1745691613514450 · Cited by 597
Replication, falsification, and the crisis of confidence in social psychology
Earp, B. D., & Trafimow, D. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00621 · Cited by 472
Detecting and avoiding likely false‐positive findings – a practical guide
Forstmeier, W., Wagenmakers, E., & Parker, T. H. (2017) · Biological Reviews · doi:10.1111/brv.12315 · Cited by 436
Likelihood of Null Effects of Large NHLBI Clinical Trials Has Increased over Time
Kaplan, R. M., & Irvin, V. L. (2015) · PLOS ONE · doi:10.1371/journal.pone.0132382 · Cited by 356 · cited 1×
“47 While this solution is not perfect and does not fi t all types of research questions, we believe that it is a model worth adopting in the fi eld of exercise and sport science.”
Nosek, B. A., & Errington, T. M. (2017) · eLife · doi:10.7554/elife.23383 · Cited by 242 · cited 6×
“50,53 Replication facilitates a deeper understanding of which effects are robust and consistent and lead to better use of limited resources, as only repeatable data will be used as a platform on which to build.”
BackgroundMethodInfluentialDamas, F., Phillips, S., Vechin, F. C., & Ugrinowitsch, C. (2015) · Sports Medicine · doi:10.1007/s40279-015-0320-0 · Cited by 225
D. Chambers, C., 1 Cardiff University Brain Research Imaging Centre, S. O. P., Feredoes, E., D. Muthukumaraswamy, S., & J. Etchells, P. (2014) · AIMS Neuroscience · doi:10.3934/neuroscience.2014.1.4 · Cited by 213
Muscle Activation in the Loaded Free Barbell Squat: A Brief Review
Clark, D. R., Lambert, M. I., & Hunter, A. M. (2012) · Journal of Strength and Conditioning Research · doi:10.1519/jsc.0b013e31822d533d · Cited by 170 · cited 1×
“16,17 It is speculated that exercises eliciting greater EMG amplitudes are superior (for an outcome of interest) than those eliciting lower amplitudes.”
BackgroundAre We Wasting a Good Crisis? The Availability of Psychological Research Data after the Storm
Vanpaemel, W., Vermorgen, M., Deriemaecker, L., & Storms, G. (2015) · Collabra · doi:10.1525/collabra.13 · Cited by 152
Schoenfeld, B. J. (2013) · Journal of Strength and Conditioning Research · doi:10.1519/jsc.0b013e31828ddd53 · Cited by 74
Cited by
Vigotsky, A. D., Halperin, I., Lehman, G. J., Trajano, G. S., & Vieira, T. M. (2018) · Frontiers in Physiology · doi:10.3389/fphys.2017.00985 · Cited by 503
Self-citationNunes, J. P., Grgic, J., Cunha, P. M., Ribeiro, A. S., Schoenfeld, B. J., de Salles, B. F., & Cyrino, E. S. (2021) · European Journal of Sport Science · doi:10.1080/17461391.2020.1733672 · Cited by 86
Schulz, R., Langen, G., Prill, R., Cassel, M., & Weissgerber, T. L. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-059347 · Cited by 23
Ben Othman, A., Chaouachi, A., Chaouachi, M., Makhlouf, I., Farthing, J. P., Granacher, U., & Behm, D. G. (2019) · Applied Physiology, Nutrition, and Metabolism · doi:10.1139/apnm-2018-0766 · Cited by 19
Assessing Open Science practices in physical activity behaviour change intervention evaluations
Norris, E., Sulevani, I., Finnerty, A. N., & Castro, O. (2022) · BMJ Open Sport & Exercise Medicine · doi:10.1136/bmjsem-2021-001282 · Cited by 14
Metadata
- Authors
- Halperin, I., Vigotsky, A. D., Foster, C., & Pyne, D. B.
- Venue
- International Journal of Sports Physiology and Performance
- Publisher
- Human Kinetics
- Published
- 2018-02
- Volume
- 13
- Issue
- 2
- Pages
- 127-134
- ISSN
- 1555-0265 (ISSN-L)
- 1555-0273
- OpenAlex
- W2743305921
- Cited by
- 130
- References
- 27
- FWCI
- 6.26
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.