Identifying the ‘incredible’! Part 1: assessing the risk of bias in outcomes included in systematic reviews
Open accessThe DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
In this editorial, we introduced risk of bias as the perceived risk that the results of a research study may underestimate or overestimate the truth. Systematic review authors should perform a domain-based risk of bias assessment that reflects risk of bias instead of assessing study quality. If a research study reports multiple outcome measures, separate risk of bias assessments should be performed for each outcome measure.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The text we found for this paper looks like another document, so the self-check wasn’t run.
Citations
Cites
RoB 2: a revised tool for assessing risk of bias in randomised trials
Sterne, J. A. C., Savović, J., Page, M. J., Elbers, R. G., Blencowe, N. S., Boutron, I., Cates, C. J., Cheng, H.-Y., Corbett, M. S., Eldridge, S. M., et al. (2019) · BMJ · doi:10.1136/bmj.l4898 · Cited by 34,787
Self-citationThe Cochrane Collaboration's tool for assessing risk of bias in randomised trials
Higgins, J. P. T., Altman, D. G., Gotzsche, P. C., Juni, P., Moher, D., Oxman, A. D., Savovic, J., Schulz, K. F., Weeks, L., Sterne, J. A. C., et al. (2011) · BMJ · doi:10.1136/bmj.d5928 · Cited by 33,817
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164
Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions
Sterne, J. A., Hernán, M. A., Reeves, B. C., Savović, J., Berkman, N. D., Viswanathan, M., Henry, D., Altman, D. G., Ansari, M. T., Boutron, I., et al. (2016) · BMJ · doi:10.1136/bmj.i4919 · Cited by 20,329
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gotzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · BMJ · doi:10.1136/bmj.b2700 · Cited by 17,648
Assessing the quality of controlled clinical trials
Jüni, P., Altman, D. G., & Egger, M. (2001) · BMJ · doi:10.1136/bmj.323.7303.42 · Cited by 3,309
Assessing Bias in Studies of Prognostic Factors
Hayden, J. A., van der Windt, D. A., Cartwright, J. L., Côté, P., & Bombardier, C. (2013) · Annals of Internal Medicine · doi:10.7326/0003-4819-158-4-201302190-00009 · Cited by 3,287
Wood, L., Egger, M., Gluud, L. L., Schulz, K. F., Jüni, P., Altman, D. G., Gluud, C., Martin, R. M., Wood, A. J. G., & Sterne, J. A. C. (2008) · BMJ · doi:10.1136/bmj.39465.451748.ad · Cited by 2,538
ROBIS: A new tool to assess risk of bias in systematic reviews was developed
Whiting, P., Savović, J., Higgins, J. P. T., Caldwell, D. M., Reeves, B. C., Shea, B., Davies, P., Kleijnen, J., & Churchill, R. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.06.005 · Cited by 2,272
Cited by
Page, M. J., Moher, D., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n160 · Cited by 13,262
Page, M. J., Moher, D., Bossuyt, P., Boutron, I., Hoffmann, T., mulrow, C., Shamseer, L., Tetzlaff, J., Akl, E., Brennan, S. E., et al. (2020) · doi:10.31222/osf.io/gwdhk · Cited by 916
O'Dea, R. E., Lagisz, M., Jennions, M. D., Koricheva, J., Noble, D. W. A., Parker, T. H., Gurevitch, J., Page, M. J., Stewart, G., Moher, D., et al. (2021) · Biological Reviews · doi:10.1111/brv.12721 · Cited by 697
Ardern, C. L., Büttner, F., Andrade, R., Weir, A., Ashe, M. C., Holden, S., Impellizzeri, F. M., Delahunt, E., Dijkstra, H. P., Mathieson, S., et al. (2022) · British Journal of Sports Medicine · doi:10.1136/bjsports-2021-103987 · Cited by 458
Self-citationMorrissey, D., Cotchett, M., J’Bari, A. S., Prior, T. D., Griffiths, I. B., Rathleff, M. S., Gülle, H., Vicenzino, B., & Barton, C. J. (2021) · British Journal of Sports Medicine · doi:10.1136/bjsports-2019-101970 · Cited by 173
Metadata
- Authors
- Büttner, F., Winters, M., Delahunt, E., Elbers, R., Lura, C. B., Khan, K. M., Weir, A., & Ardern, C. L.
- Affiliations
- University College Dublin (IE)
- Aalborg University (DK)
- University of Bristol (GB)
- University of British Columbia (CA)
- Erasmus MC (NL)
- Linköping University (SE)
- Corresponding author
- Büttner, Fionn
- ORCID
- Venue
- British Journal of Sports Medicine
- Publisher
- BMJ
- Published
- 2019-12-23
- Volume
- 54
- Issue
- 13
- Pages
- 798-800
- ISSN
- 0306-3674 (ISSN-L)
- 1473-0480
- OpenAlex
- W2994704700
- Cited by
- 47
- References
- 25
- Citations by year
- 2026: 5 · 2025: 8 · 2024: 4 · 2023: 5 · 2022: 9 · 2021: 11 · 2020: 5
- FWCI
- 1.27
- Type
- journal article
- Language
- en
- Open access
- Licence
- other-oa
- Locations
- British Journal of Sports Medicine (publishedVersion)
- PubMed (publishedVersion)
- Explore Bristol Research (acceptedVersion, other-oa)
- VBN Forskningsportal (Aalborg Universitet) (submittedVersion, cc-by-nc)
- EUR Research Repository (Erasmus University Rotterdam) (submittedVersion, other-oa)
- RePub (Erasmus University Rotterdam) (submittedVersion, other-oa)
- HighWire Press Open Archive (submittedVersion)
- Bristol Research (University of Bristol) (submittedVersion, other-oa)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- risk of bias, systematic reviews, outcome measures, study quality, bias assessment, sports science research
- MeSH terms
- Systematic Reviews as Topic, Humans, Research Design, Sports Medicine, Bias, Risk Assessment, Checklist
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Identifying the ‘incredible’! Part 1: assessing the risk of bias in outcomes included in systematic reviews. https://app.cochat.ai/papers/10.1136/bjsports-2019-100806
- The paper
- Büttner, F., Winters, M., Delahunt, E., Elbers, R., Lura, C. B., Khan, K. M., Weir, A., & Ardern, C. L. (2020). Identifying the ‘incredible’! Part 1: assessing the risk of bias in outcomes included in systematic reviews. British Journal of Sports Medicine. https://doi.org/10.1136/bjsports-2019-100806
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.