A unified framework for bias assessment in clinical research
The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Abstract
Methodological flaws, limitations, and inadequate practices in research are well known and pose threats to the internal validity of any research study. However, there are ways of safeguarding research conduct to reduce the chance of research producing distorted results. Numerous tools now exist to assess the incorporation of such safeguards into primary research studies (also known as quality and/or risk-of-bias assessment). These tools typically include a variety of items that are then checked against those implemented in the study. Despite a lot of research in this area, no comprehensive generic classification of safeguards across study designs exist, although attempts have been made to clarify aspects of this. We review the developments in this area as well as use preliminary data from 100 methodological studies to illustrate our proposed approach. We conclude by proposing a new framework for identifying research studies at risk of being biased and the information in this article will promote a unification of the diverse approaches to facilitating bias assessment in clinical research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions
Sterne, J. A., Hernán, M. A., Reeves, B. C., Savović, J., Berkman, N. D., Viswanathan, M., Henry, D., Altman, D. G., Ansari, M. T., Boutron, I., et al. (2016) · BMJ · doi:10.1136/bmj.i4919 · Cited by 20,329
Self-citationA structural approach to selection bias
Hernán, M. A., Hernández-Díaz, S., & Robins, J. M. (2004) · Epidemiology · doi:10.1097/01.ede.0000135174.63482.43 · Cited by 2,844 · cited 1×
“The difference in the exposure–outcome relationship may be attributed to a selection (or attrition) variable being a common effect of both the exposure and the outcome, known as conditioning on common effects.(66,67) Consequently, selection probabilities may be influenced by imbalances in the cross-classification of”
BackgroundHoy, D., Brooks, P., Woolf, A., Blyth, F., March, L., Bain, C., Baker, P., Smith, E., & Buchbinder, R. (2012) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2011.11.014 · Cited by 2,555
Wood, L., Egger, M., Gluud, L. L., Schulz, K. F., Jüni, P., Altman, D. G., Gluud, C., Martin, R. M., Wood, A. J. G., & Sterne, J. A. C. (2008) · BMJ · doi:10.1136/bmj.39465.451748.ad · Cited by 2,538
Updated Method Guidelines for Systematic Reviews in the Cochrane Collaboration Back Review Group
van Tulder, M., Furlan, A., Bombardier, C., & Bouter, L. (2003) · Spine · doi:10.1097/01.brs.0000065484.95996.af · Cited by 2,180
Thomas, B. H., Ciliska, D., Dobbins, M., & Micucci, S. (2004) · Worldviews on Evidence-Based Nursing · doi:10.1111/j.1524-475x.2004.04006.x · Cited by 2,118
Zeng, X., Zhang, Y., Kwong, J. S. W., Zhang, C., Li, S., Sun, F., Niu, Y., & Du, L. (2015) · Journal of Evidence-Based Medicine · doi:10.1111/jebm.12141 · Cited by 2,082
Sackett, D. L. (1979) · Journal of Chronic Diseases · doi:10.1016/0021-9681(79)90012-2 · Cited by 2,075
Bias and causal associations in observational research
Grimes, D. A., & Schulz, K. F. (2002) · The Lancet · doi:10.1016/s0140-6736(02)07451-2 · Cited by 1,553
Sanderson, S., Tatt, I. D., & Higgins, J. P. (2007) · International Journal of Epidemiology · doi:10.1093/ije/dym018 · Cited by 1,531 · cited 5×
“In a review of tools that assess susceptibility to bias in observational studies, it was found that only half of the tools examined were transparent in their descriptions of the tool development process, including their design, applicability, and the empirical basis for item inclusion.(14) Yet, despite this absence of…”
BackgroundMethodInfluential
Cited by
Barker, T. H., Stone, J. C., Sears, K., Klugar, M., Tufanaru, C., Leonardi-Bee, J., Aromataris, E., & Munn, Z. (2023) · JBI Evidence Synthesis · doi:10.11124/jbies-22-00430 · Cited by 1,225
Self-citationBarker, T. H., Habibi, N., Aromataris, E., Stone, J. C., Leonardi-Bee, J., Sears, K., Hasanoff, S., Klugar, M., Tufanaru, C., Moola, S., et al. (2024) · JBI Evidence Synthesis · doi:10.11124/jbies-23-00268 · Cited by 843
“In this example, this means that the appraiser would need to answer questions 8 and 9 four times.”
BackgroundSelf-citationBarker, T. H., Stone, J. C., Sears, K., Klugar, M., Leonardi-Bee, J., Tufanaru, C., Aromataris, E., & Munn, Z. (2023) · JBI Evidence Synthesis · doi:10.11124/jbies-22-00125 · Cited by 471
Self-citationDoi, S. A. R., Furuya‐Kanamori, L., Toft, E., Musa, O. A. H., Islam, N., Clark, J., & Thalib, L. (2020) · Obesity Reviews · doi:10.1111/obr.12964 · Cited by 39
Self-citation
Metadata
- Authors
- Stone, J. C., Glass, K., Clark, J., Munn, Z., Tugwell, P., & Doi, S. A. R.
- Venue
- International Journal of Evidence-Based Healthcare
- Published
- 2019-06
- Volume
- 17
- Issue
- 2
- Pages
- 106-120
- ISSN
- 1744-1595 (ISSN-L)
- 1744-1609
- OpenAlex
- W2945795829
- Cited by
- 40
- References
- 38
- FWCI
- 3.84
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A unified framework for bias assessment in clinical research. https://app.cochat.ai/papers/10.1097/xeb.0000000000000165
- The paper
- Stone, J. C., Glass, K., Clark, J., Munn, Z., Tugwell, P., & Doi, S. A. R. (2019). A unified framework for bias assessment in clinical research. International Journal of Evidence-Based Healthcare. https://doi.org/10.1097/xeb.0000000000000165
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.