Why the Cochrane Risk of Bias Tool Should not Include Funding Source as a Standard Item
Open accessAbstract
This editorial is based on a
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The rationale for not including financial conflicts of interest in ROBINS-E is that if financial conflicts of interest lead to bias then this will operate through one of the domains already in the tool.
“The rationale, previously discussed in the context of randomized trials (Sterne, 2013), is that if financial conflicts of interest lead to bias then this will operate through one of the domains already in the tool.”
From A tool to assess risk of bias in non-randomized follow-up studies of exposure effects (ROBINS-E) (2024) · cites this paper as Sterne, 2013
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Why the Cochrane Risk of Bias Tool Should Include Funding Source as a Standard Item
Bero, L. A. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.ed000075 · Cited by 96 · see citing works
Neuraminidase inhibitors--the story behind the Cochrane review
Doshi, P. (2009) · BMJ · doi:10.1136/bmj.b5164 · Cited by 86 · see citing works
AbbVie considers harms to be commercially confidential information: sign a petition
Gøtzsche, P. C. (2013) · BMJ · doi:10.1136/bmj.f7569 · Cited by 3 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- Higgins JPT, Altman DG, Sterne JAC on behalf of the COchrane Statistical Methods Group and the Cochrane Bias Methods Group. Chapter 8: Assessing risk of bias in included studies. In: Higgins JPT, Green S (editors). Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011]. The Cochrane Collaboration, 2011. Available at handbook.cochrane.org.
Cited by
Sorted by citations
A tool to assess risk of bias in non-randomized follow-up studies of exposure effects (ROBINS-E)
Higgins, J. P. T., Morgan, R. L., Rooney, A. A., Taylor, K. W., Thayer, K. A., Silva, R. A., Lemeris, C., Akl, E. A., Bateson, T. F., Berkman, N. D., et al. (2024) · Environment International · doi:10.1016/j.envint.2024.108602 · Cited by 1,022 · see citing works
“The rationale, previously discussed in the context of randomized trials (Sterne, 2013), is that if financial conflicts of interest lead to bias then this will operate through one of the domains already in the tool.”
Self-citationMargulis, A. V., Pladevall, M., Riera‐Guàrdia, N., Varas‐Lorenzo, C., Hazell, L., Berkman, N. D., Viswanathan, M., & Perez‐Gutthann, S. (2014) · Clinical Epidemiology · doi:10.2147/clep.s66677 · Cited by 441 · see citing works
Catalá-López, F., Hutton, B., Núñez-Beltrán, A., Page, M. J., Ridao, M., Macías Saint-Gerons, D., Catalá, M. A., Tabarés-Seisdedos, R., & Moher, D. (2017) · PLOS ONE · doi:10.1371/journal.pone.0180355 · Cited by 396 · see citing works
Jørgensen, L., Paludan-Müller, A. S., Laursen, D. R. T., Savović, J., Boutron, I., Sterne, J. A. C., Higgins, J. P. T., & Hróbjartsson, A. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0259-8 · Cited by 396 · see citing works
Self-citationMethylphenidate for children and adolescents with attention deficit hyperactivity disorder (ADHD)
Storebø, O. J., Ramstad, E., Krogh, H. B., Nilausen, T. D., Skoog, M., Holmskov, M., Rosendal, S., Groth, C., Magnusson, F. L., Moreira-Maia, C. R., et al. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009885.pub2 · Cited by 347 · see citing works
Page, M. J., Sterne, J. A. C., Higgins, J. P. T., & Egger, M. (2021) · Research Synthesis Methods · doi:10.1002/jrsm.1468 · Cited by 294 · see citing works
Self-citationNejadghaderi, S. A., Balibegloo, M., & Rezaei, N. (2024) · Health Science Reports · doi:10.1002/hsr2.2165 · Cited by 263 · see citing works
Considering bias and conflicts of interest among the included studies
Boutron, I., Page, M. J., Higgins, J. P., Altman, D. G., Lundh, A., Hróbjartsson, A., & on behalf of the Cochrane Bias Methods Group (2019) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9781119536604.ch7 · Cited by 258 · see citing works
Lam, J., Koustas, E., Sutton, P., Johnson, P. I., Atchley, D. S., Sen, S., Robinson, K. A., Axelrad, D. A., & Woodruff, T. J. (2014) · Environmental Health Perspectives · doi:10.1289/ehp.1307923 · Cited by 214 · see citing works
Amphetamines for attention deficit hyperactivity disorder (ADHD) in children and adolescents
Punja, S., Shamseer, L., Hartling, L., Urichuk, L., Vandermeer, B., Nikles, J., & Vohra, S. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009996.pub2 · Cited by 122 · see citing works
Pharmacological interventions for people with borderline personality disorder
Stoffers‐Winterling, J., Storebø, O. J., Ribeiro, J. P., Kongerslev, M., Vӧllm, B., Mattivi, J. T., Faltinsen, E. G., Todorovac, A., Jørgensen, M. S., Edemann-Callesen, H., et al. (2022) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012956.pub2 · Cited by 118 · see citing works
Systemic antibiotics for treating diabetic foot infections
Selva, A., Solà, I., Barajas-Nava, L. A., Gianneo, O. D., Bonfill, X., & Lipsky, B. A. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009061.pub2 · Cited by 101 · see citing works
Rooney, A. A., Cooper, G. S., Jahnke, G. D., Lam, J., Morgan, R. L., Boyles, A. L., Ratcliffe, J. M., Kraft, A. D., Schünemann, H. J., Schwingl, P. J., et al. (2016) · Environment International · doi:10.1016/j.envint.2016.01.005 · Cited by 95 · see citing works
Antibiotic therapy for pelvic inflammatory disease
Savaris, R. F., Fuhrich, D. G., Maissiat, J., Duarte, R. V., & Ross, J. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010285.pub3 · Cited by 81 · see citing works
da Costa, B. R., Beckett, B., Diaz, A., Resta, N. M., Johnston, B. C., Egger, M., Jüni, P., & Armijo-Olivo, S. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0441-7 · Cited by 62 · see citing works
Antibiotic therapy for pelvic inflammatory disease
Savaris, R. F., Fuhrich, D. G., Duarte, R. V., Franik, S., & Ross, J. D. C. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010285.pub2 · Cited by 66 · see citing works
Rethinking the assessment of risk of bias due to selective reporting: a cross-sectional study
Page, M. J., & Higgins, J. P. T. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0289-2 · Cited by 60 · see citing works
Babić, A., Pijuk, A., Brázdilová, L., Georgieva, Y., Pereira, M. A. R., Peričić, T. P., & Puljak, L. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-019-0718-8 · Cited by 60 · see citing works
Modified intention-to-treat analysis did not bias trial results
Døssing, A., Tarp, S., Furst, D. E., Gluud, C. N., Wells, G. A., Beyene, J., Hansen, B. B., Bliddal, H., & Christensen, R. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.11.003 · Cited by 55 · see citing works
Lee, H. W., Park, J., Jo, J., Jang, E. J., & Lee, C. (2019) · PLoS Medicine · doi:10.1371/journal.pmed.1002958 · Cited by 51 · see citing works
Tsikopoulos, K., Vasiliadis, H. S., & Mavridis, D. (2016) · British Journal of Sports Medicine · doi:10.1136/bjsports-2015-095437 · Cited by 47 · see citing works
Industry Support of Medical Research: Important Opportunity or Treacherous Pitfall?
Tierney, W. M., Meslin, E. M., & Kroenke, K. (2015) · Journal of General Internal Medicine · doi:10.1007/s11606-015-3495-z · Cited by 44 · see citing works
Saltaji, H., Armijo-Olivo, S., Cummings, G. G., Amin, M., & Flores-Mir, C. (2017) · PLoS ONE · doi:10.1371/journal.pone.0190089 · Cited by 43 · see citing works
Methylphenidate for ADHD in children and adolescents: throwing the baby out with the bathwater
Banaschewski, T., Buitelaar, J., Chui, C. S. L., Coghill, D., Cortese, S., Simonoff, E., & Wong, I. C. K. (2016) · Evidence Based Mental Health · doi:10.1136/eb-2016-102461 · Cited by 35 · see citing works
Harris, R. G., Neale, E. P., & Ferreira, I. (2019) · The American Journal of Clinical Nutrition · doi:10.1093/ajcn/nqz071 · Cited by 38 · see citing works
Gerlach, M., Banaschewski, T., Coghill, D., Rohde, L. A., & Romanos, M. (2017) · ADHD Attention Deficit and Hyperactivity Disorders · doi:10.1007/s12402-017-0220-2 · Cited by 23 · see citing works
Benea, C., Turner, K. A., Roseman, M., Bero, L. A., Lexchin, J., Turner, E. H., & Thombs, B. D. (2020) · Systematic Reviews · doi:10.1186/s13643-020-01318-5 · Cited by 22 · see citing works
Døssing, A., Tarp, S., Furst, D. E., Gluud, C. N., Beyene, J., Hansen, B. B., Bliddal, H., & Christensen, R. (2014) · BMJ Open · doi:10.1136/bmjopen-2014-005297 · Cited by 21 · see citing works
Tanni, K. A., Truong, B., Johnson, B., & Qian, J. (2021) · Critical Reviews in Oncology/Hematology · doi:10.1016/j.critrevonc.2021.103375 · Cited by 20 · see citing works
Kumar, D., Dhull, S., Nara, K., & Kumar, P. (2023) · Health sport rehabilitation · doi:10.58962/hsr.2023.9.3.118-133 · Cited by 19 · see citing works
Vassilopoulou, L., Spyromitrou-Xioufi, P., & Ladomenou, F. (2021) · European Journal of Pediatrics · doi:10.1007/s00431-021-04046-7 · Cited by 22 · see citing works
Turner, K. A., Carboni-Jiménez, A., Benea, C., Elder, K., Levis, B., Boruff, J. T., Roseman, M., Bero, L. A., Lexchin, J., Turner, E. H., et al. (2020) · BMJ Open · doi:10.1136/bmjopen-2019-035633 · Cited by 17 · see citing works
Pharmacological interventions for people with borderline personality disorder
Stoffers-Winterling, J. M., Storebø, O. J., Vӧllm, B., Mattivi, J. T., Nielsen, S. S., Kielsholm, M. L., Faltinsen, E. G., Simonsen, E. H., & Lieb, K. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012956 · Cited by 18 · see citing works
Lundh, A., Rasmussen, K., Østengaard, L., Boutron, I., Stewart, L. A., & Hróbjartsson, A. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.12.005 · Cited by 15 · see citing works
Grundy, Q. (2021) · Science and Engineering Ethics · doi:10.1007/s11948-021-00315-8 · Cited by 13 · see citing works
da Costa, B. R., Resta, N. M., Beckett, B., Israel-Stahre, N., Diaz, A., Johnston, B. C., Egger, M., Jüni, P., & Armijo-Olivo, S. L. (2014) · Systematic Reviews · doi:10.1186/2046-4053-3-144 · Cited by 13 · see citing works
The effect of indapamide vs. bendroflumethiazide for primary hypertension: a systematic review
Macfarlane, T. V., Pigazzani, F., Flynn, R., & MacDonald, T. M. (2018) · British Journal of Clinical Pharmacology · doi:10.1111/bcp.13787 · Cited by 13 · see citing works
Nejstgaard, C. H., Laursen, D. R. T., Lundh, A., & Hróbjartsson, A. (2022) · Research Synthesis Methods · doi:10.1002/jrsm.1611 · Cited by 12 · see citing works
Evidence on methylphenidate in children and adolescents with ADHD is in fact of ‘very low quality’
Storebø, O. J., Zwi, M., Krogh, H. B., Maia, C. R. M., Holmskov, M., Gillies, D. M., Groth, C., Simonsen, E. H., & Gluud, C. N. (2016) · Evidence-Based Mental Health · doi:10.1136/eb-2016-102499 · Cited by 11 · see citing works
The advantage and disadvantage of body composition on athletic success: A kabaddi player perspective
Kumar, D., Nara, K., & Dhull, S. (2023) · International Journal of Yogic Human Movement and Sports Sciences · doi:10.22271/yogic.2023.v8.i2c.1448 · Cited by 9 · see citing works
Conflicts of interest in nutritional sciences: The forgotten bias in meta-analysis
Lucas, M. (2015) · World Journal of Methodology · doi:10.5662/wjm.v5.i4.175 · Cited by 9 · see citing works
Vriezen, R., Sargeant, J. M., Vriezen, E. R., Winder, C. B., & O'Connor, A. M. C. (2019) · Animal Health Research Reviews · doi:10.1017/s146625231900029x · Cited by 9 · see citing works
Investigating and Dealing with Publication Bias and Other Reporting Biases
Page, M. J., Sterne, J. A. C., Higgins, J. P. T., & Egger, M. (2022) · Wiley eBooks · doi:10.1002/9781119099369.ch5 · Cited by 9 · see citing works
Self-citationHow about the evidence assessment tools used in education and management systematic reviews?
Lan, H., Yu, X., Wang, Z., Wang, P., Sun, Y., Wang, Z., Su, R., Wang, L., Zhao, J., Hu, Y., et al. (2023) · Frontiers in Medicine · doi:10.3389/fmed.2023.1160289 · Cited by 8 · see citing works
Krogh, J., Hjorthøj, C. R., Jakobsen, J. C., Lindschou, J., Kessing, L. V., Nordentoft, M., & Gluud, C. N. (2015) · Journal of Affective Disorders · doi:10.1016/j.jad.2015.03.042 · Cited by 8 · see citing works
Myers, E. F., Parrott, J. S., Splett, P. L., Chung, M., & Handu, D. (2018) · PLoS ONE · doi:10.1371/journal.pone.0197425 · Cited by 8 · see citing works
Bidiwala, S., Jabarkhyl, D., & Bidiwala, K. (2025) · Cureus · doi:10.7759/cureus.77007 · Cited by 7 · see citing works
Seidler, A., Hunter, K., Chartres, N., & Askie, L. (2019) · PLoS ONE · doi:10.1371/journal.pone.0222117 · Cited by 7 · see citing works
Trinh, M., Kalloniatis, M., & Nivison‐Smith, L. (2021) · Ophthalmic and Physiological Optics · doi:10.1111/opo.12919 · Cited by 5 · see citing works
Zarasvand, S. A., Ogawa, S., Nestor, B., Bridges, W. C., & Haley‐Zitlin, V. (2024) · Nutrition Reviews · doi:10.1093/nutrit/nuae068 · Cited by 4 · see citing works
Hoekstra, P. J., & Buitelaar, J. K. (2016) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-016-0856-z · Cited by 3 · see citing works
Babić, A., Pijuk, A., Brázdilová, L., Georgieva, Y., Pereira, M. A. R., Peričić, T. P., & Puljak, L. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/366591 · Cited by 3 · see citing works
Thadiboina, O., Shah, S. S. A., Ray, R., Hack, S. A., Munir, M., Shah, Q., Bhullar, A., Shah, S. Z. H., Ali, M., Nureen, U., et al. (2025) · Cureus · doi:10.7759/cureus.85923 · Cited by 2 · see citing works
Zhang, N., Yan, P., Zhao, H., Feng, L., Chu, X., Li, J., Chen, N., Yang, K., & Liu, X. (2021) · International Journal of Health Policy and Management · doi:10.34172/ijhpm.2021.162 · Cited by 2 · see citing works
Snellman, A., Carlberg, S., & Olsson, L. (2023) · Systematic Reviews · doi:10.1186/s13643-023-02342-x · Cited by 2 · see citing works
Schwingshackl, L., Neuenschwander, M., HOFFMANN, G. E., Buyken, A. E., & Schlesinger, S. (2020) · American Journal of Clinical Nutrition · doi:10.1093/ajcn/nqaa006
Assessment of the Risk of Bias
Moon, K., & Rao, S. C. (2021) · Springer eBooks · doi:10.1007/978-3-030-71921-0_4
Addressing Conflicts of Interest in Clinical Trials
Lundh, A., & Hróbjartsson, A. (2026) · Springer eBooks · doi:10.1007/978-3-032-27479-3_6
Omar, S. H., Ghani, A., Sanober, A., & Umar, A. (2026) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2026.106627
Felemban, R. G., Alzahrani, R. R., Alrefaei, N. F., Alharbi, N. M., Alghamdi, A. S., & Alqadi, S. (2026) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2026.1857109 · Cited by 1 · see citing works
- Authors
- Sterne, J. A.
- Affiliations
- University of Bristol (GB)
- Corresponding author
- Sterne, Jonathan AC
- ORCID
- Sterne, Jonathan AC
- Venue
- Cochrane Database of Systematic Reviews
- Publisher
- John Wiley & Sons, Ltd
- Published
- 2013-12-20
- Issue
- 12
- Pages
- ED000076-ED000076
- ISSN
- 1361-6137 (ISSN-L)
- PMC
- PMC10897924
- OpenAlex
- W2763135972
- Cited by
- 60
- References
- 3
- Citations by year
- 2026: 3 · 2025: 2 · 2024: 3 · 2023: 4 · 2022: 3 · 2021: 6 · 2020: 5 · 2019: 7 · 2018: 4 · 2017: 5 · 2016: 8 · 2015: 6 · 2014: 4
- Type
- reference entry
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Cochrane Database of Systematic Reviews (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Bristol Research (University of Bristol) (publishedVersion)
- Explore Bristol Research (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Pharmacology › Pharmaceutical industry and healthcare
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Keywords
- Cochrane risk of bias tool, funding sources, risk of bias assessment, conflicts of interest, research funding disclosure, systematic review methodology
- MeSH terms
- Drug Industry, Research Support as Topic, Review Literature as Topic, Risk, Conflict of Interest, Publication Bias
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review