Outcome reporting bias in randomized trials funded by the Canadian Institutes of Health Research
Open accessThe DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Abstract
BACKGROUND: The reporting of outcomes within published randomized trials has previously been shown to be incomplete, biased and inconsistent with study protocols. We sought to determine whether outcome reporting bias would be present in a cohort of government-funded trials subjected to rigorous peer review. METHODS: We compared protocols for randomized trials approved for funding by the Canadian Institutes of Health Research (formerly the Medical Research Council of Canada) from 1990 to 1998 with subsequent reports of the trials identified in journal publications. Characteristics of reported and unreported outcomes were recorded from the protocols and publications. Incompletely reported outcomes were defined as those with insufficient data provided in publications for inclusion in meta-analyses. An overall odds ratio measuring the association between completeness of reporting and statistical significance was calculated stratified by trial. Finally, primary outcomes specified in trial protocols were compared with those reported in publications. RESULTS: We identified 48 trials with 68 publications and 1402 outcomes. The median number of participants per trial was 299, and 44% of the trials were published in general medical journals. A median of 31% (10th-90th percentile range 5%-67%) of outcomes measured to assess the efficacy of an intervention (efficacy outcomes) and 59% (0%-100%) of those measured to assess the harm of an intervention (harm outcomes) per trial were incompletely reported. Statistically significant efficacy outcomes had a higher odds than nonsignificant efficacy outcomes of being fully reported (odds ratio 2.7; 95% confidence interval 1.5-5.0). Primary outcomes differed between protocols and publications for 40% of the trials. INTERPRETATION: Selective reporting of outcomes frequently occurs in publications of high-quality government-funded trials.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Our findings echo previous research that suggests that the effects of education on behaviour may be limited [5,78,80,82-85], but may represent a necessary ingredient or first step in the process of change.”
From Systematic review of knowledge translation strategies in the allied health professions (2012) · cites this paper as [84]
In the citing paper
“There is emerging evidence that this is a common problem in the literature, yet it is a difficult problem to pinpoint [84].”
From Systematic review of knowledge translation strategies in the allied health professions (2012) · cites this paper as [84]
In the citing paper
“Although up to 38% of trials defined multiple primary outcomes,249 250 251 252”
From SPIRIT 2025 explanation and elaboration: updated guideline for protocols of randomised trials (2025) · cites this paper as [250]
In the citing paper
“These substantive modifications are rarely acknowledged in the final trial reports.200 249 250 480”
From SPIRIT 2025 explanation and elaboration: updated guideline for protocols of randomised trials (2025) · cites this paper as [250]
In the citing paper
“Outcome reporting bias (i.e., within study) occurs when authors select specific outcomes to include in the report of their research; such selection is associated with those outcomes that appear to reach statistical significance.”
From Reporting research results: a moral obligation for all researchers. (2007) · cites this paper as [11]
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Deeks, J. J., Altman, D. G., & Bradburn, M. J. (2001) · Systematic Reviews in Health Care · doi:10.1002/9780470693926.ch15 · Cited by 2,163
Chan, A.-W., Hróbjartsson, A., Haahr, M. T., Gøtzsche, P. C., & Altman, D. G. (2004) · JAMA · doi:10.1001/jama.291.20.2457 · Cited by 1,845 · cited 3×
“Deviations from trial protocols should be described in the published reports so that readers can assess the potential for bias.(1,13) At a minimum, they should be declared at the time of submission to journals.”
BackgroundResultSelf-citationMeta‐Analysis Of Controlled Clinical Trials
Whitehead, A. (2002) · doi:10.1002/0470854200 · Cited by 827
Melander, H., Ahlqvist-Rastad, J., Meijer, G., & Beermann, B. (2003) · BMJ · doi:10.1136/bmj.326.7400.1171 · Cited by 635
Publication and Related Biases
Song, F., Eastwood, A., Gilbody, S., Duley, L., & Sutton, A. (2001) · The Advanced Handbook of Methods in Evidence Based Healthcare · doi:10.4135/9781848608344.n21 · Cited by 455
Publication and related biases.
Song, Eastwood, Gilbody, Duley, & Sutton (2000) · Health Technology Assessment · doi:10.3310/hta4100 · Cited by 427
How important is publication bias? A synthesis of available data.
Dickersin, K. (1997) · PubMed · Cited by 311
Bias in meta-analytic research
Felson, D. T. (1992) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(92)90072-u · Cited by 231
Underpowering in randomized trials reporting a sample size calculation
Vickers, A. J. (2003) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(03)00141-0 · Cited by 102
Hahn, S., Williamson, P. R., & Hutton, J. L. (2002) · Journal of Evaluation in Clinical Practice · doi:10.1046/j.1365-2753.2002.00314.x · Cited by 97 · cited 1×
“Other literature on outcome reporting bias is limited to case reports and a small pilot study that required permission from researchers to access their ethics protocols.(8) Comparisons between journal publications and final reports submitted to drug-approval agencies have also revealed discrepancies in data reporting.”
Background
Cited by
Items 101–200 of 444
Why we need easy access to all data from all clinical trials and how to accomplish it
Gøtzsche, P. C. (2011) · Trials · doi:10.1186/1745-6215-12-249 · Cited by 137
Omega-6 fats for the primary and secondary prevention of cardiovascular disease
Hooper, L., Al-Khudairy, L., Abdelhamid, A. S., Rees, K., Brainard, J. S., Brown, T. J., Ajabnoor, S. M., O'Brien, A. T., Winstanley, L. E., Donaldson, D. H., et al. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011094.pub3 · Cited by 134
Apollonio, D. E., Philipps, R., & Bero, L. A. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010274.pub2 · Cited by 135
Omega-6 fats for the primary and secondary prevention of cardiovascular disease
Hooper, L., Al-Khudairy, L., Abdelhamid, A. S., Rees, K., Brainard, J. S., Brown, T. J., Ajabnoor, S. M., O'Brien, A. T., Winstanley, L. E., Donaldson, D. H., et al. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011094.pub4 · Cited by 133
US studies may overestimate effect sizes in softer research
Fanelli, D., & Ioannidis, J. P. A. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1302997110 · Cited by 130
Detecting and adjusting for small‐study effects in meta‐analysis
Rücker, G., Carpenter, J. R., & Schwarzer, G. (2011) · Biometrical Journal · doi:10.1002/bimj.201000151 · Cited by 132
Evolution and Translation of Research Findings: From Bench to Where
Ioannidis, J. P. A. (2006) · PLoS Clinical Trials · doi:10.1371/journal.pctr.0010036 · Cited by 129
“tackle [44–46].”
Outcome-Reporting Bias in Education Research
Pigott, T. D., Valentine, J. C., Polanin, J. R., Williams, R. T., & Canada, D. D. (2013) · Educational Researcher · doi:10.3102/0013189x13507104 · Cited by 127
The tyranny of power: is there a better way to calculate sample size?
Bland, J. M. (2009) · BMJ · doi:10.1136/bmj.b3985 · Cited by 123
A guide to prospective meta-analysis
Seidler, A. L., Hunter, K. E., Cheyne, S., Ghersi, D., Berlin, J. A., & Askie, L. (2019) · BMJ · doi:10.1136/bmj.l5342 · Cited by 125
Improving the reporting of randomised trials: the CONSORT Statement and beyond
Altman, D. G., Moher, D., & Schulz, K. F. (2012) · Statistics in Medicine · doi:10.1002/sim.5402 · Cited by 117
Kelley, G. A., Kelley, K. S., & Kohrt, W. M. (2013) · International Journal of Endocrinology · doi:10.1155/2013/741639 · Cited by 109
Simoni, J. M., Smith, L. R., Oost, K. M., Lehavot, K., & Fredriksen‐Goldsen, K. I. (2016) · Journal of Homosexuality · doi:10.1080/00918369.2016.1174021 · Cited by 129
Selection in Reported Epidemiological Risks: An Empirical Assessment
Kavvoura, F. K., Liberopoulos, G., & Ioannidis, J. P. A. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040079 · Cited by 115
Small-Study Effects in Meta-Analysis
Schwarzer, G., Carpenter, J. R., & Rücker, G. (2015) · Use R! · doi:10.1007/978-3-319-21416-0_5 · Cited by 145
Blümle, A., Huwiler, K., & Witschi, M. (2008) · Swiss Medical Weekly · doi:10.4414/smw.2008.12027 · Cited by 115
The evolution of a new publication type: Steps and challenges of producing overviews of reviews
Thomson, D., Russell, K., Becker, L., Klassen, T., & Hartling, L. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.30 · Cited by 109
No short-cut in assessing trial quality: a case study
Hirji, K. F. (2009) · Trials · doi:10.1186/1745-6215-10-1 · Cited by 109
BJELAKOVIC, G., NIKOLOVA, D., SIMONETTI, R. G., & GLUUD, C. (2008) · Alimentary Pharmacology & Therapeutics · doi:10.1111/j.1365-2036.2008.03785.x · Cited by 103
Reporting of Results in ClinicalTrials.gov and High-Impact Journals
Becker, J. E., Krumholz, H. M., Ben-Josef, G., & Ross, J. S. (2014) · JAMA · doi:10.1001/jama.2013.285634 · Cited by 100
Little, J., Higgins, J. P. T., Ioannidis, J. P. A., Moher, D., Gagnon, F., von Elm, E. B., Khoury, M. J., Cohen, B. J., Smith, G. D., Grimshaw, J., et al. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.12.004 · Cited by 106
Non-publication and delayed publication of randomized trials on vaccines: survey
Manzoli, L., Flacco, M. E., D'Addario, M., Capasso, L., De Vito, C., Marzuillo, C., Villari, P., & Ioannidis, J. P. A. (2014) · BMJ · doi:10.1136/bmj.g3058 · Cited by 99
Scott, A., Rucklidge, J. J., & Mulder, R. T. (2015) · PLOS ONE · doi:10.1371/journal.pone.0133718 · Cited by 99
Hannink, G., Gooszen, H. G., & Rovers, M. M. (2013) · Annals of Surgery · doi:10.1097/sla.0b013e3182864fa3 · Cited by 102
Patient-reported outcomes in meta-analyses – Part 1: assessing risk of bias and combining outcomes
Johnston, B. C., Patrick, D. L., Busse, J. W., Schünemann, H. J., Agarwal, A., & Guyatt, G. H. (2013) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-11-109 · Cited by 93
Cybulski, L., Mayo-Wilson, E., & Grant, S. (2016) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000115 · Cited by 90
Bevorzugte Report Items für systematische Übersichten und Meta-Analysen: Das PRISMA-Statement
Ziegler, A., Antes, G., & König, I. R. (2011) · DMW - Deutsche Medizinische Wochenschrift · doi:10.1055/s-0031-1272978 · Cited by 93
When and How Can Endpoints Be Changed after Initiation of a Randomized Clinical Trial
Evans, S. (2007) · PLoS Clinical Trials · doi:10.1371/journal.pctr.0020018 · Cited by 88
Terracciano, L., Brozek, J., Compalati, E., & Schünemann, H. (2010) · Current Opinion in Allergy & Clinical Immunology · doi:10.1097/aci.0b013e32833c148b · Cited by 89
Tsilidis, K. K., Papatheodorou, S. I., Evangelou, E., & Ioannidis, J. P. A. (2012) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/djs437 · Cited by 93
Systematic reviews and meta-analysis
Egger, M., Smith, G. D., & Sterne, J. A. C. (2009) · Oxford University Press eBooks · doi:10.1093/med/9780199218707.003.0039 · Cited by 91
Guidelines for randomized clinical trial protocol content: a systematic review
Tetzlaff, J. M., Chan, A.-W., Kitchen, J., Sampson, M., Tricco, A. C., & Moher, D. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-43 · Cited by 81
Self-citationHolmes, D., Perron, A., & O’Byrne, P. (2006) · Worldviews on Evidence-Based Nursing · doi:10.1111/j.1741-6787.2006.00058.x · Cited by 88
Empirical evaluation of which trial characteristics are associated with treatment effect estimates
Dechartres, A., Trinquart, L., Faber, T., & Ravaud, P. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.04.005 · Cited by 85
Believability of relative risks and odds ratios in abstracts: Cross sectional study.
Gøtzsche, P. C. (2006) · BMJ · doi:10.1136/bmj.38895.410451.79 · Cited by 85
Promoting public access to clinical trial protocols: challenges and recommendations
Chan, A.-W., & Hróbjartsson, A. (2018) · Trials · doi:10.1186/s13063-018-2510-1 · Cited by 84
Self-citationCharacteristics of Published Comparative Effectiveness Studies of Medications
Hochman, M. (2010) · JAMA · doi:10.1001/jama.2010.240 · Cited by 81
Appraisal of primary outcome measures used in trials of patient decision support
Kryworuchko, J., Stacey, D., Bennett, C. L., & Graham, I. D. (2008) · Patient Education and Counseling · doi:10.1016/j.pec.2008.07.011 · Cited by 90
Few systematic reviews exist documenting the extent of bias: a systematic review
Tricco, A. C., Tetzlaff, J., Sampson, M., Fergusson, D. A., Cogo, E., Horsley, T., & Moher, D. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.10.017 · Cited by 93
Promoting Transparency in Pharmaceutical Industry–Sponsored Research
Ross, J. S., Gross, C. P., & Krumholz, H. M. (2011) · American Journal of Public Health · doi:10.2105/ajph.2011.300187 · Cited by 85
Cirocchi, R., Søreide, K., Saverio, S. D., Rossi, E. G., Arezzo, A., Zago, M., Abraha, I., Vettoretto, N., & Chiarugi, M. (2018) · The Journal of Trauma: Injury, Infection, and Critical Care · doi:10.1097/ta.0000000000001925 · Cited by 92
The culture of designing hepato-biliary randomised trials
Gluud, C. N. (2006) · Journal of Hepatology · doi:10.1016/j.jhep.2005.12.006 · Cited by 79
Young, A. E., Brookes, S. T., Avery, K. N. L., Davies, A., Metcalfe, C., & Blazeby, J. M. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.06.016 · Cited by 77
Mills, E. J., Wu, P., Gagnier, J. J., Heels‐Ansdell, D., & Montori, V. M. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.01.004 · Cited by 82
Use of Trial Register Information during the Peer Review Process
Mathieu, S., Chan, A.-W., & Ravaud, P. (2013) · PLoS ONE · doi:10.1371/journal.pone.0059910 · Cited by 71
Self-citationPage, M., Mckenzie, J., & Forbes, A. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2012.10.010 · Cited by 71
You, B., Gan, H. K., Pond, G., & Chen, E. X. (2012) · Journal of Clinical Oncology · doi:10.1200/jco.2011.37.0890 · Cited by 74
Developing a guideline for clinical trial protocol content: Delphi consensus survey
Tetzlaff, J. M., Moher, D., & Chan, A.-W. (2012) · Trials · doi:10.1186/1745-6215-13-176 · Cited by 70
Self-citationNo common denominator: a review of outcome measures in IVF RCTs
Wilkinson, J., Roberts, S. A., Showell, M. G., Brison, D. R., & Vail, A. (2016) · Human Reproduction · doi:10.1093/humrep/dew227 · Cited by 81
Raftery, J., Young, A., Stanton, L., Milne, R., Cook, A., Turner, D., & Davidson, P. (2015) · Health Technology Assessment · doi:10.3310/hta19110 · Cited by 74
Hamm, M. P., Hartling, L., Milne, A., Tjosvold, L., Vandermeer, B., Thomson, D., Curtis, S., & Klassen, T. P. (2010) · BMC Pediatrics · doi:10.1186/1471-2431-10-96 · Cited by 74
Hopewell, S., Boutron, I., Altman, D. G., Barbour, G., Moher, D., Montori, V., Schriger, D., Cook, J., Gerry, S., Omar, O., et al. (2016) · BMC Medicine · doi:10.1186/s12916-016-0736-x · Cited by 69
Norris, S. L., Atkins, D. C., Bruening, W., Fox, S. B., Johnson, E., Kane, R. L., Morton, S. C., Oremus, M., Ospina, M. B., Randhawa, G. S., et al. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.04.027 · Cited by 73
Antioxidant supplements for liver diseases
Bjelaković, G., Gluud, L. L., Nikolova, D., Bjelaković, M., Nagorni, A. V., & Gluud, C. N. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007749.pub2 · Cited by 78
Avoidable waste of research related to outcome planning and reporting in clinical trials
Yordanov, Y., Dechartres, A., Atal, I., Tran, V.-T., Boutron, I., Créquit, P., & Ravaud, P. (2018) · BMC Medicine · doi:10.1186/s12916-018-1083-x · Cited by 76
Antioxidant supplements for preventing gastrointestinal cancers
Bjelakovic, G., Nikolova, D., Simonetti, R., & Gluud, C. (2004) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004183.pub2 · Cited by 70
Safety of regular formoterol or salmeterol in adults with asthma: an overview of Cochrane reviews
Cates, C. J., Wieland, L. S., Oleszczuk, M., & Kew, K. M. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010314.pub2 · Cited by 75
Little, J., Higgins, J. P. T., Ioannidis, J. P. A., Moher, D., Gagnon, F., von Elm, E. B., Khoury, M. J., Cohen, B. J., Smith, G. D., Grimshaw, J., et al. (2009) · European Journal of Epidemiology · doi:10.1007/s10654-008-9302-y · Cited by 83
Li, G., Abbade, L. P. F., Nwosu, I., Jin, Y., Leenus, A., Maaz, M., Wang, M., Bhatt, M., Zielinski, L., Sanger, N., et al. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0465-7 · Cited by 70
Saquib, N., Saquib, J., & Ioannidis, J. P. A. (2013) · BMJ · doi:10.1136/bmj.f4313 · Cited by 68
Hirsch, L. J. (2009) · Mayo Clinic Proceedings · doi:10.4065/84.9.811 · Cited by 78
Milette, K., Roseman, M., & Thombs, B. D. (2010) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2010.09.015 · Cited by 71
Turner, L., Boutron, I., Hróbjartsson, A., Altman, D. G., & Moher, D. (2013) · Systematic Reviews · doi:10.1186/2046-4053-2-79 · Cited by 62
Publication Bias, with a Focus on Psychiatry: Causes and Solutions
Turner, E. H. (2013) · CNS Drugs · doi:10.1007/s40263-013-0067-9 · Cited by 70
Rasmussen, N., Lee, K., & Bero, L. (2009) · Trials · doi:10.1186/1745-6215-10-116 · Cited by 62
Meta‐analysis: antioxidant supplements for liver diseases – the Cochrane Hepato‐Biliary Group
Bjelaković, G., Gluud, L. L., Nikolova, D., Bjelaković, M., Nagorni, A. V., & Gluud, C. N. (2010) · Alimentary Pharmacology & Therapeutics · doi:10.1111/j.1365-2036.2010.04371.x · Cited by 67
Alfonso, F., Timmis, A., Pinto, F. J., Ambrosio, G., Ector, H., Kułakowski, P., Vardas, P. E., on behalf of the Editors' Network European Society of Cardiology Task Force, Editors' Network members:, Antoniades, L., et al. (2012) · European Heart Journal · doi:10.1093/eurheartj/ehr464 · Cited by 62
Moja, L. P., Moschetti, I., Nurbhai, M., Compagnoni, A., Liberati, A., Grimshaw, J. M., Chan, A.-W., Dickersin, K., Krleza-Jeric, K., Moher, D., et al. (2009) · Trials · doi:10.1186/1745-6215-10-56 · Cited by 62
Self-citationA systematic review of midwife-led interventions to address post partum post-traumatic stress
Cunen, N. B., McNeill, J. A., & Murray, K. B. (2013) · Midwifery · doi:10.1016/j.midw.2013.09.003 · Cited by 70
Kelley, G. A., Kelley, K. S., Hootman, J. M., & Jones, D. L. (2009) · Journal of Applied Gerontology · doi:10.1177/0733464808327456 · Cited by 78
How Outcomes Are Defined in Clinical Trials of Mechanically Ventilated Adults and Children
Blackwood, B., Clarke, M. J., McAuley, D. F., McGuigan, P. J., Marshall, J. C., & Rose, L. (2014) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.201309-1645pp · Cited by 66
Reporting research results: a moral obligation for all researchers.
Moher, D. (2007) · Canadian Journal of Anesthesia/Journal canadien d anesthésie · doi:10.1007/bf03022653 · Cited by 60
Rethinking the assessment of risk of bias due to selective reporting: a cross-sectional study
Page, M. J., & Higgins, J. P. T. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0289-2 · Cited by 60
Multiplicity of data in trial reports and the reliability of meta-analyses: empirical study
Tendal, B., Nuesch, E., Higgins, J. P. T., Juni, P., & Gotzsche, P. C. (2011) · BMJ · doi:10.1136/bmj.d4829 · Cited by 60
Protect us from poor-quality medical research
ESHRE Capri Workshop Group, Ioannidis, J. P. A., Bhattacharya, S., Evers, J. L. H., der Veen, F. V., Somigliana, E., Barratt, C. L. R., Bontempi, G., Baird, D. T., Crosignani, P., et al. (2018) · Human Reproduction · doi:10.1093/humrep/dey056 · Cited by 59
Raghav, K. P. S., Mahajan, S., Yao, J. C., Hobbs, B. P., Berry, D. A., Pentz, R. D., Tam, A., Hong, W. K., Ellis, L. M., Abbruzzese, J., et al. (2015) · Journal of Clinical Oncology · doi:10.1200/jco.2015.62.4148 · Cited by 59
Reporting of Harm in Randomized Controlled Trials Published in the Urological Literature
Breau, R. H., Gaboury, I., Scales, C. D., Fesperman, S. F., Watterson, J. D., & Dahm, P. (2010) · Journal of Urology · doi:10.1016/j.juro.2010.01.030 · Cited by 58
Baron, G., Boutron, I., Giraudeau, B., & Ravaud, P. (2005) · Arthritis & Rheumatism · doi:10.1002/art.21116 · Cited by 59
Publicación de ensayos clínicos en revistas científicas: consideraciones editoriales
Alfonso, F., Segovia, J., Heras, M., & Bermejo, J. (2006) · Revista Española de Cardiología · doi:10.1157/13095794 · Cited by 64
Pinto, R. Z., Elkins, M. R., Moseley, A. M., Sherrington, C., Herbert, R. D., Maher, C. G., Ferreira, P. H., & Ferreira, M. L. (2013) · Physical Therapy · doi:10.2522/ptj.20120206 · Cited by 51
Rongen, J. J., & Hannink, G. (2016) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.15.00400 · Cited by 53
Contopoulos‐Ioannidis, D. G., Alexiou, G. Α., Gouvias, T. C., & Ioannidis, J. P. A. (2006) · Pharmacogenetics and Genomics · doi:10.1097/01.fpc.0000236332.11304.8f · Cited by 55
Outcome reporting bias in randomized-controlled trials investigating antipsychotic drugs
Lancee, M., Lemmens, C. M. C., Kahn, R. S., Vinkers, C. H., & Luykx, J. J. (2017) · Translational Psychiatry · doi:10.1038/tp.2017.203 · Cited by 51
Publication bias in the medical literature: A review by a Canadian research ethics board
Hall, R., de Antueno, C., & Webber, A. (2007) · Canadian Journal of Anesthesia · doi:10.1007/bf03022661 · Cited by 54
Publication of Clinical Trials in Scientific Journals: Editorial Issves
Alfonso, F., Segovia, J., Heras, M., & Bermejo, J. (2006) · Revista Española de Cardiología (English Edition) · doi:10.1016/s1885-5857(07)60074-7 · Cited by 67
Panagiotou, O. A., & Ioannidis, J. P. A. (2012) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2012.01.008 · Cited by 53
Undisclosed Changes in Outcomes in Randomized Controlled Trials: An Observational Study
Ewart, R., Lausen, H., & Millian, N. (2009) · The Annals of Family Medicine · doi:10.1370/afm.1017 · Cited by 50
Rosenthal, R., & Dwan, K. (2013) · Annals of Surgery · doi:10.1097/sla.0b013e318283cf7f · Cited by 50
Risk of bias assessments for selective reporting were inadequate in the majority of Cochrane reviews
Saric, F., Barcot, O., & Puljak, L. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.04.007 · Cited by 48
Biologic agents in rheumatology: unmet issues after 200 trials and $200 billion sales
Ioannidis, J. P. A., Karassa, F. B., Druyts, E., Thorlund, K., & Mills, E. J. (2013) · Nature Reviews Rheumatology · doi:10.1038/nrrheum.2013.134 · Cited by 51
Kavvoura, F. K., McQueen, M. B., Khoury, M. J., Tanzi, R. E., Bertram, L., & Ioannidis, J. P. A. (2008) · American Journal of Epidemiology · doi:10.1093/aje/kwn206 · Cited by 48
Vedula, S. S., Goldman, P. S., Rona, I. J., Greene, T. M., & Dickersin, K. (2012) · Trials · doi:10.1186/1745-6215-13-136 · Cited by 46
A protocol developing, disseminating and implementing a core outcome set for infertility
Duffy, J. M., Bhattacharya, S., Curtis, C., Evers, J. L. H., Farquharson, R. G., Franik, S., Khalaf, Y., Legro, R. S., Lensen, S. F., Mol, B. W., et al. (2018) · Human Reproduction Open · doi:10.1093/hropen/hoy007 · Cited by 50
Reveiz, L., Chan, A.-W., Krleža-Jerić, K., Granados, C. E., Pinart, M., Etxeandia, I., Rada, D., Martinez, M., Bonfill, X., & Cardona, A. F. (2010) · PLoS ONE · doi:10.1371/journal.pone.0012484 · Cited by 47
Self-citationA method for the meta‐analysis of mutually exclusive binary outcomes
Trikalinos, T. A., & Olkin, I. (2008) · Statistics in Medicine · doi:10.1002/sim.3299 · Cited by 46
Waiving confidentiality for the greater good
Chan, A.-W., Upshur, R., Singh, J. A., Ghersi, D., Chapuis, F., & Altman, D. G. (2006) · BMJ · doi:10.1136/bmj.332.7549.1086 · Cited by 46
Self-citationBialy, L., Vandermeer, B., Lacaze‐Masmonteil, T., Dryden, D. M., & Hartling, L. (2014) · Evidence-Based Child Health: A Cochrane Review Journal · doi:10.1002/ebch.1985 · Cited by 46
Economic Evaluations in the Canadian Common Drug Review
Laupacis, A. (2006) · PharmacoEconomics · doi:10.2165/00019053-200624110-00011 · Cited by 46
Reporting of clinical trials: a review of research funders' guidelines
Dwan, K. M., Gamble, C. L., Williamson, P. R., & Altman, D. G. (2008) · Trials · doi:10.1186/1745-6215-9-66 · Cited by 44
Walking the talk: the need for a trial registry for development interventions
Rasmussen, O. D., Malchow‐Møller, N., & Andersen, T. B. (2011) · Journal of Development Effectiveness · doi:10.1080/19439342.2011.605160 · Cited by 42
Metadata
- Authors
- Chan, A.-W.
- Affiliations
- Canadian Institutes of Health Research (CA)
- Corresponding author
- Chan, A.-W.
- Venue
- Canadian Medical Association Journal
- Publisher
- CMA Impact Inc.
- Published
- 2004-09-28
- Volume
- 171
- Issue
- 7
- Pages
- 735-740
- ISSN
- 0820-3946 (ISSN-L)
- 1488-2329
- PMC
- PMC517858
- OpenAlex
- W2159096825
- Cited by
- 444
- References
- 18
- Citations by year
- 2026: 5 · 2025: 9 · 2024: 9 · 2023: 14 · 2022: 14 · 2021: 15 · 2020: 13 · 2019: 16 · 2018: 21 · 2017: 17 · 2016: 20 · 2015: 23 · 2014: 16 · 2013: 27 · 2012: 42
- FWCI
- 25.89
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- Canadian Medical Association Journal (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- DigitalGeorgetown (Georgetown University Library) (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Health Sciences › Nursing › Issues, ethics and legal aspects › Pharmaceutical industry and healthcare
- Keywords
- selective reporting, selective outcome reporting, Canadian Institutes of Health Research, primary outcome reporting, efficacy outcomes, publication bias
- MeSH terms
- Canada, Government Agencies, Humans, Research Support as Topic, Randomized Controlled Trials as Topic, Treatment Outcome, Publication Bias
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.