Cited by 188Meta-analysis and systematic reviewsStatistical Methods in Clinical TrialsStatistical Methods in Epidemiology

The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.

Outcome selection bias in meta-analysis

Williamson, P R, Gamble, C, Altman, D G, Hutton, J L·2005·Statistical Methods in Medical Research

DOI 10.1191/0962280205sm415oa

Open this paper in CoChat — free account

Abstract

Publication bias has been previously identified as a threat to the validity of a meta-analysis. Recently, new evidence has documented an additional threat to validity, the selective reporting of trial outcomes within published studies. Several diseases have several possible measures of outcome. Some articles might report only a selection of those outcomes, perhaps those with statistically significant results. In this article, we review this problem while addressing the questions: what is within-study selective reporting? how common is it? why is it done? how can it mislead? how can it be detected?, and finally, what is the solution? We recommend that both publication bias and selective reporting should be routinely investigated in systematic reviews.

Integrity signals

Registry

Crossref · 10.1191/0962280205sm415oa

Cites

36 of 36 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Trim and Fill: A Simple Funnel‐Plot–Based Method of Testing and Adjusting for Publication Bias in Meta‐Analysis
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099
Journal of the American Statistical Association
Fildes, R. A. (1989) · International Journal of Forecasting · doi:10.1016/0169-2070(89)90106-4 · Cited by 3,956
AIDS Education and Prevention
誠一, 市. (2004) · The Journal of AIDS Research · doi:10.11391/aidsr1999.6.104 · Cited by 3,233
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109
A Nonparametric “Trim and Fill” Method of Accounting for Publication Bias in Meta-Analysis
Duval, S., & Tweedie, R. (2000) · Journal of the American Statistical Association · doi:10.1080/01621459.2000.10473905 · Cited by 2,955
Statistical Methods for Meta-Analysis
(1985) · Elsevier eBooks · doi:10.1016/c2009-0-03396-0 · Cited by 2,570
Empirical Evidence for Selective Reporting of Outcomes in Randomized Trials: Comparison of Protocols to Published Articles
Chan, A.-W., Hróbjartsson, A., Haahr, M. T., Gøtzsche, P. C., & Altman, D. G. (2004) · JAMA · doi:10.1001/jama.291.20.2457 · Cited by 1,845
Self-citation
Systematic Reviews in Health Care: Meta‐Analysis in Context
(2001) · doi:10.1002/9780470693926 · Cited by 1,693
Cochrane Injuries Group Albumin ReviewersWhy albumin may not work
Berger, A. (1998) · BMJ · doi:10.1136/bmj.317.7153.235 · Cited by 1,080
Consequences of prejudice against the null hypothesis.
Greenwald, A. G. (1975) · Psychological Bulletin · doi:10.1037/h0076157 · Cited by 1,022

Show all 35 references

Research works printed but not linked: 1

Hutton JL, 2000, Applied Statistics, 49, 359

Sorted by citations

Items 101–188 of 188

Sponsorship-Related Outcome Selection Bias in Published Economic Studies of Triptans
Peura, P. K., Martikainen, J. A., Purmonen, T. T., & Turunen, J. H. O. (2011) · Medical Decision Making · doi:10.1177/0272989x11403834 · Cited by 19
Not Published Is Not Perished: Addressing Publication Bias in Meta-Analytic Studies in Communication
Sun, Y., & Pan, Z. (2020) · Human Communication Research · doi:10.1093/hcr/hqz015 · Cited by 18
Exploring neurodevelopmental outcome measures used in children with cerebral malaria: the perspectives of caregivers and health workers in Malawi
Mbale, E. W., Taylor, T. E., Brabin, B. J., Mallewa, M., & Gladstone, M. (2017) · BMC Pediatrics · doi:10.1186/s12887-016-0763-y · Cited by 18
“This poses difficulties when comparing the impact of interventions, and interferes with the ability to summarize comparative evidence on clinical outcomes [16].”
Background
Outcomes in Clinical Trials of Inhaled Corticosteroids for Children with Asthma Are Narrowly Focussed on Short Term Disease Activity.
Sinha, I. P., Williamson, P. R., & Smyth, R. L. (2009) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/ajrccm-conference.2009.179.1_meetingabstracts.a4821 · Cited by 18
Self-citation
The Chiropractic Care of Infants with Breastfeeding Difficulties
Alcantara, J., Alcantara, J., & Alcantara, J. (2015) · EXPLORE · doi:10.1016/j.explore.2015.08.005 · Cited by 17
Selective primary outcome reporting in high-impact journals of anaesthesia and pain
Bonnot, B., Yavchitz, A., Mantz, J., Paugam-Burtz, C., & Boutron, I. (2016) · British Journal of Anaesthesia · doi:10.1093/bja/aew280 · Cited by 17
Omega-3 polyunsaturated fatty acid supplementation during the pre and post-natal period: A meta-analysis and systematic review of randomized and semi-randomized controlled trials
Quin, C., Erland, B. M., Loeppky, J. L., & Gibson, D. L. (2016) · Journal of Nutrition & Intermediary Metabolism · doi:10.1016/j.jnim.2016.04.005 · Cited by 17
Interventions for preventing oral mucositis in patients with cancer receiving treatment: cytokines and growth factors
Riley, P., Glenny, A., Worthington, H. V., Littlewood, A., Clarkson, J., & McCabe, M. G. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011990 · Cited by 16
Outcomes in orthopedics and traumatology: translating research into practice
de Moraes, V. Y., Ferrari, P. M. D. O., Gracitelli, G. C., Faloppa, F., & Belloti, J. C. (2014) · Acta Ortopédica Brasileira · doi:10.1590/1413-78522014220601009 · Cited by 16
Addressing selective reporting of experiments through predefined exclusion criteria
Neves, K., & Amaral, O. B. (2020) · eLife · doi:10.7554/elife.56626 · Cited by 15
Modelling multiple sources of dissemination bias in meta‐analysis
Bowden, J., Jackson, D., & Thompson, S. G. (2010) · Statistics in Medicine · doi:10.1002/sim.3813 · Cited by 15
Outcome pre-specification requires sufficient detail to guard against outcome switching in clinical trials: a case study
Kahan, B. C., & Jairath, V. (2018) · Trials · doi:10.1186/s13063-018-2654-z · Cited by 16
Association study and meta-analysis of Alzheimer's disease risk and presenilin-1 intronic polymorphism
Rodríguez-Manotas, M., Amorin-Díaz, M., Cañizares-Hernández, F., Espejo, F. R., Vidal, S. M., González‐Sarmiento, R., Martínez-Hernández, P., & Cabezas‐Herrera, J. (2007) · Brain Research · doi:10.1016/j.brainres.2007.07.032 · Cited by 15
Promotion and caution in research article abstracts: The use of positive, negative and hedge words across disciplines and rankings
Xie, S., & Mi, C. (2023) · Learned Publishing · doi:10.1002/leap.1515 · Cited by 15
“Other studies found that positive or significant outcomes are more likely to be fully reported (Dwan et al., 2013; Pigott et al., 2013; Williamson et al., 2005).”
Background
The Vast Complexity of the Epigenetic Landscape during Neurodevelopment: An Open Frame to Understanding Brain Function
Cariaga-Martínez, A. E., Gutiérrez, K. J., & Alelú‐Paz, R. (2018) · International Journal of Molecular Sciences · doi:10.3390/ijms19051333 · Cited by 14
“Furthermore, this point is also important for understanding when researchers develop meta-analyses, given the prestige and scientific power of these [120].”
Background
Reporting bias and other biases affecting systematic reviews and meta-analyses: a methodological commentary
Sinha, M. K., & Montori, V. M. (2006) · Expert Review of Pharmacoeconomics & Outcomes Research · doi:10.1586/14737167.6.5.603 · Cited by 15
Ethical considerations in the management of amyotrophic lateral sclerosis
Eisen, A., & Krieger, C. (2013) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2013.05.001 · Cited by 14
Access to unpublished protocols and statistical analysis plans of randomised trials
Campbell, D., McDonald, C., Cro, S., Jairath, V., & Kahan, B. C. (2022) · Trials · doi:10.1186/s13063-022-06641-x · Cited by 13
Examining how meta‐analytic methods perform in the presence of bias: A simulation study
Bramley, P., López-López, J. A., & Higgins, J. P. T. (2021) · Research Synthesis Methods · doi:10.1002/jrsm.1516 · Cited by 12
Meta-analysis of the Relation Between the VDR Gene TaqIpolymorphism and Genetic Susceptibility to Prostate Cancer in Asian Populations
Guo, Y., Shi, Z., Liu, J., Lei, N., Chen, Q., & Tang, Y. (2012) · Asian Pacific Journal of Cancer Prevention · doi:10.7314/apjcp.2012.13.9.4441 · Cited by 12
“The inhibitory protein can inhibit the activation of CCDK complexes, then the cells are arrested in G0/G1 phase; therefore, the proliferation of tumor cells is inhibited (Campbell et al., 1997; Ylikomi et al., 2002).”
Background
Patient-reported outcomes and outcome measures in childbirth perineal trauma research: a systematic review
Doumouchtsis, S. K., Loganathan, J., Fahmy, J., Falconi, G., Rada, M. P., Elfituri, A., Haddad, J. M., Pergialiotis, V., & Betschart, C. (2021) · International Urogynecology Journal · doi:10.1007/s00192-021-04820-z · Cited by 13
Evidence based evaluation of immuno-coagulatory interventions in critical care.
Afshari, A. (2011) · PubMed · Cited by 11
Outcome Reporting bias in Exercise Oncology trials (OREO): a cross-sectional studyPreprint
Singh, B., Fairman, C. M., Christensen, J. F., Bolam, K. A., Twomey, R., Nunan, D., & Lahart, I. M. (2021) · medRxiv · doi:10.1101/2021.03.12.21253378 · Cited by 13
Contradictory Findings of Two Recent Meta-Analyses: What Are We Supposed to Believe About Anesthetic Technique in Patients Undergoing Cardiac Surgery?
Pagel, P. S., & Crystal, G. J. (2021) · Journal of Cardiothoracic and Vascular Anesthesia · doi:10.1053/j.jvca.2021.04.026 · Cited by 11
Measurement properties and interpretability of the Patient-Reported Impact of Dermatological Diseases (PRIDD) measure
Pattinson, R., Trialonis‐Suthakharan, N., Pickles, T., Austin, J., FitzGerald, A., Augustin, M., & Bundy, C. (2024) · British Journal of Dermatology · doi:10.1093/bjd/ljae267 · Cited by 10
A core outcome set for clinical studies of adhesive small bowel obstruction
Tripartite Gastrointestinal Recovery SBO Group (2022) · Colorectal Disease · doi:10.1111/codi.16158 · Cited by 11
“Ensuring consistency in reported outcomes is important as thorough outcome reporting might avoid issues such as reporting bias [14], maximise information from each study, and reduce heterogeneity in subsequent metaanalysis [15].”
Background
Publikationsbias in Abhängigkeit von der Art der Finanzierung bei klinischen Studien
Schott, G., Pachl, H., & Ludwig, W.-D. (2010) · Zeitschrift für Evidenz Fortbildung und Qualität im Gesundheitswesen · doi:10.1016/j.zefq.2010.03.029 · Cited by 11
Abstracts presented at the European Association for Osseointegration (EAO) Congresses: Publication fate and discrepancies with full‐length articles
Wu, X., Yan, Q., Riley, P., Hua, F., Shi, B., Glenny, A., & Tu, Y. (2020) · Clinical Oral Implants Research · doi:10.1111/clr.13620 · Cited by 10
Deep brain stimulation of subthalamic nucleus for Parkinson's disease
Motto, C., Tamma, F., Candelise, L., Pecoraro, V. L., Banzi, R., & Moja, L. (2003) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004491 · Cited by 10
Retracted
Pooling resources to enhance rigour in psychophysiological research: Insights from open science approaches to meta-analysis
Saunders, B., & Inzlicht, M. (2021) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2021.01.018 · Cited by 9
“tion bias on the meta-analytic effect size (Sterne et al., 2001; Thornton and Lee, 2000; Williamson et al., 2005).”
Background
An integrative review of the literature on the chiropractic care of infants with constipation
Alcantara, J., Alcantara, J. D., & Alcantara, J. (2013) · Complementary Therapies in Clinical Practice · doi:10.1016/j.ctcp.2013.10.008 · Cited by 9
What If We Were Texas Sharpshooters? Predictor Reporting Bias in Regression Analysis
Biemann, T. (2013) · Organizational Research Methods · doi:10.1177/1094428113485135 · Cited by 9
Central thalamic deep brain stimulation for disorders of consciousness: an individual participant data meta-analysis
Bergeron, D., Mithani, K., Raguž, M., Chudy, D., Huang, Y., Hadjinicolaou, A., Iorio‐Morin, C., Fournier‐Gosselin, M., Obaïd, S., Ibrahim, G. M., et al. (2025) · Journal of neurosurgery · doi:10.3171/2025.3.jns241092 · Cited by 8
Comparative effectiveness of disease-modifying therapies for highly active relapsing-remitting multiple sclerosis despite previous treatment – a systematic review and network meta-analysis
Köhler, M., Paul, F., Janke, K., Sturtz, S., Preukschat, D., Ostlender, S., Kerekes, M. F., & Kaiser, T. (2025) · BMC Neurology · doi:10.1186/s12883-025-04338-7 · Cited by 8
“Two reviewers assessed the risk of bias for all relevant studies using criteria commonly applied to RCTs [40– 49].”
Retrospective cohort study highlighted outcome reporting bias in UK publicly funded trials
Matthews, G. A., Dumville, J. C., Hewitt, C. E., & Torgerson, D. J. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2011.03.013 · Cited by 8
Do meta-analyses in nephrology change the way we treat patients?
Mohan, S., & Radhakrishnan, J. (2010) · Kidney International · doi:10.1038/ki.2010.323 · Cited by 8
“In addition, this potential bias can be overcome with the use of patient-level data.(63)”
Background
Deep brain stimulation of subthalamic nucleus for Parkinson's disease
Motto, C., Tamma, F., Candelise, L., Pecoraro, V. L., Banzi, R., & Moja, L. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004491.pub2 · Cited by 8
Nonpublication and Selective Outcome Reporting of Oral Health Trials
Diakonoff, H., Khalil, G., Jungo, S., Treluyer, J. M., Fron-Chabouis, H., & Smaïl-Faugeron, V. (2023) · Journal of Dental Research · doi:10.1177/00220345231158544 · Cited by 10
“SOR is defined as the selection of a subset of the original variables recorded, on the basis of the results, for inclusion in publication of trials (Williamson et al. 2005).”
Pharmacological and non-pharmacological intervention for rocuronium-induced withdrawal movement in the Korean population: a meta-analysis of 41 studies including 4,742 subjects
Choi, G. J., Lee, S., Lee, J. H., Park, S. G., & Kang, H. (2014) · Korean Journal of Anesthesiology · doi:10.4097/kjae.2014.66.6.419 · Cited by 7
Systematic review of outcome measures in pediatric eosinophilic esophagitis treatment trials
Rubin, T. N., Clayton, J., Adams, D., Persad, R., & Vohra, S. (2016) · Allergy Asthma and Clinical Immunology · doi:10.1186/s13223-016-0144-y · Cited by 7
“Standardized outcome selection and reporting, regardless of statistical significance, might also minimize outcome reporting bias [6].”
Background
Reporting on outcome measures in pediatric chronic intestinal failure: A systematic review
Nagelkerke, S. C. J., Mager, D. J., Benninga, M. A., & Tabbers, M. M. (2019) · Clinical Nutrition · doi:10.1016/j.clnu.2019.08.027 · Cited by 7
A bias–variance evaluation framework for information retrieval systems
Zhang, P., Gao, H., Hu, Z., Yang, M., Song, D., Wang, Y.-X., Hou, Y., & Hu, B. (2021) · Information Processing & Management · doi:10.1016/j.ipm.2021.102747 · Cited by 7
Systematic review of outcome measures in trials of pediatric anaphylaxis treatment
Rubin, T. N., Clayton, J., Adams, D., Jou, H., & Vohra, S. (2014) · BMC Pediatrics · doi:10.1186/1471-2431-14-158 · Cited by 7
“Outcomes that should be measured and reported in all clinical trials of a specific condition, regardless of statistical significance, would also help reduce the problem of outcome reporting bias [6].”
Background
Too Small to Succeed: Small Samples and the p-Value Problem
Aguirre-Urreta, M. I., Rönkkö, M., & McIntosh, C. N. (2024) · ACM SIGMIS Database the DATABASE for Advances in Information Systems · doi:10.1145/3685235.3685238 · Cited by 8
“The practice of HARKing is a form of outcome reporting bias, where researchers report a subset of statistically significant outcomes but omit non-significant ones (Copas & Shi, 2001; Hutton & Williamson, 2000; O’Boyle et al., 2017; Williamson et al., 2005).”
Obstacles to researching the researchers: A case study of the ethical challenges of undertaking methodological research investigating the reporting of randomised controlled trials
McKenzie, J. E., Herbison, P., Roth, P., & Paul, C. (2010) · Trials · doi:10.1186/1745-6215-11-28 · Cited by 6
“In addition to misrepresenting the results from the RCT, bias arising from selective reporting can impact on meta-analyses [14], influencing the conclusions of systematic reviews, and in turn, evidence based clinical practice guidelines [19-21].”
Background
Consensus development of priority outcome domains for community mental health cares by multiple stakeholders: Protocol for an online Delphi study in Japan
Shiozawa, T., Yamaguchi, S., Ogawa, M., Abe, M., Kawaguchi, T., Igarashi, M., Yasuma, N., & Fujii, C. (2021) · Neuropsychopharmacology Reports · doi:10.1002/npr2.12211 · Cited by 6
Missing Data in Meta-analysis: Strategies and Approaches
Pigott, T. (2011) · Springer eBooks · doi:10.1007/978-1-4614-2278-5_7 · Cited by 8
Renoprotective effects of renin-angiotensin-system inhibitors
Adler, A., STRATTON, I. M., & Shine, B. S. F. (2006) · The Lancet · doi:10.1016/s0140-6736(06)68372-4 · Cited by 6
CBMAT: a MATLAB toolbox for data preparation and post hoc analyses in neuroimaging meta-analyses
Manuello, J., Liloia, D., Crocetta, A., Cauda, F., & Costa, T. (2023) · Behavior Research Methods · doi:10.3758/s13428-023-02185-3 · Cited by 5
“…in no more than one of the considered experiments (Liloia et al., 2021; Liloia, Cauda, et al., 2022a; Liloia, Crocetta, et al., 2022b) to prevent spurious results related to overlapping population within the same paper (i.e. selection bias) (Hutton and Williamson, 2000; Williamson et al., 2005).”
Background
Inconsistent Reporting Between Meta-analysis Protocol and Publication – A Cross-Sectional Study
Delgado, A. F., & Delgado, A. F. (2017) · Anticancer Research · doi:10.21873/anticanres.11928 · Cited by 4
When prevention is a bad idea: Problems with the DECARD trial and the premise behind it
Thombs, B. D., & Ziegelstein, R. C. (2012) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2012.02.005 · Cited by 5
Anticholinerge Therapie der überaktiven Blase
Schneider, T., & Michel, M. C. (2009) · Der Urologe · doi:10.1007/s00120-008-1915-y · Cited by 4
Restoring invisible and abandoned trials of gabapentin for neuropathic pain: a clinical and methodological investigation
Mayo-Wilson, E., Chen, X., Qureshı, R., Dickinson, S., Golzarri‐Arroyo, L., Hong, H., Görg, C., & Li, T. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-047785 · Cited by 4
Differences in physical health between caregivers of children with and without disabilities: A systematic review and meta analysis
Ku, B., Moon, H., Lee, H., Kim, B., & Lee, S. (2025) · Disability and health journal · doi:10.1016/j.dhjo.2025.101977 · Cited by 3
Lacosamide add-on therapy for partial epilepsy
Shukralla, A. A., & Marson, A. G. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008841 · Cited by 3
Outcome Selection and Methodological Quality of Major and Minor Shoulder Surgery Studies: A Scoping Review
El‐Boghdadly, K., Abdallah, F. W., Short, A., Vorobeichik, L., Memtsoudis, S. G., & Chan, V. W. S. (2019) · Clinical Orthopaedics and Related Research · doi:10.1097/corr.0000000000000578 · Cited by 3
Which outcome measures are reported by clinical trials investigating OME treatment? A case for standardised reporting
Chessman, R., Kamani, T., Birchall, J. P., Barry, J. G., & Daniel, M. (2016) · International Journal of Pediatric Otorhinolaryngology · doi:10.1016/j.ijporl.2016.04.029 · Cited by 2
“This is to avoid the temptation of reporting just those outcomes that show the authors’ own opinions or results in themost favourable light [5,6].”
Patient-focused outcomes are infrequently reported in pediatric health information technology trials: a systematic review
Neame, M. T., Chacko, J., Kirkham, J. J., Sinha, I. P., & Hawcutt, D. B. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.11.017 · Cited by 2
Residual disease after primary surgery for advanced epithelial ovarian cancer: expert elicitation exercise to explore opinions about potential impact of publication bias in a planned systematic review and meta-analysis
Bryant, A., Grayling, M. J., Hiu, S. K. W., Gajjar, K. B., Johnson, E. E., Elattar, A., Vale, L. D., Craig, D., & Naik, R. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-060183 · Cited by 2
What constitutes good trial evidence?
Lavender, T., & Richens, Y. (2015) · British Journal of Midwifery · doi:10.12968/bjom.2015.23.5.316 · Cited by 1
Development of a core outcome set for pharmacist interventions in chronic kidney disease
Ardavani, A., Curtis, F., HIGHTON, P. J., Khunti, K., & Wilkinson, T. J. (2024) · Journal of Kidney Care · doi:10.12968/jokc.2024.9.4.163 · Cited by 1
The Decline Effect in Cardiovascular Medicine: Is the Effect of Cardiovascular Medicine and Stent on Cardiovascular Events Decline Over the Years?
Lee, M.-S., Flammer, A. J., & Lerman, A. (2013) · Korean Circulation Journal · doi:10.4070/kcj.2013.43.7.443 · Cited by 1
Review article: A primer for clinical researchers in the emergency department: Part VI. Measuring what matters: Core outcome sets in emergency medicine research
Craig, S. S., Graudins, A., Dalziel, S. R., Powell, C., & Babl, F. E. (2018) · Emergency Medicine Australasia · doi:10.1111/1742-6723.12970 · Cited by 1
“Another significant issue is that of outcome-reporting bias – the selective reporting of some – but not all – outcomes from a dataset, often based on the presence of ‘statistically significant’ results.(36) Although this has been somewhat addressed by the increasing utilisation of clinical trial registries, significan…”
Background
Systematic review of outcome measures in trials of pediatric anaphylaxis treatment
Rubin, T. N., Clayton, J., Adams, D., Jou, H., & Vohra, S. (2014) · Allergy Asthma and Clinical Immunology · doi:10.1186/1710-1492-10-s1-a36 · Cited by 1
RE: "INVITED COMMENTARY: HORMONE THERAPY AND RISK OF CORONARY HEART DISEASE WHY RENEW THE FOCUS ON THE EARLY YEARS OF MENOPAUSE?"
Dören, M., & Greiser, E. M. (2007) · American Journal of Epidemiology · doi:10.1093/aje/kwm303 · Cited by 1
Data Mining and Other Informatics Approaches to Pharmacoepidemiology
Bate, A., Trifirò, G., Avillach, P., & Evans, S. J. W. (2019) · Pharmacoepidemiology · doi:10.1002/9781119413431.ch27 · Cited by 1
Response to Letter‐to‐Editor by Lixandrão et al. published in Scand. J. Med. Sci. Sports 31(2), 489–492, 2021
Grønfeldt, B. M., Nielsen, J. L., Mieritz, R. M., Lund, H., & Aagaard, P. (2021) · Scandinavian Journal of Medicine and Science in Sports · doi:10.1111/sms.14047 · Cited by 1
Outcome Measures
Dupuy, A., Sbidian, É., & Bastuji‐Garin, S. (2014) · doi:10.1002/9781118357606.ch16 · Cited by 1
Publication Bias in Psychology
Kühberger, A. (2023) · Oxford University Press eBooks · doi:10.1093/obo/9780199828340-0307 · Cited by 2
Estudio de los polimorfismos: rs165932 (intron 8), apoe ε2/3/4 y rs669 (V1000I) y la Enfermedad de Alzheimer de comienzo tardío en la región del noroeste Murciano
Manotas, M. R. (2009) · Gredos (University of Salamanca) · doi:10.14201/gredos.76537
Systematic review of outcome measures in randomised controlled trials of pediatric eosinophilic esophagitis (EoE) treatment
Rubin, T. N., Clayton, J., Adams, D., Persad, R., & Vohra, S. (2014) · Allergy Asthma and Clinical Immunology · doi:10.1186/1710-1492-10-s1-a70
“The consequence may be invalid results from RCTs, or difficulty in comparing results across trials [2,3].”
Result
New Developments in the Use of Biomarkers in Translational Medicine
Serruys, B., Stöhr, T., Ulrichts, H., Vanheusden, K., & Roy, M. V. (2015) · Elsevier eBooks · doi:10.1016/b978-0-12-803460-6.00001-5
Publicações científicas em ortopedia e traumatologia no Brasil: onde são concentradas e quais possíveis razões dessa concentração?
da Silva, S. W. G., Lima, G. D. A., Ferreira, A. D. A., & Cavalcante, J. C. C. E. (2018) · Revista de Medicina da UFC · doi:10.20513/2447-6595.2018v58n1p8-12
Meta-analysis as a research design – steps demystified for novice medical researchers: a brief review
Manoj Kumar, L. (2021) · Kerala Journal of Psychiatry · doi:10.30834/kjp.34.2.2021.293 · Cited by 1
Addressing selective reporting of experiments – the case for predefined exclusion criteriaPreprint
Neves, K., & Amaral, O. B. (2019) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/a8gu5
Meta-analysis
Montgomery, P., & Morton, M. (2009) · Oxford University Press eBooks · doi:10.1093/obo/9780195389678-0054
Editors' Introduction
Klassen, T. P., & Offringa, M. (2007) · Evidence-Based Child Health A Cochrane Review Journal · doi:10.1002/ebch.118
What constitutes good trial evidence?
Lavender, T., & Richens, Y. (2016) · Journal of Health Visiting · doi:10.12968/johv.2016.4.1.32
Bias in Meta-Analysis
Kumar, A. (2023) · Springer eBooks · doi:10.1007/978-981-99-2370-0_7
Assessing uptake of the core outcome set in clinical trials for immune thrombocytopenia: A cross-sectional analysis
Chaudhry, M., Stadler, J. K., Fitzgerald, K., Modi, J., Jones, G., Magana, K., Ward, S., Magee, T., Hughes, G. K., Ford, A. I., et al. (2024) · Thrombosis Research · doi:10.1016/j.thromres.2023.12.017
Additional file 1 of Evidence of unexplained discrepancies between planned and conducted statistical analyses: a review of randomised trials
Cro, S., Forbes, G., Johnson, N. A., & Kahan, B. C. (2020) · Figshare · doi:10.6084/m9.figshare.12386315
Additional file 1 of Meat consumption and risk of 25 common conditions: outcome-wide analyses in 475,000 men and women in the UK Biobank study
Papier, K., Fensom, G. K., Knüppel, A., Appleby, P. N., Tong, T. Y. N., Schmidt, J. A., Travis, R. C., Key, T. J., & Perez‐Cornago, A. (2021) · Figshare · doi:10.6084/m9.figshare.14140042
Additional file 1 of Immunogenicity and safety of inactivated quadrivalent influenza vaccine compared with the trivalent vaccine for influenza infection: an overview of systematic reviews
Carregaro, R. L., Roscani, A. N. C. P., Raimundo, A. C. S., Ferreira, L., Vanni, T., da Graça Salomão, M., Probst, L. F., & Viscondi, J. Y. K. (2023) · Figshare · doi:10.6084/m9.figshare.24054265
Additional file 2 of Evidence of unexplained discrepancies between planned and conducted statistical analyses: a review of randomised trials
Cro, S., Forbes, G., Johnson, N. A., & Kahan, B. C. (2020) · Figshare · doi:10.6084/m9.figshare.12386318
Toward a definition of a core outcome set in neuromyelitis optica spectrum disorder: a scoping review protocol
Navarro, C. E., Rodas, M. I. Z., Gorst, S. L., Delgado, C. E. Y., Chvatal‐Medina, M., Bautista, H., & Flórez, I. D. (2026) · JBI Evidence Synthesis · doi:10.11124/jbies-25-00456
COSMIC: a core outcome set for intravenous maintenance fluid therapy trials in children
Brossier, D., Valla, F. V., Briassoulis, G. C., Chaparro, C. J., Chiusolo, F., Dursun, O., Duval, E. L. I. M., Horváth, K., Ilia, S., Kenderessy, P., et al. (2026) · World Journal of Pediatrics · doi:10.1007/s12519-026-01066-x
“However, the lack of stand-ardisation in outcomes has prevented this for many IVMFT questions [8].”
Estimation and inference for step-function selection models in meta-analyses with dependent effects
Pustejovsky, J. E., Citkowicz, M., & Joshi, M. (2026) · Research Synthesis Methods · doi:10.1017/rsm.2026.10117
Efficacy and safety of short-course (<14 days) vs. standard-course (≥14 days) antibiotic therapy for neonatal sepsis: a systematic review and meta-analysis
Li, S., & Zeng, Q. (2026) · Frontiers in Pediatrics · doi:10.3389/fped.2026.1956188

Authors: Williamson, P. R., Gamble, C., Altman, D. G., & Hutton, J. L.
Affiliations: University of Liverpool (GB)
University of Oxford (GB)
University of Warwick (GB)
ORCID: Williamson, P R
Gamble, C
Altman, D G
Hutton, J L
Venue: Statistical Methods in Medical Research
Publisher: SAGE Publications
Published: 2005-10
Volume: 14
Issue: 5
Pages: 515-524
ISSN: 0962-2802 (ISSN-L)
1477-0334
DOI: 10.1191/0962280205sm415oa
OpenAlex: W2056439589
Cited by: 188
References: 35
Citations by year: 2026: 4 · 2025: 3 · 2024: 4 · 2023: 10 · 2022: 4 · 2021: 18 · 2020: 7 · 2019: 9 · 2018: 6 · 2017: 9 · 2016: 9 · 2015: 10 · 2014: 8 · 2013: 11 · 2012: 8
FWCI: 10.34
Type: journal article
Language: en
Open access: closed
Licence: journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations: Statistical Methods in Medical Research (publishedVersion)
PubMed (publishedVersion)
Topics: Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
Keywords: selective reporting, publication bias, meta-analysis validity, systematic reviews, trial outcomes
MeSH terms: Clinical Trials as Topic, United Kingdom, Humans, Publications, Meta-Analysis as Topic, Reproducibility of Results, Bias, Outcome Assessment, Health Care

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Outcome selection bias in meta-analysis

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Citations

Cites

Cited by

Related

Metadata

Record

About these checks