The Impact of Study Size on Meta-analyses: Examination of Underpowered Studies in Cochrane Reviews
Open accessThe DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Most meta-analyses include data from one or more small studies that, individually, do not have power to detect an intervention effect. The relative influence of adequately powered and underpowered studies in published meta-analyses has not previously been explored. We examine the distribution of power available in studies within meta-analyses published in Cochrane reviews, and investigate the impact of underpowered studies on meta-analysis results. METHODS AND FINDINGS: For 14,886 meta-analyses of binary outcomes from 1,991 Cochrane reviews, we calculated power per study within each meta-analysis. We defined adequate power as ≥50% power to detect a 30% relative risk reduction. In a subset of 1,107 meta-analyses including 5 or more studies with at least two adequately powered and at least one underpowered, results were compared with and without underpowered studies. In 10,492 (70%) of 14,886 meta-analyses, all included studies were underpowered; only 2,588 (17%) included at least two adequately powered studies. 34% of the meta-analyses themselves were adequately powered. The median of summary relative risks was 0.75 across all meta-analyses (inter-quartile range 0.55 to 0.89). In the subset examined, odds ratios in underpowered studies were 15% lower (95% CI 11% to 18%, P<0.0001) than in adequately powered studies, in meta-analyses of controlled pharmacological trials; and 12% lower (95% CI 7% to 17%, P<0.0001) in meta-analyses of controlled non-pharmacological trials. The standard error of the intervention effect increased by a median of 11% (inter-quartile range -1% to 35%) when underpowered studies were omitted; and between-study heterogeneity tended to decrease. CONCLUSIONS: When at least two adequately powered studies are available in meta-analyses reported by Cochrane reviews, underpowered studies often contribute little information, and could be left out if a rapid review of the evidence is required. However, underpowered studies made up the entirety of the evidence in most Cochrane reviews.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“we pooled results excluding studies with fewer than 50 participants in the experimental group, as a planned sensitivity analysis”
From Effectiveness of psychological interventions in prison to reduce recidivism: a systematic review and meta-analysis of randomised controlled trials (2021) · cites this paper as [66]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“there is a risk that untested approaches may introduce new forms of bias 18 .”
From Software support for environmental evidence synthesis (2018) · cites this paper as [18]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“On collating the evidence, some studies may appear underpowered for the outcome(s) of interest to us (Turner 2013), yet were adequately powered for the studies' primary measure.”
From Physical activity and exercise for chronic pain in adults: an overview of Cochrane Reviews (2017) · cites this paper as Turner 2013
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Although our number of effect sizes (n=37) is relatively large in terms of outcomes analyzed, it is small in terms of statistical analyses that combine empirical studies [100].”
From Generative AI Mental Health Chatbots as Therapeutic Tools: Systematic Review and Meta-Analysis of Their Role in Reducing Mental Health Issues (2025) · cites this paper as [100]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Meta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552 · cited 2×
“In each meta-analysis j, we fitted a random-effects model, using a method-of-moments estimate for the between study variance [17], and calculated the variance Vj of the combined intervention effect (on the log relative risk scale).”
MethodSterne, J. A. C., Sutton, A. J., Ioannidis, J. P. A., Terrin, N., Jones, D. R., Lau, J., Carpenter, J., Rucker, G., Harbord, R. M., Schmid, C. H., et al. (2011) · BMJ · doi:10.1136/bmj.d4002 · Cited by 7,709 · cited 1×
“[24], who published new guidelines.”
Self-citationKjaergard, L. L., Villumsen, J., & Gluud, C. (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-135-11-200112040-00010 · Cited by 2,283 · cited 1×
“Alternatively, small-study effects may arise from biases caused by methodological flaws arising more frequently in small studies [3], or may be due to true differences in the underlying effects between smaller and larger studies.”
BackgroundPublication and related bias in meta-analysis
Sterne, J. A. C., Gavaghan, D., & Egger, M. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(00)00242-0 · Cited by 2,282
Trial sequential analysis may establish when firm evidence is reached in cumulative meta-analysis
Wetterslev, J., Thorlund, K., Brok, J., & Gluud, C. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.03.013 · Cited by 1,881
Brok, J., Thorlund, K., Gluud, C., & Wetterslev, J. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.10.007 · Cited by 1,113 · cited 1×
“[20], who had, however, excluded both reviews with fewer than three trials and those in which all trials had a high risk of bias, in which metaanalytic size is likely to have been smaller.”
ResultTotal Plasma Homocysteine and Cardiovascular Risk Profile: The Hordaland Homocysteine Study
Nygård, O., Vollset, S. E., Refsum, H., Stensvold, I., Tverdal, A., Nordrehaug, J. E., Ueland, P. M., & Kvåle, G. (1995) · JAMA · doi:10.1001/jama.1995.03530190040032 · Cited by 1,042
The scandal of poor medical research.
Altman, D. G. (1994) · BMJ · doi:10.1136/bmj.308.6924.283 · Cited by 897 · cited 1×
“Researchers who choose to undertake a study that is capable of detecting only an unrealistically large effect may lack understanding of both scientific methods and ethics [10].”
BackgroundThe power of statistical tests in meta-analysis
Hedges, L. V., & Pigott, T. D. (2001) · Psychological Methods · doi:10.1037/1082-989x.6.3.203 · Cited by 716 · cited 1×
“where W is the cumulative standard normal distribution function and Ca=2~W {1 1{a=2 ð Þ[18].”
BackgroundMeta‐analysis of drug‐related deaths soon after release from prison
Merrall, E. L. C., Kariminia, A., Binswanger, I. A., Hobbs, M. S., Farrell, M., Marsden, J., Hutchinson, S. J., & Bird, S. M. (2010) · Addiction · doi:10.1111/j.1360-0443.2010.02990.x · Cited by 674 · cited 1×
“In teaching, Bird has long advocated that trials should not be started unless they could deliver at least 50% power in respect of a priori plausible, worthwhile effect sizes [6].”
BackgroundSelf-citation
Cited by
Items 501–600 of 672
The Effect of Chlorhexidine Mouthwash on Blood Pressure: A Systematic Review and Meta‐Analysis
Toonen, L. S. J., Swaaij, B. W. M. V., Vagevuur, M. L., van der Weijden, G. A., Timmerman, M. F., & Slot, D. E. (2026) · International Journal of Dental Hygiene · doi:10.1111/idh.70035 · Cited by 5
“However, it is worth noting that underpowered studies tend to contribute little information when examined in Cochrane reviews [67] and that the advantage of conducting a meta-analysis is that it allows the combination of individual studies to provide a single and more precise estimate of treat-ment…”
Sandven, I., Eritsland, J., & Abdelnoor, M. (2020) · Clinical Epidemiology · doi:10.2147/clep.s249785 · Cited by 4
Power(ful) myths: misconceptions regarding sample size in quality of life research
Anderson, S. F. (2021) · Quality of Life Research · doi:10.1007/s11136-021-03020-y · Cited by 5
Daoud, S. S., Jamous, M. A., Barbarawi, M. M. A., Jarrar, S. M., Jaradat, A. A., Aljabali, A. S., Altal, M. K., Hulliel, A. F., Hazaimeh, E. A., Jbarah, O. F., et al. (2024) · Neurochirurgie · doi:10.1016/j.neuchi.2024.101578 · Cited by 4
Antibiotics for hospital-acquired pneumonia in neonates and children
Korang, S. K., Nava, C., Nygaard, U., & Jakobsen, J. C. (2021) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013864 · Cited by 5
Runjić, R., Plenković, M., Pirosca, S., Clarke, M. J., Treweek, S. P., & Puljak, L. (2022) · Journal of Comparative Effectiveness Research · doi:10.2217/cer-2022-0042 · Cited by 6
Ofori‐Asenso, R., Zomer, E., Curtis, A. J., Tonkin, A. M., Nelson, M. R., Gambhir, M., Liew, D., & Zoungas, S. (2017) · JMIR Research Protocols · doi:10.2196/resprot.7195 · Cited by 4
“Studies with sample sizes <50 will be excluded [40].”
Sánchez-Jimenez, B., Chávez-Tapia, N. C., Jakobsen, J. C., Nikolova, D., & Gluud, C. N. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013175 · Cited by 4
Wang, B., Ma, M., Guo, X., Yan, Y., & Li, L. (2021) · Medicine · doi:10.1097/md.0000000000027527 · Cited by 4
“Due to dispersed data and repeated significance testing, type I and type II errors are inevitable in traditional updated meta-analysis with new trials.([39]) Bias from trials with low methodological quality, outcome measure bias, early stopping for benefit, and small trial bias may result in spurious P values, therefo…”
MethodHayes, J., & Aoyama, K. (2023) · Canadian Journal of Anesthesia/Journal canadien d anesthésie · doi:10.1007/s12630-023-02659-0 · Cited by 4
“Nevertheless, these trial conditions are not usually met 5,6 and as the authors point out, trials are resource-intensive and often stopped early for a variety of reasons.”
How to conduct a meta-analysis in hand surgery. Part II: heterogeneity and publication bias
Rosales, R. S., & Ruettermann, M. (2025) · Journal of Hand Surgery (European Volume) · doi:10.1177/17531934251317837 · Cited by 4
“There is an association between small studies and a larger effect (Turner et al. 2013).”
Exposure Therapy Consortium: Outcomes of the Proof-of-Principle Study
Smits, J. A. J., Abramowitz, J. S., Anderson, R., Arch, J. J., Badeja, D., Barzilay, S., Belanger, A., Borchert, T., Bryant, E., Burger, A. S., et al. (2024) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2024.102962 · Cited by 4
“This pattern is not unique to exposure therapy research (Kühberger et al., 2014; Turner et al., 2013; Vries et al., 2023).”
Qin, R., Li, Z., Gong, L., Miao, B., Sun, Y., Liu, W., & Chen, L. (2025) · Archives of Gerontology and Geriatrics · doi:10.1016/j.archger.2025.105952 · Cited by 4
Yan, Y., Huang, Y., Wang, M. P., Lau, K. K., Anderson, C. S., & Lee, J. J. (2025) · Nursing and Health Sciences · doi:10.1111/nhs.70183 · Cited by 4
“Meta-analyses were conducted for outcomes reported in three or more studies to increase statistical power and provide more precise effect estimates (Turner et al. 2013).”
Kalantari, A., Karimizadeh, Z., Behfar, M., & Hamidieh, A. A. (2025) · Clinical Transplantation · doi:10.1111/ctr.70274 · Cited by 3
“The small-study effect occurs due to publication bias, methodological inadequacy, or true differences between small and large populations [41].”
Lao, H.-C., Huang, C., Wang, S.-H., Su, Y.-L., Chang, C.-H., Liao, C.-Y., Wu, J.-C., Lin, Y.-C., & Tsai, J. (2026) · Journal of Neuroimmune Pharmacology · doi:10.1007/s11481-025-10273-8 · Cited by 3
“Relative risk reduction (RRR) was defined as 30%, based on standard convention to reach adequate clinical significance (Turner et al. 2013).”
Zheng, S., Guo, X., & Ying, X. (2026) · Journal of Clinical Medicine · doi:10.3390/jcm15041479 · Cited by 4
“The discrepancy is likely attributable to the inclusion of more recent studies in our analysis, resulting in a larger overall sample size and enhanced statistical power, thereby providing a more updated summary of the available evidence [43].”
Rygård, S. L., Jonsson, A. B., Madsen, M. B., Perner, A., Holst, L. B., Johansson, P. I., & Wetterslev, J. (2017) · Acta Anaesthesiologica Scandinavica · doi:10.1111/aas.12991 · Cited by 3
Xu, Z., Li, X., Qin, Z., Xue, J., Wang, J., Liu, Z., Cai, H., Yu, B., Xu, T., & Zou, Q. (2017) · The International Journal of Biological Markers · doi:10.5301/ijbm.5000269 · Cited by 3
Khalil, M. A., Kaddoura, R., Omar, A. S., Abohamar, A. D., & Izham, M. (2023) · Perfusion · doi:10.1177/02676591231159506 · Cited by 4
“21 The publication bias was examined through visual inspection of funnel plots.”
MethodTiming of Ventilator Circuit Tubing Replacement
Jafari, Z., & Severn, M. (2023) · Canadian Journal of Health Technologies · doi:10.51731/cjht.2023.730 · Cited by 3
Implementation of the aIAT for Forensic Purposes: A Narrative-Methodological Review
Crivelli, D., Zangrossi, A., & Balconi, M. (2024) · Journal of Forensic Psychology Research and Practice · doi:10.1080/24732850.2024.2334729 · Cited by 3
“…to the experimental procedure called aIAT; (5) sample (in case of original research) of at least 10 participants per condition, since studies with small sample sizes are known to be more susceptible to publication bias and could overestimate effect sizes (Sterne et al., 2000; Turner et al., 2013).”
The correlation between serum angiopoietin-2 levels and acute kidney injury (AKI): a meta-analysis
Zhang, J., Huang, Z., Lin, Q., Hu, W., Zhong, H., Zhang, F., & Huang, J. (2024) · Clinical Chemistry and Laboratory Medicine (CCLM) · doi:10.1515/cclm-2024-0365 · Cited by 3
“Because this phenomenon has been thoroughly documented in other fi elds [49].”
BackgroundThe efficacy of psychodynamic psychotherapy for young adults: a systematic review and meta-analysis
Trotta, A., Gerber, A. J., Rost, F., Robertson, S., Shmueli, A., & Perelberg, R. J. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1366032 · Cited by 4
Meta-analysis of Aspirin for Primary Prevention of Cardiovascular Events—Reply
Zheng, S. L., & Roddick, A. (2019) · JAMA · doi:10.1001/jama.2019.4017 · Cited by 3
Jayaraj, R., Kumarasamy, C., Shetty, S. S., Raymond, G., Mani, R. R., Govind, S. K., Chandramoorthy, H. C. K., & Shaw, P. M. (2020) · Oral Oncology · doi:10.1016/j.oraloncology.2020.104622 · Cited by 3
Pirosca, S., Clarke, M. J., & Treweek, S. P. (2020) · F1000Research · doi:10.12688/f1000research.22635.1 · Cited by 3
Wichmann, S., Barbateskovic, M., Lindschou, J., Gluud, C. N., Perner, A., & Bestle, M. H. (2020) · Acta Anaesthesiologica Scandinavica · doi:10.1111/aas.13655 · Cited by 3
Morphologic and functional vascular alterations in patients with polycystic ovary syndrome.
Demir, B., Paşa, S., Demir, S. S., Büyükkaya, R., Atay, A. E., Atamer, Y., & Gul, T. (2011) · PubMed · Cited by 3
Cabanas‐Valdés, R., Llurda-Almuzara, L., López-de–Celis, C., Myers-Escolà, A., Svoboda, S., Ortiz-Miguel, S., & Pérez‐Bellmunt, A. (2022) · Revista de Neurología · doi:10.33588/rn.7412.2022019 · Cited by 3
“El tamaño del efecto se clasificó en 0,2, 0,5, 0,8 y 1,3, los cuales se consideraron pequeño, mediano, grande y muy grande, respectivamente [18].”
BackgroundPicchio, M. (2022) · Springer eBooks · doi:10.1007/978-3-319-57365-6_350-1 · Cited by 4
Carter, C., Boisvert, I., & Docking, K. M. (2023) · Pediatric Blood & Cancer · doi:10.1002/pbc.30595 · Cited by 4
Ellekjær, K. L., Perner, A., Sivapalan, P., & Møller, M. H. (2020) · Acta Anaesthesiologica Scandinavica · doi:10.1111/aas.13703 · Cited by 3
Oxygen supplementation for critically ill patients—A protocol for a systematic review
Barbateskovic, M., Schjørring, O. L., Jakobsen, J. C., Meyhoff, C. S., Rasmussen, B. S., Perner, A., & Wetterslev, J. (2018) · Acta Anaesthesiologica Scandinavica · doi:10.1111/aas.13127 · Cited by 3
Wetterslev, M., Granholm, A., Haase, N., Hassager, C., Møller, M. H., & Perner, A. (2020) · Acta Anaesthesiologica Scandinavica · doi:10.1111/aas.13672 · Cited by 3
Sample Size Planning for Statistical Power and Accurate Estimation
Anderson, S. F., & Lamp, S. J. (2022) · Oxford University Press eBooks · doi:10.1093/obo/9780199828340-0296 · Cited by 4
Vigneri, M., Masset, E., Clarke, M. J., Exley, J., Tugwell, P., Welch, V. A., & White, H. (2018) · doi:10.51744/cip10 · Cited by 3
Cheng, S., Chen, S., Salcher‐Konrad, M., Choy, J. C. P., Luo, H., Leung, D. K. Y., Cai, X., Zeng, Y., Dai, R., Comas‐Herrera, A., et al. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-047560 · Cited by 4
da Costa, J. G. R., Alves, J. E., Nery, E. C. H. P., & Silva, A. G. (2025) · Pain Practice · doi:10.1111/papr.70025 · Cited by 2
“45 Some studies used several instruments to assess one domain, and in these cases, only one instrument was used in the meta-analysis.”
Vitamin D lacks efficacy: A re‐analysis of a systematic review using the REB method
Bironneau, V., Palamede, M. L., Charuel, É., Jouault, C., Blanchard, C., Mainbourg, S., Grenet, G., Roussel, H. V., & Boussageon, R. (2025) · Fundamental and Clinical Pharmacology · doi:10.1111/fcp.70011 · Cited by 2
“Another possible explanation is the small study effect [17, 19, 20] as RCTs with small sample sizes often have a higher risk of bias.”
Huizing, M. J., Vizzari, G., Bartos̆, F., Cavallaro, G., Giannì, M. L., & Villamor, E. (2025) · Acta Paediatrica · doi:10.1111/apa.70260 · Cited by 5
Knep, S. N., & Shires, A. G. (2025) · ALPHA PSYCHIATRY · doi:10.31083/ap39860 · Cited by 2
“This could be due to a focus on the main effects or direct relationships between variables, a lack of a theoretical framework for hypothesising mediators, or smaller sample sizes limiting the statistical power needed for mediation analyses [76].”
Lim, K. S. A., Tng, W. X. A., Theng, W. D. B., Lee, B. T. K., Chin, C. F., Li, K. Z., & Moss, H. E. (2026) · Frontiers in Ophthalmology · doi:10.3389/fopht.2025.1691582 · Cited by 3
Fuentes, G. R., Bermúdez-Rodas, A., Rodríguez-Otero, H., & Campo-Prieto, P. (2026) · Applied Sciences · doi:10.3390/app16031324 · Cited by 3
EMG-Driven Robotic Therapy for Neurological Rehabilitation: A Systematic Review and Meta-Analysis
Kiper, P., Kopp, C., Nicolas, Z., Taupin, S., Meroni, R., Calabrò, R. S., Kiper, A., Federico, S., & Cieślik, B. (2026) · Technologies · doi:10.3390/technologies14020119 · Cited by 2
“The articles included had small sample sizes, ranging from 16 to 32 participants, thus resulting in limited statistical power [29].”
Core concepts in statistics and research methods. Part 6: Sample size calculations
Bould, M. D., & McIsaac, D. (2026) · BJA Education · doi:10.1016/j.bjae.2026.02.002 · Cited by 2
Zhang, J., Tang, H., Zheng, X., Zuo, C., Xie, Y., & Fan, Y. (2026) · PLoS ONE · doi:10.1371/journal.pone.0358479 · Cited by 2
“Fourth, imprecision was judged using the width of the 95% confidence interval and whether the total sample size reached the optimal information size (OIS) [46].”
Kashihara, Y., Li, Q., Shimizu, S., Diderichsen, P. M., Kotsuma, M., & Yoshihara, K. (2025) · CPT Pharmacometrics & Systems Pharmacology · doi:10.1002/psp4.70133 · Cited by 2
Petersen, C., Wetterslev, J., & Meyhoff, C. S. (2018) · Acta Anaesthesiologica Scandinavica · doi:10.1111/aas.13123 · Cited by 2
“For estimation of the required information size, we will use a diversity-adjusted required sample size for an equally powered trial to detect a 20% relative risk reduction (RRR).(43,44) 1016 | PETERSEN ET AL.”
MethodSharma, P. (2018) · Biomedical Journal of Scientific & Technical Research · doi:10.26717/bjstr.2018.06.001314 · Cited by 2
“In the study, TSA was used to control the risk of random error by calculating the required information size and an adjusted threshold for statistical significance to make a robust conclusion [20-23].”
MethodAntibiotic prophylaxis for people with cirrhosis and variceal bleeding
Sánchez-Jimenez, B., Chávez-Tapia, N. C., Jakobsen, J. C., Nikolova, D., & Gluud, C. N. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013214 · Cited by 2
Side predilection in congenital anomalies of the kidney, urinary and genital tracts
Kirkpatrick, J., Upadhyay, V., Mirjalili, S. A., & Taghavi, K. (2020) · Journal of Pediatric Urology · doi:10.1016/j.jpurol.2020.08.001 · Cited by 2
Mheissen, S., Aldandan, M., & Khan, H. (2023) · European Journal of Orthodontics · doi:10.1093/ejo/cjad049 · Cited by 2
Nielsen, E. E., Feinberg, J. B., Wetterslev, J., Gluud, C. N., & Jakobsen, J. C. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012068 · Cited by 2
RetractedSethi, N. J., Naqash, A. I., Nielsen, N., & Jakobsen, J. C. (2019) · BMJ Open · doi:10.1136/bmjopen-2019-032389 · Cited by 3
Radiofrequency Ablation for Papillary Microcarcinoma of the Thyroid—Reply
van Dijk, S. P. J., Coerts, H. I., & van Ginhoven, T. M. (2022) · JAMA Otolaryngology–Head & Neck Surgery · doi:10.1001/jamaoto.2022.1177 · Cited by 2
Central venous catheter (CVC) removal for adult patients with candidaemia
Janum, S., & Afshari, A. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011195 · Cited by 2
Clinical applications of real-time FMRI neurofeedback training : premises, promises, and pitfalls
Mehler, D. M. A. (2018) · ORCA Online Research @Cardiff (Cardiff University) · Cited by 4
(2020) · Bundesgesundheitsblatt - Gesundheitsforschung - Gesundheitsschutz · doi:10.1007/s00103-020-03183-y · Cited by 3
Successful Impact Evaluations: Lessons from DFID and 3ie
Masset, E., Rathinam, F., Nath, M., Vigneri, M., & Wood, B. D. K. (2019) · doi:10.51744/cip6 · Cited by 2
Belden, J. E., Myers, J. A., Colquitt, E. W., & Tanner, E. K. (2024) · Journal of Research on Educational Effectiveness · doi:10.1080/19345747.2024.2410324 · Cited by 2
“First, although our meta-analysis revealed a positive overall effect, it is limited by a relatively small sample size (n = 24; Turner et al., 2013).”
Novera, M., Wetasin, K., Aulia, F., Asman, A., & Elvira, M. (2024) · Journal of Infrastructure Policy and Development · doi:10.24294/jipd.v8i8.6383 · Cited by 1
Meta-Analysis of Pilot Source Studies
ALMamari, K. (2024) · Aviation Psychology and Applied Human Factors · doi:10.1027/2192-0923/a000282 · Cited by 1
Goh, K. K., Chen, C.-H., & Lu, M. (2025) · Journal of Psychopharmacology · doi:10.1177/02698811251326945 · Cited by 2
“To avoid underpowered results, we included pooled results only when at least two adequately powered studies were available (Turner et al., 2013).”
Awla, H. K., Othman, B. A., Rafeeq, D. D., Smail, S. W., Yashooa, R. K., Ghareeb, A. A., Salih, R. H., Omar, S. A., & Janson, C. (2025) · The Journal of Steroid Biochemistry and Molecular Biology · doi:10.1016/j.jsbmb.2025.106879 · Cited by 1
“…limited sample sizes may lead to an over-estimation of odds ratios due to random variation and publication bias, as evidenced by [58,60] Furthermore, [61,62] shown in a comprehensive meta-epidemiological research that smaller trials generally reveal larger treatment effects than larger trials.”
Francesco, S. D., Fagnani, C., Medda, E., Palmieri, S., Mansueto, G., Munari, G. D., Caselli, G., & Scaini, S. (2025) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2025.1674793 · Cited by 2
Léonard, F., & Tirelli, E. (2026) · Journal of Trial and Error · doi:10.36850/34b0-42b1 · Cited by 1
Xiao, H., Zhu, H., Liu, Z.-Y., Zeng, T.-A., Wang, J.-Y., Shataer, S., Wang, H.-P., & Yang, C.-J. (2026) · Research in Autism · doi:10.1016/j.reia.2026.202905 · Cited by 1
Sotiropoulos, J. X., Manley, B. J., Libesman, S., Ambalavanan, N., Das, A., McKinlay, C. J. D., Panigrahy, N., Cruz, M., Nguyen, D., Williams, J., et al. (2026) · Acta Paediatrica · doi:10.1111/apa.70638 · Cited by 1
“Small studies (i.e., with 50 total participants) increase heterogeneity [31] and the risk of bias [32] while providing a minimal contribution of additional information [33] (see power calculations in Appendix S3), and will be excluded.”
Busnelli, A., Fauque, P., Cirillo, F., Fernández-Shaw, S., & Levi-Setti, P. E. (2026) · Fertility and Sterility · doi:10.1016/j.fertnstert.2026.07.007 · Cited by 1
Adaptive versus fixed designs in confirmatory clinical trials: centering the choice on ethics
Baas, S., Pin, L., Robertson, D. S., Bretz, F., Cho, H. J., Flight, L., van der Graaf, R., Graham, M., Jacko, P., Jaki, T., et al. (2026) · Clinical Trials · doi:10.1177/17407745261468001 · Cited by 4
“…design becomes a valuable choice. i For a fixed design to advance these three ethical objectives, it requires that no circumstances–and in particular no circumstances relating to data emerging from the trial itself–arise that necessitate major changes to the trial. p However, such circumstances…”
Bindeeba, D. S., Kembabazi, O., & Tibihika, A. (2026) · Future Business Journal · doi:10.1186/s43093-026-00964-w · Cited by 1
“Statistical heterogeneity was assessed using the Cochran Q statistic, τ 2 , and I 2 , which together provide complementary evidence on the magnitude and sources of between-study variability [67].”
Effects of task complexity and pre-training on problem solving: A cognitive load perspective
Zeitlhofer, I., Zumbach, J., & Schwartz, N. (2026) · European Journal of Psychology of Education · doi:10.1007/s10212-026-01176-0 · Cited by 1
“Pre-training was not included because it was absent in Experiment 1 and, with only three studies available, a meta-analytic estimate would be statistically unstable and difficult to interpret (Borenstein et al., 2009; Turner et al., 2013; Valentine et al., 2010).”
Pulmonary perfusion versus no pulmonary perfusion during cardiopulmonary bypass for cardiac surgery
Buggeskov, K. B., Nielsen, J. B., & Wetterslev, J. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011098 · Cited by 1
Drug-eluting stents versus bare-metal stents for stable ischaemic heart disease
Nielsen, E. E., Feinberg, J. B., Greenhalgh, J., Hounsome, J. C., Sethi, N. J., Safi, S., Gluud, C. N., & Jakobsen, J. C. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012480 · Cited by 2
RetractedBeta-blockers for non-acute treatment after myocardial infarction
Nielsen, E. E., Feinberg, J. B., Safi, S., Sethi, N. J., Gluud, C. N., & Jakobsen, J. C. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012565 · Cited by 2
Liang, N., Kong, D., Ma, S.-S., Lu, C.-L., Yang, M., Feng, L., Liu, X., Gluud, C. N., & Liu, J. (2019) · The Journal of Alternative and Complementary Medicine · doi:10.1089/acm.2018.0484 · Cited by 1
Marsman, M. S., Wetterslev, J., Keus, F., van Aalst, D., van Rooij, F. G., Heyligers, J. M. M., Moll, F. L., Jahrome, A. K., Vriens, P. W. H. E., & Koning, G. G. (2020) · International Journal of Surgery Protocols · doi:10.1016/j.isjp.2019.12.002 · Cited by 1
Bicarbonate for acute acidosis
Korang, S. K., Safi, S., Feinberg, J. B., Nielsen, E. E., Gluud, C. N., & Jakobsen, J. C. (2021) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd014371 · Cited by 1
Nam, J. H., Kim, C. Y., Lee, Y. K., Jung, D. W., Gwak, H. Y., & Chung, J. E. (2021) · Korean Journal of Clinical Pharmacy · doi:10.24304/kjcp.2021.31.2.87 · Cited by 1
Khan, M., Khan, S. A., Mandal, R. K., Mahto, H. S., Lohani, M., Ahmad, S., Sherwani, S., Jandrajupalli, S. B., & Haque, S. (2021) · Revista română de medicină de laborator · doi:10.2478/rrlm-2021-0028 · Cited by 3
Ostuzzi, G., Schneider‐Thoma, J., Tedeschi, F., Leucht, S., & Barbui, C. (2023) · BMJ Mental Health · doi:10.1136/bmjment-2023-300677 · Cited by 1
“15 Considering that sample size did not act as an effect modifier, inclusion of small studies could have led to higher precision of estimates in Ostuzzi et al .”
ResultRegional analgesia techniques for lumbar spine surgery: a frequentist network meta-analysis
Liu, G., & Ying, J. (2023) · International Journal of Surgery · doi:10.1097/js9.0000000000000765 · Cited by 1
“Fifth, most of the studies (31 of 34 included trials) were composed of relatively small sample sizes (the experimental group sample size is less than 50), and overestimation of the treatment effect is more likely in smaller trials compared with larger samples [6] .”
ResultThe Nigerian Postgraduate Medical Journal: The journey so far …
Adesanya, A. A. (2016) · Nigerian Postgraduate Medical Journal · doi:10.4103/1117-1936.190339 · Cited by 1
Calcium and Vitamin D Supplements and Fractures in Community-Dwelling Adults
Pundole, X., Lopez-Olivo, M. A., & Lu, H. (2018) · JAMA · doi:10.1001/jama.2018.3931 · Cited by 1
de Araujo, F. X., de Castro, M. P., Schell, M. S., Vidmar, M. F., Marques, F. O., Pierri, C. A. A., & Silva, M. F. (2018) · The American Journal of Sports Medicine · doi:10.1177/0363546518788318 · Cited by 1
“Usually, at least 80% power is recommended in medical reasearch(2); however, underpowered studies are very common in the literature,(14,21,30) which could lead to 3 main problems: higher chance of not finding statistically significant differences when they exist (type II error), inflated effect sizes, and lower positi…”
BackgroundSupplemental Material for Risk Factors for Child Sexual Abuse Victimization: A Meta-Analytic Review
Assink, M., van der Put, C. E., Meeuwsen, M. W. C. M., de Jong, N., Oort, F. J., Stams, G. J. J. M., & Hoeve, M. (2019) · Psychological Bulletin · doi:10.1037/bul0000188.supp · Cited by 2
Shi, J., Liu, S., Guo, Y., Liu, S., Xu, J., Pan, L., Hu, Y., Liu, Y., & Cheng, Y. (2021) · Research Square · doi:10.21203/rs.3.rs-139290/v1 · Cited by 1
Concerns Over Diagnostic Accuracy of Fine-Needle Biopsy in Thyroid Nodule Diagnosis—Reply
Hsiao, V., Fernandes‐Taylor, S., & Francis, D. O. (2023) · JAMA Surgery · doi:10.1001/jamasurg.2023.0569 · Cited by 1
Kumar, S., Neyazi, A., Mehta, R., & Sah, R. (2025) · Rheumatology · doi:10.1093/rheumatology/keaf078 · Cited by 1
Effects of HIV Behavioral Interventions for Men Who Have Sex With Men - United States, 1988-2014
Larson, H. J. (2016) · Digital Commons - URI (University of Rhode Island) · doi:10.23860/diss-larson-h.-2016
Klinička praksa temeljena na dokazima: pregled prijetnji valjanosti dokaza i kako ih spriječiti
Garattini, S. K., Jakobsen, J. C., Wetterslev, J., Bertelè, V., Banzi, R., Rath, A., Neugebauer, E. A. M., Laville, M., Masson, Y., Hivert, V., et al. (2017) · Medicina Fluminensis · doi:10.21860/medflum2017_187362
Caution is needed when assessing results of home birth–Authors’ reply
Hutton, E. K., Reitsma, A. H., Simioni, J. C., Brunton, G., & Kaufman, K. J. (2019) · EClinicalMedicine · doi:10.1016/j.eclinm.2019.09.008
Higher versus lower blood pressure targets in adults with shock
Korang, S. K., Safi, S., Feinberg, J. B., Gluud, C. N., Perner, A., & Jakobsen, J. C. (2019) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013470
“Turner 2013 Turner RM, Bird SM, Higgins JP.”
MethodCOVID 19-How is the Exposure of the Pediatric Population? A Systematic Review Protocol
Oliveira, V. M. M., de Almeida‐Neto, P. F., de Lima, F. D. P. D., de Sousa, S. K. F., de Sousa, A. C., Galdino, R. S., de Matos, D. G., Cabral, B. G. D. A. T., & Lima, G. P. (2021) · American Journal of Infectious Diseases · doi:10.3844/ajidsp.2021.49.54 · Cited by 1
“Thus, if there are at least two studies of adequate power reporting the same result with units of similar measures, they will be included in the meta-analyzes (Turner et al., 2013).”
ResultBarbateskovic, M., Schjørring, O. L., Krauss, S. R., Jakobsen, J. C., Meyhoff, C. S., Dahl, R. M., Rasmussen, B. S., Perner, A., & Wetterslev, J. (2021) · JBMEDE - Jornal Brasileiro de Medicina de Emergência
Metadata
- Authors
- Turner, R. M., Bird, S. M., & Higgins, J. P. T.
- Affiliations
- MRC Biostatistics Unit (GB)
- University of Bristol (GB)
- Corresponding author
- Turner, Rebecca M.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2013-03-27
- Volume
- 8
- Issue
- 3
- Pages
- e59202
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC3609745
- OpenAlex
- W2015824469
- Cited by
- 672
- References
- 25
- Citations by year
- 2026: 46 · 2025: 51 · 2024: 51 · 2023: 59 · 2022: 70 · 2021: 70 · 2020: 59 · 2019: 49 · 2018: 56 · 2017: 60 · 2016: 45 · 2015: 31 · 2014: 20 · 2013: 4
- FWCI
- 36.78
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, other-oa)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- UCL Discovery (University College London) (submittedVersion)
- Bristol Research (University of Bristol) (submittedVersion)
- Funders
- Medical Research Council (U105260794)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Keywords
- underpowered studies, study size, statistical power, meta-analysis, binary outcomes, relative risk, standard errors, study heterogeneity, rapid review
- MeSH terms
- Humans, Review Literature as Topic, Meta-Analysis as Topic, Odds Ratio, Sample Size, Risk Reduction Behavior
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
