The DOI matches its Crossref record; 58 of the 58 references it cites were found in a registry or an index.
Interpretation of tests of heterogeneity and bias in meta-analysis
Abstract
Statistical tests of heterogeneity and bias, in particular publication bias, are very popular in meta-analyses. These tests use statistical approaches whose limitations are often not recognized. Moreover, it is often implied with inappropriate confidence that these tests can provide reliable answers to questions that in essence are not of statistical nature. Statistical heterogeneity is only a correlate of clinical and pragmatic heterogeneity and the correlation may sometimes be weak. Similarly, statistical signals may hint to bias, but seen in isolation they cannot fully prove or disprove bias in general, let alone specific causes of bias, such as publication bias in particular. Both false-positive and false-negative signals of heterogeneity and bias can be common and their prevalence may be anticipated based on some rational considerations. Here I discuss the major common challenges and flaws that emerge in using and interpreting statistical tests of heterogeneity and bias in meta-analyses. I discuss misinterpretations that can occur at the level of statistical inference, clinical/pragmatic inference and specific cause attribution. Suggestions are made on how to avoid these flaws, use these tests properly and learn from them.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“These limitations are common in meta-analyses of cross-sectional studies (Ioannidis, 2008).”
From Decision making capacity for treatment in psychiatric inpatients: a systematic review and meta-analysis (2024) · cites this paper as Ioannidis, 2008
Citations
Cites
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
Operating characteristics of a rank correlation test for publication bias
Begg, C. B., & Mazumdar, M. (1994) · Biometrics · doi:10.2307/2533446 · Cited by 16,955
Evidence based medicine: what it is and what it isn't
Sackett, D. L., Rosenberg, W. M. C., Gray, J. A. M., Haynes, R. B., & Richardson, W. S. (1996) · BMJ · doi:10.1136/bmj.312.7023.71 · Cited by 15,769
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Self-citationThe combination of estimates from different experiments
Cochran, W. G. (1954) · Biometrics · doi:10.2307/3001666 · Cited by 5,380
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702
Self-citationAssessing heterogeneity in meta-analysis: Q statistic or I² index?
Huedo-Medina, T. B., Sánchez-Meca, J., Marín-Martínez, F., & Botella, J. (2006) · Psychological Methods · doi:10.1037/1082-989x.11.2.193 · Cited by 4,256
Funnel plots for detecting bias in meta-analysis
Sterne, J. A. C., & Egger, M. (2001) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(01)00377-8 · Cited by 3,779
Cited by
Sorted by citations
Items 601–695 of 695
Quality Assessment of Meta-Analyses on Cervical Cancer
Milosavljevic, S., Yang, P.-Y., Kang, H., Mullen, P. D., & Gong, Y. (2022) · Studies in health technology and informatics · doi:10.3233/shti220111
Yuan, H., Wang, L., Li, H., Huang, J., Xiao, L., Liu, S. J., Wang, Y., Yang, Y., & Zhang, H. (2022) · Research Square · doi:10.21203/rs.3.rs-1730196/v1
Improving Statistical Inferences: MOOC Enhances Conceptual Understanding Among Online Learners
Herrera-Bennett, A. (2019) · American Educational Research Association Annual Meeting (AERA) · doi:10.3102/1446221
Kang, B., Liu, X., & Peng, D. (2023) · Open Medicine · doi:10.1515/med-2022-0605
“53) [14,15,18,19] had no significant difference (Table 2).”
BackgroundHu, H., Hu, X., Liang, Z., Yang, W., Li, S., Li, D., & Cai, J. (2023) · Research Square · doi:10.21203/rs.3.rs-2211568/v1
(2023) · Annals of Surgical Oncology · doi:10.1245/s10434-023-13650-w
Global COVID-19 Vaccine Acceptance Level and its Determinants: An Umbrella ReviewPreprint
Abate, B. B., Tilahun, B. D., & Mulu, B. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4505333
Unique Challenges in Diabetic Foot Science
Verdin, C. J., Zarick, C. S., & Steinberg, J. S. (2023) · Clinics in Podiatric Medicine and Surgery · doi:10.1016/j.cpm.2023.08.003
Moreno-Castillo, C., Echeverría, J. T., Martínez, F. T., & Reinares, F. (2023) · Cureus · doi:10.7759/cureus.47880
“The levels of heterogeneity will be categorised as follows: <25% low, 25% to 50% moderate, and >50% high [29,30].”
BackgroundMo, Q., Zheng, J., Hu, F., Gao, P., Wu, T., Wei, S., Zhang, J., Tang, C., Zou, J., & Zheng, X. (2024) · medRxiv · doi:10.1101/2024.01.07.24300948
Qin, X. G., Wang, M., Zhang, W., Liu, W., Shu, H., & Xiong, X. (2024) · BMJ Open · doi:10.1136/bmjopen-2023-076570
"Negative Association between Diabetes Mellitus and the Efficacy of Cancer Immunotherapy"
Sun, M. (2024) · Biomedical Journal of Scientific & Technical Research · doi:10.26717/bjstr.2024.55.008726
Fu, Y., Pu, H., Wang, Y., Lu, X., Qiu, P., Hu, M. S., & Cheng, Y. (2024) · BMJ Open · doi:10.1136/bmjopen-2023-074547
Techane, M. A., Workneh, B. S., Zegeye, A. F., Terefe, B., Tamir, T. T., & Mekonen, E. G. (2024) · International Journal of Scientific Reports · doi:10.18203/issn.2454-2156.intjscirep20241664
Jiang, W. H., Feng, Z., Qiu, J. Y., Long, Z., Liang, Y., Hu, M., Han, Y., & Qin, X. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4876271
Yilak, G., Abate, B. B., Zemariam, A. B., Alamaw, A. W., Lake, E. S., Ayele, M., Belay, A. S., & Tilahun, B. D. (2024) · Reproductive Health · doi:10.1186/s12978-024-01893-z
“The values of 25%, 50%, and 75% represent low, moderate, and high heterogeneity, respectively [33, 35, 36].”
Tiongco, R. E., Flores, J. A., Castro, E. J., Dayrit, S. A., Dominguez, M. J., Manahan, E., & Pineda-Cortel, M. R. (2024) · Journal of Helminthology · doi:10.1017/s0022149x24000828 · Cited by 1
“Publication bias testing was no longer performed due to the limited studies included (Dalton et al. 2016; Ioannidis 2008).”
Anumas, S., Tansawet, A., Numthavaj, P., Pattharanitima, P., Pabalan, N., Jarjanazi, H., Mongkolrob, R., Tasanarong, A., & Tharabenjasin, P. (2025) · Genetics and Molecular Biology · doi:10.1590/1678-4685-gmb-2024-0077
“Tests for publication bias were used to evaluate the influence of small-study specific effects (Ioannidis, 2008) and were applied only to comparisons that showed associative significance ( p 0.05) and passed Bonferroni correction.”
InfluentialRen, S., Wang, W., Yao, X., Fang, W., Li, G., Feng, Y., & Xia, M. (2025) · Frontiers in Pharmacology · doi:10.3389/fphar.2025.1511171
“Statistical heterogeneity was estimated using the I 2 statistic, for which an I 2 value of ≤ 25%, between 26% and 75%, and > 75% represents low, moderate, and high heterogeneity, respectively (Ioannidis, 2008).”
Tiongco, R. E., Catacata, M., Castro, E. J., Flores, J. A., Dayrit, S. A., Geonzon, K., Tongio, M. A., & Dominguez, M. J. (2025) · Journal of Diabetes & Metabolic Disorders · doi:10.1007/s40200-025-01671-z
Tiongco, R. E., Mañalac, A. R., Cayanan, N. D., Cuartelon, A. M., & Dominguez, M. J. (2025) · The Egyptian Journal of Internal Medicine · doi:10.1186/s43162-025-00491-0
Environmental Risk Factors and Appendicitis Incidence: A Pooled Up AnalysisPreprint
Xiang, C.-Y., Liu, X., Lu, W., Zhao, J.-N., & Wang, Z. (2025) · Research Square · doi:10.21203/rs.3.rs-7168890/v1
Prevalence of Neural Axis Abnormalities in Typical and Atypical Laterality Idiopathic Scoliosis
Cortés‐Pérez, I., Gallego‐Siles, J. R., Obrero‐Gaitán, E., Ibáñez‐Vera, A. J., Peinado-Rubia, A. B., & Lomas‐Vega, R. (2025) · Spine · doi:10.1097/brs.0000000000005485 · Cited by 1
Dawood, Z. S., Khalil, M., Javid, A., Ali, A. M. S., Waqar, U., Alidina, Z., Banani, I., & Pawlik, T. M. (2025) · Surgical Oncology · doi:10.1016/j.suronc.2025.102307
Ouyang, Z., Li, S., & Quan, A. (2025) · Clinical Breast Cancer · doi:10.1016/j.clbc.2025.10.002
Verma, S., Mishra, G. C., Dudy, N. K., & Chitra, P. (2025) · The Journal of Indian Orthodontic Society · doi:10.1177/03015742251382649
Bhadania, M., Yadav, S., Mathur, A. S., Acharya, A., & Mehta, V. (2025) · BMC Public Health · doi:10.1186/s12889-025-24990-5 · Cited by 1
Sabry, M., Gundala, C., Hamad, M., Tummala, N., Hamid, A. A., Mohamed, A. J., Zia, U., Hassan, A. M., Essani, B., Abid, M., et al. (2025) · Cureus · doi:10.7759/cureus.97569
“…is high, it does not negate the overall conclusions of the meta-analysis, but it highlights the prerequisite for caution in generalizing results and suggests that future research should explore the factors contributing to these variations to better understand the sources of heterogeneity [35].”
Mohamed, M. A., Garoma, S., Kassa, D. H., Kampise, A., Dade, K., Edin, A., & Wachamo, D. (2025) · Journal of Global Health Science · doi:10.35500/jghs.2025.7.e20
Association of Toxoplasma gondii seropositivity with type 2 diabetes mellitus: a meta-analysis
Tiongco, R. E., Arbas, R. L., Balanditan, I. D., Castro, E. J., Dominguez, M. J., Salinas, J. C., & Pineda-Cortel, M. R. (2025) · Journal of Diabetes & Metabolic Disorders · doi:10.1007/s40200-025-01822-2
Chinzowu, T., Roy, S., & Nishtala, P. S. (2021) · Figshare · doi:10.6084/m9.figshare.16916598
Abbing, A., Koretsi, V., Eliades, T., & Papageorgiou, S. N. (2020) · Figshare · doi:10.6084/m9.figshare.13049149
An, X., Shen, T., Yin, X., Xu, J., Zhang, Y., & Wang, T. (2024) · Figshare · doi:10.6084/m9.figshare.26674038
Hussen, S., Assegu, D., Tadesse, B. T., & Shimelis, T. (2021) · Figshare · doi:10.6084/m9.figshare.13685138
An, X., Shen, T., Yin, X., Xu, J., Zhang, Y., & Wang, T. (2024) · Figshare · doi:10.6084/m9.figshare.26673999
An, X., Shen, T., Yin, X., Xu, J., Zhang, Y., & Wang, T. (2024) · Figshare · doi:10.6084/m9.figshare.26674005
Bedaso, A., Adams, J., Peng, W., & Sibbritt, D. W. (2021) · Figshare · doi:10.6084/m9.figshare.15071311
An, X., Shen, T., Yin, X., Xu, J., Zhang, Y., & Wang, T. (2024) · Figshare · doi:10.6084/m9.figshare.26674029
Chinzowu, T., Roy, S., & Nishtala, P. S. (2021) · Figshare · doi:10.6084/m9.figshare.16916595
Bedaso, A., Adams, J., Peng, W., & Sibbritt, D. W. (2021) · Figshare · doi:10.6084/m9.figshare.15071317
An, X., Shen, T., Yin, X., Xu, J., Zhang, Y., & Wang, T. (2024) · Figshare · doi:10.6084/m9.figshare.26674011
An, X., Shen, T., Yin, X., Xu, J., Zhang, Y., & Wang, T. (2024) · Figshare · doi:10.6084/m9.figshare.26674002
Hussen, S., Assegu, D., Tadesse, B. T., & Shimelis, T. (2021) · Figshare · doi:10.6084/m9.figshare.13685135
An, X., Shen, T., Yin, X., Xu, J., Zhang, Y., & Wang, T. (2024) · Figshare · doi:10.6084/m9.figshare.26674023
Chinzowu, T., Roy, S., & Nishtala, P. S. (2021) · Figshare · doi:10.6084/m9.figshare.16916592
An, X., Shen, T., Yin, X., Xu, J., Zhang, Y., & Wang, T. (2024) · Figshare · doi:10.6084/m9.figshare.26674035
An, X., Shen, T., Yin, X., Xu, J., Zhang, Y., & Wang, T. (2024) · Figshare · doi:10.6084/m9.figshare.26674032
Chinzowu, T., Roy, S., & Nishtala, P. S. (2021) · Figshare · doi:10.6084/m9.figshare.16916586
Kitaw, T. A., Abate, B. B., Yilak, G., Tilahun, B. D., Faris, A. M., Walle, G. T., & Haile, R. N. (2024) · Figshare · doi:10.6084/m9.figshare.26738814
An, X., Shen, T., Yin, X., Xu, J., Zhang, Y., & Wang, T. (2024) · Figshare · doi:10.6084/m9.figshare.26673996
An, X., Shen, T., Yin, X., Xu, J., Zhang, Y., & Wang, T. (2024) · Figshare · doi:10.6084/m9.figshare.26674014
An, X., Shen, T., Yin, X., Xu, J., Zhang, Y., & Wang, T. (2024) · Figshare · doi:10.6084/m9.figshare.26674026
An, X., Shen, T., Yin, X., Xu, J., Zhang, Y., & Wang, T. (2024) · Figshare · doi:10.6084/m9.figshare.26674017
An, X., Shen, T., Yin, X., Xu, J., Zhang, Y., & Wang, T. (2024) · Figshare · doi:10.6084/m9.figshare.25107804
Abate, B. B., Tilahun, B. D., & Yayeh, B. M. (2024) · Figshare · doi:10.6084/m9.figshare.24934602
Zenebe, T., Zegeye, N., & Eguale, T. (2020) · Figshare · doi:10.6084/m9.figshare.13364312
An, X., Shen, T., Yin, X., Xu, J., Zhang, Y., & Wang, T. (2024) · Figshare · doi:10.6084/m9.figshare.26674008
An, X., Shen, T., Yin, X., Xu, J., Zhang, Y., & Wang, T. (2024) · Figshare · doi:10.6084/m9.figshare.26674020
Hussen, S., Assegu, D., Tadesse, B. T., & Shimelis, T. (2021) · Figshare · doi:10.6084/m9.figshare.13685141
Abate, B. B., Tilahun, B. D., & Yayeh, B. M. (2024) · Figshare · doi:10.6084/m9.figshare.24934315
Bedaso, A., Adams, J., Peng, W., & Sibbritt, D. W. (2021) · Figshare · doi:10.6084/m9.figshare.15071320
An, X., Shen, T., Yin, X., Xu, J., Zhang, Y., & Wang, T. (2024) · Figshare · doi:10.6084/m9.figshare.25107901
Hussen, S., Assegu, D., Tadesse, B. T., & Shimelis, T. (2021) · Figshare · doi:10.6084/m9.figshare.13685129
Hussen, S., Assegu, D., Tadesse, B. T., & Shimelis, T. (2021) · Figshare · doi:10.6084/m9.figshare.13685132
Antoniou, E. E., & Dekant, W. (2024) · Figshare · doi:10.6084/m9.figshare.26231178
Goodman, S. H., Suzuki, S., Kushner, E. H., Sbrilli, M. D., Ziegler, J., & Yang, A. Y. (2026) · Journal of Child and Family Studies · doi:10.1007/s10826-025-03231-8
“Ioannidis (2008) argues that publication bias may occur for multiple reasons and suggests cautions against drawing possibly false conclusions while not disregarding the effects.”
Meta-analysis: Design, measures, and classic example
Vangsness, K. L., & Carré, A. L. (2026) · Elsevier eBooks · doi:10.1016/b978-0-323-91168-9.00049-1
Hofmann, B. M. (2026) · European Journal of Internal Medicine · doi:10.1016/j.ejim.2026.106734
Gibney, D., & Cariola, L. A. (2026) · Journal of Forensic Psychology Research and Practice · doi:10.1080/24732850.2026.2626508
Zhong, C. C., Wang, B. H., Jiang, M. Y., Wu, I. X., Ho, L. T. F., Ho, F. F., Xu, S. S., Kwong, M. H., Zhou, J. H. S., Lam, J. K. C., et al. (2026) · Journal of Evidence-Based Integrative Medicine · doi:10.1177/2515690x261422020
Abuhay, A. E., Asaye, M. M., Zeleke, T. A., Mihret, S. A., Getahun, A. B., Zeleke, M. E., Defersha, K. K., Asrie, A. E., Anteneh, D. E., & Mengistie, B. A. (2026) · Systematic Reviews · doi:10.1186/s13643-026-03118-9
Xiang, C., Peng, D., Zhao, J., Wang, L., Liu, X., Ji, G., Wang, Z., & Du, D. (2026) · BMC Surgery · doi:10.1186/s12893-026-03611-x
“For studies with I 2 ≤ 50%, a fixed-effects model was used, and a P-value 0.05 was considered statistically significant [24, 25].”
InfluentialStevenson, L., & Halter, M. (2026) · British Paramedic Journal · doi:10.29045/14784726.2026.3.10.4.34
He, C., Li, F., He, M., & Li, J. (2026) · Acta Oncologica · doi:10.2340/1651-226x.2026.44984
“Otherwise, a fixed-effects model was used for meta-analysis [26, 27].”
Liu, Y., Liu, K., Ren, L., Yue, S., Li, Z., Li, X., & Su, C. (2026) · Medicine · doi:10.1097/md.0000000000048179
Örgütsel adalet ile örgütsel bağlılık arasındaki ilişki: mini bir meta analiz
Çiçeklioğlu, H., Özkan, A., & Yazıcı, A. M. (2026) · Hitit Sosyal Bilimler Dergisi · doi:10.17218/hititsbd.1630717
Usso, A. A., Mohammed, H., & Ahmed, M. (2026) · Journal of obstetrics and gynaecology research · doi:10.1111/jog.70313
Neophytou, C., Davidopoulou, S., Kaklamanos, E. G., Neofytou, A. M., Goulis, D. G., & Papadimitriou, K. (2026) · Lasers in Dental Science · doi:10.1007/s41547-026-00343-2
“Analyses to identify reporting biases, including potential publication bias, were intended for meta-analyses with seven or more studies [25, 26].”
Rajput, J., Yadav, I., Oyarebu, B. O., Lashari, U. G., Mohammad, A., Kaur, M., Ibadin, S. O., & Kolotouros, E. (2026) · Cureus · doi:10.7759/cureus.109961
“Although all studies demonstrated a positive association, the variability in the strength of these associations justified the use of a random-effects model in the meta-analysis [28].”
Tiongco, R. E., Balatbat, D. R., Castro, E. J., Dimalanta, A., Dominguez, M. J., Guinto, A. Y., Sibal, M., & Soriano, D. R. (2026) · The Egyptian Journal of Internal Medicine · doi:10.1186/s43162-026-00656-5
Liu, Q., Gou, J., & Hong, X. (2026) · Early Years Journal of International Research and Development · doi:10.1080/09575146.2026.2680455
Liver enzymes as predictors of gestational diabetes: a meta-analysis
Cuartelon, A. M., Flores, J. A., Dayrit, S. A., & Tiongco, R. E. (2026) · Journal of Diabetes & Metabolic Disorders · doi:10.1007/s40200-026-01977-6
Abdullah, F., Kowash, M., Hussein, I., Halabi, M. A., Salami, A., Makrygiannakis, M. A., Khamis, A., & Kaklamanos, E. G. (2026) · European Archives of Paediatric Dentistry · doi:10.1007/s40368-026-01232-9
Tiongco, R. E., Basilio, P. V., Dequiros, R. A., Dominguez, M. J., Flores, J. A., Manansala, N. T., Masiclat, S., Tiam-Lee, C., & Navarro, A. T. (2026) · SN Comprehensive Clinical Medicine · doi:10.1007/s42399-026-02562-x
Laparoscopic versus open repair for umbilical hernia: outcomes and complications
Zheng, X., Song, M., Liu, J., Jiang, B., Hu, W., & Li, Z. (2026) · Hernia · doi:10.1007/s10029-026-03792-7
“If I 2 > 50%, it was considered high heterogeneity, the random effect model was used, and p 0.1 was considered statistically significant [ 19 ].”
InfluentialBellos, I., Marinaki, S., & Benetou, V. (2026) · Lipids in Health and Disease · doi:10.1186/s12944-026-03018-w
“Publication bias was not statistically assessed because of the limited number of available studies [17].”
Demeke, A. D., Yeshiwas, A., Gebrie, H., Akele, M. A., Gashaw, A., Gessesse, A. D., Tamir, T., Bogale, N., Eba, W. W., Mekuriaw, B. Y., et al. (2026) · Palliative Care and Social Practice · doi:10.1177/26323524261473625
Ma, J., & Zhao, W. (2026) · Journal of the Egyptian National Cancer Institute · doi:10.1186/s43046-026-00387-2
“Therefore, the significant Egger’s test should be interpreted as evidence of possible funnel plot asymmetry rather than definitive proof of publication bias [50].”
Liang, R., Zhang, X., Li, H., Li, Z., Hu, Y., Ma, L., Liang, Z., & Liu, X. (2026) · Frontiers in Pharmacology · doi:10.3389/fphar.2026.1827554
“Global heterogeneity was assessed using the I 2 statistic and the generalized Qstatistic (Ioannidis, 2008).”
A comprehensive systematic review for management of condylar fractures in adult patients
Yadav, R., Batra, H., & Sharma, M. (2026) · Advances in Oral and Maxillofacial Surgery · doi:10.1016/j.adoms.2026.100711
Türkiye'de Yaşlılarda Polifarmasi ve Geriatrik Farmakoterapi: Sistematik Derleme ve Meta-Analiz
BÖLÜKBAŞI, S., & Dere, B. (2026) · Arşiv Kaynak Tarama Dergisi · doi:10.17827/aktd.1788275
Verma, S., Thakur, A., Keerthana, P., Dudy, N. K., & Chitra, P. (2026) · Romanian Journal of Stomatology · doi:10.37897/rjs.2026.3.4
“Statistical significance was set at p 0.05, except for tests of heterogeneity and subgroup differences, for which p < 0.10 was considered statistically significant [27].”
InfluentialRen, H., Jiao, J., Lan, X., Tan, C., Wang, Z., Pei, H., Yao, D., Liu, T., & Dong, L. (2026) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2026.1894724
“Heterogeneity was assessed using Cochran’s Q statistic and the I 2 index, with I 2 values of approximately 25%, 50%, and 75% interpreted as low, moderate, and high heterogeneity, respectively (Ioannidis, 2008).”
Liu, M., Li, H., Yang, G., Deng, X., Guan, C., Lv, X., Peng, S., Ma, J., Ji, X., Wu, Y., et al. (2026) · Journal of Integrative Neuroscience · doi:10.31083/jin49076
Spender, K., Parsons, L., Wilkes‐Gillan, S., Chen, Y.-W. R., So, J., & Cordier, R. (2026) · Review of Education · doi:10.1002/rev3.70235
Metadata
- Authors
- Ioannidis, J. P. A.
- Affiliations
- University of Ioannina (GR)
- Corresponding author
- Ioannidis, John P. A.
- Venue
- Journal of Evaluation in Clinical Practice
- Publisher
- Wiley
- Published
- 2008-10
- Volume
- 14
- Issue
- 5
- Pages
- 951-957
- ISSN
- 1356-1294 (ISSN-L)
- 1365-2753
- OpenAlex
- W2144112749
- Cited by
- 696
- References
- 57
- Citations by year
- 2026: 52 · 2025: 69 · 2024: 98 · 2023: 72 · 2022: 50 · 2021: 64 · 2020: 49 · 2019: 34 · 2018: 30 · 2017: 23 · 2016: 23 · 2015: 26 · 2014: 27 · 2013: 22 · 2012: 15
- FWCI
- 4.52
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Evaluation in Clinical Practice (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Keywords
- heterogeneity testing, publication bias, meta-analysis, statistical heterogeneity, clinical heterogeneity, false positive signals, bias detection
- MeSH terms
- Data Interpretation, Statistical, Humans, Regression Analysis, Research Design, Risk, Sensitivity and Specificity, Meta-Analysis as Topic, Reproducibility of Results, Bias, Confidence Intervals, Publication Bias, Evidence-Based Medicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review